Compression rate degrades for long streams

[jmacd]

We have observed a pattern where compression rate will be very good (say 5%) for 10-100s of MiB of data, but when it becomes 100s-1000s of MiB the compression rate will degrade to the level zstd could achieve on its own. This is considered a bug, we are investigating.

As a short term solution, we are recommending shorter stream duration (e.g., 30s).

[jmacd]

#82