Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Change default parquet compression format from Snappy to LZ4
Snappy's status as default is maybe just due to history. Snappy had better Java support and LZ4 wasn't always available in systems like Spark. Today Spark and other systems support LZ4 as well, and LZ4 generally performs a bit better, especially on decompression. This is a significant change, but I think the only reason not to do it is historical, which I think maybe isn't a good enough reason these days.
- Loading branch information