hi folks, (cross-posting to dev@arrow and dev@parquet since there are stakeholders in both places)
It seems there are still problems at least with the C++ implementation of LZ4 compression in Parquet files https://issues.apache.org/jira/browse/PARQUET-1241 https://issues.apache.org/jira/browse/PARQUET-1878 If these problems cannot be resolved, I am going to recommend that we disable use of LZ4 in the Parquet C++ library until these things can be properly tested and validated across different implementations. Thoughts? We're within weeks of the next Apache Arrow release so if we're going to disable LZ4-for-Parquet it needs to happen soon. Thanks Wes