I'm working on getting the int64 delta encoding [1] contributed by
lunchev in for 1.9. It's about ready to go, but since it is a new
encoding it isn't a forward-compatible change: data stored in int64
delta can't be read by readers that can read the entire "parquet 2.0"
file format.
So my question is: is the set of things to support for "parquet 2.0"
already released and closed, or do we consider that open for new additions?
rb
[1]: https://github.com/apache/parquet-mr/pull/154
--
Ryan Blue
Software Engineer
Cloudera, Inc.