Attendees/agenda: Santlal
Deepak (Vertical): deprecation of older compression. Lars (Cloudera, Impala): Column indexes Marcel: Column indexes Ryan (Netflix): release parquet-format 2.4.0. need help on java side. parquet related table format (id based column projection) Jim (Cloudera) Zoltan (Cloudera) Anna (Cloudera) Julien: New compression alg / Deprecation of older compression: - we can't remove algos that have been used (lzo, brotli). We can add recommendation on algo to use. - added language to clarify support of algorithms plus dependency on installing some. - LZ4 widely available - zstandard harder to install but better. Column indexes: - action: make max always present - always have min and max values (max not optional) - add metadata to capture if min/max are ordered. enum. - clarify meaning of null page. - todo: update PR and merge soon. parquet-format release: blocked on page index parquet related table format discussion: will happen separately. next meeting in 2 weeks. On Wed, Oct 11, 2017 at 9:06 AM, Julien Le Dem <[email protected]> wrote: > https://meet.google.com/oto-xpdf-kug >
