Agenda/attendees:
Lars (Impala): how we store splitter elements for page indexes when very
long common prefixes.
Ryan (Netflix):
- getting 1.10 out of parquet-mr
- Status on statistics bug fixes changes
Zoltan and team (Cloudera):
- Parquet-format release
- New logical type representation
Marcel (unaffiliated):
- Iceberg
Benoit (Criteo):
- Parquet-proto
Deepak (Vertica)
Julien (WeWork):
- Parquet-proto
- Release
Notes
- Releases 1.10
-
- Parquet-mr 1.10 => Ryan to start release process
- Parquet-format => Zoltan to start release process
- Statistics error fixes
-
- Null/NaN/+0/-0
-
- NaN never < no > any value. So if it’s the 1st value it gets
stuck in min/max
- +0 == -0 according to < and not according to compareTo
- Page index Statistics
-
- long common prefix
-
- Action: Lars, Zoltan, Gabor: create proposal and follow up on
email
- Parquet-proto: Parquet-968
-
- https://github.com/apache/parquet-mr/pull/411
- Action: Julien, Ryan to give feedback on PR
- Support for proto-2 is not needed and will be dropped in next
release.
-
-
https://issues.apache.org/jira/projects/PARQUET/issues/PARQUET-1259
- Action: Benoit to comment on the Jira
- New logical type representation
- Iceberg: reach out to Ryan for details.
On Wed, Mar 28, 2018 at 9:00 AM, Julien Le Dem <[email protected]>
wrote:
> https://meet.google.com/xpc-gwie-sem
>
