Sergio Peña created PARQUET-378:
-----------------------------------
Summary: Add thoroughly parquet test encodings
Key: PARQUET-378
URL: https://issues.apache.org/jira/browse/PARQUET-378
Project: Parquet
Issue Type: Test
Components: parquet-mr
Affects Versions: 1.8.0
Reporter: Sergio Peña
Assignee: Sergio Peña
PARQUET-246 highlighted the need to have more thorough validation of the
Parquet encodings. With the 2.0 encodings as high priority, we need to validate
each encoding with its spec (and ensure there is a spec).
We also need to add a suite of validations that are used for all encodings that
test:
- Writing multiple pages (v1 and v2 pages) and multiple row groups
- Validating that each page can be read individually or with last-to-first page
order and has the correct set of values (would have caught PARQUET-246).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)