Sergio Peña created PARQUET-378:
-----------------------------------

             Summary: Add thoroughly parquet test encodings
                 Key: PARQUET-378
                 URL: https://issues.apache.org/jira/browse/PARQUET-378
             Project: Parquet
          Issue Type: Test
          Components: parquet-mr
    Affects Versions: 1.8.0
            Reporter: Sergio Peña
            Assignee: Sergio Peña


PARQUET-246 highlighted the need to have more thorough validation of the 
Parquet encodings. With the 2.0 encodings as high priority, we need to validate 
each encoding with its spec (and ensure there is a spec). 

We also need to add a suite of validations that are used for all encodings that 
test:
- Writing multiple pages (v1 and v2 pages) and multiple row groups
- Validating that each page can be read individually or with last-to-first page 
order and has the correct set of values (would have caught PARQUET-246).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to