Shan Huang created ARROW-14089:
----------------------------------

             Summary: [C++] Correctly read DELTA_BYTE_ARRAY data written with 
bug PARQUET-246
                 Key: ARROW-14089
                 URL: https://issues.apache.org/jira/browse/ARROW-14089
             Project: Apache Arrow
          Issue Type: Improvement
            Reporter: Shan Huang


If a parquet file is written by parquet-mr before version 1.8.0, the bug 
[PARQUET-246|https://issues.apache.org/jira/browse/PARQUET-246] will produce 
data inconsistent with the encoding of DELTA_BYTE_ARRAY.

There are two solutions:

1. We should update the read side to recover data written with this bug.

2. We need to throw an exception if the parquet file is written by parquet-mr 
before version 1.8.0 and has DELTA_BYTE_ARRAY encoding data.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to