tustvold opened a new issue #1417:
URL: https://github.com/apache/arrow-rs/issues/1417


   **Describe the bug**
   
   From the parquet 
[specification](https://github.com/apache/parquet-format/blob/master/Encodings.md).
   
   > If, in the last block, less than <number of miniblocks in a block> 
miniblocks are needed to store the values, the bytes storing the bit widths of 
the unneeded miniblocks are still present, their value should be zero, but 
readers must accept arbitrary values as well.
   
   This is particularly important at the moment because of #1416 which causes 
the padding to be arbitrary in the event an encoder is reused.
   
   **To Reproduce**
   
   This is one of the underlying bugs behind 
https://github.com/apache/arrow-datafusion/issues/1976
   
   **Expected behavior**
   
   The decoder should ignore the padded miniblock bit widths
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to