alamb opened a new issue, #5104:
URL: https://github.com/apache/arrow-datafusion/issues/5104

   **Describe the bug**
   parquet page level skipping (page index pruning) panic's  with evolved 
schemas
   
   **To Reproduce**
   
   Enable setting like
   
   ```rust
           pub enable_page_index: bool, default = true
   ```
   
   And then run test:
   ```shell
   cargo test -p datafusion --lib -- evolved_schema_disjoint_schema_filter
   ```
   
   Which fails
   
   ```
   test 
physical_plan::file_format::parquet::tests::evolved_schema_disjoint_schema_filter
 ... FAILED
   
   failures:
   
   ---- 
physical_plan::file_format::parquet::tests::evolved_schema_disjoint_schema_filter
 stdout ----
   thread 
'physical_plan::file_format::parquet::tests::evolved_schema_disjoint_schema_filter'
 panicked at 'index out of bounds: the len is 1 but the index is 1', 
/Users/alamb/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-31.0.0/src/file/metadata.rs:251:10
   ```
   
   **Expected behavior**
   Test should pass
   
   **Additional context**
   I found this while working to enable this feature by default
   https://github.com/apache/arrow-datafusion/pull/5099


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to