Anurag-S1ngh opened a new pull request, #4402:
URL: https://github.com/apache/iceberg-python/pull/4402

   ## Summary
   
   PyIceberg never wrote Parquet page indexes, so readers that support them 
cannot skip non-matching pages during predicate evaluation. PyArrow already 
supports this with `ParquetWriter(write_page_index=True)`.
   
   ## Changes
   
   - Add the `write.parquet.page-index-enabled` table property, default 
`false`, so current output and file sizes are preserved.
   - Pass `write_page_index` from `_get_parquet_writer_kwargs` to the Parquet 
writer.
   - Document the property in the write options table.
   
   ## Testing
   
   - Added a test that writes with the property off and on, and checks 
`has_column_index` and `has_offset_index` on the resulting row group.
   - `make test` passes (4695 passed, 5 skipped).
   
   Closes #3847


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to