judahrand commented on PR #37469: URL: https://github.com/apache/arrow/pull/37469#issuecomment-1712137084
> > Great! I'll take a careful round later. By the way we can disable statistics to just disable Column Index but write offset index. Maybe this could be add to doc later. > > Are you saying `write_statistics=False, wrtie_page_index=True` will write the OffsetIndex but not the ColumnIndex? If that's the case then I'd absolutely agree the docs should be updated as currently they suggest that `write_statistics` is ignored if `write_page_index=True`! But this should probably be a separate PR as the docs will need updating in `pyarrow.parquet` too? That is indeed what you were saying as the test shows! That behaviour strikes me as quite unintuitive! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
