Alwaysgaurav1 opened a new pull request, #17461: URL: https://github.com/apache/iceberg/pull/17461
Closes #15347. `Parquet.setColumnStatsConfig` previously applied per-column statistics enablement via `withColumnStatsEnabled.accept(...)` on `ParquetProperties.Builder` / `ParquetWriter.Builder` but did not propagate `parquet.column.statistics.enabled#<column>` into the Hadoop `Configuration` instance (`conf`). When users configured multiple table properties to disable statistics across multiple columns (e.g., `write.parquet.stats-enabled.column.colA = false` and `write.parquet.stats-enabled.column.colB = false`), statistics were only disabled for the first column processed while subsequent columns continued to write statistics into the Parquet file header. This change explicitly passes per-column statistics enablement settings into `conf` as well (`parquet.column.statistics.enabled#<parquetColumnPath>`), ensuring consistent behavior across all configured columns regardless of write path. ## Tests Added - `testMultipleColumnStatisticsDisabled` in `TestParquet.java`: Validates that configuring `write.parquet.stats-enabled.column.<col> = false` across multiple columns disables statistics for all specified columns in the generated Parquet file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
