yangshangqing95 opened a new pull request, #17192: URL: https://github.com/apache/iceberg/pull/17192
### Summary This PR adds a new puffin_files metadata table that exposes registered Puffin statistics files from Iceberg table metadata. The table reads only `Table#statisticsFiles()` and does not open Puffin files, read Puffin footers, or parse blob payload bytes. The new metadata table returns one row per registered statistics file with file-level summary information: ``` snapshot_id statistics_path file_size_in_bytes file_footer_size_in_bytes blob_count blob_types field_ids field_names ``` Example Spark SQL output: ```sql SELECT * FROM catalog.db.table..puffin_files; ``` | snapshot_id | statistics_path | file_size_in_bytes | file_footer_size_in_bytes | blob_count | blob_types | field_ids | field_names | |---:|---|---:|---:|---:|---|---|---| | xxxxxxxxxx | `.../xxxxxx....stats` | 617 | 523 | 2 | `["apache-datasketches-theta-v1"]` | `[1,2]` | `["id","data"]` | ### Motivation Iceberg tables can register Puffin statistics files in table metadata, but there is currently no metadata table that makes those registered statistics files easy to inspect through SQL. Exposing this information through a metadata table makes it easier to debug and observe Puffin-backed table statistics, such as NDV statistics written by compute_table_stats, without requiring users to inspect metadata JSON manually. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
