Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/22008 )
Change subject: IMPALA-13471: test_enable_reading_puffin() seems to fail in the Ozone build ...................................................................... IMPALA-13471: test_enable_reading_puffin() seems to fail in the Ozone build The tests TestIcebergWithPuffinStatsStartupFlag::test_[dis|en]able_reading_puffin queried an Iceberg table that is created during normal dataload from existing non-filesystem-specific metadata and data files. Therefore the path of the Puffin stats file that is present in the metadata.json file does not contain any filesystem-specific prefix, for which Puffin reading does not work on Ozone. Note that reading Puffin stats for tables that are created normally do work on Ozone. This change modifies the tests to create the table on the fly, modifying the file path to include the filesystem-specific prefix. Change-Id: I7afec1c70d7b43bae98289d65749b01ca720e7f7 Reviewed-on: http://gerrit.cloudera.org:8080/22008 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M testdata/data/README R testdata/data/iceberg_test/iceberg_with_puffin_stats/data/524c361b0ae84073-d6306ef200000000_1823051976_data.0.parq D testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/20240906_085606_00006_wsfgs-4d9242d5-bd79-4069-be8b-2cfced8e0647.stats A testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/20241028_142058_00006_dn7is-8d3be062-6b30-45ea-b26e-6b706c50f8e3.stats R testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/989a6a68-ca7b-4339-adc2-cb5ba2656f0c-m0.avro R testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/snap-8614787612208071008-1-989a6a68-ca7b-4339-adc2-cb5ba2656f0c.avro M testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/v1.metadata.json M testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/v2.metadata.json M testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/v3.metadata.json M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M tests/custom_cluster/test_iceberg_with_puffin.py M tests/util/iceberg_metadata_util.py 13 files changed, 68 insertions(+), 57 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/22008 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I7afec1c70d7b43bae98289d65749b01ca720e7f7 Gerrit-Change-Number: 22008 Gerrit-PatchSet: 5 Gerrit-Owner: Daniel Becker <[email protected]> Gerrit-Reviewer: Daniel Becker <[email protected]> Gerrit-Reviewer: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
