Michael Smith has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19254 )
Change subject: IMPALA-11697: Enable SkipIf.not_hdfs tests for Ozone ...................................................................... IMPALA-11697: Enable SkipIf.not_hdfs tests for Ozone Convert SkipIf.not_hdfs to SkipIf.not_dfs for tests that require filesystem semantics, adding more feature test coverage with Ozone. Creates a separate not_scratch_fs flag for scratch dir tests as they're not supported with Ozone yet. Filed IMPALA-11730 to address this. Preserves not_hdfs for a specific test that uses the dfsadmin CLI to put it in safemode. Adds sfs_ofs_unsupported for SmallFileSystem tests. This should work for many of our filesystems based on https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L62-L87. Makes sfs tests work on S3. Adds hardcoded_uris for IcebergV2 tests where deletes are implemented as hardcoded URIs in parquet files. Adding a parquet read/write library for Python is beyond the scope if this patch. Change-Id: Iafc1dac52d013e74a459fdc4336c26891a256ef1 Reviewed-on: http://gerrit.cloudera.org:8080/19254 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Joe McDonnell <[email protected]> --- M testdata/workloads/functional-query/queries/QueryTest/sfs.test M tests/common/skip.py M tests/custom_cluster/test_disable_features.py M tests/custom_cluster/test_hedged_reads.py M tests/custom_cluster/test_scratch_disk.py M tests/data_errors/test_data_errors.py M tests/metadata/test_ddl.py M tests/query_test/test_acid.py M tests/query_test/test_iceberg.py M tests/query_test/test_sfs.py M tests/stress/test_acid_stress.py M tests/stress/test_insert_stress.py 12 files changed, 68 insertions(+), 50 deletions(-) Approvals: Impala Public Jenkins: Verified Joe McDonnell: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/19254 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Iafc1dac52d013e74a459fdc4336c26891a256ef1 Gerrit-Change-Number: 19254 Gerrit-PatchSet: 6 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Yida Wu <[email protected]>
