Zoltán Borók-Nagy created IMPALA-13561:
------------------------------------------
Summary: Impala test test_read_mixed_format_position_deletes fails
with newer Hive versions
Key: IMPALA-13561
URL: https://issues.apache.org/jira/browse/IMPALA-13561
Project: IMPALA
Issue Type: Bug
Components: Test
Reporter: Zoltán Borók-Nagy
Assignee: Zoltán Borók-Nagy
test_read_mixed_format_position_deletes can fail with newer Hive versions as
they start to name data files differently:
h3. Error Message
{noformat}
query_test/test_iceberg.py:1552: in test_read_mixed_format_position_deletes
vector, unique_database) common/impala_test_suite.py:831: in run_test_case
self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:638: in __verify_results_and_errors
replace_filenames_with_placeholder) common/test_result_verifier.py:520: in
verify_raw_results VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:290: in verify_query_result_is_subset
unicode(expected_row), unicode(actual_results)) E AssertionError: Could not
find expected row
row_regex:'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/.*-data-.*.orc','.*B','','.*'
in actual rows: E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115135_6295fffb-3866-4d8f-952f-c0469fd7ef32-job_17321205656900_0102-1-00001.parquet','620B','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115144_c568d95a-bdc9-4951-91f0-d8e51fc06a94-job_17321205656900_0102-2-00001-pos-deletes.parquet','1.99KB','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115146_5f2ce745-9081-485e-8d8d-ee18b303f422-job_17321205656900_0102-3-00001.orc','307B','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115146_a2094dcc-1a54-4d8a-ae8e-9a86ab3dc8c0-job_17321205656900_0102-4-00001-pos-deletes.orc','1.08KB','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115148_10cf2288-9c17-41de-af9b-11447026fd70-job_17321205656900_0102-5-00001-pos-deletes.avro','830B','','NONE'
{noformat}
h3. Stacktrace
{noformat}
query_test/test_iceberg.py:1552: in test_read_mixed_format_position_deletes
vector, unique_database)
common/impala_test_suite.py:831: in run_test_case
self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:638: in __verify_results_and_errors
replace_filenames_with_placeholder)
common/test_result_verifier.py:520: in verify_raw_results
VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:290: in verify_query_result_is_subset
unicode(expected_row), unicode(actual_results))
E AssertionError: Could not find expected row
row_regex:'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/.*-data-.*.orc','.*B','','.*'
in actual rows:
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115135_6295fffb-3866-4d8f-952f-c0469fd7ef32-job_17321205656900_0102-1-00001.parquet','620B','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115144_c568d95a-bdc9-4951-91f0-d8e51fc06a94-job_17321205656900_0102-2-00001-pos-deletes.parquet','1.99KB','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115146_5f2ce745-9081-485e-8d8d-ee18b303f422-job_17321205656900_0102-3-00001.orc','307B','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115146_a2094dcc-1a54-4d8a-ae8e-9a86ab3dc8c0-job_17321205656900_0102-4-00001-pos-deletes.orc','1.08KB','','NONE'
E
'hdfs://localhost:20500/test-warehouse/test_read_mixed_format_position_deletes_6fb8ae98.db/ice_mixed_formats/data/00000-0-jenkins_20241120115148_10cf2288-9c17-41de-af9b-11447026fd70-job_17321205656900_0102-5-00001-pos-deletes.avro','830B','','NONE'
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
