Quanlong Huang created IMPALA-9802:
--------------------------------------
Summary: TestCompressedFormats.test_compressed_formats fails in
HDFS copy
Key: IMPALA-9802
URL: https://issues.apache.org/jira/browse/IMPALA-9802
Project: IMPALA
Issue Type: Bug
Affects Versions: Impala 4.0
Reporter: Quanlong Huang
See this fails in rc and seq file formats:
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.bz2', 'bzip') | file_format: rc]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.deflate', 'def') | file_format: rc]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.gz', 'gzip') | file_format: rc]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.snappy', 'snap') | file_format: rc]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.snappy', 'snap') | file_format: seq]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.gz', 'gzip') | file_format: seq]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.deflate', 'def') | file_format: seq]
query_test.test_compressed_formats.TestCompressedFormats.test_compressed_formats[compression_format:
('.bz2', 'bzip') | file_format: seq]
One of the stacktrace:
{code:java}
query_test/test_compressed_formats.py:83: in test_compressed_formats
'tinytable', db_suffix, suffix, '000000_0', extension)
query_test/test_compressed_formats.py:114: in _copy_and_query_compressed_file
self.filesystem_client.copy(src_file, dest_file, overwrite=True)
/data/jenkins/workspace/impala-cdpd-master-exhaustive/repos/Impala/tests/util/hdfs_util.py:79:
in copy
self.hdfs_filesystem_client.copy(src, dst, overwrite)
/data/jenkins/workspace/impala-cdpd-master-exhaustive/repos/Impala/tests/util/hdfs_util.py:241:
in copy
'{0} copy failed: '.format(self.filesystem_type) + stderr + "; " + stdout
E AssertionError: HDFS copy failed: cp:
`/test-warehouse/managed/tinytable_snap_copy/000000_0.snappy': No such file or
directory:
`hdfs://localhost:20500/test-warehouse/managed/tinytable_snap_copy/000000_0.snappy'
E ; {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
