IMPALA-7048: Failed test: test_write_index_many_columns_tables The test in the title fails when the local filesystem is used.
Looking at the error message it seems that the determined Parquet file size is too small when the local filesystem is used. There is already an annotation for that: 'SkipIfLocal.parquet_file_size' I added this annotation to the TestHdfsParquetTableIndexWriter class, therefore these tests won't be executed when the test-warehouse directory of Impala resides on the local filesystem. Change-Id: Idd3be70fb654a49dda44309a8914fe1f2b48a1af Reviewed-on: http://gerrit.cloudera.org:8080/10476 Reviewed-by: Zoltan Borok-Nagy <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/impala/repo Commit: http://git-wip-us.apache.org/repos/asf/impala/commit/a48bbfdf Tree: http://git-wip-us.apache.org/repos/asf/impala/tree/a48bbfdf Diff: http://git-wip-us.apache.org/repos/asf/impala/diff/a48bbfdf Branch: refs/heads/2.x Commit: a48bbfdf4692eb68f06a4cd192a98947bcc04aba Parents: a3efde8 Author: Zoltan Borok-Nagy <[email protected]> Authored: Tue May 22 18:13:45 2018 +0200 Committer: Impala Public Jenkins <[email protected]> Committed: Fri May 25 23:17:16 2018 +0000 ---------------------------------------------------------------------- tests/query_test/test_parquet_page_index.py | 2 ++ 1 file changed, 2 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/impala/blob/a48bbfdf/tests/query_test/test_parquet_page_index.py ---------------------------------------------------------------------- diff --git a/tests/query_test/test_parquet_page_index.py b/tests/query_test/test_parquet_page_index.py index 51632e5..0ee5d37 100644 --- a/tests/query_test/test_parquet_page_index.py +++ b/tests/query_test/test_parquet_page_index.py @@ -24,6 +24,7 @@ from subprocess import check_call from parquet.ttypes import BoundaryOrder, ColumnIndex, OffsetIndex, PageHeader, PageType from tests.common.impala_test_suite import ImpalaTestSuite +from tests.common.skip import SkipIfLocal from tests.util.filesystem_utils import get_fs_path from tests.util.get_parquet_metadata import ( decode_stats_value, @@ -34,6 +35,7 @@ from tests.util.get_parquet_metadata import ( PAGE_INDEX_MAX_STRING_LENGTH = 64 [email protected]_file_size class TestHdfsParquetTableIndexWriter(ImpalaTestSuite): """Since PARQUET-922 page statistics can be written before the footer. The tests in this class checks if Impala writes the page indices correctly.
