[
https://issues.apache.org/jira/browse/IMPALA-10255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217382#comment-17217382
]
ASF subversion and git services commented on IMPALA-10255:
----------------------------------------------------------
Commit 198bbe280cb991f653eba18c3d49b35582608520 in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=198bbe2 ]
IMPALA-10255: Fix TestInsertQueries.test_insert fails in exhaustive builds
The patch in IMPALA-10233 adds 3 insert statements in
testdata/workloads/functional-query/queries/QueryTest/insert.test. The
test has CREATE TABLE ... LIKE functional.alltypes; therefore it'll
create a TEXT table regardless to the test vector. But the compression
codec is determined by the test vector, and since Impala cannot write
compressed text, the test fails.
The created table should use the same table format as the one in the
test vector.
Tests:
- Run TestInsertQueries.test_insert in exhaustive mode.
Change-Id: Id0912f751fa04015f1ffdc38f5c7207db7679896
Reviewed-on: http://gerrit.cloudera.org:8080/16609
Reviewed-by: Quanlong Huang <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> query_test.test_insert.TestInsertQueries.test_insert fails in exhaustive
> builds
> -------------------------------------------------------------------------------
>
> Key: IMPALA-10255
> URL: https://issues.apache.org/jira/browse/IMPALA-10255
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Blocker
>
> The patch in IMPALA-10233 adds 3 insert statements in
> testdata/workloads/functional-query/queries/QueryTest/insert.test. They
> introduce test failures in parquet format with non-none compressions:
> {code:java}
> query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> snappy | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> gzip | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> zstd | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> lz4 | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> lz4 | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> zstd | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> gzip | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> snappy | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> snappy | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen':
> False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} |
> table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> gzip | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> zstd | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> lz4 | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> lz4 | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> zstd | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> gzip | protocol: beeswax | exec_option: {'sync_ddl': 1, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0]query_test.test_insert.TestInsertQueries.test_insert[compression_codec:
> snappy | protocol: beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none-unique_database0] {code}
> The failure is
> {code:java}
> query_test/test_insert.py:141: in test_insert
> .get_db_name_from_format(vector.get_value('table_format'))})
> common/impala_test_suite.py:662: in run_test_case
> result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
> common/impala_test_suite.py:600: in __exec_in_impala
> result = self.__execute_query(target_impalad_client, query, user=user)
> common/impala_test_suite.py:909: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:205: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:187: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:365: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:386: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:Writing to compressed text table is not supported. {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
