[
https://issues.apache.org/jira/browse/IMPALA-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845069#comment-16845069
]
Tim Armstrong edited comment on IMPALA-8567 at 5/21/19 5:37 PM:
----------------------------------------------------------------
{noformat}
query_test.test_insert_parquet.TestHdfsParquetTableStatsWriter.test_write_statistics_multiple_row_groups[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none] (from pytest)
Failing for the past 1 build (Since Failed#288 )
Took 7.6 sec.
add description
Error Message
query_test/test_insert_parquet.py:787: in
test_write_statistics_multiple_row_groups self.execute_query(query,
vector.get_value('exec_option')) common/impala_test_suite.py:644: in wrapper
return function(*args, **kwargs) common/impala_test_suite.py:675: in
execute_query return self.__execute_query(self.client, query,
query_options) common/impala_test_suite.py:746: in __execute_query return
impalad_client.execute(query, user=user) common/impala_connection.py:180: in
execute return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:187: in execute handle =
self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:362: in __execute_query handle =
self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:356: in execute_query_async handle =
self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:516: in __do_rpc raise
ImpalaBeeswaxException(self.__build_error_message(b), b) E
ImpalaBeeswaxException: ImpalaBeeswaxException: E INNER EXCEPTION: <class
'beeswaxd.ttypes.BeeswaxException'> E MESSAGE: AnalysisException: Table does
not exist:
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
Stacktrace
query_test/test_insert_parquet.py:787: in
test_write_statistics_multiple_row_groups
self.execute_query(query, vector.get_value('exec_option'))
common/impala_test_suite.py:644: in wrapper
return function(*args, **kwargs)
common/impala_test_suite.py:675: in execute_query
return self.__execute_query(self.client, query, query_options)
common/impala_test_suite.py:746: in __execute_query
return impalad_client.execute(query, user=user)
common/impala_connection.py:180: in execute
return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:187: in execute
handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:362: in __execute_query
handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:356: in execute_query_async
handle = self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:516: in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E ImpalaBeeswaxException: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: AnalysisException: Table does not exist:
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
Standard Error
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE IF EXISTS `test_write_statistics_multiple_row_groups_3bed993c`
CASCADE;
-- 2019-05-21 02:25:33,533 INFO MainThread: Started query
ae4e9c0107c68e9e:6c0d8b4100000000
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET sync_ddl=False;
-- executing against localhost:21000
CREATE DATABASE `test_write_statistics_multiple_row_groups_3bed993c`;
-- 2019-05-21 02:25:34,034 INFO MainThread: Started query
f1487560c0eb8826:21fa1b9600000000
-- 2019-05-21 02:25:34,038 INFO MainThread: Created database
"test_write_statistics_multiple_row_groups_3bed993c" for test ID
"query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none]"
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
create table
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
sort by (o_orderkey) like tpch_parquet.orders stored as parquet;
-- 2019-05-21 02:25:37,542 INFO MainThread: Started query
8346c67c58db2156:3403c4cb00000000
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET batch_size=0;
SET num_nodes=1;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET parquet_file_size=8388608;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
insert into
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
select * from tpch_parquet.orders;
{noformat}
was (Author: tarmstrong):
query_test.test_insert_parquet.TestHdfsParquetTableStatsWriter.test_write_statistics_multiple_row_groups[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none] (from pytest)
Failing for the past 1 build (Since Failed#288 )
Took 7.6 sec.
add description
Error Message
query_test/test_insert_parquet.py:787: in
test_write_statistics_multiple_row_groups self.execute_query(query,
vector.get_value('exec_option')) common/impala_test_suite.py:644: in wrapper
return function(*args, **kwargs) common/impala_test_suite.py:675: in
execute_query return self.__execute_query(self.client, query,
query_options) common/impala_test_suite.py:746: in __execute_query return
impalad_client.execute(query, user=user) common/impala_connection.py:180: in
execute return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:187: in execute handle =
self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:362: in __execute_query handle =
self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:356: in execute_query_async handle =
self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:516: in __do_rpc raise
ImpalaBeeswaxException(self.__build_error_message(b), b) E
ImpalaBeeswaxException: ImpalaBeeswaxException: E INNER EXCEPTION: <class
'beeswaxd.ttypes.BeeswaxException'> E MESSAGE: AnalysisException: Table does
not exist:
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
Stacktrace
query_test/test_insert_parquet.py:787: in
test_write_statistics_multiple_row_groups
self.execute_query(query, vector.get_value('exec_option'))
common/impala_test_suite.py:644: in wrapper
return function(*args, **kwargs)
common/impala_test_suite.py:675: in execute_query
return self.__execute_query(self.client, query, query_options)
common/impala_test_suite.py:746: in __execute_query
return impalad_client.execute(query, user=user)
common/impala_connection.py:180: in execute
return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:187: in execute
handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:362: in __execute_query
handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:356: in execute_query_async
handle = self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:516: in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E ImpalaBeeswaxException: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: AnalysisException: Table does not exist:
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
Standard Error
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE IF EXISTS `test_write_statistics_multiple_row_groups_3bed993c`
CASCADE;
-- 2019-05-21 02:25:33,533 INFO MainThread: Started query
ae4e9c0107c68e9e:6c0d8b4100000000
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET sync_ddl=False;
-- executing against localhost:21000
CREATE DATABASE `test_write_statistics_multiple_row_groups_3bed993c`;
-- 2019-05-21 02:25:34,034 INFO MainThread: Started query
f1487560c0eb8826:21fa1b9600000000
-- 2019-05-21 02:25:34,038 INFO MainThread: Created database
"test_write_statistics_multiple_row_groups_3bed993c" for test ID
"query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none]"
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
create table
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
sort by (o_orderkey) like tpch_parquet.orders stored as parquet;
-- 2019-05-21 02:25:37,542 INFO MainThread: Started query
8346c67c58db2156:3403c4cb00000000
SET
client_identifier=query_test/test_insert_parquet.py::TestHdfsParquetTableStatsWriter::()::test_write_statistics_multiple_row_groups[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exe;
SET batch_size=0;
SET num_nodes=1;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET parquet_file_size=8388608;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
insert into
test_write_statistics_multiple_row_groups_3bed993c.test_hdfs_parquet_table_writer
select * from tpch_parquet.orders;
> Many random catalog consistency issues with catalog v2/event processor
> ----------------------------------------------------------------------
>
> Key: IMPALA-8567
> URL: https://issues.apache.org/jira/browse/IMPALA-8567
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 3.3.0
> Reporter: Tim Armstrong
> Assignee: Vihang Karajgaonkar
> Priority: Blocker
> Labels: broken-build, catalog, flaky
>
> [~tlipcon] [~vihangk1] FYI. I'm not sure whether the local catalog or the
> event processor is likely to blame here so I'll let you look. The general
> theme is tables and databases not existing when they should.
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/289/testReport/junit/metadata.test_refresh_partition/TestRefreshPartition/test_drop_hive_partition_and_refresh_protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___5000___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_none_/
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/267/testReport/junit/query_test.test_kudu/TestKuduOperations/test_kudu_insert_protocol__beeswax___exec_option____kudu_read_mode____READ_AT_SNAPSHOT____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_none_/
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/286/testReport/junit/metadata.test_metadata_query_statements/TestMetadataQueryStatements/test_describe_db_protocol__beeswax___exec_option____sync_ddl___0___batch_size___0___num_nodes___0___disable_codegen_rows_threshold___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_none_/
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/286/testReport/junit/metadata.test_hms_integration/TestHmsIntegrationSanity/test_sanity_protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___5000___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_none_/
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/288/testReport/junit/query_test.test_insert_parquet/TestHdfsParquetTableStatsWriter/test_write_statistics_multiple_row_groups_protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__parquet_none_/
> I'll include the output of each job in a follow-on comment.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
