[
https://issues.apache.org/jira/browse/IMPALA-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114423#comment-17114423
]
Wenzhe Zhou edited comment on IMPALA-9775 at 5/24/20, 6:20 AM:
---------------------------------------------------------------
This issue was caused by
[MPALA-9764|http://issues.apache.org/jira/browse/IMPALA-9764]
([https://gerrit.cloudera.org/#/c/15956/).|https://gerrit.cloudera.org/#/c/15956/]
The sleep interval between heartbeats was changed from 60 seconds to a value
read from the Hive configuration. The test case will be failed if there is no
heartbeat detected in 200 seconds. To fix it, we should not allow the sleep
time more than 60 seconds, or set hive.txn.timeout as 180 seconds..
The Issue could be reproduced on local machine by running following command. It
may failed for different table format in each run.
./bin/impala-py.test
tests/query_test/test_acid.py::TestAcid::test_acid_heartbeats
--workload_exploration_strategy=functional-query:exhaustive
Verified that the issue was fixed by setting the maximum sleep interval as 60
sec.
was (Author: wzhou):
This issue was caused by
[MPALA-9764|http://issues.apache.org/jira/browse/IMPALA-9764]
([https://gerrit.cloudera.org/#/c/15956/).|https://gerrit.cloudera.org/#/c/15956/]
The heartbeat interval was changed from 60 seconds to a value read from the
Hive configuration. The test case will be failed if there is no heartbeat
detected in 200 seconds. To fix it, we should set a max value for heartbeat
interval.
The Issue could be reproduced on local machine by running following command. It
failed for table format text/gzip/block and text/lzo/block.
./bin/impala-py.test
tests/query_test/test_acid.py::TestAcid::test_acid_heartbeats
--workload_exploration_strategy=functional-query:exhaustive
============================================================= FAILURES
=============================================================
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
|table_format: text/gzip/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
TestAcid.test_acid_heartbeats[protocol: beeswax|exec_option:|
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
|table_format: text/lzo/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False|
Tried to increase the MAX_ATTEMPTS from 10 to 20 in test_acid_heartbeats
function, but it did not help. Ran the test again, it failed in different table
formats: text/def/block and text/snap/block.
============================================================= FAILURES
=============================================================
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
|table_format: text/def/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
TestAcid.test_acid_heartbeats[protocol: beeswax|exec_option:|
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
|table_format: text/snap/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False|
Verified that the issue was fixed by setting the maximum heartbeat interval as
60 sec.
> Failure in TestAcid.test_acid_heartbeats
> ----------------------------------------
>
> Key: IMPALA-9775
> URL: https://issues.apache.org/jira/browse/IMPALA-9775
> Project: IMPALA
> Issue Type: Bug
> Components: Backend, Frontend
> Affects Versions: Impala 4.0
> Reporter: Wenzhe Zhou
> Assignee: Wenzhe Zhou
> Priority: Blocker
> Labels: broken-build
>
> Got following failures when running exhaustive pre-review test.
> *
> [query_test.test_queries.TestQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestQueries/]
> *
> [query_test.test_queries.TestHdfsQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestHdfsQueries/]
> *
> [query_test.test_queries.TestQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestQueries_2/]
> *
> [query_test.test_queries.TestHdfsQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestHdfsQueries_2/]
> * [query_test.test_acid.TestAcid.test_acid_heartbeats[protocol: beeswax |
> exec_option: \{'batch_size': 0, 'num_nodes': 0,
> 'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> text/snap/block]|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test.test_acid/TestAcid/test_acid_heartbeats_protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___5000___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_snap_block_/]
> *
> [query_test.test_queries.TestQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestQueries_3/]
> *
> [query_test.test_queries.TestHdfsQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestHdfsQueries_3/]
> h3. Stacktrace
> query_test/test_queries.py:46: in add_test_dimensions
> extend_exec_option_dimension(cls, "exec_single_node_rows_threshold", "100") E
> NameError: global name 'extend_exec_option_dimension' is not defined
>
> query_test/test_acid.py:201: in test_acid_heartbeats
> assert success E assert False
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
