[
https://issues.apache.org/jira/browse/IMPALA-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114423#comment-17114423
]
Wenzhe Zhou edited comment on IMPALA-9775 at 5/24/20, 12:18 AM:
----------------------------------------------------------------
This issue was caused by
[MPALA-9764|http://issues.apache.org/jira/browse/IMPALA-9764]
([https://gerrit.cloudera.org/#/c/15956/).|https://gerrit.cloudera.org/#/c/15956/]
The heartbeat interval was changed from 60 seconds to a value read from the
Hive configuration. The test case will be failed if there is no heartbeat
detected in 200 seconds. To fix it, we should set a max value for heartbeat
interval.
The Issue could be reproduced on local machine by running following command. It
failed for table format text/gzip/block and text/lzo/block.
./bin/impala-py.test
tests/query_test/test_acid.py::TestAcid::test_acid_heartbeats
--workload_exploration_strategy=functional-query:exhaustive
============================================================= FAILURES
=============================================================
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
|table_format: text/gzip/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
TestAcid.test_acid_heartbeats[protocol: beeswax|exec_option:|
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
|table_format: text/lzo/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False|
Tried to increase the MAX_ATTEMPTS from 10 to 20 in test_acid_heartbeats
function, but it did not help. Ran the test again, it failed in different table
formats: text/def/block and text/snap/block.
============================================================= FAILURES
=============================================================
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
| table_format: text/def/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
| table_format: text/snap/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
Verified that the issue was fixed by setting the maximum heartbeat interval as
100 sec.
was (Author: wzhou):
This issue was caused by
[MPALA-9764|http://issues.apache.org/jira/browse/IMPALA-9764]
([https://gerrit.cloudera.org/#/c/15956/).|https://gerrit.cloudera.org/#/c/15956/]
The heartbeat interval was changed from 60 seconds to a value read from the
Hive configuration. The test case will be failed if there is no heartbeat
detected in 200 seconds. To fix it, we should set a max value for heartbeat
interval.
The Issue could be reproduced on local machine by running following command. It
failed for table format text/gzip/block and text/lzo/block.
./bin/impala-py.test
tests/query_test/test_acid.py::TestAcid::test_acid_heartbeats
--workload_exploration_strategy=functional-query:exhaustive
============================================================= FAILURES
=============================================================
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
| table_format: text/gzip/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0}
| table_format: text/lzo/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
Tried to increase the MAX_ATTEMPTS from 10 to 20 in test_acid_heartbeats
function, but it did not help. Ran the test again, it failed in different table
formats: text/def/block and text/snap/block.
============================================================= FAILURES
=============================================================
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
\\{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0} | table_format: text/def/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
TestAcid.test_acid_heartbeats[protocol: beeswax | exec_option:
\\{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0} | table_format: text/snap/block]
tests/query_test/test_acid.py:201: in test_acid_heartbeats
assert success
E assert False
Verified that the issue was fixed by setting the maximum heartbeat interval as
100 sed.
> Failure in TestAcid.test_acid_heartbeats
> ----------------------------------------
>
> Key: IMPALA-9775
> URL: https://issues.apache.org/jira/browse/IMPALA-9775
> Project: IMPALA
> Issue Type: Bug
> Components: Backend, Frontend
> Affects Versions: Impala 4.0
> Reporter: Wenzhe Zhou
> Assignee: Wenzhe Zhou
> Priority: Blocker
> Labels: broken-build
>
> Got following failures when running exhaustive pre-review test.
> *
> [query_test.test_queries.TestQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestQueries/]
> *
> [query_test.test_queries.TestHdfsQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestHdfsQueries/]
> *
> [query_test.test_queries.TestQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestQueries_2/]
> *
> [query_test.test_queries.TestHdfsQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestHdfsQueries_2/]
> * [query_test.test_acid.TestAcid.test_acid_heartbeats[protocol: beeswax |
> exec_option: \{'batch_size': 0, 'num_nodes': 0,
> 'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> text/snap/block]|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test.test_acid/TestAcid/test_acid_heartbeats_protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___5000___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_snap_block_/]
> *
> [query_test.test_queries.TestQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestQueries_3/]
> *
> [query_test.test_queries.TestHdfsQueries|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/10724/testReport/junit/query_test/test_queries/TestHdfsQueries_3/]
> h3. Stacktrace
> query_test/test_queries.py:46: in add_test_dimensions
> extend_exec_option_dimension(cls, "exec_single_node_rows_threshold", "100") E
> NameError: global name 'extend_exec_option_dimension' is not defined
>
> query_test/test_acid.py:201: in test_acid_heartbeats
> assert success E assert False
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
