[
https://issues.apache.org/jira/browse/IMPALA-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qifan Chen updated IMPALA-10927:
--------------------------------
Description:
RowsSentRate counter is seen with a value of 0 and the following is the error
report. A fix in the similar area was described in IMPALA-8957, where a delay
via DEBUG_ACTION BPRS_BEFORE_ADD_BATCH was introduced.
{code:java}
query_test.test_fetch.TestFetchAndSpooling.test_rows_sent_counters[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none] (from pytest)
Failing for the past 1 build (Since Failed#206 )
Took 0.47 sec.
Error Message
query_test/test_fetch.py:101: in test_rows_sent_counters assert
float(rows_sent_rate.group(1)) > 0 E assert 0.0 > 0 E + where 0.0 =
float('0') E + where '0' = <built-in method group of _sre.SRE_Match
object at 0x7f9d22693030>(1) E + where <built-in method group of
_sre.SRE_Match object at 0x7f9d22693030> = <_sre.SRE_Match object at
0x7f9d22693030>.group
Stacktrace
query_test/test_fetch.py:101: in test_rows_sent_counters
assert float(rows_sent_rate.group(1)) > 0
E assert 0.0 > 0
E + where 0.0 = float('0')
E + where '0' = <built-in method group of _sre.SRE_Match object at
0x7f9d22693030>(1)
E + where <built-in method group of _sre.SRE_Match object at
0x7f9d22693030> = <_sre.SRE_Match object at 0x7f9d22693030>.group
Standard Error
SET
client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table;
-- connecting to: localhost:21000
-- connecting to localhost:21050 with impyla
-- 2021-09-10 04:41:56,852 INFO MainThread: Closing active operation
-- connecting to localhost:28000 with impyla
-- 2021-09-10 04:41:56,925 INFO MainThread: Closing active operation
-- connecting to localhost:11050 with impyla
-- 2021-09-10 04:41:56,939 INFO MainThread: Could not connect to ('::1',
11050, 0, 0)
-- 2021-09-10 04:41:56,939 ERROR MainThread: Could not connect to any of
[('::1', 11050, 0, 0), ('127.0.0.1', 11050)]
-- 2021-09-10 04:41:56,939 INFO MainThread: HS2 FENG connection setup
failed, continuing...: Could not connect to any of [('::1', 11050, 0, 0),
('127.0.0.1', 11050)]
SET
client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table;
SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET debug_action=BPRS_BEFORE_ADD_ROWS:SLEEP@1000;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
select id from functional.alltypes limit 10;
-- 2021-09-10 04:41:56,988 INFO MainThread: Started query
b04941a7ffff5e31:1da6c8eb00000000
Options
{code}
was:
RowsSentRate counter is seen with a value of 0 and the following is the error
report. A fix in the similar area was described in IMPALA-8957, where a delay
via DEBUG_ACTION BPRS_BEFORE_ADD_BATCH was introduced.
{code:java}
query_test.test_fetch.TestFetchAndSpooling.test_rows_sent_counters[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none] (from pytest)
Failing for the past 1 build (Since Failed#206 )
Took 0.47 sec.
Error Message
query_test/test_fetch.py:101: in test_rows_sent_counters assert
float(rows_sent_rate.group(1)) > 0 E assert 0.0 > 0 E + where 0.0 =
float('0') E + where '0' = <built-in method group of _sre.SRE_Match
object at 0x7f9d22693030>(1) E + where <built-in method group of
_sre.SRE_Match object at 0x7f9d22693030> = <_sre.SRE_Match object at
0x7f9d22693030>.group
Stacktrace
query_test/test_fetch.py:101: in test_rows_sent_counters
assert float(rows_sent_rate.group(1)) > 0
E assert 0.0 > 0
E + where 0.0 = float('0')
E + where '0' = <built-in method group of _sre.SRE_Match object at
0x7f9d22693030>(1)
E + where <built-in method group of _sre.SRE_Match object at
0x7f9d22693030> = <_sre.SRE_Match object at 0x7f9d22693030>.group
Standard Error
SET
client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table;
-- connecting to: localhost:21000
-- connecting to localhost:21050 with impyla
-- 2021-09-10 04:41:56,852 INFO MainThread: Closing active operation
-- connecting to localhost:28000 with impyla
-- 2021-09-10 04:41:56,925 INFO MainThread: Closing active operation
-- connecting to localhost:11050 with impyla
-- 2021-09-10 04:41:56,939 INFO MainThread: Could not connect to ('::1',
11050, 0, 0)
Traceback (most recent call last):
File
"/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/thrift-0.11.0-p4/python/lib/python2.7/site-packages/thrift/transport/TSocket.py",
line 104, in open
handle.connect(sockaddr)
File
"/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/python-2.7.16/lib/python2.7/socket.py",
line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
-- 2021-09-10 04:41:56,939 INFO MainThread: Could not connect to
('127.0.0.1', 11050)
Traceback (most recent call last):
File
"/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/thrift-0.11.0-p4/python/lib/python2.7/site-packages/thrift/transport/TSocket.py",
line 104, in open
handle.connect(sockaddr)
File
"/data/jenkins/workspace/impala-cdpd-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc7.5.0/python-2.7.16/lib/python2.7/socket.py",
line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
-- 2021-09-10 04:41:56,939 ERROR MainThread: Could not connect to any of
[('::1', 11050, 0, 0), ('127.0.0.1', 11050)]
-- 2021-09-10 04:41:56,939 INFO MainThread: HS2 FENG connection setup
failed, continuing...: Could not connect to any of [('::1', 11050, 0, 0),
('127.0.0.1', 11050)]
SET
client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table;
SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET debug_action=BPRS_BEFORE_ADD_ROWS:SLEEP@1000;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
select id from functional.alltypes limit 10;
-- 2021-09-10 04:41:56,988 INFO MainThread: Started query
b04941a7ffff5e31:1da6c8eb00000000
Options
{code}
> TestFetchAndSpooling.test_rows_sent_counters is flaky in core-s3 based test
> ---------------------------------------------------------------------------
>
> Key: IMPALA-10927
> URL: https://issues.apache.org/jira/browse/IMPALA-10927
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Qifan Chen
> Priority: Major
>
> RowsSentRate counter is seen with a value of 0 and the following is the error
> report. A fix in the similar area was described in IMPALA-8957, where a delay
> via DEBUG_ACTION BPRS_BEFORE_ADD_BATCH was introduced.
> {code:java}
> query_test.test_fetch.TestFetchAndSpooling.test_rows_sent_counters[protocol:
> beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
> 'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> parquet/none] (from pytest)
> Failing for the past 1 build (Since Failed#206 )
> Took 0.47 sec.
> Error Message
> query_test/test_fetch.py:101: in test_rows_sent_counters assert
> float(rows_sent_rate.group(1)) > 0 E assert 0.0 > 0 E + where 0.0 =
> float('0') E + where '0' = <built-in method group of _sre.SRE_Match
> object at 0x7f9d22693030>(1) E + where <built-in method group of
> _sre.SRE_Match object at 0x7f9d22693030> = <_sre.SRE_Match object at
> 0x7f9d22693030>.group
> Stacktrace
> query_test/test_fetch.py:101: in test_rows_sent_counters
> assert float(rows_sent_rate.group(1)) > 0
> E assert 0.0 > 0
> E + where 0.0 = float('0')
> E + where '0' = <built-in method group of _sre.SRE_Match object at
> 0x7f9d22693030>(1)
> E + where <built-in method group of _sre.SRE_Match object at
> 0x7f9d22693030> = <_sre.SRE_Match object at 0x7f9d22693030>.group
> Standard Error
> SET
> client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table;
> -- connecting to: localhost:21000
> -- connecting to localhost:21050 with impyla
> -- 2021-09-10 04:41:56,852 INFO MainThread: Closing active operation
> -- connecting to localhost:28000 with impyla
> -- 2021-09-10 04:41:56,925 INFO MainThread: Closing active operation
> -- connecting to localhost:11050 with impyla
> -- 2021-09-10 04:41:56,939 INFO MainThread: Could not connect to ('::1',
> 11050, 0, 0)
> -- 2021-09-10 04:41:56,939 ERROR MainThread: Could not connect to any of
> [('::1', 11050, 0, 0), ('127.0.0.1', 11050)]
> -- 2021-09-10 04:41:56,939 INFO MainThread: HS2 FENG connection setup
> failed, continuing...: Could not connect to any of [('::1', 11050, 0, 0),
> ('127.0.0.1', 11050)]
> SET
> client_identifier=query_test/test_fetch.py::TestFetchAndSpooling::()::test_rows_sent_counters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table;
> SET batch_size=0;
> SET num_nodes=0;
> SET disable_codegen_rows_threshold=0;
> SET disable_codegen=False;
> SET abort_on_error=1;
> SET debug_action=BPRS_BEFORE_ADD_ROWS:SLEEP@1000;
> SET exec_single_node_rows_threshold=0;
> -- executing against localhost:21000
> select id from functional.alltypes limit 10;
> -- 2021-09-10 04:41:56,988 INFO MainThread: Started query
> b04941a7ffff5e31:1da6c8eb00000000
> Options
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
