This is an automated email from the ASF dual-hosted git repository.
joemcdonnell pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit f1cca6c767696c9dcf145ec0eda167f8efe84628
Author: Riza Suminto <riza.sumi...@cloudera.com>
AuthorDate: Thu Jun 1 14:21:14 2023 -0700
IMPALA-12135: Deflake test_krpc_datastream_sender_shuffle
test_krpc_datastream_sender_shuffle has been failing with OOM error in
HDFS EC environement. This is due to fix introduced in IMPALA-12106
reduce num instances of a union fragment (F06) from 3 to 2. Running the
test with BATCH_SIZE=8 help pass the test while still holding the
assertion (KrpcDataStreamSender claiming megabytes of memory for
RowBatchSerialization).
Testing:
- test_krpc_datastream_sender_shuffle pass both in regular minicluster
and HDFS EC setup.
Change-Id: I8c7961ad8dd489a4d62e738d364d4da1fa44d0cc
Reviewed-on: http://gerrit.cloudera.org:8080/20011
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Reviewed-by: Joe McDonnell <joemcdonn...@cloudera.com>
---
tests/query_test/test_datastream_sender.py | 1 +
1 file changed, 1 insertion(+)
diff --git a/tests/query_test/test_datastream_sender.py
b/tests/query_test/test_datastream_sender.py
index b5c266a35..96132323b 100644
--- a/tests/query_test/test_datastream_sender.py
+++ b/tests/query_test/test_datastream_sender.py
@@ -33,4 +33,5 @@ class TestDataStreamSenderTpch(ImpalaTestSuite):
v.get_value('table_format').file_format in ['parquet'])
def test_krpc_datastream_sender_shuffle(self, vector):
+ vector.get_value('exec_option')['batch_size'] = 8
self.run_test_case('datastream-sender', vector)
