[
https://issues.apache.org/jira/browse/IMPALA-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085018#comment-17085018
]
ASF subversion and git services commented on IMPALA-9596:
---------------------------------------------------------
Commit dc410a2cf47bcf06a0f4563d05a9d0a339af5fb2 in impala's branch
refs/heads/master from Tim Armstrong
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=dc410a2 ]
IMPALA-9596: deflake test_tpch_mem_limit_single_node
This changes the test to use a debug action instead of
trying to hit the memory limit in the right spot, which
has tended to be flaky. This still exercises the error
handling code in the scanner, which was the original
point of the test (see IMPALA-2376).
This revealed an actual bug in the ORC scanner, where
it was not returning the error directly from
AssembleCollection(). Before I fixed that, the scanner
got stuck in an infinite loop when running the test.
Change-Id: I4678963c264b7c15fbac6f71721162b38676aa21
Reviewed-on: http://gerrit.cloudera.org:8080/15700
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Gabor Kaszab <[email protected]>
> TestNestedTypesNoMtDop.test_tpch_mem_limit_single_node failed
> -------------------------------------------------------------
>
> Key: IMPALA-9596
> URL: https://issues.apache.org/jira/browse/IMPALA-9596
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 4.0
> Reporter: Yongzhi Chen
> Assignee: Tim Armstrong
> Priority: Blocker
> Labels: broken-build, flaky
>
> parallel-all-tests-nightly failed with:
> query_test.test_nested_types.TestNestedTypesNoMtDop.test_tpch_mem_limit_single_node[protocol:
> beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
> 'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> orc/def/block] (from pytest)
> Error Message
> query_test/test_nested_types.py:159: in test_tpch_mem_limit_single_node
> new_vector, use_db='tpch_nested' + db_suffix)
> common/impala_test_suite.py:665: in run_test_case
> self.__verify_exceptions(test_section['CATCH'], str(e), use_db)
> common/impala_test_suite.py:481: in __verify_exceptions (expected_str,
> actual_str) E AssertionError: Unexpected exception string. Expected:
> row_regex: .*Memory limit exceeded: Failed to allocate [0-9]+ bytes for
> collection 'tpch_nested_.*.customer.c_orders.item.o_lineitems'.* E Not
> found in actual: ImpalaBeeswaxException: Query aborted:Memory limit exceeded:
> Error occurred on backend a3c3b59bd11e:22000 by fragment
> c3440dc607fd4a18:25e42cf500000000Memory left in process limit: 8.26 GBMemory
> left in query limit: -3.94 KBQuery(c3440dc607fd4a18:25e42cf500000000): memory
> limit exceeded. Limit=20.00 MB Reservation=8.00 MB ReservationLimit=24.00 MB
> OtherMemory=12.00 MB Total=20.00 MB Peak=20.00 MB Fragment
> c3440dc607fd4a18:25e42cf500000000: Reservation=8.00 MB OtherMemory=12.00 MB
> Total=20.00 MB Peak=20.00 MB AGGREGATION_NODE (id=6): Total=24.00 KB
> Peak=24.00 KB NonGroupingAggregator 0: Total=8.00 KB Peak=8.00 KB
> Exprs: Total=4.00 KB Peak=4.00 KB SUBPLAN_NODE (id=1): Total=4.81 MB
> Peak=4.81 MB HDFS_SCAN_NODE (id=0): Reservation=8.00 MB OtherMemory=7.12
> MB Total=15.12 MB Peak=15.12 MB NESTED_LOOP_JOIN_NODE (id=5): Total=24.00
> KB Peak=24.00 KB Nested Loop Join Builder: Total=8.00 KB Peak=8.00 KB
> AGGREGATION_NODE (id=4): Total=24.00 KB Peak=24.00 KB
> NonGroupingAggregator 0: Total=16.00 KB Peak=16.00 KB Exprs:
> Total=4.00 KB Peak=4.00 KB UNNEST_NODE (id=3): Total=0 Peak=0
> SINGULAR_ROW_SRC_NODE (id=2): Total=0 Peak=0 PLAN_ROOT_SINK: Total=0
> Peak=0 CodeGen: Total=2.48 KB Peak=351.00 KB
> Stacktrace
> query_test/test_nested_types.py:159: in test_tpch_mem_limit_single_node
> new_vector, use_db='tpch_nested' + db_suffix)
> common/impala_test_suite.py:665: in run_test_case
> self.__verify_exceptions(test_section['CATCH'], str(e), use_db)
> common/impala_test_suite.py:481: in __verify_exceptions
> (expected_str, actual_str)
> E AssertionError: Unexpected exception string. Expected: row_regex:
> .*Memory limit exceeded: Failed to allocate [0-9]+ bytes for collection
> 'tpch_nested_.*.customer.c_orders.item.o_lineitems'.*
> E Not found in actual: ImpalaBeeswaxException: Query aborted:Memory limit
> exceeded: Error occurred on backend a3c3b59bd11e:22000 by fragment
> c3440dc607fd4a18:25e42cf500000000Memory left in process limit: 8.26 GBMemory
> left in query limit: -3.94 KBQuery(c3440dc607fd4a18:25e42cf500000000): memory
> limit exceeded. Limit=20.00 MB Reservation=8.00 MB ReservationLimit=24.00 MB
> OtherMemory=12.00 MB Total=20.00 MB Peak=20.00 MB Fragment
> c3440dc607fd4a18:25e42cf500000000: Reservation=8.00 MB OtherMemory=12.00 MB
> Total=20.00 MB Peak=20.00 MB AGGREGATION_NODE (id=6): Total=24.00 KB
> Peak=24.00 KB NonGroupingAggregator 0: Total=8.00 KB Peak=8.00 KB
> Exprs: Total=4.00 KB Peak=4.00 KB SUBPLAN_NODE (id=1): Total=4.81 MB
> Peak=4.81 MB HDFS_SCAN_NODE (id=0): Reservation=8.00 MB OtherMemory=7.12
> MB Total=15.12 MB Peak=15.12 MB NESTED_LOOP_JOIN_NODE (id=5): Total=24.00
> KB Peak=24.00 KB Nested Loop Join Builder: Total=8.00 KB Peak=8.00 KB
> AGGREGATION_NODE (id=4): Total=24.00 KB Peak=24.00 KB
> NonGroupingAggregator 0: Total=16.00 KB Peak=16.00 KB Exprs:
> Total=4.00 KB Peak=4.00 KB UNNEST_NODE (id=3): Total=0 Peak=0
> SINGULAR_ROW_SRC_NODE (id=2): Total=0 Peak=0 PLAN_ROOT_SINK: Total=0
> Peak=0 CodeGen: Total=2.48 KB Peak=351.00 KB
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
