Yida Wu created IMPALA-12336:
--------------------------------
Summary: Testcases failed with "Memory is likely oversubscribed"
Key: IMPALA-12336
URL: https://issues.apache.org/jira/browse/IMPALA-12336
Project: IMPALA
Issue Type: Bug
Components: Backend
Reporter: Yida Wu
TestScannersAllTableFormats.test_hdfs_scanner_profile fails with following
error messages:
{code:java}
query_test.test_scanners.TestScannersAllTableFormats.test_hdfs_scanner_profile[protocol:
beeswax | table_format: rc/def/block | exec_option: {'test_replan': 1,
'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0,
'disable_codegen': True, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0} | batch_size: 16 | mt_dop: 1 |
debug_action: -1:OPEN:[email protected]]
{code}
*Error Message*
{code:java}
query_test/test_scanners.py:114: in test_hdfs_scanner_profile
self.run_test_case('QueryTest/hdfs_scanner_profile', vector)
common/impala_test_suite.py:718: in run_test_case result = exec_fn(query,
user=test_section.get('USER', '').strip() or None)
common/impala_test_suite.py:656: in __exec_in_impala result =
self.__execute_query(target_impalad_client, query, user=user)
common/impala_test_suite.py:992: in __execute_query return
impalad_client.execute(query, user=user) common/impala_connection.py:214: in
execute return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:191: in execute handle =
self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:369: in __execute_query
self.wait_for_finished(handle) beeswax/impala_beeswax.py:390: in
wait_for_finished raise ImpalaBeeswaxException("Query aborted:" +
error_log, None) E ImpalaBeeswaxException: ImpalaBeeswaxException: E Query
aborted:Failed to get minimum memory reservation of 18.94 MB on daemon
impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000 for query
264e9962cf0b6c6b:baec25ee00000000 due to following error: Memory limit
exceeded: Could not allocate memory while trying to increase reservation. E
Query(264e9962cf0b6c6b:baec25ee00000000) could not allocate 18.94 MB without
exceeding limit. E Error occurred on backend
impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000 E Memory
left in process limit: 1.21 GB E Query(264e9962cf0b6c6b:baec25ee00000000):
Reservation=0 ReservationLimit=9.60 GB OtherMemory=0 Total=0 Peak=0 E Memory
is likely oversubscribed. Reducing query concurrency or configuring admission
control may help avoid this error.
{code}
*Stacktrace*
{code:java}
query_test/test_scanners.py:114: in test_hdfs_scanner_profile
self.run_test_case('QueryTest/hdfs_scanner_profile', vector)
common/impala_test_suite.py:718: in run_test_case
result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
common/impala_test_suite.py:656: in __exec_in_impala
result = self.__execute_query(target_impalad_client, query, user=user)
common/impala_test_suite.py:992: in __execute_query
return impalad_client.execute(query, user=user)
common/impala_connection.py:214: in execute
return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:191: in execute
handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:369: in __execute_query
self.wait_for_finished(handle)
beeswax/impala_beeswax.py:390: in wait_for_finished
raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
E ImpalaBeeswaxException: ImpalaBeeswaxException:
E Query aborted:Failed to get minimum memory reservation of 18.94 MB on
daemon impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000 for
query 264e9962cf0b6c6b:baec25ee00000000 due to following error: Memory limit
exceeded: Could not allocate memory while trying to increase reservation.
E Query(264e9962cf0b6c6b:baec25ee00000000) could not allocate 18.94 MB
without exceeding limit.
E Error occurred on backend
impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000
E Memory left in process limit: 1.21 GB
E Query(264e9962cf0b6c6b:baec25ee00000000): Reservation=0
ReservationLimit=9.60 GB OtherMemory=0 Total=0 Peak=0
E Memory is likely oversubscribed. Reducing query concurrency or configuring
admission control may help avoid this error.
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
