[
https://issues.apache.org/jira/browse/IMPALA-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Riza Suminto resolved IMPALA-12336.
-----------------------------------
Fix Version/s: Impala 4.5.0
Target Version: Impala 4.5.0
Resolution: Fixed
Should be resolved by IMPALA-13280.
> Testcases failed with "Memory is likely oversubscribed"
> -------------------------------------------------------
>
> Key: IMPALA-12336
> URL: https://issues.apache.org/jira/browse/IMPALA-12336
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Reporter: Yida Wu
> Assignee: Riza Suminto
> Priority: Major
> Fix For: Impala 4.5.0
>
>
> TestScannersAllTableFormats.test_hdfs_scanner_profile fails with following
> error messages:
> {code:java}
> query_test.test_scanners.TestScannersAllTableFormats.test_hdfs_scanner_profile[protocol:
> beeswax | table_format: rc/def/block | exec_option: {'test_replan': 1,
> 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0,
> 'disable_codegen': True, 'abort_on_error': 1,
> 'exec_single_node_rows_threshold': 0} | batch_size: 16 | mt_dop: 1 |
> debug_action: -1:OPEN:[email protected]]
> {code}
> *Error Message*
> {code:java}
> query_test/test_scanners.py:114: in test_hdfs_scanner_profile
> self.run_test_case('QueryTest/hdfs_scanner_profile', vector)
> common/impala_test_suite.py:718: in run_test_case result = exec_fn(query,
> user=test_section.get('USER', '').strip() or None)
> common/impala_test_suite.py:656: in __exec_in_impala result =
> self.__execute_query(target_impalad_client, query, user=user)
> common/impala_test_suite.py:992: in __execute_query return
> impalad_client.execute(query, user=user) common/impala_connection.py:214: in
> execute return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:191: in execute handle =
> self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:369: in __execute_query
> self.wait_for_finished(handle) beeswax/impala_beeswax.py:390: in
> wait_for_finished raise ImpalaBeeswaxException("Query aborted:" +
> error_log, None) E ImpalaBeeswaxException: ImpalaBeeswaxException: E
> Query aborted:Failed to get minimum memory reservation of 18.94 MB on daemon
> impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000 for
> query 264e9962cf0b6c6b:baec25ee00000000 due to following error: Memory limit
> exceeded: Could not allocate memory while trying to increase reservation. E
> Query(264e9962cf0b6c6b:baec25ee00000000) could not allocate 18.94 MB without
> exceeding limit. E Error occurred on backend
> impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000 E
> Memory left in process limit: 1.21 GB E
> Query(264e9962cf0b6c6b:baec25ee00000000): Reservation=0 ReservationLimit=9.60
> GB OtherMemory=0 Total=0 Peak=0 E Memory is likely oversubscribed. Reducing
> query concurrency or configuring admission control may help avoid this error.
> {code}
> *Stacktrace*
> {code:java}
> query_test/test_scanners.py:114: in test_hdfs_scanner_profile
> self.run_test_case('QueryTest/hdfs_scanner_profile', vector)
> common/impala_test_suite.py:718: in run_test_case
> result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
> common/impala_test_suite.py:656: in __exec_in_impala
> result = self.__execute_query(target_impalad_client, query, user=user)
> common/impala_test_suite.py:992: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:214: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:191: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:369: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:390: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:Failed to get minimum memory reservation of 18.94 MB on
> daemon impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000
> for query 264e9962cf0b6c6b:baec25ee00000000 due to following error: Memory
> limit exceeded: Could not allocate memory while trying to increase
> reservation.
> E Query(264e9962cf0b6c6b:baec25ee00000000) could not allocate 18.94 MB
> without exceeding limit.
> E Error occurred on backend
> impala-ec2-centos79-m6i-4xlarge-ondemand-1bfe.vpc.cloudera.com:27000
> E Memory left in process limit: 1.21 GB
> E Query(264e9962cf0b6c6b:baec25ee00000000): Reservation=0
> ReservationLimit=9.60 GB OtherMemory=0 Total=0 Peak=0
> E Memory is likely oversubscribed. Reducing query concurrency or
> configuring admission control may help avoid this error.
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
