[
https://issues.apache.org/jira/browse/HIVE-27916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-27916:
--------------------------------
Description: this is HIVE-27695 for another tez drivers (was: Running all
the tests under TestMiniTezCliDriver very frequently (but still intermittently)
leads to OutOfMemory errors.
{noformat}
cd itests/qtest && mvn test -Dtest=TestMiniTezCliDriver
{noformat}
I set {{-XX:+HeapDumpOnOutOfMemoryError}} and the respective heapdumps are
attached to this ticket.
The OOM is thrown from the application master and a quick inspection of the
dumps shows that it comes mainly from the accumulation of Configuration objects
(~1MB each) by various classes.
The max heap size for application master is pretty low (~100MB) so it is quite
easy to reach. The heap size is explicitly very low for testing purposes but
maybe we should re-evaluate the current configurations for the tests.)
> Increase tez.am.resource.memory.mb for TestIcebergCliDrver
> ----------------------------------------------------------
>
> Key: HIVE-27916
> URL: https://issues.apache.org/jira/browse/HIVE-27916
> Project: Hive
> Issue Type: Bug
> Components: Test
> Affects Versions: 4.0.0-beta-1
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
>
> this is HIVE-27695 for another tez drivers
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
