[
https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14546137#comment-14546137
]
Alexander Pivovarov commented on HIVE-10711:
--------------------------------------------
Ok the goal is to prevent OOM
What is the probability of OOM if noConditionalTaskThreshold = 4000MB and
processMaxMemory = 4000MB?
Pretty high.
This is why I think we need to reduce OOM probability if we see that
noConditionalTaskThreshold is very close or even more than processMaxMemory.
> Tez HashTableLoader attempts to allocate more memory than available when
> HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem
> ------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-10711
> URL: https://issues.apache.org/jira/browse/HIVE-10711
> Project: Hive
> Issue Type: Bug
> Reporter: Jason Dere
> Assignee: Jason Dere
> Attachments: HIVE-10711.1.patch, HIVE-10711.2.patch
>
>
> Tez HashTableLoader bases its memory allocation on
> HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD. If this value is largeer than the
> process max memory then this can result in the HashTableLoader trying to use
> more memory than available to the process.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
