[
https://issues.apache.org/jira/browse/HIVE-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003748#comment-16003748
]
Sergey Shelukhin commented on HIVE-16582:
-----------------------------------------
"// guard against poor configuration of noconditional task size. We let hash
table grow till 2/3'rd memory" etc. code is duplicated.
Also 2/3 could be configurable.
Otherwise looks good.
This doesn't account for the number of fragments actually running, does it?
> HashTableLoader should log info about the input, rows, size etc.
> ----------------------------------------------------------------
>
> Key: HIVE-16582
> URL: https://issues.apache.org/jira/browse/HIVE-16582
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 3.0.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Minor
> Attachments: HIVE-16582.1.patch, HIVE-16582.2.patch,
> HIVE-16582.3.patch, HIVE-16582.4.patch
>
>
> Will be useful to log the following info during hash table loading
> - input name
> - number of rows
> - estimated data size (LLAP tracks this)
> - object cache key
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)