[
https://issues.apache.org/jira/browse/HIVE-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946249#comment-15946249
]
Siddharth Seth commented on HIVE-16318:
---------------------------------------
bq. Note that with this temporary approach, the memory is completely taken out
of data cache... Actually, given that we don't alloc on-heap, we could set
metadata cache to a fraction of data cache, w/o reducing the latter. Thoughts?
Makes sense to me.
Also, the metadata cache being a fraction of heapsize may make sizing the
entire YARN container a little easier. I don't think we should change the
executor memory though.
> LLAP cache: address some issues in 2.2/2.3
> ------------------------------------------
>
> Key: HIVE-16318
> URL: https://issues.apache.org/jira/browse/HIVE-16318
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-16318.01.patch, HIVE-16318.02.patch,
> HIVE-16318.patch
>
>
> We've run into HIVE-16233 and HIVE-15665 and given that 2.2 and 2.3 releases
> are approaching we are going to add workarounds for them, and then commit the
> above patches and revert the workarounds as soon as we can.
> Unfortunately this will result in cache wasting some memory on some datasets,
> but the alternatives, when they are encountered (usually only on large
> datasets), are worse.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
