[
https://issues.apache.org/jira/browse/HIVE-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HIVE-16318:
------------------------------------
Attachment: HIVE-16318.02.patch
Updated based on CR feedback. I think for realistic cases, 15% is enough; the
only reason we saw it because dataset was huge so basically metadata took all
the cache.
Note that with this temporary approach, the memory is completely taken out of
data cache... Actually, given that we don't alloc on-heap, we could set
metadata cache to a fraction of data cache, w/o reducing the latter. Thoughts?
> LLAP cache: address some issues in 2.2/2.3
> ------------------------------------------
>
> Key: HIVE-16318
> URL: https://issues.apache.org/jira/browse/HIVE-16318
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-16318.01.patch, HIVE-16318.02.patch,
> HIVE-16318.patch
>
>
> We've run into HIVE-16233 and HIVE-15665 and given that 2.2 and 2.3 releases
> are approaching we are going to add workarounds for them, and then commit the
> above patches and revert the workarounds as soon as we can.
> Unfortunately this will result in cache wasting some memory on some datasets,
> but the alternatives, when they are encountered (usually only on large
> datasets), are worse.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
