[
https://issues.apache.org/jira/browse/HIVE-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mithun Radhakrishnan updated HIVE-17188:
----------------------------------------
Description:
For large batches (e.g. hundreds) of {{addPartitions()}}, the {{ObjectStore}}
runs out of memory. Flushing the {{PersistenceManager}} alleviates the problem.
Note: The problem being addressed here isn't so much with the size of the
hundreds of Partition objects, but the cruft that builds with the
PersistenceManager, in the JDO layer, as confirmed through memory-profiling.
(Raising this on behalf of [~cdrome] and [~thiruvel].)
was:
For large batches (e.g. hundreds) of {{addPartitions()}}, the {{ObjectStore}}
runs out of memory. Flushing the {{PersistenceManager}} alleviates the problem.
(Raising this on behalf of [~cdrome] and [~thiruvel].)
> ObjectStore runs out of memory for large batches of addPartitions().
> --------------------------------------------------------------------
>
> Key: HIVE-17188
> URL: https://issues.apache.org/jira/browse/HIVE-17188
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 2.2.0
> Reporter: Mithun Radhakrishnan
> Assignee: Chris Drome
> Attachments: HIVE-17188.1.patch
>
>
> For large batches (e.g. hundreds) of {{addPartitions()}}, the {{ObjectStore}}
> runs out of memory. Flushing the {{PersistenceManager}} alleviates the
> problem.
> Note: The problem being addressed here isn't so much with the size of the
> hundreds of Partition objects, but the cruft that builds with the
> PersistenceManager, in the JDO layer, as confirmed through memory-profiling.
> (Raising this on behalf of [~cdrome] and [~thiruvel].)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
