[ https://issues.apache.org/jira/browse/HIVE-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264582#comment-13264582 ]
Edward Capriolo commented on HIVE-2988: --------------------------------------- I think the patch is great, but the JDK heap default is 512MB in recent JDKs. I know 4K of ram job a man to the moon, but why are you running such a low default? > Use of XMLEncoder to serialize MapredWork causes OOM in hive cli > ---------------------------------------------------------------- > > Key: HIVE-2988 > URL: https://issues.apache.org/jira/browse/HIVE-2988 > Project: Hive > Issue Type: Improvement > Components: CLI > Reporter: Rohini Palaniswamy > Labels: Performance > > When running queries on tables with 6000 partitions, hive cli if configured > with 128M runs into OOM. Heapdump showed 37MB occupied by one XMLEncoder > object while the MapredWork was 500K which is highly inefficient. We should > switch to using something more efficient like XStream. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira