[ 
https://issues.apache.org/jira/browse/HIVE-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264582#comment-13264582
 ] 

Edward Capriolo commented on HIVE-2988:
---------------------------------------

I think the patch is great, but the JDK heap default is 512MB in recent JDKs. I 
know 4K of ram job a man to the moon, but why are you running such a low 
default?
                
> Use of XMLEncoder to serialize MapredWork causes OOM in hive cli
> ----------------------------------------------------------------
>
>                 Key: HIVE-2988
>                 URL: https://issues.apache.org/jira/browse/HIVE-2988
>             Project: Hive
>          Issue Type: Improvement
>          Components: CLI
>            Reporter: Rohini Palaniswamy
>              Labels: Performance
>
> When running queries on tables with 6000 partitions, hive cli if configured 
> with 128M runs into OOM. Heapdump showed 37MB occupied by one XMLEncoder 
> object while the MapredWork was 500K which is highly inefficient. We should 
> switch to using something more efficient like XStream. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to