[
https://issues.apache.org/jira/browse/CHUKWA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709504#action_12709504
]
Jerome Boulon commented on CHUKWA-239:
--------------------------------------
Ari, yes for the one you changed, on my laptop I'm running with similar setting
however you may also want to change the default value for io.sort.factor to be
10.
But be careful, there's a bug in Demux.java, demux force a load of the config
coming from CHUKWA_HOME/conf so if you have a separate config dir then you will
only see the default value. I'm not sure if I have open a Jira for that but I
will fix it early next week.
> demux settings should work correctly out-of-the-box
> ---------------------------------------------------
>
> Key: CHUKWA-239
> URL: https://issues.apache.org/jira/browse/CHUKWA-239
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Reporter: Ari Rabkin
> Priority: Critical
> Attachments: CHUKWA-239.patch
>
>
> The sort buffer sizes in chukwa-demux-conf are incompatible with the Hadoop
> defaults.
> As a result, the demux mapred jobs all fail almost immediately with an
> out-of-memory if run on an out-of-the-box Hadoop.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
