[
https://issues.apache.org/jira/browse/CHUKWA-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415678#comment-13415678
]
Ari Rabkin commented on CHUKWA-647:
-----------------------------------
Looks good to me. Will commit to Trunk barring objections.
(My sense is that we aren't going to be doing minor-version releases so it
doens't make sense to apply to 0.4 or 0.5 branches.)
> Spread out intermediate data with the same ReduceType into different Reduce
> Tasks
> ---------------------------------------------------------------------------------
>
> Key: CHUKWA-647
> URL: https://issues.apache.org/jira/browse/CHUKWA-647
> Project: Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.4.0, 0.6.0
> Reporter: Jie Huang
> Priority: Minor
> Attachments: Chukwa-647-0_4.patch
>
>
> We have found that if we partitioned the map output data according to
> ReduceType, we can see the data skew in some HiTune cases. Then one or two
> Reduce Tasks slow down the whole Demux job somehow, since those reduce tasks
> have to process more input-data.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
