[
https://issues.apache.org/jira/browse/CHUKWA-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jie Huang updated CHUKWA-647:
-----------------------------
Attachment: (was: Chukwa-647.patch)
> Spread out intermediate data with the same ReduceType into different Reduce
> Tasks
> ---------------------------------------------------------------------------------
>
> Key: CHUKWA-647
> URL: https://issues.apache.org/jira/browse/CHUKWA-647
> Project: Chukwa
> Issue Type: Improvement
> Components: Data Processors
> Affects Versions: 0.4.0, 0.6.0
> Reporter: Jie Huang
> Priority: Minor
> Attachments: Chukwa-647-0_4.patch
>
>
> We have found that if we partitioned the map output data according to
> ReduceType, we can see the data skew in some HiTune cases. Then one or two
> Reduce Tasks slow down the whole Demux job somehow, since those reduce tasks
> have to process more input-data.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
