[
https://issues.apache.org/jira/browse/KYLIN-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15809108#comment-15809108
]
kangkaisen commented on KYLIN-2365:
-----------------------------------
Hi, zhifeng. I agree with you. But the better way is outputing the value by
{{context.wirte}} reducer. I am doing this work, please watch KYLIN-2242.
> multi FactDistinctColumnsReducer task write the same output file
> ----------------------------------------------------------------
>
> Key: KYLIN-2365
> URL: https://issues.apache.org/jira/browse/KYLIN-2365
> Project: Kylin
> Issue Type: Bug
> Components: streaming
> Affects Versions: v1.6.0
> Reporter: zheng zhifeng
> Fix For: Future
>
>
> Multi FactDistinctColumnsReducer task will write the
> distinct columns to the same output file if the mapreduce
> property mapreduce.reduce.speculative is true. This will
> make the mapreduce job failed or the output file is redundancy.
> I think it shoud set mapreduce.reduce.speculative to false on
> Extract Fact Table Distinct Columns step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
