[
https://issues.apache.org/jira/browse/KYLIN-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zheng zhifeng updated KYLIN-2366:
---------------------------------
Description:
Multi FactDistinctColumnsReducer task will write the
distinct column to the same output file if the mapreduce
property mapreduce.reduce.speculative is true. This will
make the mapreduce job failed or the output file is redundancy.
I think it shoud set mapreduce.reduce.speculative to false on
Extract Fact Table Distinct Columns step.
was:
Multi FactDistinctColumnsReducer task will write the
distinct columns to the same output file if the mapreduce
property mapreduce.reduce.speculative is true. This will
make the mapreduce job failed or the output file is redundancy.
I think it shoud set mapreduce.reduce.speculative to false on
Extract Fact Table Distinct Columns step.
> multi FactDistinctColumnsReducer task write the same output file
> ----------------------------------------------------------------
>
> Key: KYLIN-2366
> URL: https://issues.apache.org/jira/browse/KYLIN-2366
> Project: Kylin
> Issue Type: Bug
> Components: streaming
> Affects Versions: v1.6.0
> Reporter: zheng zhifeng
> Fix For: Future
>
>
> Multi FactDistinctColumnsReducer task will write the
> distinct column to the same output file if the mapreduce
> property mapreduce.reduce.speculative is true. This will
> make the mapreduce job failed or the output file is redundancy.
> I think it shoud set mapreduce.reduce.speculative to false on
> Extract Fact Table Distinct Columns step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
