[
https://issues.apache.org/jira/browse/KYLIN-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15125265#comment-15125265
]
Shaofeng SHI commented on KYLIN-1385:
-------------------------------------
Code pushed to 2.x-staging branch, will run full regression in CI.
> Enhance FactDistinctColumnsJob to use multiple reducers
> -------------------------------------------------------
>
> Key: KYLIN-1385
> URL: https://issues.apache.org/jira/browse/KYLIN-1385
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Affects Versions: v2.0, v1.2
> Reporter: Shaofeng SHI
> Assignee: Shaofeng SHI
> Fix For: v2.1
>
>
> So far the FactDistinctColumnsJob is using 1 reducer to merge the distinct
> values for all dimension columns on fact table. When there are 1 or multiple
> ultra high cardinality columns, it couldn't gain concurrency; It should
> dispatch the workload to multiple reducers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
