[jira] [Updated] (KYLIN-2135) Enlarge FactDistinctColumns reducer number

[kangkaisen (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KYLIN-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kangkaisen updated KYLIN-2135:
--
Attachment: KYLIN-2135.patch

This is the patch.

> Enlarge FactDistinctColumns reducer number
> --
>
> Key: KYLIN-2135
> URL: https://issues.apache.org/jira/browse/KYLIN-2135
> Project: Kylin
>  Issue Type: Improvement
>  Components: Job Engine
>Affects Versions: v1.5.4.1
>Reporter: kangkaisen
>Assignee: kangkaisen
> Attachments: KYLIN-2135.patch, new.png, old.png
>
>
> When the hive table has billions of rows and use global dictionary for 
> precise count distinct measures, the  {{Extract Fact Table Distinct Columns}} 
> job will run o long time.
> So we could use more reducer to deal with the one column.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (KYLIN-2139) record Hive intermediate table size

[Roger Shi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KYLIN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Roger Shi updated KYLIN-2139:
-
Priority: Minor  (was: Major)

> record Hive intermediate table size
> ---
>
> Key: KYLIN-2139
> URL: https://issues.apache.org/jira/browse/KYLIN-2139
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Roger Shi
>Assignee: Roger Shi
>Priority: Minor
>
> kylin only record Hive intermediate table row count, sometimes its size is 
> also required. Record it for later reference.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2139) record Hive intermediate table size

[Roger Shi (JIRA)]

Roger Shi created KYLIN-2139:


 Summary: record Hive intermediate table size
 Key: KYLIN-2139
 URL: https://issues.apache.org/jira/browse/KYLIN-2139
 Project: Kylin
  Issue Type: Improvement
Reporter: Roger Shi
Assignee: Roger Shi


kylin only record Hive intermediate table row count, sometimes its size is also 
required. Record it for later reference.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)