[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-07-08 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368889#comment-15368889 ] Shaofeng SHI commented on KYLIN-1656: - it has been resolved in master; > Improve perf

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-06-11 Thread hongbin ma (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326200#comment-15326200 ] hongbin ma commented on KYLIN-1656: --- hi [~gaodayue] what's the status of the jira? > Im

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-31 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15309376#comment-15309376 ] Dayue Gao commented on KYLIN-1656: -- no problem :-) > Improve performance of MRv2 engine

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-31 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15309258#comment-15309258 ] Shaofeng SHI commented on KYLIN-1656: - I would give it a netual value like 1 or 2 mill

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-31 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15309184#comment-15309184 ] Dayue Gao commented on KYLIN-1656: -- Hi Shaofeng, {quote} did you observe the source file

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-25 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301335#comment-15301335 ] Shaofeng SHI commented on KYLIN-1656: - Yes I believe my cluster is much smaller than y

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-25 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300145#comment-15300145 ] Dayue Gao commented on KYLIN-1656: -- Hi Shaofeng, We choose 500K to increase parallelism

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-23 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297761#comment-15297761 ] Shaofeng SHI commented on KYLIN-1656: - Hi Dayue, do you have the feeling that "kylin.j

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-18 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15288669#comment-15288669 ] Shaofeng SHI commented on KYLIN-1656: - Merged to master together with KYLIN-1677 > I

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-11 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279682#comment-15279682 ] Shaofeng SHI commented on KYLIN-1656: - The CI is success; as v1.5.2 is on the way to r

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276344#comment-15276344 ] Dayue Gao commented on KYLIN-1656: -- Didn't get the time to create the branch, thank you S

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-09 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276068#comment-15276068 ] Shaofeng SHI commented on KYLIN-1656: - Created branch "KYLIN-1656" from master, apply

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-08 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275580#comment-15275580 ] liyang commented on KYLIN-1656: --- +1 Great improvement. > Improve performance of MRv2 engine

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-04 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271983#comment-15271983 ] Shaofeng SHI commented on KYLIN-1656: - +1 Good enhancement, it can let Kylin balance t