[jira] [Updated] (KYLIN-3449) Should allow deleting a segment in NEW status
[ https://issues.apache.org/jira/browse/KYLIN-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3449: Fix Version/s: v2.5.0 > Should allow deleting a segment in NEW status > - > > Key: KYLIN-3449 > URL: https://issues.apache.org/jira/browse/KYLIN-3449 > Project: Kylin > Issue Type: Improvement >Reporter: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Sometimes the job is dropped or not successfully created, then the new > segment becomes orphan. So far Kylin doesn't allow deleting a NEW status > segment, that is bad. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3451) the cloned cube don't have Mandatory Cuboids
[ https://issues.apache.org/jira/browse/KYLIN-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3451: Fix Version/s: v2.5.0 v2.4.1 Good catch; thank you Peng! > the cloned cube don't have Mandatory Cuboids > - > > Key: KYLIN-3451 > URL: https://issues.apache.org/jira/browse/KYLIN-3451 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.3.0 >Reporter: Peng Xing >Assignee: Peng Xing >Priority: Minor > Fix For: v2.4.1, v2.5.0 > > Attachments: > 0001-KYLIN-3451-the-cloned-cube-don-t-have-Mandatory-Cubo.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3453) Improve cube size estimation for TOPN, COUNT DISTINCT
Chao Long created KYLIN-3453: Summary: Improve cube size estimation for TOPN, COUNT DISTINCT Key: KYLIN-3453 URL: https://issues.apache.org/jira/browse/KYLIN-3453 Project: Kylin Issue Type: Improvement Reporter: Chao Long Assignee: Chao Long -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3452) Optimize spark cubing memory footprint
[ https://issues.apache.org/jira/browse/KYLIN-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3452: Description: Noticed that there are some steps can be optimized: 1) Cuboid.findForMandatory() will create new object each time, which this can be cached; 2) Executor repeatedly load dictionary, not hit the cache; 3) NDCuboidBuilder and RowkeyEncoder, can optimize for less array copy; > Optimize spark cubing memory footprint > -- > > Key: KYLIN-3452 > URL: https://issues.apache.org/jira/browse/KYLIN-3452 > Project: Kylin > Issue Type: Improvement > Components: Spark Engine >Reporter: Shaofeng SHI >Priority: Major > > Noticed that there are some steps can be optimized: > 1) Cuboid.findForMandatory() will create new object each time, which this can > be cached; > 2) Executor repeatedly load dictionary, not hit the cache; > 3) NDCuboidBuilder and RowkeyEncoder, can optimize for less array copy; -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3452) Optimize spark cubing memory footprint
Shaofeng SHI created KYLIN-3452: --- Summary: Optimize spark cubing memory footprint Key: KYLIN-3452 URL: https://issues.apache.org/jira/browse/KYLIN-3452 Project: Kylin Issue Type: Improvement Components: Spark Engine Reporter: Shaofeng SHI -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3168) CubeHFileJob should use currentHBaseConfiguration but not new create hbase configuration
[ https://issues.apache.org/jira/browse/KYLIN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyingjun updated KYLIN-3168: - Attachment: KYLIN-3438.patch > CubeHFileJob should use currentHBaseConfiguration but not new create hbase > configuration > > > Key: KYLIN-3168 > URL: https://issues.apache.org/jira/browse/KYLIN-3168 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.2.0, v2.3.0 >Reporter: wuyingjun >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.0 > > Attachments: AfterModified.png, CubeHFileJob_Exception.png, > KYLIN-3168.patch, KYLIN-3438.patch, Scheduler.png, job_queue.png, > queue_set.png, result.png, 飞信截图20180124232443.png > > > CubeHFileJob use new hbase configuration is not correct because when the > zookeeper quorum is not localhost (job worker)， kylin may encounter zookeeper > ConnectionLossException. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3168) CubeHFileJob should use currentHBaseConfiguration but not new create hbase configuration
[ https://issues.apache.org/jira/browse/KYLIN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyingjun updated KYLIN-3168: - Attachment: (was: KYLIN-3168.patch) > CubeHFileJob should use currentHBaseConfiguration but not new create hbase > configuration > > > Key: KYLIN-3168 > URL: https://issues.apache.org/jira/browse/KYLIN-3168 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.2.0, v2.3.0 >Reporter: wuyingjun >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.0 > > Attachments: AfterModified.png, CubeHFileJob_Exception.png, > KYLIN-3168.patch, KYLIN-3438.patch, Scheduler.png, job_queue.png, > queue_set.png, result.png, 飞信截图20180124232443.png > > > CubeHFileJob use new hbase configuration is not correct because when the > zookeeper quorum is not localhost (job worker)， kylin may encounter zookeeper > ConnectionLossException. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3168) CubeHFileJob should use currentHBaseConfiguration but not new create hbase configuration
[ https://issues.apache.org/jira/browse/KYLIN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544457#comment-16544457 ] wuyingjun commented on KYLIN-3168: -- [~Shaofengshi] sorry to introduce the bug, please check and validate it. > CubeHFileJob should use currentHBaseConfiguration but not new create hbase > configuration > > > Key: KYLIN-3168 > URL: https://issues.apache.org/jira/browse/KYLIN-3168 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.2.0, v2.3.0 >Reporter: wuyingjun >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.0 > > Attachments: AfterModified.png, CubeHFileJob_Exception.png, > KYLIN-3168.patch, KYLIN-3168.patch, Scheduler.png, job_queue.png, > queue_set.png, result.png, 飞信截图20180124232443.png > > > CubeHFileJob use new hbase configuration is not correct because when the > zookeeper quorum is not localhost (job worker)， kylin may encounter zookeeper > ConnectionLossException. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3168) CubeHFileJob should use currentHBaseConfiguration but not new create hbase configuration
[ https://issues.apache.org/jira/browse/KYLIN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyingjun updated KYLIN-3168: - Attachment: Scheduler.png result.png queue_set.png KYLIN-3168.patch job_queue.png > CubeHFileJob should use currentHBaseConfiguration but not new create hbase > configuration > > > Key: KYLIN-3168 > URL: https://issues.apache.org/jira/browse/KYLIN-3168 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.2.0, v2.3.0 >Reporter: wuyingjun >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.0 > > Attachments: AfterModified.png, CubeHFileJob_Exception.png, > KYLIN-3168.patch, KYLIN-3168.patch, Scheduler.png, job_queue.png, > queue_set.png, result.png, 飞信截图20180124232443.png > > > CubeHFileJob use new hbase configuration is not correct because when the > zookeeper quorum is not localhost (job worker)， kylin may encounter zookeeper > ConnectionLossException. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3438) mapreduce.job.queuename does not work at 'Convert Cuboid Data to HFile' Step
[ https://issues.apache.org/jira/browse/KYLIN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544456#comment-16544456 ] wuyingjun commented on KYLIN-3438: -- [~Shaofengshi] please check the patch and validate it. > mapreduce.job.queuename does not work at 'Convert Cuboid Data to HFile' Step > > > Key: KYLIN-3438 > URL: https://issues.apache.org/jira/browse/KYLIN-3438 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.4.0 >Reporter: powerinf >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.1, v2.5.0 > > Attachments: KYLIN-3438.patch, Scheduler.png, job_queue.png, > queue_set.png, result.png > > > set the mapreduce.job.queuename does not work until the ' Convert Cuboid Data > to HFile' step ，but precious steps can work well。 > I put the mapreduce.job.queuename property in all conf file including > kylin_hive_conf.xml、kylin_job_conf_inmem.xml、kylin_job_conf.xml ，but does not > work，it alse to use the default queue -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3438) mapreduce.job.queuename does not work at 'Convert Cuboid Data to HFile' Step
[ https://issues.apache.org/jira/browse/KYLIN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyingjun updated KYLIN-3438: - Attachment: Scheduler.png result.png queue_set.png KYLIN-3438.patch job_queue.png > mapreduce.job.queuename does not work at 'Convert Cuboid Data to HFile' Step > > > Key: KYLIN-3438 > URL: https://issues.apache.org/jira/browse/KYLIN-3438 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.4.0 >Reporter: powerinf >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.1, v2.5.0 > > Attachments: KYLIN-3438.patch, Scheduler.png, job_queue.png, > queue_set.png, result.png > > > set the mapreduce.job.queuename does not work until the ' Convert Cuboid Data > to HFile' step ，but precious steps can work well。 > I put the mapreduce.job.queuename property in all conf file including > kylin_hive_conf.xml、kylin_job_conf_inmem.xml、kylin_job_conf.xml ，but does not > work，it alse to use the default queue -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3438) mapreduce.job.queuename does not work at 'Convert Cuboid Data to HFile' Step
[ https://issues.apache.org/jira/browse/KYLIN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyingjun reassigned KYLIN-3438: Assignee: wuyingjun (was: Shaofeng SHI) > mapreduce.job.queuename does not work at 'Convert Cuboid Data to HFile' Step > > > Key: KYLIN-3438 > URL: https://issues.apache.org/jira/browse/KYLIN-3438 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.4.0 >Reporter: powerinf >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.1, v2.5.0 > > > set the mapreduce.job.queuename does not work until the ' Convert Cuboid Data > to HFile' step ，but precious steps can work well。 > I put the mapreduce.job.queuename property in all conf file including > kylin_hive_conf.xml、kylin_job_conf_inmem.xml、kylin_job_conf.xml ，but does not > work，it alse to use the default queue -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3168) CubeHFileJob should use currentHBaseConfiguration but not new create hbase configuration
[ https://issues.apache.org/jira/browse/KYLIN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544411#comment-16544411 ] wuyingjun commented on KYLIN-3168: -- I will check and resolve it > CubeHFileJob should use currentHBaseConfiguration but not new create hbase > configuration > > > Key: KYLIN-3168 > URL: https://issues.apache.org/jira/browse/KYLIN-3168 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.2.0, v2.3.0 >Reporter: wuyingjun >Assignee: wuyingjun >Priority: Major > Fix For: v2.4.0 > > Attachments: AfterModified.png, CubeHFileJob_Exception.png, > KYLIN-3168.patch, 飞信截图20180124232443.png > > > CubeHFileJob use new hbase configuration is not correct because when the > zookeeper quorum is not localhost (job worker)， kylin may encounter zookeeper > ConnectionLossException. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (KYLIN-2755) Kylin support hive and hbase authenticated with Kerberos
[ https://issues.apache.org/jira/browse/KYLIN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyingjun closed KYLIN-2755. Resolution: Won't Fix > Kylin support hive and hbase authenticated with Kerberos > > > Key: KYLIN-2755 > URL: https://issues.apache.org/jira/browse/KYLIN-2755 > Project: Kylin > Issue Type: New Feature >Affects Versions: v2.0.0 >Reporter: wuyingjun >Assignee: wuyingjun >Priority: Major > Attachments: KYLIN-2755.patch, code modify.png > > > I want to know how to integrate the kylin into hive datasource and hbase > storage with kerberos. > I have used hive beeline and modifid the hbase configuration initialization > in the source code. > Can the current kylin version support kerberos environment a a better way in > mapreduce cubing? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
