[jira] [Commented] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773799#comment-16773799 ] ASF subversion and git services commented on KYLIN-3819: Commit 0b92dd41b458ef43c4f37223905e063534143264 in kylin's branch refs/heads/master from Temple Zhou [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0b92dd4 ] KYLIN-3819 kylin.sh run in the foreground > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] shaofengshi merged pull request #472: KYLIN-3819 kylin.sh run in the foreground
shaofengshi merged pull request #472: KYLIN-3819 kylin.sh run in the foreground URL: https://github.com/apache/kylin/pull/472 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773798#comment-16773798 ] ASF GitHub Bot commented on KYLIN-3819: --- shaofengshi commented on pull request #472: KYLIN-3819 kylin.sh run in the foreground URL: https://github.com/apache/kylin/pull/472 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773813#comment-16773813 ] ASF subversion and git services commented on KYLIN-3819: Commit 881f74504c7f31ce7a2b18a9b7f598e2c7528ca7 in kylin's branch refs/heads/2.6.x from Temple Zhou [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=881f745 ] KYLIN-3819 kylin.sh run in the foreground > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > Fix For: v2.6.1 > > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773814#comment-16773814 ] ASF subversion and git services commented on KYLIN-3819: Commit 989957ad3c2a56bdfae333f2697420310de46325 in kylin's branch refs/heads/2.5.x from Temple Zhou [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=989957a ] KYLIN-3819 kylin.sh run in the foreground > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > Fix For: v2.6.1 > > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] asfgit commented on issue #475: kylin - livy
asfgit commented on issue #475: kylin - livy URL: https://github.com/apache/kylin/pull/475#issuecomment-465926318 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] javalife0312 opened a new pull request #475: kylin - livy
javalife0312 opened a new pull request #475: kylin - livy URL: https://github.com/apache/kylin/pull/475 livy submit spark-job This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Resolved] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3819. - Resolution: Fixed It makes sense; Thanks for the PR, Temple! > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > Fix For: v2.6.1 > > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3820) Add a curator-based scheduler
Chao Long created KYLIN-3820: Summary: Add a curator-based scheduler Key: KYLIN-3820 URL: https://issues.apache.org/jira/browse/KYLIN-3820 Project: Kylin Issue Type: Improvement Reporter: Chao Long Assignee: Chao Long Fix For: v2.6.1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3322) TopN requires a SUM to work
[ https://issues.apache.org/jira/browse/KYLIN-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI reassigned KYLIN-3322: --- Assignee: Na Zhai > TopN requires a SUM to work > --- > > Key: KYLIN-3322 > URL: https://issues.apache.org/jira/browse/KYLIN-3322 > Project: Kylin > Issue Type: Bug > Components: Measure - TopN >Reporter: liyang >Assignee: Na Zhai >Priority: Major > > Currently if user creates a measure of TopN seller by sum of price, it is > required that user also creates a measure of SUM(price). Otherwise, NPE will > be thrown at query time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3795) Submit Spark jobs via Apache Livy
[ https://issues.apache.org/jira/browse/KYLIN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773867#comment-16773867 ] jinguowei commented on KYLIN-3795: -- h1. USEAGE kylin.properties #build by spark and use livy kylin.engine.livy-conf.livy.enable=true #livy server address kylin.engine.livy-conf.livy.url=[http://127.0.0.1:8|http://10.83.16.2:8010/]998 #include org.apache.kylin.engine.spark.SparkSqlOnLivyBatch for step_1 for sql kylin.engine.livy-conf.livy-key.file=[hdfs://your_self_path/kylin-job-2.5.0-job.jar] > Submit Spark jobs via Apache Livy > - > > Key: KYLIN-3795 > URL: https://issues.apache.org/jira/browse/KYLIN-3795 > Project: Kylin > Issue Type: New Feature > Components: Spark Engine >Reporter: Shaofeng SHI >Assignee: jinguowei >Priority: Major > Attachments: Kylin+-+Livy.doc > > > Livy is a rest service for Spark. Some users are using Livy as the interface > for Spark. Kylin can have the capability to submit spark job via Livy. > https://livy.incubator.apache.org/ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3819: Fix Version/s: v2.6.1 > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > Fix For: v2.6.1 > > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3322) TopN requires a SUM to work
[ https://issues.apache.org/jira/browse/KYLIN-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773830#comment-16773830 ] Shaofeng SHI commented on KYLIN-3322: - TopN does need a separate SUM measure to work. We will update the document to let user know this. > TopN requires a SUM to work > --- > > Key: KYLIN-3322 > URL: https://issues.apache.org/jira/browse/KYLIN-3322 > Project: Kylin > Issue Type: Bug > Components: Measure - TopN >Reporter: liyang >Priority: Major > > Currently if user creates a measure of TopN seller by sum of price, it is > required that user also creates a measure of SUM(price). Otherwise, NPE will > be thrown at query time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3322) TopN requires a SUM to work
[ https://issues.apache.org/jira/browse/KYLIN-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3322: Fix Version/s: (was: v2.6.1) (was: v2.5.3) > TopN requires a SUM to work > --- > > Key: KYLIN-3322 > URL: https://issues.apache.org/jira/browse/KYLIN-3322 > Project: Kylin > Issue Type: Bug > Components: Measure - TopN >Reporter: liyang >Priority: Major > > Currently if user creates a measure of TopN seller by sum of price, it is > required that user also creates a measure of SUM(price). Otherwise, NPE will > be thrown at query time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3795) Submit Spark jobs via Apache Livy
[ https://issues.apache.org/jira/browse/KYLIN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773873#comment-16773873 ] jinguowei commented on KYLIN-3795: -- https://github.com/apache/kylin/pull/475 > Submit Spark jobs via Apache Livy > - > > Key: KYLIN-3795 > URL: https://issues.apache.org/jira/browse/KYLIN-3795 > Project: Kylin > Issue Type: New Feature > Components: Spark Engine >Reporter: Shaofeng SHI >Assignee: jinguowei >Priority: Major > Attachments: Kylin+-+Livy.doc > > > Livy is a rest service for Spark. Some users are using Livy as the interface > for Spark. Kylin can have the capability to submit spark job via Livy. > https://livy.incubator.apache.org/ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3795) Submit Spark jobs via Apache Livy
[ https://issues.apache.org/jira/browse/KYLIN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinguowei updated KYLIN-3795: - Attachment: Kylin+-+Livy.doc > Submit Spark jobs via Apache Livy > - > > Key: KYLIN-3795 > URL: https://issues.apache.org/jira/browse/KYLIN-3795 > Project: Kylin > Issue Type: New Feature > Components: Spark Engine >Reporter: Shaofeng SHI >Assignee: jinguowei >Priority: Major > Attachments: Kylin+-+Livy.doc > > > Livy is a rest service for Spark. Some users are using Livy as the interface > for Spark. Kylin can have the capability to submit spark job via Livy. > https://livy.incubator.apache.org/ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] Sidonet commented on issue #474: KYLIN-3537
Sidonet commented on issue #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474#issuecomment-465982746 Hello Shaofengshi! Yes you are right, i've moved PR to correct branch. Thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] shaofengshi commented on issue #474: KYLIN-3537
shaofengshi commented on issue #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474#issuecomment-465973503 Alexander, thanks for the PR! I think this is only for Hadoop 3/HBase 2 right? If so, the change should go to "master-hadoop3.1" branch. Just let me know so I can move the change to the right branch. Thank you! This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] shaofengshi commented on issue #473: add Apache find-spark-home fallback script
shaofengshi commented on issue #473: add Apache find-spark-home fallback script URL: https://github.com/apache/kylin/pull/473#issuecomment-465974613 Hello Shopee, could you please report a JIRA to describe this enhancement? Thank you! Click "Create" and then select "KYLIN" as the project to proceed: https://issues.apache.org/jira/secure/Dashboard.jspa This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] codecov-io edited a comment on issue #474: KYLIN-3537
codecov-io edited a comment on issue #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474#issuecomment-465703293 # [Codecov](https://codecov.io/gh/apache/kylin/pull/474?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master-hadoop3.1@d090367`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `26.25%`. [](https://codecov.io/gh/apache/kylin/pull/474?src=pr=tree) ```diff @@ Coverage Diff @@ ## master-hadoop3.1 #474 +/- ## === Coverage? 24.46% Complexity ? 4961 === Files ? 1144 Lines ?69429 Branches? 9895 === Hits?16984 Misses ?50730 Partials? 1715 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/474?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [.../apache/kylin/dict/global/GlobalDictHDFSStore.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1kaWN0aW9uYXJ5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9kaWN0L2dsb2JhbC9HbG9iYWxEaWN0SERGU1N0b3JlLmphdmE=) | `70.44% <ø> (ø)` | `18 <0> (?)` | | | [.../org/apache/kylin/metadata/filter/TupleFilter.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWV0YWRhdGEvZmlsdGVyL1R1cGxlRmlsdGVyLmphdmE=) | `72.5% <ø> (ø)` | `47 <0> (?)` | | | [...a/org/apache/kylin/job/engine/JobEngineConfig.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9lbmdpbmUvSm9iRW5naW5lQ29uZmlnLmphdmE=) | `13.55% <ø> (ø)` | `6 <0> (?)` | | | [...n/java/org/apache/kylin/job/dao/ExecutableDao.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9kYW8vRXhlY3V0YWJsZURhby5qYXZh) | `33.02% <ø> (ø)` | `24 <0> (?)` | | | [...ylin/metadata/badquery/BadQueryHistoryManager.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWV0YWRhdGEvYmFkcXVlcnkvQmFkUXVlcnlIaXN0b3J5TWFuYWdlci5qYXZh) | `78.57% <ø> (ø)` | `9 <0> (?)` | | | [...tasource/framework/utils/ExpressionComparator.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-ZGF0YXNvdXJjZS1zZGsvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Nkay9kYXRhc291cmNlL2ZyYW1ld29yay91dGlscy9FeHByZXNzaW9uQ29tcGFyYXRvci5qYXZh) | `53.52% <ø> (ø)` | `2 <0> (?)` | | | [...ylin/measure/percentile/PercentileMeasureType.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWVhc3VyZS9wZXJjZW50aWxlL1BlcmNlbnRpbGVNZWFzdXJlVHlwZS5qYXZh) | `50% <ø> (ø)` | `4 <0> (?)` | | | [...kylin/measure/percentile/PercentileSerializer.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWVhc3VyZS9wZXJjZW50aWxlL1BlcmNlbnRpbGVTZXJpYWxpemVyLmphdmE=) | `75% <ø> (ø)` | `5 <0> (?)` | | | [...ache/kylin/dimension/DimensionEncodingFactory.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vZGltZW5zaW9uL0RpbWVuc2lvbkVuY29kaW5nRmFjdG9yeS5qYXZh) | `0% <ø> (ø)` | `0 <0> (?)` | | | [...ylin/sdk/datasource/framework/conv/ConvMaster.java](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree#diff-ZGF0YXNvdXJjZS1zZGsvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Nkay9kYXRhc291cmNlL2ZyYW1ld29yay9jb252L0NvbnZNYXN0ZXIuamF2YQ==) | `68.65% <ø> (ø)` | `11 <0> (?)` | | | ... and [195 more](https://codecov.io/gh/apache/kylin/pull/474/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/474?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/474?src=pr=footer). Last update [d090367...05cee4f](https://codecov.io/gh/apache/kylin/pull/474?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
[jira] [Assigned] (KYLIN-3822) "bin/kylin.sh org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI [file_path] [nOfThread] all" can not run successfully
[
https://issues.apache.org/jira/browse/KYLIN-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI reassigned KYLIN-3822:
---
Assignee: 梁龙
Fix Version/s: v2.6.1
Summary: "bin/kylin.sh
org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI [file_path]
[nOfThread] all" can not run successfully (was: $KYLIN_HOME/bin/kylin.sh
org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
$KYLIN_HOME/lib/kylin-coprocessor-*.jar [nOfThread] all 不能正确执行)
> "bin/kylin.sh org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
> [file_path] [nOfThread] all" can not run successfully
> -
>
> Key: KYLIN-3822
> URL: https://issues.apache.org/jira/browse/KYLIN-3822
> Project: Kylin
> Issue Type: Improvement
> Components: Storage - HBase
>Affects Versions: v2.5.1
>Reporter: 梁龙
>Assignee: 梁龙
>Priority: Minor
> Labels: easyfix
> Fix For: v2.6.1
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> 源码片段如下
> {code:java}
> int curIdx = 0;
> if ("default".equals(args[curIdx++])) {
> localCoprocessorJar = kylinConfig.getCoprocessorLocalJar();
> } else {
> curIdx--;
> localCoprocessorJar = new File(args[curIdx++]).getAbsolutePath();
> }
> {code}
> org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
> {code:java}
> "default".equals(args[curIdx++]){code}
> 运行完之后，curIdx的值为1，如果该表达式为false，则args[curIdx]取到的参数为第二个参数，非第一个参数（第一个参数才代表localCoprocessorJar的地址）
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3537) Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0
[ https://issues.apache.org/jira/browse/KYLIN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774841#comment-16774841 ] ASF subversion and git services commented on KYLIN-3537: Commit a634c75cfcdaa620bca6078d3315e4c76105701e in kylin's branch refs/heads/2.6.x-hadoop3.1 from alexandr.sidorchuk [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a634c75 ] KYLIN-3537 Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 add HBase dependicies to avoid java.lang.NoClassDefFoundError Signed-off-by: shaofengshi > Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 > > > Key: KYLIN-3537 > URL: https://issues.apache.org/jira/browse/KYLIN-3537 > Project: Kylin > Issue Type: Bug > Environment: HDP3.0 >Reporter: Lijun Cao >Assignee: Lijun Cao >Priority: Major > Attachments: KYLIN-3537.master.001.patch > > > *The log on Yarn:* > 18/09/05 03:34:00 INFO scheduler.DAGScheduler: Job 0 failed: > saveAsNewAPIHadoopDataset at SparkCubeHFile.java:227, took 13.734642 s > 18/09/05 03:34:00 ERROR yarn.ApplicationMaster: User class threw exception: > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > at > org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) > at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:636) > Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: > Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in > stage 1.0 (TID 14, ignite02.com, executor 2): java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/io/hfile/HFileWriterImpl > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.createRecordWriter(HFileOutputFormat2.java:209) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.getRecordWriter(HFileOutputFormat2.java:181) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1119) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Driver stacktrace: > at > org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at scala.Option.foreach(Option.scala:257) > at > org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1928) > at
[GitHub] asfgit commented on issue #476: bugfix, fetch param error
asfgit commented on issue #476: bugfix, fetch param error URL: https://github.com/apache/kylin/pull/476#issuecomment-466288924 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3537) Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0
[ https://issues.apache.org/jira/browse/KYLIN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774836#comment-16774836 ] ASF subversion and git services commented on KYLIN-3537: Commit 8245efb67083cbb676f1fcee1c9a230c03a10715 in kylin's branch refs/heads/master-hadoop3.1 from alexandr.sidorchuk [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8245efb ] KYLIN-3537 Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 add HBase dependicies to avoid java.lang.NoClassDefFoundError Signed-off-by: shaofengshi > Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 > > > Key: KYLIN-3537 > URL: https://issues.apache.org/jira/browse/KYLIN-3537 > Project: Kylin > Issue Type: Bug > Environment: HDP3.0 >Reporter: Lijun Cao >Assignee: Lijun Cao >Priority: Major > Attachments: KYLIN-3537.master.001.patch > > > *The log on Yarn:* > 18/09/05 03:34:00 INFO scheduler.DAGScheduler: Job 0 failed: > saveAsNewAPIHadoopDataset at SparkCubeHFile.java:227, took 13.734642 s > 18/09/05 03:34:00 ERROR yarn.ApplicationMaster: User class threw exception: > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > at > org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) > at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:636) > Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: > Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in > stage 1.0 (TID 14, ignite02.com, executor 2): java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/io/hfile/HFileWriterImpl > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.createRecordWriter(HFileOutputFormat2.java:209) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.getRecordWriter(HFileOutputFormat2.java:181) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1119) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Driver stacktrace: > at > org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at scala.Option.foreach(Option.scala:257) > at > org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1928) > at
[GitHub] 470024581 opened a new pull request #476: bugfix, fetch param error
470024581 opened a new pull request #476: bugfix, fetch param error URL: https://github.com/apache/kylin/pull/476 101行运行完之后，curIdx的值为1，如果101行表达式为false，则args[curIdx]取到的参数为第二个参数，非第一个参数（第一个参数才代表localCoprocessorJar的地址） This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (KYLIN-3537) Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0
[ https://issues.apache.org/jira/browse/KYLIN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3537: Fix Version/s: v2.6.1 > Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 > > > Key: KYLIN-3537 > URL: https://issues.apache.org/jira/browse/KYLIN-3537 > Project: Kylin > Issue Type: Bug > Environment: HDP3.0 >Reporter: Lijun Cao >Assignee: Lijun Cao >Priority: Major > Fix For: v2.6.1 > > Attachments: KYLIN-3537.master.001.patch > > > *The log on Yarn:* > 18/09/05 03:34:00 INFO scheduler.DAGScheduler: Job 0 failed: > saveAsNewAPIHadoopDataset at SparkCubeHFile.java:227, took 13.734642 s > 18/09/05 03:34:00 ERROR yarn.ApplicationMaster: User class threw exception: > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > at > org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) > at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:636) > Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: > Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in > stage 1.0 (TID 14, ignite02.com, executor 2): java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/io/hfile/HFileWriterImpl > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.createRecordWriter(HFileOutputFormat2.java:209) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.getRecordWriter(HFileOutputFormat2.java:181) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1119) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Driver stacktrace: > at > org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at scala.Option.foreach(Option.scala:257) > at > org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1928) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1941) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1961) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply$mcV$sp(PairRDDFunctions.scala:1158) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:1085) > at >
[GitHub] codecov-io commented on issue #476: bugfix KYLIN-3822, fetch param error
codecov-io commented on issue #476: bugfix KYLIN-3822, fetch param error URL: https://github.com/apache/kylin/pull/476#issuecomment-466293663 # [Codecov](https://codecov.io/gh/apache/kylin/pull/476?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@0b92dd4`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/476?src=pr=tree) ```diff @@Coverage Diff@@ ## master #476 +/- ## = Coverage ? 24.46% Complexity? 4961 = Files ? 1144 Lines ?69418 Branches ? 9895 = Hits ?16981 Misses?50721 Partials ? 1716 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/476?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...kylin/storage/hbase/util/DeployCoprocessorCLI.java](https://codecov.io/gh/apache/kylin/pull/476/diff?src=pr=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS91dGlsL0RlcGxveUNvcHJvY2Vzc29yQ0xJLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/476?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/476?src=pr=footer). Last update [0b92dd4...81f](https://codecov.io/gh/apache/kylin/pull/476?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3814) Add pause interval for job retry
[ https://issues.apache.org/jira/browse/KYLIN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774805#comment-16774805 ] ASF subversion and git services commented on KYLIN-3814: Commit 2b759f9cfab369bcfbb4410730c55735412f6bfa in kylin's branch refs/heads/master-hadoop3.1 from ZhengshuaiPENG [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2b759f9 ] #KYLIN-3814, add pause interval before the job retry > Add pause interval for job retry > > > Key: KYLIN-3814 > URL: https://issues.apache.org/jira/browse/KYLIN-3814 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Reporter: PENG Zhengshuai >Assignee: PENG Zhengshuai >Priority: Blocker > > When there is an exception occurred while the job was running, like network > shake or ZK service shake. The job will be retried. The configuration > "kylin.job.retry" will handle this. > But sometimes we need to pause a little time before the retry job start. The > purpose is to wait for the network shake or ZK shake recovered, otherwise the > retry make no sense. > The design is to add a configuration "kylin.job.retry-interval", the default > is 3 milliseconds. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3815) Unexpected behavior when joinning streaming table and hive table
[ https://issues.apache.org/jira/browse/KYLIN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774820#comment-16774820 ] ASF subversion and git services commented on KYLIN-3815: Commit d362acb644745b5fa59e74faa00d9fe16e7e16de in kylin's branch refs/heads/master-hadoop3.1 from chao long [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d362acb ] KYLIN-3815 Unexpected behavior when joinning streaming table and hive table Minor, replace hql with quoted table identity KYLIN-3815 code review > Unexpected behavior when joinning streaming table and hive table > > > Key: KYLIN-3815 > URL: https://issues.apache.org/jira/browse/KYLIN-3815 > Project: Kylin > Issue Type: Bug > Components: NRT Streaming >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > Fix For: v2.6.1 > > Attachments: image-2019-02-19-11-27-35-686.png, > image-2019-02-19-11-27-48-004.png, image-2019-02-19-11-28-04-709.png, > image-2019-02-19-11-28-14-221.png > > > http://apache-kylin.74782.x6.nabble.com/Unexpected-behavior-when-joinning-streaming-table-and-hive-table-td12766.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] shaofengshi closed pull request #474: KYLIN-3537
shaofengshi closed pull request #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3537) Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0
[ https://issues.apache.org/jira/browse/KYLIN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774842#comment-16774842 ] ASF GitHub Bot commented on KYLIN-3537: --- shaofengshi commented on pull request #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 > > > Key: KYLIN-3537 > URL: https://issues.apache.org/jira/browse/KYLIN-3537 > Project: Kylin > Issue Type: Bug > Environment: HDP3.0 >Reporter: Lijun Cao >Assignee: Lijun Cao >Priority: Major > Attachments: KYLIN-3537.master.001.patch > > > *The log on Yarn:* > 18/09/05 03:34:00 INFO scheduler.DAGScheduler: Job 0 failed: > saveAsNewAPIHadoopDataset at SparkCubeHFile.java:227, took 13.734642 s > 18/09/05 03:34:00 ERROR yarn.ApplicationMaster: User class threw exception: > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > at > org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) > at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:636) > Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: > Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in > stage 1.0 (TID 14, ignite02.com, executor 2): java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/io/hfile/HFileWriterImpl > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.createRecordWriter(HFileOutputFormat2.java:209) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.getRecordWriter(HFileOutputFormat2.java:181) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1119) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Driver stacktrace: > at > org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at scala.Option.foreach(Option.scala:257) > at > org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1928) > at
[GitHub] shaofengshi commented on issue #474: KYLIN-3537
shaofengshi commented on issue #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474#issuecomment-466291792 Alexander, have you registered Apache JIRA? I want to add you to the Kylin team and then mark you as the assignee of KYLIN-3537. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] shaofengshi commented on issue #474: KYLIN-3537
shaofengshi commented on issue #474: KYLIN-3537 URL: https://github.com/apache/kylin/pull/474#issuecomment-466291478 Hello, I have manually applied your PR to the master-hadoop3.1 and 2.6.x-hadoop3.1 branches so will close this PR. Thank for contributing to Kylin! This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3822) $KYLIN_HOME/bin/kylin.sh org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI $KYLIN_HOME/lib/kylin-coprocessor-*.jar [nOfThread] all 不能正确执行
梁龙 created KYLIN-3822:
-
Summary: $KYLIN_HOME/bin/kylin.sh
org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
$KYLIN_HOME/lib/kylin-coprocessor-*.jar [nOfThread] all 不能正确执行
Key: KYLIN-3822
URL: https://issues.apache.org/jira/browse/KYLIN-3822
Project: Kylin
Issue Type: Improvement
Components: Storage - HBase
Affects Versions: v2.5.1
Reporter: 梁龙
源码片段如下
{code:java}
int curIdx = 0;
if ("default".equals(args[curIdx++])) {
localCoprocessorJar = kylinConfig.getCoprocessorLocalJar();
} else {
curIdx--;
localCoprocessorJar = new File(args[curIdx++]).getAbsolutePath();
}
{code}
org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
{code:java}
"default".equals(args[curIdx++]){code}
运行完之后，curIdx的值为1，如果该表达式为false，则args[curIdx]取到的参数为第二个参数，非第一个参数（第一个参数才代表localCoprocessorJar的地址）
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (KYLIN-3537) Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0
[ https://issues.apache.org/jira/browse/KYLIN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI reassigned KYLIN-3537: --- Assignee: (was: Lijun Cao) > Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 > > > Key: KYLIN-3537 > URL: https://issues.apache.org/jira/browse/KYLIN-3537 > Project: Kylin > Issue Type: Bug > Environment: HDP3.0 >Reporter: Lijun Cao >Priority: Major > Fix For: v2.6.1 > > Attachments: KYLIN-3537.master.001.patch > > > *The log on Yarn:* > 18/09/05 03:34:00 INFO scheduler.DAGScheduler: Job 0 failed: > saveAsNewAPIHadoopDataset at SparkCubeHFile.java:227, took 13.734642 s > 18/09/05 03:34:00 ERROR yarn.ApplicationMaster: User class threw exception: > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > at > org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) > at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:636) > Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: > Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in > stage 1.0 (TID 14, ignite02.com, executor 2): java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/io/hfile/HFileWriterImpl > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.createRecordWriter(HFileOutputFormat2.java:209) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.getRecordWriter(HFileOutputFormat2.java:181) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1119) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Driver stacktrace: > at > org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at scala.Option.foreach(Option.scala:257) > at > org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1928) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1941) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1961) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply$mcV$sp(PairRDDFunctions.scala:1158) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:1085) > at >
[jira] [Resolved] (KYLIN-3537) Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0
[ https://issues.apache.org/jira/browse/KYLIN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3537. - Resolution: Fixed > Use Spark to build Cube on Yarn faild at Setp8 on HDP3.0 > > > Key: KYLIN-3537 > URL: https://issues.apache.org/jira/browse/KYLIN-3537 > Project: Kylin > Issue Type: Bug > Environment: HDP3.0 >Reporter: Lijun Cao >Priority: Major > Fix For: v2.6.1 > > Attachments: KYLIN-3537.master.001.patch > > > *The log on Yarn:* > 18/09/05 03:34:00 INFO scheduler.DAGScheduler: Job 0 failed: > saveAsNewAPIHadoopDataset at SparkCubeHFile.java:227, took 13.734642 s > 18/09/05 03:34:00 ERROR yarn.ApplicationMaster: User class threw exception: > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.steps.SparkCubeHFile > at > org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) > at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:636) > Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: > Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in > stage 1.0 (TID 14, ignite02.com, executor 2): java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/io/hfile/HFileWriterImpl > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.createRecordWriter(HFileOutputFormat2.java:209) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.getRecordWriter(HFileOutputFormat2.java:181) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1119) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Driver stacktrace: > at > org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at scala.Option.foreach(Option.scala:257) > at > org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605) > at > org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > at > org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1928) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1941) > at org.apache.spark.SparkContext.runJob(SparkContext.scala:1961) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply$mcV$sp(PairRDDFunctions.scala:1158) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:1085) > at >
[jira] [Assigned] (KYLIN-3821) Expose real-time streaming data consuming lag info
[ https://issues.apache.org/jira/browse/KYLIN-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ma Gang reassigned KYLIN-3821: -- Assignee: XiaoXiang Yu (was: Ma Gang) > Expose real-time streaming data consuming lag info > -- > > Key: KYLIN-3821 > URL: https://issues.apache.org/jira/browse/KYLIN-3821 > Project: Kylin > Issue Type: Improvement > Components: Real-time Streaming >Reporter: Ma Gang >Assignee: XiaoXiang Yu >Priority: Major > > Expose real-time streaming data consuming lag info, so that user can easily > know the lag information. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3821) Expose real-time streaming data consuming lag info
[ https://issues.apache.org/jira/browse/KYLIN-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774770#comment-16774770 ] Ma Gang commented on KYLIN-3821: It can be done by adding a new method in IStreamingConnector to fetch the latest streaming source position. > Expose real-time streaming data consuming lag info > -- > > Key: KYLIN-3821 > URL: https://issues.apache.org/jira/browse/KYLIN-3821 > Project: Kylin > Issue Type: Improvement > Components: Real-time Streaming >Reporter: Ma Gang >Assignee: XiaoXiang Yu >Priority: Major > > Expose real-time streaming data consuming lag info, so that user can easily > know the lag information. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774795#comment-16774795 ] ASF subversion and git services commented on KYLIN-2565: Commit 3eaa0774587a770821aba50757c464d5148ee375 in kylin's branch refs/heads/2.6.x-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3eaa077 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3518) Coprocessor reports NPE when execute a query on HBase 2.0
[
https://issues.apache.org/jira/browse/KYLIN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774797#comment-16774797
]
ASF subversion and git services commented on KYLIN-3518:
Commit 3eaa0774587a770821aba50757c464d5148ee375 in kylin's branch
refs/heads/2.6.x-hadoop3.1 from Cheng Wang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3eaa077 ]
KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
KYLIN-3518 Fix Coprocessor NPE problem on hbase 2
Signed-off-by: shaofengshi
KYLIN-2565 Add cdh60 profile
Signed-off-by: shaofengshi
> Coprocessor reports NPE when execute a query on HBase 2.0
> -
>
> Key: KYLIN-3518
> URL: https://issues.apache.org/jira/browse/KYLIN-3518
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
>Reporter: Shaofeng SHI
>Assignee: Lijun Cao
>Priority: Major
> Fix For: v2.5.0
>
>
> On HDP 3.0, build a cube and then run a simple count query, NPE occurred:
>
> {code:java}
> 2018-08-28 01:30:16,969 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:315 : hbase.rpc.timeout = 9 ms, use 81000 ms as timeout
> for coprocessor
> 2018-08-28 01:30:16,983 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:141 : Serialized scanRequestBytes 522 bytes,
> rawScanBytesString 44 bytes
> 2018-08-28 01:30:16,984 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:143 : The scan 67b41fc6 for segment
> kylin_sales_cube_clone[2012010100_2013010100] is as below with 1
> separate raw scans, shard part of start/end key is set to 0
> 2018-08-28 01:30:16,991 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:288 : Visiting hbase table KYLIN_5Q088VO5I0: cuboid require
> post aggregation, from 0 to 16384 Start:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\xFF\xFF\xFF\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\xFF\xFF\xFF\x00), No Fuzzy Key
> 2018-08-28 01:30:16,991 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:148 : Submitting rpc to 1 shards starting from shard
> 0, scan range count 1
> 2018-08-28 01:30:17,010 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:332 : Loading kylin-defaults.properties from
> file:/root/shaofengshi/apache-kylin-2.5.0-SNAPSHOT-bin/tomcat/webapps/kylin/WEB-INF/lib/kylin-core-common-2.5.0-SNAPSHOT.jar!/kylin-defaults.properties
> 2018-08-28 01:30:17,033 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:291 : KYLIN_CONF property was not set, will seek
> KYLIN_HOME env variable
> 2018-08-28 01:30:17,051 INFO [pool-14-thread-1] hbase.HBaseConnection:110 :
> Creating coprocessor thread pool with max of 2048, core of 2048
> 2018-08-28 01:30:17,094 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> gtrecord.SequentialCubeTupleIterator:73 : Using SortedIteratorMergerWithLimit
> to merge segment results
> 2018-08-28 01:30:17,097 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> enumerator.OLAPEnumerator:117 : return TupleIterator...
> 2018-08-28 01:30:21,607 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call exception, tries=6, retries=6,
> started=4410 ms ago, cancelled=false, msg=java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> ... 3 more
> , details=row '' on table 'KYLIN_5Q088VO5I0' at
> region=KYLIN_5Q088VO5I0,,1535417272444.27b82cb4702db4557a98b9a7e60b7692.,
> hostname=ignite03.com,16020,1534313612401, seqNum=2
> 2018-08-28 01:30:25,633 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774798#comment-16774798 ] ASF subversion and git services commented on KYLIN-2565: Commit 3eaa0774587a770821aba50757c464d5148ee375 in kylin's branch refs/heads/2.6.x-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3eaa077 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3518) Coprocessor reports NPE when execute a query on HBase 2.0
[
https://issues.apache.org/jira/browse/KYLIN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774794#comment-16774794
]
ASF subversion and git services commented on KYLIN-3518:
Commit 3eaa0774587a770821aba50757c464d5148ee375 in kylin's branch
refs/heads/2.6.x-hadoop3.1 from Cheng Wang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3eaa077 ]
KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
KYLIN-3518 Fix Coprocessor NPE problem on hbase 2
Signed-off-by: shaofengshi
KYLIN-2565 Add cdh60 profile
Signed-off-by: shaofengshi
> Coprocessor reports NPE when execute a query on HBase 2.0
> -
>
> Key: KYLIN-3518
> URL: https://issues.apache.org/jira/browse/KYLIN-3518
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
>Reporter: Shaofeng SHI
>Assignee: Lijun Cao
>Priority: Major
> Fix For: v2.5.0
>
>
> On HDP 3.0, build a cube and then run a simple count query, NPE occurred:
>
> {code:java}
> 2018-08-28 01:30:16,969 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:315 : hbase.rpc.timeout = 9 ms, use 81000 ms as timeout
> for coprocessor
> 2018-08-28 01:30:16,983 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:141 : Serialized scanRequestBytes 522 bytes,
> rawScanBytesString 44 bytes
> 2018-08-28 01:30:16,984 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:143 : The scan 67b41fc6 for segment
> kylin_sales_cube_clone[2012010100_2013010100] is as below with 1
> separate raw scans, shard part of start/end key is set to 0
> 2018-08-28 01:30:16,991 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:288 : Visiting hbase table KYLIN_5Q088VO5I0: cuboid require
> post aggregation, from 0 to 16384 Start:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\xFF\xFF\xFF\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\xFF\xFF\xFF\x00), No Fuzzy Key
> 2018-08-28 01:30:16,991 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:148 : Submitting rpc to 1 shards starting from shard
> 0, scan range count 1
> 2018-08-28 01:30:17,010 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:332 : Loading kylin-defaults.properties from
> file:/root/shaofengshi/apache-kylin-2.5.0-SNAPSHOT-bin/tomcat/webapps/kylin/WEB-INF/lib/kylin-core-common-2.5.0-SNAPSHOT.jar!/kylin-defaults.properties
> 2018-08-28 01:30:17,033 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:291 : KYLIN_CONF property was not set, will seek
> KYLIN_HOME env variable
> 2018-08-28 01:30:17,051 INFO [pool-14-thread-1] hbase.HBaseConnection:110 :
> Creating coprocessor thread pool with max of 2048, core of 2048
> 2018-08-28 01:30:17,094 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> gtrecord.SequentialCubeTupleIterator:73 : Using SortedIteratorMergerWithLimit
> to merge segment results
> 2018-08-28 01:30:17,097 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> enumerator.OLAPEnumerator:117 : return TupleIterator...
> 2018-08-28 01:30:21,607 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call exception, tries=6, retries=6,
> started=4410 ms ago, cancelled=false, msg=java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> ... 3 more
> , details=row '' on table 'KYLIN_5Q088VO5I0' at
> region=KYLIN_5Q088VO5I0,,1535417272444.27b82cb4702db4557a98b9a7e60b7692.,
> hostname=ignite03.com,16020,1534313612401, seqNum=2
> 2018-08-28 01:30:25,633 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774793#comment-16774793 ] ASF subversion and git services commented on KYLIN-2565: Commit 3eaa0774587a770821aba50757c464d5148ee375 in kylin's branch refs/heads/2.6.x-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3eaa077 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774796#comment-16774796 ] ASF subversion and git services commented on KYLIN-2565: Commit 3eaa0774587a770821aba50757c464d5148ee375 in kylin's branch refs/heads/2.6.x-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3eaa077 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3518) Coprocessor reports NPE when execute a query on HBase 2.0
[
https://issues.apache.org/jira/browse/KYLIN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774813#comment-16774813
]
ASF subversion and git services commented on KYLIN-3518:
Commit 5dcf206b51509f849bccd9afa05c1481d3bbc6d2 in kylin's branch
refs/heads/master-hadoop3.1 from Cheng Wang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5dcf206 ]
KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
KYLIN-3518 Fix Coprocessor NPE problem on hbase 2
Signed-off-by: shaofengshi
KYLIN-2565 Add cdh60 profile
Signed-off-by: shaofengshi
> Coprocessor reports NPE when execute a query on HBase 2.0
> -
>
> Key: KYLIN-3518
> URL: https://issues.apache.org/jira/browse/KYLIN-3518
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
>Reporter: Shaofeng SHI
>Assignee: Lijun Cao
>Priority: Major
> Fix For: v2.5.0
>
>
> On HDP 3.0, build a cube and then run a simple count query, NPE occurred:
>
> {code:java}
> 2018-08-28 01:30:16,969 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:315 : hbase.rpc.timeout = 9 ms, use 81000 ms as timeout
> for coprocessor
> 2018-08-28 01:30:16,983 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:141 : Serialized scanRequestBytes 522 bytes,
> rawScanBytesString 44 bytes
> 2018-08-28 01:30:16,984 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:143 : The scan 67b41fc6 for segment
> kylin_sales_cube_clone[2012010100_2013010100] is as below with 1
> separate raw scans, shard part of start/end key is set to 0
> 2018-08-28 01:30:16,991 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:288 : Visiting hbase table KYLIN_5Q088VO5I0: cuboid require
> post aggregation, from 0 to 16384 Start:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\xFF\xFF\xFF\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\xFF\xFF\xFF\x00), No Fuzzy Key
> 2018-08-28 01:30:16,991 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:148 : Submitting rpc to 1 shards starting from shard
> 0, scan range count 1
> 2018-08-28 01:30:17,010 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:332 : Loading kylin-defaults.properties from
> file:/root/shaofengshi/apache-kylin-2.5.0-SNAPSHOT-bin/tomcat/webapps/kylin/WEB-INF/lib/kylin-core-common-2.5.0-SNAPSHOT.jar!/kylin-defaults.properties
> 2018-08-28 01:30:17,033 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:291 : KYLIN_CONF property was not set, will seek
> KYLIN_HOME env variable
> 2018-08-28 01:30:17,051 INFO [pool-14-thread-1] hbase.HBaseConnection:110 :
> Creating coprocessor thread pool with max of 2048, core of 2048
> 2018-08-28 01:30:17,094 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> gtrecord.SequentialCubeTupleIterator:73 : Using SortedIteratorMergerWithLimit
> to merge segment results
> 2018-08-28 01:30:17,097 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> enumerator.OLAPEnumerator:117 : return TupleIterator...
> 2018-08-28 01:30:21,607 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call exception, tries=6, retries=6,
> started=4410 ms ago, cancelled=false, msg=java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> ... 3 more
> , details=row '' on table 'KYLIN_5Q088VO5I0' at
> region=KYLIN_5Q088VO5I0,,1535417272444.27b82cb4702db4557a98b9a7e60b7692.,
> hostname=ignite03.com,16020,1534313612401, seqNum=2
> 2018-08-28 01:30:25,633 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call
[jira] [Commented] (KYLIN-3804) Advanced Snapshot Table save not friendly
[ https://issues.apache.org/jira/browse/KYLIN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774818#comment-16774818 ] ASF subversion and git services commented on KYLIN-3804: Commit 73ae41cebb8fd086a40810303e6482fcc49ec7aa in kylin's branch refs/heads/master-hadoop3.1 from liapan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=73ae41c ] KYLIN-3804 Advanced Snapshot Table save not friendly > Advanced Snapshot Table save not friendly > - > > Key: KYLIN-3804 > URL: https://issues.apache.org/jira/browse/KYLIN-3804 > Project: Kylin > Issue Type: Improvement > Components: Web >Reporter: Pan, Julian >Assignee: Pan, Julian >Priority: Critical > Fix For: v2.6.1 > > Attachments: new implementation-edit.png, new > implementation-saved.png, not save.png, save.png > > > The configuration for "Advanced Snapshot Table" in "Advance Setting" may > confuse customer. > User need click "+" to save the snapshot info. > Change the the implementation similar with "Advanced Dictionaries". -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3804) Advanced Snapshot Table save not friendly
[ https://issues.apache.org/jira/browse/KYLIN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774808#comment-16774808 ] ASF subversion and git services commented on KYLIN-3804: Commit 73ae41cebb8fd086a40810303e6482fcc49ec7aa in kylin's branch refs/heads/master-hadoop3.1 from liapan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=73ae41c ] KYLIN-3804 Advanced Snapshot Table save not friendly > Advanced Snapshot Table save not friendly > - > > Key: KYLIN-3804 > URL: https://issues.apache.org/jira/browse/KYLIN-3804 > Project: Kylin > Issue Type: Improvement > Components: Web >Reporter: Pan, Julian >Assignee: Pan, Julian >Priority: Critical > Fix For: v2.6.1 > > Attachments: new implementation-edit.png, new > implementation-saved.png, not save.png, save.png > > > The configuration for "Advanced Snapshot Table" in "Advance Setting" may > confuse customer. > User need click "+" to save the snapshot info. > Change the the implementation similar with "Advanced Dictionaries". -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774812#comment-16774812 ] ASF subversion and git services commented on KYLIN-2565: Commit 5dcf206b51509f849bccd9afa05c1481d3bbc6d2 in kylin's branch refs/heads/master-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5dcf206 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3815) Unexpected behavior when joinning streaming table and hive table
[ https://issues.apache.org/jira/browse/KYLIN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774809#comment-16774809 ] ASF subversion and git services commented on KYLIN-3815: Commit d362acb644745b5fa59e74faa00d9fe16e7e16de in kylin's branch refs/heads/master-hadoop3.1 from chao long [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d362acb ] KYLIN-3815 Unexpected behavior when joinning streaming table and hive table Minor, replace hql with quoted table identity KYLIN-3815 code review > Unexpected behavior when joinning streaming table and hive table > > > Key: KYLIN-3815 > URL: https://issues.apache.org/jira/browse/KYLIN-3815 > Project: Kylin > Issue Type: Bug > Components: NRT Streaming >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > Fix For: v2.6.1 > > Attachments: image-2019-02-19-11-27-35-686.png, > image-2019-02-19-11-27-48-004.png, image-2019-02-19-11-28-04-709.png, > image-2019-02-19-11-28-14-221.png > > > http://apache-kylin.74782.x6.nabble.com/Unexpected-behavior-when-joinning-streaming-table-and-hive-table-td12766.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3597) Fix sonar reported static code issues phase 1
[ https://issues.apache.org/jira/browse/KYLIN-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774806#comment-16774806 ] ASF subversion and git services commented on KYLIN-3597: Commit 0d43ae933937a9c25f81fca16de6c7b627e45371 in kylin's branch refs/heads/master-hadoop3.1 from whuwb [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0d43ae9 ] KYLIN-3597 fix sonar issues and refactor test cases > Fix sonar reported static code issues phase 1 > - > > Key: KYLIN-3597 > URL: https://issues.apache.org/jira/browse/KYLIN-3597 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Shaofeng SHI >Priority: Major > Fix For: v2.6.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3801) find-hive-dependency.sh fail to grep env:CLASSPATH from beeline output
[
https://issues.apache.org/jira/browse/KYLIN-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774807#comment-16774807
]
ASF subversion and git services commented on KYLIN-3801:
Commit 96d72ca74d5b19173aef11df51d1e9f50eac557a in kylin's branch
refs/heads/master-hadoop3.1 from kikniknik
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=96d72ca ]
KYLIN-3801 Add --text flag in grep in find-hive-dependency.sh
> find-hive-dependency.sh fail to grep env:CLASSPATH from beeline output
> --
>
> Key: KYLIN-3801
> URL: https://issues.apache.org/jira/browse/KYLIN-3801
> Project: Kylin
> Issue Type: Bug
> Components: Tools, Build and Test
>Affects Versions: v2.6.0
>Reporter: Nikodimos Nikolaidis
>Assignee: Nikodimos Nikolaidis
>Priority: Major
> Fix For: v2.6.1
>
>
> In a Debian stretch system with GNU grep version 2.27, whenever
> bin/find-hive-dependency.sh is executed, with beeline enabled, the following
> error message is produced:
> {noformat}
> Retrieving hive dependency...
> ./find-hive-dependency.sh: line 40: [: too many arguments
> Couldn't find hive configuration directory. Please set HIVE_CONF to the path
> which contains hive-site.xml.{noformat}
> In line 34, output format of beeline is defined as dsv, which is something
> that grep thinks is binary data - although it's text - and it leads to
> {code:java}
> hive_env='Binary file (standard input) matches'{code}
> instead of correct env:CLASSPATH grepping, which causes the above error. One
> solution would be to set the flag '-text' of grep to force processing beeline
> output as text.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774811#comment-16774811 ] ASF subversion and git services commented on KYLIN-3819: Commit 0b92dd41b458ef43c4f37223905e063534143264 in kylin's branch refs/heads/master-hadoop3.1 from Temple Zhou [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0b92dd4 ] KYLIN-3819 kylin.sh run in the foreground > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > Fix For: v2.6.1 > > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3814) Add pause interval for job retry
[ https://issues.apache.org/jira/browse/KYLIN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774815#comment-16774815 ] ASF subversion and git services commented on KYLIN-3814: Commit 2b759f9cfab369bcfbb4410730c55735412f6bfa in kylin's branch refs/heads/master-hadoop3.1 from ZhengshuaiPENG [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2b759f9 ] #KYLIN-3814, add pause interval before the job retry > Add pause interval for job retry > > > Key: KYLIN-3814 > URL: https://issues.apache.org/jira/browse/KYLIN-3814 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Reporter: PENG Zhengshuai >Assignee: PENG Zhengshuai >Priority: Blocker > > When there is an exception occurred while the job was running, like network > shake or ZK service shake. The job will be retried. The configuration > "kylin.job.retry" will handle this. > But sometimes we need to pause a little time before the retry job start. The > purpose is to wait for the network shake or ZK shake recovered, otherwise the > retry make no sense. > The design is to add a configuration "kylin.job.retry-interval", the default > is 3 milliseconds. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3801) find-hive-dependency.sh fail to grep env:CLASSPATH from beeline output
[
https://issues.apache.org/jira/browse/KYLIN-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774817#comment-16774817
]
ASF subversion and git services commented on KYLIN-3801:
Commit 96d72ca74d5b19173aef11df51d1e9f50eac557a in kylin's branch
refs/heads/master-hadoop3.1 from kikniknik
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=96d72ca ]
KYLIN-3801 Add --text flag in grep in find-hive-dependency.sh
> find-hive-dependency.sh fail to grep env:CLASSPATH from beeline output
> --
>
> Key: KYLIN-3801
> URL: https://issues.apache.org/jira/browse/KYLIN-3801
> Project: Kylin
> Issue Type: Bug
> Components: Tools, Build and Test
>Affects Versions: v2.6.0
>Reporter: Nikodimos Nikolaidis
>Assignee: Nikodimos Nikolaidis
>Priority: Major
> Fix For: v2.6.1
>
>
> In a Debian stretch system with GNU grep version 2.27, whenever
> bin/find-hive-dependency.sh is executed, with beeline enabled, the following
> error message is produced:
> {noformat}
> Retrieving hive dependency...
> ./find-hive-dependency.sh: line 40: [: too many arguments
> Couldn't find hive configuration directory. Please set HIVE_CONF to the path
> which contains hive-site.xml.{noformat}
> In line 34, output format of beeline is defined as dsv, which is something
> that grep thinks is binary data - although it's text - and it leads to
> {code:java}
> hive_env='Binary file (standard input) matches'{code}
> instead of correct env:CLASSPATH grepping, which causes the above error. One
> solution would be to set the flag '-text' of grep to force processing beeline
> output as text.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3815) Unexpected behavior when joinning streaming table and hive table
[ https://issues.apache.org/jira/browse/KYLIN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774810#comment-16774810 ] ASF subversion and git services commented on KYLIN-3815: Commit d362acb644745b5fa59e74faa00d9fe16e7e16de in kylin's branch refs/heads/master-hadoop3.1 from chao long [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d362acb ] KYLIN-3815 Unexpected behavior when joinning streaming table and hive table Minor, replace hql with quoted table identity KYLIN-3815 code review > Unexpected behavior when joinning streaming table and hive table > > > Key: KYLIN-3815 > URL: https://issues.apache.org/jira/browse/KYLIN-3815 > Project: Kylin > Issue Type: Bug > Components: NRT Streaming >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > Fix For: v2.6.1 > > Attachments: image-2019-02-19-11-27-35-686.png, > image-2019-02-19-11-27-48-004.png, image-2019-02-19-11-28-04-709.png, > image-2019-02-19-11-28-14-221.png > > > http://apache-kylin.74782.x6.nabble.com/Unexpected-behavior-when-joinning-streaming-table-and-hive-table-td12766.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774814#comment-16774814 ] ASF subversion and git services commented on KYLIN-2565: Commit 5dcf206b51509f849bccd9afa05c1481d3bbc6d2 in kylin's branch refs/heads/master-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5dcf206 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3518) Coprocessor reports NPE when execute a query on HBase 2.0
[
https://issues.apache.org/jira/browse/KYLIN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774823#comment-16774823
]
ASF subversion and git services commented on KYLIN-3518:
Commit 5dcf206b51509f849bccd9afa05c1481d3bbc6d2 in kylin's branch
refs/heads/master-hadoop3.1 from Cheng Wang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5dcf206 ]
KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
KYLIN-3518 Fix Coprocessor NPE problem on hbase 2
Signed-off-by: shaofengshi
KYLIN-2565 Add cdh60 profile
Signed-off-by: shaofengshi
> Coprocessor reports NPE when execute a query on HBase 2.0
> -
>
> Key: KYLIN-3518
> URL: https://issues.apache.org/jira/browse/KYLIN-3518
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
>Reporter: Shaofeng SHI
>Assignee: Lijun Cao
>Priority: Major
> Fix For: v2.5.0
>
>
> On HDP 3.0, build a cube and then run a simple count query, NPE occurred:
>
> {code:java}
> 2018-08-28 01:30:16,969 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:315 : hbase.rpc.timeout = 9 ms, use 81000 ms as timeout
> for coprocessor
> 2018-08-28 01:30:16,983 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:141 : Serialized scanRequestBytes 522 bytes,
> rawScanBytesString 44 bytes
> 2018-08-28 01:30:16,984 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:143 : The scan 67b41fc6 for segment
> kylin_sales_cube_clone[2012010100_2013010100] is as below with 1
> separate raw scans, shard part of start/end key is set to 0
> 2018-08-28 01:30:16,991 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseRPC:288 : Visiting hbase table KYLIN_5Q088VO5I0: cuboid require
> post aggregation, from 0 to 16384 Start:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop:
> \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\xFF\xFF\xFF\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\xFF\xFF\xFF\x00), No Fuzzy Key
> 2018-08-28 01:30:16,991 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> v2.CubeHBaseEndpointRPC:148 : Submitting rpc to 1 shards starting from shard
> 0, scan range count 1
> 2018-08-28 01:30:17,010 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:332 : Loading kylin-defaults.properties from
> file:/root/shaofengshi/apache-kylin-2.5.0-SNAPSHOT-bin/tomcat/webapps/kylin/WEB-INF/lib/kylin-core-common-2.5.0-SNAPSHOT.jar!/kylin-defaults.properties
> 2018-08-28 01:30:17,033 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> common.KylinConfig:291 : KYLIN_CONF property was not set, will seek
> KYLIN_HOME env variable
> 2018-08-28 01:30:17,051 INFO [pool-14-thread-1] hbase.HBaseConnection:110 :
> Creating coprocessor thread pool with max of 2048, core of 2048
> 2018-08-28 01:30:17,094 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> gtrecord.SequentialCubeTupleIterator:73 : Using SortedIteratorMergerWithLimit
> to merge segment results
> 2018-08-28 01:30:17,097 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71]
> enumerator.OLAPEnumerator:117 : return TupleIterator...
> 2018-08-28 01:30:21,607 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call exception, tries=6, retries=6,
> started=4410 ms ago, cancelled=false, msg=java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> ... 3 more
> , details=row '' on table 'KYLIN_5Q088VO5I0' at
> region=KYLIN_5Q088VO5I0,,1535417272444.27b82cb4702db4557a98b9a7e60b7692.,
> hostname=ignite03.com,16020,1534313612401, seqNum=2
> 2018-08-28 01:30:25,633 INFO [kylin-coproc--pool9-t1]
> client.RpcRetryingCallerImpl:134 : Call
[jira] [Commented] (KYLIN-3815) Unexpected behavior when joinning streaming table and hive table
[ https://issues.apache.org/jira/browse/KYLIN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774819#comment-16774819 ] ASF subversion and git services commented on KYLIN-3815: Commit d362acb644745b5fa59e74faa00d9fe16e7e16de in kylin's branch refs/heads/master-hadoop3.1 from chao long [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d362acb ] KYLIN-3815 Unexpected behavior when joinning streaming table and hive table Minor, replace hql with quoted table identity KYLIN-3815 code review > Unexpected behavior when joinning streaming table and hive table > > > Key: KYLIN-3815 > URL: https://issues.apache.org/jira/browse/KYLIN-3815 > Project: Kylin > Issue Type: Bug > Components: NRT Streaming >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > Fix For: v2.6.1 > > Attachments: image-2019-02-19-11-27-35-686.png, > image-2019-02-19-11-27-48-004.png, image-2019-02-19-11-28-04-709.png, > image-2019-02-19-11-28-14-221.png > > > http://apache-kylin.74782.x6.nabble.com/Unexpected-behavior-when-joinning-streaming-table-and-hive-table-td12766.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774824#comment-16774824 ] ASF subversion and git services commented on KYLIN-2565: Commit 5dcf206b51509f849bccd9afa05c1481d3bbc6d2 in kylin's branch refs/heads/master-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5dcf206 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Support Hadoop 3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774822#comment-16774822 ] ASF subversion and git services commented on KYLIN-2565: Commit 5dcf206b51509f849bccd9afa05c1481d3bbc6d2 in kylin's branch refs/heads/master-hadoop3.1 from Cheng Wang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5dcf206 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 Signed-off-by: shaofengshi KYLIN-2565 Add cdh60 profile Signed-off-by: shaofengshi > Support Hadoop 3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3819) kylin.sh run in the foreground
[ https://issues.apache.org/jira/browse/KYLIN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774821#comment-16774821 ] ASF subversion and git services commented on KYLIN-3819: Commit 0b92dd41b458ef43c4f37223905e063534143264 in kylin's branch refs/heads/master-hadoop3.1 from Temple Zhou [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0b92dd4 ] KYLIN-3819 kylin.sh run in the foreground > kylin.sh run in the foreground > -- > > Key: KYLIN-3819 > URL: https://issues.apache.org/jira/browse/KYLIN-3819 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.4.0, v2.5.0, v2.6.0 >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Major > Fix For: v2.6.1 > > > The "kylin.sh start" can only run kylin in the background, but it should be > run in the foreground as well. Because only in this way, both streams can be > captured if using a supervision system like daemontools. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3597) Fix sonar reported static code issues phase 1
[ https://issues.apache.org/jira/browse/KYLIN-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774816#comment-16774816 ] ASF subversion and git services commented on KYLIN-3597: Commit 0d43ae933937a9c25f81fca16de6c7b627e45371 in kylin's branch refs/heads/master-hadoop3.1 from whuwb [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0d43ae9 ] KYLIN-3597 fix sonar issues and refactor test cases > Fix sonar reported static code issues phase 1 > - > > Key: KYLIN-3597 > URL: https://issues.apache.org/jira/browse/KYLIN-3597 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Shaofeng SHI >Priority: Major > Fix For: v2.6.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3821) Expose real-time streaming data consuming lag info
Ma Gang created KYLIN-3821: -- Summary: Expose real-time streaming data consuming lag info Key: KYLIN-3821 URL: https://issues.apache.org/jira/browse/KYLIN-3821 Project: Kylin Issue Type: Improvement Components: Real-time Streaming Reporter: Ma Gang Assignee: Ma Gang Expose real-time streaming data consuming lag info, so that user can easily know the lag information. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
