[jira] [Updated] (KYLIN-4098) Add cube auto merge api
[ https://issues.apache.org/jira/browse/KYLIN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shao Feng Shi updated KYLIN-4098: - Issue Type: New Feature (was: Improvement) > Add cube auto merge api > --- > > Key: KYLIN-4098 > URL: https://issues.apache.org/jira/browse/KYLIN-4098 > Project: Kylin > Issue Type: New Feature >Reporter: Shaohui Liu >Assignee: Shaohui Liu >Priority: Minor > Fix For: v3.0.0-beta > > Attachments: image-2019-09-19-17-11-49-733.png > > > Currently the auto merging of cube is triggered by the event of new segment > is ready automatically. When the cluster restart, there may be too many > merging job. > It's better to have a rest api to trigger the merging and make it more > controllable. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4114) Provided a self-contained docker image for Kylin
[ https://issues.apache.org/jira/browse/KYLIN-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shao Feng Shi updated KYLIN-4114: - Issue Type: New Feature (was: Wish) > Provided a self-contained docker image for Kylin > > > Key: KYLIN-4114 > URL: https://issues.apache.org/jira/browse/KYLIN-4114 > Project: Kylin > Issue Type: New Feature > Components: Integration >Reporter: Xiaoxiang Yu >Assignee: weibin0516 >Priority: Major > Fix For: v3.0.0-beta > > > Provided a self-contained docker image for Kylin will benifit to > Package/Integration Test/Demo purpose. > https://issues.apache.org/jira/browse/KYLIN-4040 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (KYLIN-3878) NPE to run sonar analysis
[ https://issues.apache.org/jira/browse/KYLIN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shao Feng Shi reassigned KYLIN-3878: Assignee: nichunen > NPE to run sonar analysis > - > > Key: KYLIN-3878 > URL: https://issues.apache.org/jira/browse/KYLIN-3878 > Project: Kylin > Issue Type: Test > Components: Tools, Build and Test >Reporter: Shao Feng Shi >Assignee: nichunen >Priority: Major > Fix For: v3.0.0-beta > > > mvn sonar:sonar -Dsonar.host.url=https://sonarcloud.io > -Dsonar.organization=kylin -e > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 03:13 min > [INFO] Finished at: 2019-03-15T14:42:16Z > [INFO] > > [ERROR] Failed to execute goal > org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar > (default-cli) on project kylin: null: MojoExecutionException: > NullPointerException -> [Help 1] > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar > (default-cli) on project kylin: null > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:213) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:154) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:146) > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:117) > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:81) > at > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build > (SingleThreadedBuilder.java:56) > at org.apache.maven.lifecycle.internal.LifecycleStarter.execute > (LifecycleStarter.java:128) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) > at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) > at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956) > at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) > at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) > at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke > (NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke > (DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke (Method.java:498) > at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced > (Launcher.java:289) > at org.codehaus.plexus.classworlds.launcher.Launcher.launch > (Launcher.java:229) > at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode > (Launcher.java:415) > at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) > Caused by: org.apache.maven.plugin.MojoExecutionException > at org.sonarsource.scanner.maven.bootstrap.ScannerBootstrapper.execute > (ScannerBootstrapper.java:67) > at org.sonarsource.scanner.maven.SonarQubeMojo.execute > (SonarQubeMojo.java:104) > at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo > (DefaultBuildPluginManager.java:137) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:208) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:154) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:146) > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:117) > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:81) > at > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build > (SingleThreadedBuilder.java:56) > at org.apache.maven.lifecycle.internal.LifecycleStarter.execute > (LifecycleStarter.java:128) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) > at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) > at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956) > at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) > at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) > at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke > (NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke > (DelegatingMethodAccessorImpl.java:43) > at
[GitHub] [kylin] coveralls commented on issue #860: build dimension dictionary using spark
coveralls commented on issue #860: build dimension dictionary using spark URL: https://github.com/apache/kylin/pull/860#issuecomment-535306368 ## Pull Request Test Coverage Report for [Build 5057](https://coveralls.io/builds/25937467) * **0** of **268** **(0.0%)** changed or added relevant lines in **5** files are covered. * **2** unchanged lines in **2** files lost coverage. * Overall coverage decreased (**-0.09%**) to **27.829%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java](https://coveralls.io/builds/25937467/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java#L1458) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/model/TblColRef.java](https://coveralls.io/builds/25937467/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fmodel%2FTblColRef.java#L284) | 0 | 1 | 0.0% | [engine-mr/src/main/java/org/apache/kylin/engine/mr/JobBuilderSupport.java](https://coveralls.io/builds/25937467/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2FJobBuilderSupport.java#L255) | 0 | 1 | 0.0% | [engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java](https://coveralls.io/builds/25937467/source?filename=engine-spark%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fspark%2FSparkBatchCubingJobBuilder2.java#L80) | 0 | 18 | 0.0% | [engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBuildDictionary.java](https://coveralls.io/builds/25937467/source?filename=engine-spark%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fspark%2FSparkBuildDictionary.java#L86) | 0 | 247 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-dictionary/src/main/java/org/apache/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://coveralls.io/builds/25937467/source?filename=core-dictionary%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fdict%2Flookup%2Fcache%2FRocksDBLookupTable.java#L62) | 1 | 81.08% | | [engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java](https://coveralls.io/builds/25937467/source?filename=engine-spark%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fspark%2FSparkBatchCubingJobBuilder2.java#L86) | 1 | 0.0% | | Totals | [](https://coveralls.io/builds/25937467) | | :-- | --: | | Change from base [Build 5053](https://coveralls.io/builds/25913474): | -0.09% | | Covered Lines: | 23706 | | Relevant Lines: | 85183 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] coveralls commented on issue #859: KYLIN-4168 fix sonar bug
coveralls commented on issue #859: KYLIN-4168 fix sonar bug URL: https://github.com/apache/kylin/pull/859#issuecomment-53527 ## Pull Request Test Coverage Report for [Build 5056](https://coveralls.io/builds/25937282) * **6** of **21** **(28.57%)** changed or added relevant lines in **5** files are covered. * **5** unchanged lines in **3** files lost coverage. * Overall coverage increased (+5.0e**-05%**) to **27.916%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-common/src/main/java/org/apache/kylin/common/livy/LivyRestExecutor.java](https://coveralls.io/builds/25937282/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2Flivy%2FLivyRestExecutor.java#L66) | 0 | 1 | 0.0% | [core-common/src/main/java/org/apache/kylin/common/QueryContext.java](https://coveralls.io/builds/25937282/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FQueryContext.java#L63) | 0 | 3 | 0.0% | [core-common/src/main/java/org/apache/kylin/common/KylinVersion.java](https://coveralls.io/builds/25937282/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinVersion.java#L166) | 0 | 4 | 0.0% | [cache/src/main/java/net/spy/memcached/RefinedKetamaNodeLocator.java](https://coveralls.io/builds/25937282/source?filename=cache%2Fsrc%2Fmain%2Fjava%2Fnet%2Fspy%2Fmemcached%2FRefinedKetamaNodeLocator.java#L132) | 5 | 12 | 41.67% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-dictionary/src/main/java/org/apache/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://coveralls.io/builds/25937282/source?filename=core-dictionary%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fdict%2Flookup%2Fcache%2FRocksDBLookupTable.java#L62) | 1 | 81.08% | | [core-common/src/main/java/org/apache/kylin/common/KylinVersion.java](https://coveralls.io/builds/25937282/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinVersion.java#L168) | 2 | 39.51% | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/25937282/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | Totals | [](https://coveralls.io/builds/25937282) | | :-- | --: | | Change from base [Build 5053](https://coveralls.io/builds/25913474): | 5.0e-05% | | Covered Lines: | 23707 | | Relevant Lines: | 84923 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] coveralls commented on issue #858: KYLIN-4178: job scheduler safe mode
coveralls commented on issue #858: KYLIN-4178: job scheduler safe mode URL: https://github.com/apache/kylin/pull/858#issuecomment-535298591 ## Pull Request Test Coverage Report for [Build 5055](https://coveralls.io/builds/25937228) * **2** of **14** **(14.29%)** changed or added relevant lines in **3** files are covered. * **3** unchanged lines in **2** files lost coverage. * Overall coverage decreased (**-0.006%**) to **27.91%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java](https://coveralls.io/builds/25937228/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java#L840) | 0 | 2 | 0.0% | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultFetcherRunner.java](https://coveralls.io/builds/25937228/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultFetcherRunner.java#L83) | 2 | 6 | 33.33% | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/PriorityFetcherRunner.java](https://coveralls.io/builds/25937228/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FPriorityFetcherRunner.java#L113) | 0 | 6 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-dictionary/src/main/java/org/apache/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://coveralls.io/builds/25937228/source?filename=core-dictionary%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fdict%2Flookup%2Fcache%2FRocksDBLookupTable.java#L62) | 1 | 81.08% | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/25937228/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | Totals | [](https://coveralls.io/builds/25937228) | | :-- | --: | | Change from base [Build 5053](https://coveralls.io/builds/25913474): | -0.006% | | Covered Lines: | 23704 | | Relevant Lines: | 84930 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] RupengWang edited a comment on issue #860: build dimension dictionary using spark
RupengWang edited a comment on issue #860: build dimension dictionary using spark URL: https://github.com/apache/kylin/pull/860#issuecomment-535298407 Please don't merge this for the time being This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] RupengWang commented on issue #860: build dimension dictionary using spark
RupengWang commented on issue #860: build dimension dictionary using spark URL: https://github.com/apache/kylin/pull/860#issuecomment-535298407 Please don't merge this for time being This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] RupengWang opened a new pull request #860: build dimension dictionary using spark
RupengWang opened a new pull request #860: build dimension dictionary using spark URL: https://github.com/apache/kylin/pull/860 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asf-ci commented on issue #860: build dimension dictionary using spark
asf-ci commented on issue #860: build dimension dictionary using spark URL: https://github.com/apache/kylin/pull/860#issuecomment-535298030 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io commented on issue #858: KYLIN-4178: job scheduler safe mode
codecov-io commented on issue #858: KYLIN-4178: job scheduler safe mode URL: https://github.com/apache/kylin/pull/858#issuecomment-535297590 # [Codecov](https://codecov.io/gh/apache/kylin/pull/858?src=pr=h1) Report > Merging [#858](https://codecov.io/gh/apache/kylin/pull/858?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/75c90df928d921808201b172f14c42cc91eeae02?src=pr=desc) will **decrease** coverage by `<.01%`. > The diff coverage is `7.14%`. [](https://codecov.io/gh/apache/kylin/pull/858?src=pr=tree) ```diff @@ Coverage Diff @@ ## master #858 +/- ## - Coverage 25.46% 25.45% -0.01% + Complexity 6108 6107 -1 Files 1410 1410 Lines 8491684930 +14 Branches 1189611902 +6 - Hits 2162321620 -3 - Misses6121461229 +15 - Partials 2079 2081 +2 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/858?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...lin/job/impl/threadpool/PriorityFetcherRunner.java](https://codecov.io/gh/apache/kylin/pull/858/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9pbXBsL3RocmVhZHBvb2wvUHJpb3JpdHlGZXRjaGVyUnVubmVyLmphdmE=) | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: | | [.../java/org/apache/kylin/common/KylinConfigBase.java](https://codecov.io/gh/apache/kylin/pull/858/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpbkNvbmZpZ0Jhc2UuamF2YQ==) | `12.68% <0%> (-0.04%)` | `42 <0> (ø)` | | | [...ylin/job/impl/threadpool/DefaultFetcherRunner.java](https://codecov.io/gh/apache/kylin/pull/858/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9pbXBsL3RocmVhZHBvb2wvRGVmYXVsdEZldGNoZXJSdW5uZXIuamF2YQ==) | `66.66% <16.66%> (-7.7%)` | `6 <0> (ø)` | | | [...he/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://codecov.io/gh/apache/kylin/pull/858/diff?src=pr=tree#diff-Y29yZS1kaWN0aW9uYXJ5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9kaWN0L2xvb2t1cC9jYWNoZS9Sb2Nrc0RCTG9va3VwVGFibGUuamF2YQ==) | `72.97% <0%> (-5.41%)` | `6% <0%> (-1%)` | | | [...he/kylin/job/impl/threadpool/DefaultScheduler.java](https://codecov.io/gh/apache/kylin/pull/858/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9pbXBsL3RocmVhZHBvb2wvRGVmYXVsdFNjaGVkdWxlci5qYXZh) | `74.41% <0%> (-2.33%)` | `12% <0%> (ø)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/858?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/858?src=pr=footer). Last update [75c90df...fa8ec76](https://codecov.io/gh/apache/kylin/pull/858?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-4168) Fix sonar reported static code issues phase 2
[ https://issues.apache.org/jira/browse/KYLIN-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938174#comment-16938174 ] ASF GitHub Bot commented on KYLIN-4168: --- zhangayqian commented on pull request #859: KYLIN-4168 fix sonar bug URL: https://github.com/apache/kylin/pull/859 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Fix sonar reported static code issues phase 2 > - > > Key: KYLIN-4168 > URL: https://issues.apache.org/jira/browse/KYLIN-4168 > Project: Kylin > Issue Type: Improvement >Reporter: Yaqian Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] asf-ci commented on issue #859: KYLIN-4168 fix sonar bug
asf-ci commented on issue #859: KYLIN-4168 fix sonar bug URL: https://github.com/apache/kylin/pull/859#issuecomment-535290886 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] zhangayqian opened a new pull request #859: KYLIN-4168 fix sonar bug
zhangayqian opened a new pull request #859: KYLIN-4168 fix sonar bug URL: https://github.com/apache/kylin/pull/859 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-4178) Job scheduler support safe mode
[ https://issues.apache.org/jira/browse/KYLIN-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937567#comment-16937567 ] ASF GitHub Bot commented on KYLIN-4178: --- zhoukangcn commented on pull request #858: KYLIN-4178: job scheduler safe mode URL: https://github.com/apache/kylin/pull/858 See: https://issues.apache.org/jira/browse/KYLIN-4178?filter=-2 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Job scheduler support safe mode > > > Key: KYLIN-4178 > URL: https://issues.apache.org/jira/browse/KYLIN-4178 > Project: Kylin > Issue Type: Improvement >Reporter: ZhouKang >Priority: Major > > Job scheduler should support safe mode in case of the HBase cluster change. > In xiaomi, we want update the HBase cluster from hbase0.98 to HBase 2.0. The > history data can be migrated previously, but the job has been submitted will > keep running and write data to the old cluster. So we need a method to ensure > that, job create htable in the old cluster will write data to the old > cluster, and the job have not create htable should not be scheduled. > So we need job scheduler safe mode. Open safe mode before changing cluster > config, the running jobs can run continuous, and the new job cannot be > scheduled. > After all running job finished, we can change the cluster config to the new > one, and rest of job can be scheduled again. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] asf-ci commented on issue #858: KYLIN-4178: job scheduler safe mode
asf-ci commented on issue #858: KYLIN-4178: job scheduler safe mode URL: https://github.com/apache/kylin/pull/858#issuecomment-534943462 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] zhoukangcn opened a new pull request #858: KYLIN-4178: job scheduler safe mode
zhoukangcn opened a new pull request #858: KYLIN-4178: job scheduler safe mode URL: https://github.com/apache/kylin/pull/858 See: https://issues.apache.org/jira/browse/KYLIN-4178?filter=-2 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-4178) Job scheduler support safe mode
ZhouKang created KYLIN-4178: --- Summary: Job scheduler support safe mode Key: KYLIN-4178 URL: https://issues.apache.org/jira/browse/KYLIN-4178 Project: Kylin Issue Type: Improvement Reporter: ZhouKang Job scheduler should support safe mode in case of the HBase cluster change. In xiaomi, we want update the HBase cluster from hbase0.98 to HBase 2.0. The history data can be migrated previously, but the job has been submitted will keep running and write data to the old cluster. So we need a method to ensure that, job create htable in the old cluster will write data to the old cluster, and the job have not create htable should not be scheduled. So we need job scheduler safe mode. Open safe mode before changing cluster config, the running jobs can run continuous, and the new job cannot be scheduled. After all running job finished, we can change the cluster config to the new one, and rest of job can be scheduled again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4166) kylin parse sql error
[
https://issues.apache.org/jira/browse/KYLIN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937453#comment-16937453
]
Yaqian Zhang commented on KYLIN-4166:
-
Hi phil.zhang:
Sorry for late.Thank you for your report.
I have reproduce this problem, we will fix it in future version.
> kylin parse sql error
> -
>
> Key: KYLIN-4166
> URL: https://issues.apache.org/jira/browse/KYLIN-4166
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v3.0.0-alpha2
>Reporter: phil.zhang
>Assignee: Yaqian Zhang
>Priority: Critical
> Attachments: 1.png, 2.png, 3.png, 4.png,
> image-2019-09-20-15-22-15-356.png, image-2019-09-20-15-23-29-881.png
>
>
>
> 1. I use tableau on kylin, tableau has generate a sql :
> '''
> SELECT "X___SQL___"."FLIGHT_TYPE" AS "FLIGHT_TYPE",
> SUM("X___SQL___"."SHOPPING_SUCCESS_COUNT") AS "sum_SHOPPING_SUCCESS_COUNT_ok"
> FROM ( select *, case when cast(DURATION_LEVEL as varchar) like '1' then
> '>=0s,<3s' when cast(DURATION_LEVEL as varchar) like '2' then '>=3s,<4s' when
> cast(DURATION_LEVEL as varchar) like '3' then '>=4s,<5s' when
> cast(DURATION_LEVEL as varchar) like '4' then '>=5s,<6s' when
> cast(DURATION_LEVEL as varchar) like '5' then '>=6s,<7s' when
> cast(DURATION_LEVEL as varchar) like '6' then '>=7s,<8s' when
> cast(DURATION_LEVEL as varchar) like '7' then '>=8s,<9s' when
> cast(DURATION_LEVEL as varchar) like '8' then '>=9s,<10s' when
> cast(DURATION_LEVEL as varchar) like '9' then '>=10s,<12s' when
> cast(DURATION_LEVEL as varchar) like '10' then '>=12s,<14s' when
> cast(DURATION_LEVEL as varchar) like '11' then '>=14s,<16s' when
> cast(DURATION_LEVEL as varchar) like '12' then '>=16s,<18s' when
> cast(DURATION_LEVEL as varchar) like '13' then '>=18s,<20s' when
> cast(DURATION_LEVEL as varchar) like '14' then '>=20s,<30s' when
> cast(DURATION_LEVEL as varchar) like '15' then '>=30s,<40s' when
> cast(DURATION_LEVEL as varchar) like '16' then '>=40s,<50s' when
> cast(DURATION_LEVEL as varchar) like '17' then '>=50s' else 'null' end as
> DURATION_LEVEL_TRANS from DM_AIR_API_DURATION_SPB_D ) "X___SQL___" WHERE
> ("X___SQL___"."DURATION_LEVEL_TRANS" = '>=5s,<6s') GROUP BY 1
> '''
> it seems that the sql is correct, but the result is unexpect, it returns
> null .
> !image-2019-09-20-15-22-15-356.png!
> But actually, it should returns some rows because there exist data fit the
> query, let's change the sql form to check it.
> '''
> SELECT "FLIGHT_TYPE" AS "FLIGHT_TYPE", SUM("SHOPPING_SUCCESS_COUNT") AS
> "sum_SHOPPING_SUCCESS_COUNT_ok" from DM_AIR_API_DURATION_SPB_D WHERE
> ("DURATION_LEVEL" = 4 and "DAY_NUM"='2019-09-10') GROUP BY 1
> '''
> !image-2019-09-20-15-23-29-881.png!
>
> 2. and when i write sql like this
> '''
> SELECT flight_type,SUM("SHOPPING_SUCCESS_COUNT") AS
> "sum_SHOPPING_SUCCESS_COUNT_ok" from DM_AIR_API_DURATION_SPB_D group by
> flight_type
> '''
> i got result {color:#33}like this{color}
> {color:#33}!http://mail.163.com/js6/s?func=mbox:getMessageData=270:xtbBDhAtQVrbEIH+vQAAsh=5!{color}
> it is same to the result of
> '''
> SELECT "X___SQL___"."FLIGHT_TYPE" AS "FLIGHT_TYPE",
> SUM("X___SQL___"."SHOPPING_SUCCESS_COUNT") AS "sum_SHOPPING_SUCCESS_COUNT_ok"
> FROM ( select *, case when cast(DURATION_LEVEL as varchar)
> like '1' then *'>=0s,<3s'* when cast(DURATION_LEVEL as varchar) like
> '2' then '>=3s,<4s' when cast(DURATION_LEVEL as varchar) like '3'
> then '>=4s,<5s' when cast(DURATION_LEVEL as varchar) like '4' then
> '>=5s,<6s' when cast(DURATION_LEVEL as varchar) like '5' then
> '>=6s,<7s' when cast(DURATION_LEVEL as varchar) like '6' then
> '>=7s,<8s' when cast(DURATION_LEVEL as varchar) like '7' then
> '>=8s,<9s' when cast(DURATION_LEVEL as varchar) like '8' then
> '>=9s,<10s' when cast(DURATION_LEVEL as varchar) like '9' then
> '>=10s,<12s' when cast(DURATION_LEVEL as varchar) like '10' then
> '>=12s,<14s' when cast(DURATION_LEVEL as varchar) like '11' then
> '>=14s,<16s' when cast(DURATION_LEVEL as varchar) like '12' then
> '>=16s,<18s' when cast(DURATION_LEVEL as varchar) like '13' then
> '>=18s,<20s' when cast(DURATION_LEVEL as varchar) like '14' then
> '>=20s,<30s' when cast(DURATION_LEVEL as varchar) like '15' then
> '>=30s,<40s' when cast(DURATION_LEVEL as varchar) like '16' then
> '>=40s,<50s' when cast(DURATION_LEVEL as varchar) like '17' then
> '>=50s' else 'null' end as DURATION_LEVEL_TRANS from
> DM_AIR_API_DURATION_SPB_D ) "X___SQL___" WHERE
> ("X___SQL___"."DURATION_LEVEL_TRANS" = *'>=0s,<3s'*) GROUP BY 1
> '''
>
[jira] [Assigned] (KYLIN-4166) kylin parse sql error
[
https://issues.apache.org/jira/browse/KYLIN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaqian Zhang reassigned KYLIN-4166:
---
Assignee: Yaqian Zhang
> kylin parse sql error
> -
>
> Key: KYLIN-4166
> URL: https://issues.apache.org/jira/browse/KYLIN-4166
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v3.0.0-alpha2
>Reporter: phil.zhang
>Assignee: Yaqian Zhang
>Priority: Critical
> Attachments: 1.png, 2.png, 3.png, 4.png,
> image-2019-09-20-15-22-15-356.png, image-2019-09-20-15-23-29-881.png
>
>
>
> 1. I use tableau on kylin, tableau has generate a sql :
> '''
> SELECT "X___SQL___"."FLIGHT_TYPE" AS "FLIGHT_TYPE",
> SUM("X___SQL___"."SHOPPING_SUCCESS_COUNT") AS "sum_SHOPPING_SUCCESS_COUNT_ok"
> FROM ( select *, case when cast(DURATION_LEVEL as varchar) like '1' then
> '>=0s,<3s' when cast(DURATION_LEVEL as varchar) like '2' then '>=3s,<4s' when
> cast(DURATION_LEVEL as varchar) like '3' then '>=4s,<5s' when
> cast(DURATION_LEVEL as varchar) like '4' then '>=5s,<6s' when
> cast(DURATION_LEVEL as varchar) like '5' then '>=6s,<7s' when
> cast(DURATION_LEVEL as varchar) like '6' then '>=7s,<8s' when
> cast(DURATION_LEVEL as varchar) like '7' then '>=8s,<9s' when
> cast(DURATION_LEVEL as varchar) like '8' then '>=9s,<10s' when
> cast(DURATION_LEVEL as varchar) like '9' then '>=10s,<12s' when
> cast(DURATION_LEVEL as varchar) like '10' then '>=12s,<14s' when
> cast(DURATION_LEVEL as varchar) like '11' then '>=14s,<16s' when
> cast(DURATION_LEVEL as varchar) like '12' then '>=16s,<18s' when
> cast(DURATION_LEVEL as varchar) like '13' then '>=18s,<20s' when
> cast(DURATION_LEVEL as varchar) like '14' then '>=20s,<30s' when
> cast(DURATION_LEVEL as varchar) like '15' then '>=30s,<40s' when
> cast(DURATION_LEVEL as varchar) like '16' then '>=40s,<50s' when
> cast(DURATION_LEVEL as varchar) like '17' then '>=50s' else 'null' end as
> DURATION_LEVEL_TRANS from DM_AIR_API_DURATION_SPB_D ) "X___SQL___" WHERE
> ("X___SQL___"."DURATION_LEVEL_TRANS" = '>=5s,<6s') GROUP BY 1
> '''
> it seems that the sql is correct, but the result is unexpect, it returns
> null .
> !image-2019-09-20-15-22-15-356.png!
> But actually, it should returns some rows because there exist data fit the
> query, let's change the sql form to check it.
> '''
> SELECT "FLIGHT_TYPE" AS "FLIGHT_TYPE", SUM("SHOPPING_SUCCESS_COUNT") AS
> "sum_SHOPPING_SUCCESS_COUNT_ok" from DM_AIR_API_DURATION_SPB_D WHERE
> ("DURATION_LEVEL" = 4 and "DAY_NUM"='2019-09-10') GROUP BY 1
> '''
> !image-2019-09-20-15-23-29-881.png!
>
> 2. and when i write sql like this
> '''
> SELECT flight_type,SUM("SHOPPING_SUCCESS_COUNT") AS
> "sum_SHOPPING_SUCCESS_COUNT_ok" from DM_AIR_API_DURATION_SPB_D group by
> flight_type
> '''
> i got result {color:#33}like this{color}
> {color:#33}!http://mail.163.com/js6/s?func=mbox:getMessageData=270:xtbBDhAtQVrbEIH+vQAAsh=5!{color}
> it is same to the result of
> '''
> SELECT "X___SQL___"."FLIGHT_TYPE" AS "FLIGHT_TYPE",
> SUM("X___SQL___"."SHOPPING_SUCCESS_COUNT") AS "sum_SHOPPING_SUCCESS_COUNT_ok"
> FROM ( select *, case when cast(DURATION_LEVEL as varchar)
> like '1' then *'>=0s,<3s'* when cast(DURATION_LEVEL as varchar) like
> '2' then '>=3s,<4s' when cast(DURATION_LEVEL as varchar) like '3'
> then '>=4s,<5s' when cast(DURATION_LEVEL as varchar) like '4' then
> '>=5s,<6s' when cast(DURATION_LEVEL as varchar) like '5' then
> '>=6s,<7s' when cast(DURATION_LEVEL as varchar) like '6' then
> '>=7s,<8s' when cast(DURATION_LEVEL as varchar) like '7' then
> '>=8s,<9s' when cast(DURATION_LEVEL as varchar) like '8' then
> '>=9s,<10s' when cast(DURATION_LEVEL as varchar) like '9' then
> '>=10s,<12s' when cast(DURATION_LEVEL as varchar) like '10' then
> '>=12s,<14s' when cast(DURATION_LEVEL as varchar) like '11' then
> '>=14s,<16s' when cast(DURATION_LEVEL as varchar) like '12' then
> '>=16s,<18s' when cast(DURATION_LEVEL as varchar) like '13' then
> '>=18s,<20s' when cast(DURATION_LEVEL as varchar) like '14' then
> '>=20s,<30s' when cast(DURATION_LEVEL as varchar) like '15' then
> '>=30s,<40s' when cast(DURATION_LEVEL as varchar) like '16' then
> '>=40s,<50s' when cast(DURATION_LEVEL as varchar) like '17' then
> '>=50s' else 'null' end as DURATION_LEVEL_TRANS from
> DM_AIR_API_DURATION_SPB_D ) "X___SQL___" WHERE
> ("X___SQL___"."DURATION_LEVEL_TRANS" = *'>=0s,<3s'*) GROUP BY 1
> '''
> !http://mail.163.com/js6/s?func=mbox:getMessageData=270:xtbBDhAtQVrbEIH+vQAAsh=6!
>
>
> {quote} *I guess maybe there are some bugs about parsing sql like upper ? I
> hope someone
[jira] [Created] (KYLIN-4177) when unassign a Replica Set from a cube, can not reassign it in page.
luguosheng created KYLIN-4177: - Summary: when unassign a Replica Set from a cube, can not reassign it in page. Key: KYLIN-4177 URL: https://issues.apache.org/jira/browse/KYLIN-4177 Project: Kylin Issue Type: Improvement Reporter: luguosheng -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (KYLIN-4076) calcite parse in case when
[ https://issues.apache.org/jira/browse/KYLIN-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang reassigned KYLIN-4076: --- Assignee: Yaqian Zhang > calcite parse in case when > --- > > Key: KYLIN-4076 > URL: https://issues.apache.org/jira/browse/KYLIN-4076 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.3 >Reporter: chenchen >Assignee: Yaqian Zhang >Priority: Major > Attachments: image-2019-07-09-16-16-16-162.png, > image-2019-07-09-16-19-09-420.png, image-2019-07-09-17-15-18-516.png > > > in this version, > In SQL statements with case-when, when the name of the field is the same as > that of the case-when-as field, the result of the query is not converted to > the corresponding string. > But when I put the case when outside the braces, the query was correct again. > I suspect that "group by" has changed the order in which SQL is executed. > I wonder if there is a lack of configuration when I upgrade? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4076) calcite parse in case when
[ https://issues.apache.org/jira/browse/KYLIN-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937442#comment-16937442 ] Yaqian Zhang commented on KYLIN-4076: - Hi chenchen： Thank you for your report. I reproduced the problem you described and I think the parse of CASE WHEN in kylin have some bug. We will fix these bugs in future version. > calcite parse in case when > --- > > Key: KYLIN-4076 > URL: https://issues.apache.org/jira/browse/KYLIN-4076 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.3 >Reporter: chenchen >Priority: Major > Attachments: image-2019-07-09-16-16-16-162.png, > image-2019-07-09-16-19-09-420.png, image-2019-07-09-17-15-18-516.png > > > in this version, > In SQL statements with case-when, when the name of the field is the same as > that of the case-when-as field, the result of the query is not converted to > the corresponding string. > But when I put the case when outside the braces, the query was correct again. > I suspect that "group by" has changed the order in which SQL is executed. > I wonder if there is a lack of configuration when I upgrade? -- This message was sent by Atlassian Jira (v8.3.4#803005)
