[jira] [Closed] (KYLIN-2523) Compatible problem with HDP
[ https://issues.apache.org/jira/browse/KYLIN-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianbin closed KYLIN-2523. -- Resolution: Duplicate > Compatible problem with HDP > --- > > Key: KYLIN-2523 > URL: https://issues.apache.org/jira/browse/KYLIN-2523 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v1.6.0 > Environment: Environment: Ubuntu 14. > HDP version:2.4.2.0 > Kylin Version:apache-kylin-1.6.0-hbase1.x > Hadoop Version: 2.7.1 > Hive:1.2.1 >Reporter: sky >Assignee: Dong Li > > Hi, > Using hdp and Kylin for OLAP got lots of compatible problem. Building a cube > job will got slf4j error. the detail information as below: > > Error: loader constraint violation: when resolving method > "org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()Lorg/slf4j/ILoggerFactory;" > the class loader (instance of org/apache/hadoop/util/ApplicationClassLoader) > of the current class, org/slf4j/LoggerFactory, and the class loader (instance > of sun/misc/Launcher$AppClassLoader) for resolved class, > org/slf4j/impl/StaticLoggerBinder, have different Class objects for the type > LoggerFactory; used in the signature > --- -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KYLIN-2523) Compatible problem with HDP
[ https://issues.apache.org/jira/browse/KYLIN-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944565#comment-15944565 ] wangxianbin commented on KYLIN-2523: duplicated with KYLIN-2524 > Compatible problem with HDP > --- > > Key: KYLIN-2523 > URL: https://issues.apache.org/jira/browse/KYLIN-2523 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v1.6.0 > Environment: Environment: Ubuntu 14. > HDP version:2.4.2.0 > Kylin Version:apache-kylin-1.6.0-hbase1.x > Hadoop Version: 2.7.1 > Hive:1.2.1 >Reporter: sky >Assignee: Dong Li > > Hi, > Using hdp and Kylin for OLAP got lots of compatible problem. Building a cube > job will got slf4j error. the detail information as below: > > Error: loader constraint violation: when resolving method > "org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()Lorg/slf4j/ILoggerFactory;" > the class loader (instance of org/apache/hadoop/util/ApplicationClassLoader) > of the current class, org/slf4j/LoggerFactory, and the class loader (instance > of sun/misc/Launcher$AppClassLoader) for resolved class, > org/slf4j/impl/StaticLoggerBinder, have different Class objects for the type > LoggerFactory; used in the signature > --- -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (KYLIN-2518) Improve the sampling performance of FactDistinctColumns step
[ https://issues.apache.org/jira/browse/KYLIN-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XIE FAN updated KYLIN-2518: --- Description: The method putRowKeyToHLL() in FactDistinctColumnsMapper can be very slow when sampling rate is high. After carefully profiling, we believe that it's performance can be improved by modifying it's hash method. At the same time, we also found an algorithm that can estimate the row nums of each cuboid accurately with a lower sampling rate. I will share more test results and details of the algorithm once after this issue is done. (was: The method putRowKeyToHLL() in FactDistinctColumnsMapper can be very slow when sample rate is high. After carefully profiling, we believe that it's performance can be improved by modifying it's hash method. ) > Improve the sampling performance of FactDistinctColumns step > > > Key: KYLIN-2518 > URL: https://issues.apache.org/jira/browse/KYLIN-2518 > Project: Kylin > Issue Type: Improvement >Reporter: XIE FAN >Assignee: XIE FAN > > The method putRowKeyToHLL() in FactDistinctColumnsMapper can be very slow > when sampling rate is high. After carefully profiling, we believe that it's > performance can be improved by modifying it's hash method. At the same time, > we also found an algorithm that can estimate the row nums of each cuboid > accurately with a lower sampling rate. I will share more test results and > details of the algorithm once after this issue is done. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (KYLIN-2518) Improve the sampling performance of FactDistinctColumns step
[ https://issues.apache.org/jira/browse/KYLIN-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XIE FAN updated KYLIN-2518: --- Summary: Improve the sampling performance of FactDistinctColumns step (was: Improve putRowKeyToHLL() performance) > Improve the sampling performance of FactDistinctColumns step > > > Key: KYLIN-2518 > URL: https://issues.apache.org/jira/browse/KYLIN-2518 > Project: Kylin > Issue Type: Improvement >Reporter: XIE FAN >Assignee: XIE FAN > > The method putRowKeyToHLL() in FactDistinctColumnsMapper can be very slow > when sample rate is high. After carefully profiling, we believe that it's > performance can be improved by modifying it's hash method. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (KYLIN-2524) Compatible problem with HDP
[ https://issues.apache.org/jira/browse/KYLIN-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sky updated KYLIN-2524: --- Attachment: project_2017_03_27_16_30_17.zip Request participants: (was: ) > Compatible problem with HDP > --- > > Key: KYLIN-2524 > URL: https://issues.apache.org/jira/browse/KYLIN-2524 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v1.6.0 > Environment: Environment: Ubuntu 14. > HDP version:2.4.2.0 > Kylin Version:apache-kylin-1.6.0-hbase1.x > Hadoop Version: 2.7.1 > Hive:1.2.1 >Reporter: sky >Assignee: Dong Li > Attachments: project_2017_03_27_16_30_17.zip > > > Hi, > Using hdp and Kylin for OLAP got lots of compatible problem. Building a cube > job will got slf4j error. the detail information as below: > > Error: loader constraint violation: when resolving method > "org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()Lorg/slf4j/ILoggerFactory;" > the class loader (instance of org/apache/hadoop/util/ApplicationClassLoader) > of the current class, org/slf4j/LoggerFactory, and the class loader (instance > of sun/misc/Launcher$AppClassLoader) for resolved class, > org/slf4j/impl/StaticLoggerBinder, have different Class objects for the type > LoggerFactory; used in the signature > --- -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2524) Compatible problem with HDP
sky created KYLIN-2524: -- Summary: Compatible problem with HDP Key: KYLIN-2524 URL: https://issues.apache.org/jira/browse/KYLIN-2524 Project: Kylin Issue Type: Bug Components: Job Engine Affects Versions: v1.6.0 Environment: Environment: Ubuntu 14. HDP version:2.4.2.0 Kylin Version:apache-kylin-1.6.0-hbase1.x Hadoop Version: 2.7.1 Hive:1.2.1 Reporter: sky Assignee: Dong Li Hi, Using hdp and Kylin for OLAP got lots of compatible problem. Building a cube job will got slf4j error. the detail information as below: Error: loader constraint violation: when resolving method "org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()Lorg/slf4j/ILoggerFactory;" the class loader (instance of org/apache/hadoop/util/ApplicationClassLoader) of the current class, org/slf4j/LoggerFactory, and the class loader (instance of sun/misc/Launcher$AppClassLoader) for resolved class, org/slf4j/impl/StaticLoggerBinder, have different Class objects for the type LoggerFactory; used in the signature --- -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2523) Compatible problem with HDP
sky created KYLIN-2523: -- Summary: Compatible problem with HDP Key: KYLIN-2523 URL: https://issues.apache.org/jira/browse/KYLIN-2523 Project: Kylin Issue Type: Bug Components: Job Engine Affects Versions: v1.6.0 Environment: Environment: Ubuntu 14. HDP version:2.4.2.0 Kylin Version:apache-kylin-1.6.0-hbase1.x Hadoop Version: 2.7.1 Hive:1.2.1 Reporter: sky Assignee: Dong Li Hi, Using hdp and Kylin for OLAP got lots of compatible problem. Building a cube job will got slf4j error. the detail information as below: Error: loader constraint violation: when resolving method "org.slf4j.impl.StaticLoggerBinder.getLoggerFactory()Lorg/slf4j/ILoggerFactory;" the class loader (instance of org/apache/hadoop/util/ApplicationClassLoader) of the current class, org/slf4j/LoggerFactory, and the class loader (instance of sun/misc/Launcher$AppClassLoader) for resolved class, org/slf4j/impl/StaticLoggerBinder, have different Class objects for the type LoggerFactory; used in the signature --- -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (KYLIN-2522) Compilation fails with Java 8 when upgrading to hbase 1.2.5
[
https://issues.apache.org/jira/browse/KYLIN-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated KYLIN-2522:
--
Summary: Compilation fails with Java 8 when upgrading to hbase 1.2.5 (was:
Compilation fails with Java 8)
> Compilation fails with Java 8 when upgrading to hbase 1.2.5
> ---
>
> Key: KYLIN-2522
> URL: https://issues.apache.org/jira/browse/KYLIN-2522
> Project: Kylin
> Issue Type: Bug
>Reporter: Ted Yu
>
> Compiling master branch with Java 8, I got:
> {code}
> [ERROR]
> /Users/tyu/kylin/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperUtil.java:[23,23]
> error: cannot find symbol
> [ERROR] symbol: class Nullable
> location: package javax.annotation
> /Users/tyu/kylin/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperUtil.java:[45,13]
> error: cannot find symbol
> [ERROR] symbol: class Nullable
> /Users/tyu/kylin/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperJobLock.java:[112,13]
> error: cannot find symbol
> [INFO] 3 errors
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (KYLIN-2522) Compilation fails with Java 8
Ted Yu created KYLIN-2522:
-
Summary: Compilation fails with Java 8
Key: KYLIN-2522
URL: https://issues.apache.org/jira/browse/KYLIN-2522
Project: Kylin
Issue Type: Bug
Reporter: Ted Yu
Compiling master branch with Java 8, I got:
{code}
[ERROR]
/Users/tyu/kylin/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperUtil.java:[23,23]
error: cannot find symbol
[ERROR] symbol: class Nullable
location: package javax.annotation
/Users/tyu/kylin/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperUtil.java:[45,13]
error: cannot find symbol
[ERROR] symbol: class Nullable
/Users/tyu/kylin/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperJobLock.java:[112,13]
error: cannot find symbol
[INFO] 3 errors
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (KYLIN-2521) upgrade to calcite 1.12.0
hongbin ma created KYLIN-2521: - Summary: upgrade to calcite 1.12.0 Key: KYLIN-2521 URL: https://issues.apache.org/jira/browse/KYLIN-2521 Project: Kylin Issue Type: Task Reporter: hongbin ma Assignee: hongbin ma -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2520) Unify Restful API response and provide versioning
Roger Shi created KYLIN-2520: Summary: Unify Restful API response and provide versioning Key: KYLIN-2520 URL: https://issues.apache.org/jira/browse/KYLIN-2520 Project: Kylin Issue Type: Task Components: REST Service Reporter: Roger Shi Assignee: Zhong,Jason There's no convention in Kylin Restful API's response. It could be an object, an array or just a string. We should refine it in a "New" version Restful API and don't affect the legacy one. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (KYLIN-2520) Unify Restful API response and provide versioning
[ https://issues.apache.org/jira/browse/KYLIN-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roger Shi reassigned KYLIN-2520: Assignee: Roger Shi (was: Zhong,Jason) > Unify Restful API response and provide versioning > - > > Key: KYLIN-2520 > URL: https://issues.apache.org/jira/browse/KYLIN-2520 > Project: Kylin > Issue Type: Task > Components: REST Service >Reporter: Roger Shi >Assignee: Roger Shi > > There's no convention in Kylin Restful API's response. It could be an object, > an array or just a string. We should refine it in a "New" version Restful API > and don't affect the legacy one. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2519) find-hive-dependency.sh script found wrong hive-exec-path caused class not found error
weiyongzhuang created KYLIN-2519: Summary: find-hive-dependency.sh script found wrong hive-exec-path caused class not found error Key: KYLIN-2519 URL: https://issues.apache.org/jira/browse/KYLIN-2519 Project: Kylin Issue Type: Bug Reporter: weiyongzhuang Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-1.1.1.jar!/hive-log4j.properties SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.10.0-1.cdh5.10.0.p0.41/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/hive-jdbc-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Exception in thread "main" java.lang.NoClassDefFoundError: org/antlr/runtime/RecognitionException at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:392) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:307) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1112) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1160) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1039) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:159) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:370) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:305) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:702) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.ClassNotFoundException: org.antlr.runtime.RecognitionException at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 19 more -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2518) Improve putRowKeyToHLL() performance
XIE FAN created KYLIN-2518: -- Summary: Improve putRowKeyToHLL() performance Key: KYLIN-2518 URL: https://issues.apache.org/jira/browse/KYLIN-2518 Project: Kylin Issue Type: Improvement Reporter: XIE FAN Assignee: XIE FAN The method putRowKeyToHLL() in FactDistinctColumnsMapper can be very slow when sample rate is high. After carefully profiling, we believe that it's performance can be improved by modifying it's hash method. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
