Hi ShaoFeng Shi:
This is the original error,
When I build the cube and give the error: java.lang.NoClassDefFoundError:
com/google/protobuf/GeneratedMessageV3,
The GeneratedMessageV3 from protobuf-java-3.1.0, and there is really no it in
hive.
Maybe I should assembly it to the atopcalcite.
But I can run the hive -e command success.
#
Time taken: 0.218 seconds
Exception in thread "main" java.lang.NoClassDefFoundError:
com/google/protobuf/GeneratedMessageV3
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.calcite.avatica.ConnectionPropertiesImpl.<clinit>(ConnectionPropertiesImpl.java:38)
at org.apache.calcite.avatica.MetaImpl.<init>(MetaImpl.java:72)
at
org.apache.calcite.jdbc.CalciteMetaImpl.<init>(CalciteMetaImpl.java:88)
at org.apache.calcite.jdbc.Driver.createMeta(Driver.java:169)
at
org.apache.calcite.avatica.AvaticaConnection.<init>(AvaticaConnection.java:121)
at
org.apache.calcite.jdbc.CalciteConnectionImpl.<init>(CalciteConnectionImpl.java:113)
at
org.apache.calcite.jdbc.CalciteJdbc41Factory$CalciteJdbc41Connection.<init>(CalciteJdbc41Factory.java:114)
at
org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:59)
at
org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:44)
at
org.apache.calcite.jdbc.CalciteFactory.newConnection(CalciteFactory.java:53)
at
org.apache.calcite.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:138)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:145)
at org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:106)
at
org.apache.hadoop.hive.ql.parse.CalcitePlanner.logicalPlan(CalcitePlanner.java:1069)
at
org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:1085)
at
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:364)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:11138)
at
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:286)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:512)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
Caused by: java.lang.ClassNotFoundException:
com.google.protobuf.GeneratedMessageV3
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 51 more
The command is:
hive -e "USE default;
> 在 2018年10月15日，下午2:35，liuzhixin <[email protected]> 写道：
>
> Hi shaofeng:
>
> Yes, I can run the command well in hive shell.
>
> I can’t find calcite-core version 1.13.0-kylin-r4.
>
> Best wishes.
>
>> 在 2018年10月15日，下午2:20，ShaoFeng Shi <[email protected]
>> <mailto:[email protected]>> 写道：
>>
>> Hive version 2.3.3 can work well with HDP 3? Can you try the HiveQL that
>> Kylin executed out of Kylin, if it works, then there should be something
>> wrong in Kylin.
>>
>> liuzhixin <[email protected] <mailto:[email protected]>> 于2018年10月15日周一 下午1:47写道：
>>
>>> Thank you for the answer!
>>>
>>> I can’t decide the hive version.
>>>
>>> And the hive version 2.3.3 can work well with HDP 3.
>>>
>>> Perhaps you can test the Kylin with hive version 2.3.3.
>>>
>>> Maybe it’s other error. Thanks!
>>>
>>> Best wishes!
>>>
>>>
>>> 在 2018年10月15日，下午1:24，ShaoFeng Shi <[email protected]
>>> <mailto:[email protected]>> 写道：
>>>
>>> Hi zhixin,
>>>
>>> I think the problem is how to run Hive 2 with HDP 3, no relation with
>>> Kylin.
>>>
>>> Usually, we don't encourage user to customize the component version in a
>>> release, because that may bring dependency conflicts.
>>>
>>> I suggest you use the original Hive version in HDP 3.
>>>
>>> liuzhixin <[email protected] <mailto:[email protected]>> 于2018年10月15日周一
>>> 上午11:25写道：
>>>
>>>> Hi ShaoFeng Shi
>>>>
>>>> Yes, the error from hive version 2.3.3,
>>>>
>>>> And Kylin need hive version 3.1.0.
>>>>
>>>> So how to solve the question?
>>>>
>>>> Best wishes!
>>>>
>>>>> 在 2018年10月15日，上午11:10，ShaoFeng Shi <[email protected]
>>>>> <mailto:[email protected]>> 写道：
>>>>>
>>>>> Hi Zhixin,
>>>>>
>>>>> The error log is thrown from Hive, not from Kylin I think. Please verify
>>>>> your hive is properly installed; You can manually run that hive command
>>>> :
>>>>>
>>>>> hive -e "use default; xxx"
>>>>>
>>>>> Lijun Cao <[email protected] <mailto:[email protected]>> 于2018年10月15日周一
>>>>> 上午11:01写道：
>>>>>
>>>>>> Hi liuzhixin:
>>>>>>
>>>>>> As I remember, the Hive version in HDP 3 is 3.1.0 .
>>>>>>
>>>>>> You can update Hive to 3.1.0 and then have another try.
>>>>>>
>>>>>> And according to my previous test, the binary package
>>>>>> apache-kylin-2.5.0-bin-hadoop3.tar.gz can work properly on HDP 3. You
>>>> can
>>>>>> get it form official site.
>>>>>>
>>>>>> Best Regards
>>>>>>
>>>>>> Lijun Cao
>>>>>>
>>>>>>> 在 2018年10月15日，10:22，liuzhixin <[email protected]
>>>>>>> <mailto:[email protected]>> 写道：
>>>>>>>
>>>>>>> hi cao lijun，
>>>>>>> #
>>>>>>> the platform is ambari hdp3.0, and hive is 2.3.3, hbase version is 2.0
>>>>>>>
>>>>>>> I have compile the source code with hive 2.3.3,
>>>>>>>
>>>>>>> but the module atopcalcite depends on protobuf 3.1.0,
>>>>>>>
>>>>>>> other module depends on protobuf 2.5.0.
>>>>>>>
>>>>>>>
>>>>>>>> 在 2018年10月15日，上午8:40，Lijun Cao <[email protected]
>>>>>>>> <mailto:[email protected]>> 写道：
>>>>>>>>
>>>>>>>> Hi liuzhixin:
>>>>>>>>
>>>>>>>> Which platform did you use?
>>>>>>>>
>>>>>>>> The CDH 6.0.x or HDP 3.0 ?
>>>>>>>>
>>>>>>>> Best Regards
>>>>>>>>
>>>>>>>> Lijun Cao
>>>>>>>>
>>>>>>>>> 在 2018年10月12日，21:14，liuzhixin <[email protected]
>>>>>>>>> <mailto:[email protected]>> 写道：
>>>>>>>>>
>>>>>>>>> Logging initialized using configuration in
>>>>>>
>>>> file:/data/hadoop-enviorment/apache-hive-2.3.3/conf/hive-log4j2.properties
>>>>>> Async: true
>>>>>>>>> OK
>>>>>>>>> Time taken: 4.512 seconds
>>>>>>>>> OK
>>>>>>>>> Time taken: 1.511 seconds
>>>>>>>>> OK
>>>>>>>>> Time taken: 0.272 seconds
>>>>>>>>> OK
>>>>>>>>> Time taken: 0.185 seconds
>>>>>>>>> Exception in thread "main" java.lang.NoSuchMethodError:
>>>>>> com.google.protobuf.Descriptors$Descriptor.getOneofs()Ljava/util/List;
>>>>>>>>> at
>>>>>>
>>>> com.google.protobuf.GeneratedMessageV3$FieldAccessorTable.<init>(GeneratedMessageV3.java:1704)
>>>>>>>>> at
>>>>>> org.apache.calcite.avatica.proto.Common.<clinit>(Common.java:18927)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.avatica.proto.Common$ConnectionProperties.getDescriptor(Common.java:1264)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.avatica.ConnectionPropertiesImpl.<clinit>(ConnectionPropertiesImpl.java:38)
>>>>>>>>> at org.apache.calcite.avatica.MetaImpl.<init>(MetaImpl.java:72)
>>>>>>>>> at
>>>>>> org.apache.calcite.jdbc.CalciteMetaImpl.<init>(CalciteMetaImpl.java:88)
>>>>>>>>> at org.apache.calcite.jdbc.Driver.createMeta(Driver.java:169)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.avatica.AvaticaConnection.<init>(AvaticaConnection.java:121)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.jdbc.CalciteConnectionImpl.<init>(CalciteConnectionImpl.java:113)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.jdbc.CalciteJdbc41Factory$CalciteJdbc41Connection.<init>(CalciteJdbc41Factory.java:114)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:59)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:44)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.jdbc.CalciteFactory.newConnection(CalciteFactory.java:53)
>>>>>>>>> at
>>>>>>
>>>> org.apache.calcite.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:138)
>>>>>>>>> at java.sql.DriverManager.getConnection(DriverManager.java:664)
>>>>>>>>> at java.sql.DriverManager.getConnection(DriverManager.java:208)
>>>>>>>>> at
>>>>>> org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:145)
>>>>>>>>> at
>>>>>> org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:106)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.ql.parse.CalcitePlanner.logicalPlan(CalcitePlanner.java:1069)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:1085)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:364)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:11138)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:286)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
>>>>>>>>> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:512)
>>>>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317)
>>>>>>>>> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457)
>>>>>>>>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
>>>>>>>>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227)
>>>>>>>>> at
>>>>>>
>>>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
>>>>>>>>> at
>>>>>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
>>>>>>>>> at
>>>>>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
>>>>>>>>> at
>>>>>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336)
>>>>>>>>> at
>>>>>> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787)
>>>>>>>>> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
>>>>>>>>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
>>>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>> at
>>>>>>
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>>>>>>> at
>>>>>>
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>>>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>>>>>>>> at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
>>>>>>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
>>>>>>>>> The command is:
>>>>>>>>> hive -e "USE default;
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Best regards,
>>>>>
>>>>> Shaofeng Shi 史少锋
>>>>
>>>>
>>>>
>>>
>>> --
>>> Best regards,
>>>
>>> Shaofeng Shi 史少锋
>>>
>>>
>>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>
