Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/21706 )
Change subject: IMPALA-13311: Hive3 INSERT failed by ClassNotFoundException: org.apache.tez.runtime.api.Event ...................................................................... Patch Set 2: (1 comment) > https://issues.apache.org/jira/browse/IMPALA-13311?focusedCommentId=17875674&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17875674 Adding the protobuf-java jar will result in another error: 2024-08-22T01:41:49,824 ERROR [HiveServer2-Background-Pool: Thread-76] exec.TaskRunner: Error in executeTask java.lang.IllegalAccessError: tried to access field com.google.protobuf.AbstractMessage.memoizedSize from class org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto at org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto.getSerializedSize(DAGProtos.java:21636) ~[tez-api-0.10.3.jar:0.10.3] at com.google.protobuf.AbstractMessageLite.writeTo(AbstractMessageLite.java:75) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.tez.client.TezClientUtils.createApplicationSubmissionContext(TezClientUtils.java:571) ~[tez-api-0.10.3.jar:0.10.3] at org.apache.tez.client.TezClient.setupApplicationContext(TezClient.java:500) ~[tez-api-0.10.3.jar:0.10.3] at org.apache.tez.client.TezClient.start(TezClient.java:400) ~[tez-api-0.10.3.jar:0.10.3] at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.startSessionAndContainers(TezSessionState.java:433) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:368) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.openInternal(TezSessionPoolSession.java:124) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:245) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.tez.TezTask.ensureSessionHasResources(TezTask.java:368) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:195) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) ~[hive-exec-3.1.3.jar:3.1.3] at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:224) ~[hive-service-3.1.3.jar:3.1.3] at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87) ~[hive-service-3.1.3.jar:3.1.3] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:316) ~[hive-service-3.1.3.jar:3.1.3] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422] at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_422] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) ~[hadoop-common-3.3.6.jar:?] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:329) ~[hive-service-3.1.3.jar:3.1.3] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_422] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_422] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_422] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_422] at java.lang.Thread.run(Thread.java:750) [?:1.8.0_422] http://gerrit.cloudera.org:8080/#/c/21706/2/testdata/bin/run-hive-server.sh File testdata/bin/run-hive-server.sh: http://gerrit.cloudera.org:8080/#/c/21706/2/testdata/bin/run-hive-server.sh@143 PS2, Line 143: commons-*|RoaringBitmap*|protobuf-java*) > [root@0bd5893057df lib]# grep -ri GeneratedMessageV3* We have different versions of this jar: toolchain/apache_components/apache-hive-3.1.3-bin/lib/protobuf-java-2.5.0.jar toolchain/apache_components/apache-tez-0.10.3-bin/lib/protobuf-java-3.21.1.jar I think this results in the following error: java.lang.IllegalAccessError: tried to access field com.google.protobuf.AbstractMessage.memoizedSize from class org.apache.tez.dag.api.records.DAGProtos$ConfigurationProto -- To view, visit http://gerrit.cloudera.org:8080/21706 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Ia278a87f92fedb96ec20608b5872facc55ae0a3c Gerrit-Change-Number: 21706 Gerrit-PatchSet: 2 Gerrit-Owner: Anonymous Coward <[email protected]> Gerrit-Reviewer: Anonymous Coward <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Comment-Date: Thu, 22 Aug 2024 01:48:13 +0000 Gerrit-HasComments: Yes
