declan94 opened a new issue #8051: Protobuf Extension task failed URL: https://github.com/apache/incubator-druid/issues/8051 ### Affected Version v0.14.2 ### Description Just follow steps described here: https://druid.apache.org/docs/latest/development/extensions-core/protobuf.html Got exception in Ingestion Task: ``` java.lang.NoSuchMethodError: com.github.os72.protobuf.dynamic.DynamicSchema.getMessageDescriptor(Ljava/lang/String;)Lshaded/com/google/protobuf/Descriptors$Descriptor; at org.apache.druid.data.input.protobuf.ProtobufInputRowParser.getDescriptor(ProtobufInputRowParser.java:166) ~[?:?] at org.apache.druid.data.input.protobuf.ProtobufInputRowParser.initDescriptor(ProtobufInputRowParser.java:90) ~[?:?] at org.apache.druid.data.input.protobuf.ProtobufInputRowParser.parseBatch(ProtobufInputRowParser.java:101) ~[?:?] at org.apache.druid.data.input.protobuf.ProtobufInputRowParser.parseBatch(ProtobufInputRowParser.java:52) ~[?:?] at org.apache.druid.segment.transform.TransformingInputRowParser.parseBatch(TransformingInputRowParser.java:50) ~[druid-processing-0.14.2-incubating.jar:0.14.2-incubating] at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.runInternal(SeekableStreamIndexTaskRunner.java:562) ~[druid-indexing-service-0.14.2-incubating.jar:0.14.2-incubating] at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.run(SeekableStreamIndexTaskRunner.java:246) ~[druid-indexing-service-0.14.2-incubating.jar:0.14.2-incubating] at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTask.run(SeekableStreamIndexTask.java:166) ~[druid-indexing-service-0.14.2-incubating.jar:0.14.2-incubating] at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:419) [druid-indexing-service-0.14.2-incubating.jar:0.14.2-incubating] at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:391) [druid-indexing-service-0.14.2-incubating.jar:0.14.2-incubating] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212] Error! java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: com.github.os72.protobuf.dynamic.DynamicSchema.getMessageDescriptor(Ljava/lang/String;)Lshaded/com/google/protobuf/Descriptors$Descriptor; at com.google.common.base.Throwables.propagate(Throwables.java:160) at org.apache.druid.indexing.worker.executor.ExecutorLifecycle.join(ExecutorLifecycle.java:214) at org.apache.druid.cli.CliPeon.run(CliPeon.java:364) at org.apache.druid.cli.Main.main(Main.java:118) Caused by: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: com.github.os72.protobuf.dynamic.DynamicSchema.getMessageDescriptor(Ljava/lang/String;)Lshaded/com/google/protobuf/Descriptors$Descriptor; at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299) at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) at org.apache.druid.indexing.worker.executor.ExecutorLifecycle.join(ExecutorLifecycle.java:211) ... 2 more ``` The reason may be that protobuf extension shaded and relocated the `com.google.protobuf` package, while the binary distribution provides the original `protobuf-dynamic-0.9.3.jar` which depends on `com.google.protobuf`. When we remove `protobuf-dynamic-0.9.3.jar` from the druid-protobuf-extensions folder, it works without exceptions
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
