[jira] [Commented] (BEAM-3718) ClassNotFoundException on CloudResourceManager$Builder
[
https://issues.apache.org/jira/browse/BEAM-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388331#comment-16388331
]
Chamikara Jayalath commented on BEAM-3718:
--
Looks like you somehow ended up picking an old version of
google-api-services-cloudresourcemanager instead of 'v1-rev6-1.22.0' that is
used by Beam 2.2.0:
https://github.com/apache/beam/blob/release-2.2.0/pom.xml#L113
Can you try adding that version to your classpath (for example, by pinning that
version in pom.xml if you are using Maven).
Also can you mention how you ran the program ?
> ClassNotFoundException on CloudResourceManager$Builder
> --
>
> Key: BEAM-3718
> URL: https://issues.apache.org/jira/browse/BEAM-3718
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
>Reporter: Yunis Arif Said
>Assignee: Chamikara Jayalath
>Priority: Trivial
>
> In a spring boot application running google cloud dataflow code. The dataflow
> takes data from google PubSub, transform incoming data and output result to
> bigquery for storage. The code does not have any syntax errors. The problem
> is when the application is run, the following exception is thrown.
>
> {code:java}
> Exception in thread "main" java.lang.RuntimeException: Failed to construct
> instance from factory method DataflowRunner#fromOptions(interface
> org.apache.beam.sdk.options.PipelineOptions)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:233)
> at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:162)
> at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:52)
> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:142)
> at com.trackers.exlon.ExlonApplication.main(ExlonApplication.java:69)
>
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:222)
> ... 4 more
> Caused by: java.lang.NoClassDefFoundError:
> com/google/api/services/cloudresourcemanager/CloudResourceManager$Builder
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.newCloudResourceManagerClient(GcpOptions.java:369)
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:240)
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:228)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:592)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:533)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:156)
> at com.sun.proxy.$Proxy85.getGcpTempLocation(Unknown Source)
> at
> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:223)
> ... 9 more
> Caused by: java.lang.ClassNotFoundException:
> com.google.api.services.cloudresourcemanager.CloudResourceManager$Builder
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 17 more
> {code}
> Maven dependency tree:
> {code:java}
> [INFO] +-
> org.springframework.boot:spring-boot-starter-webflux:jar:2.0.0.RC1:compile
> [INFO] | +-
> org.springframework.boot:spring-boot-starter:jar:2.0.0.RC1:compile
> [INFO] | | +- org.springframework.boot:spring-boot:jar:2.0.0.RC1:compile
> [INFO] | | | \- org.springframework:spring-context:jar:5.0.3.RELEASE:compile
> [INFO] | | | +- org.springframework:spring-aop:jar:5.0.3.RELEASE:compile
> [INFO] | | | \-
> org.springframework:spring-expression:jar:5.0.3.RELEASE:compile
> [INFO] | | +-
> org.springframework.boot:spring-boot-autoconfigure:jar:2.0.0.RC1:compile
> [INFO] | | +-
> org.springframework.boot:spring-boot-starter-logging:jar:2.0.0.RC1:compile
> [INFO] | | | +- ch.qos.logback:logback-classic:jar:1.2.3:compile
> [INFO] | | | | \- ch.qos.logback:logback-core:jar:1.2.3:compile
> [INFO] | | | +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.10.0:compile
> [INFO] | | | | \- org.apache.logging.log4j:log4j-api:jar:2.10.0:compile
> [INFO] | | | \- org.slf4j:jul-to-slf4j:jar:1.7.25:compile
> [INFO] | | +- javax.annotation:javax.annotation-api:jar:1.3.1:compile
> [INFO] | | \-
[jira] [Commented] (BEAM-3718) ClassNotFoundException on CloudResourceManager$Builder
[
https://issues.apache.org/jira/browse/BEAM-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388279#comment-16388279
]
Raghu Angadi commented on BEAM-3718:
Assigned it to [~chamikara] for triaging. Looks like one of GCP dependencies
are missing or mismatched.
> ClassNotFoundException on CloudResourceManager$Builder
> --
>
> Key: BEAM-3718
> URL: https://issues.apache.org/jira/browse/BEAM-3718
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
>Reporter: Yunis Arif Said
>Assignee: Chamikara Jayalath
>Priority: Trivial
>
> In a spring boot application running google cloud dataflow code. The dataflow
> takes data from google PubSub, transform incoming data and output result to
> bigquery for storage. The code does not have any syntax errors. The problem
> is when the application is run, the following exception is thrown.
>
> {code:java}
> Exception in thread "main" java.lang.RuntimeException: Failed to construct
> instance from factory method DataflowRunner#fromOptions(interface
> org.apache.beam.sdk.options.PipelineOptions)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:233)
> at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:162)
> at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:52)
> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:142)
> at com.trackers.exlon.ExlonApplication.main(ExlonApplication.java:69)
>
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:222)
> ... 4 more
> Caused by: java.lang.NoClassDefFoundError:
> com/google/api/services/cloudresourcemanager/CloudResourceManager$Builder
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.newCloudResourceManagerClient(GcpOptions.java:369)
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:240)
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:228)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:592)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:533)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:156)
> at com.sun.proxy.$Proxy85.getGcpTempLocation(Unknown Source)
> at
> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:223)
> ... 9 more
> Caused by: java.lang.ClassNotFoundException:
> com.google.api.services.cloudresourcemanager.CloudResourceManager$Builder
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 17 more
> {code}
> Maven dependency tree:
> {code:java}
> [INFO] +-
> org.springframework.boot:spring-boot-starter-webflux:jar:2.0.0.RC1:compile
> [INFO] | +-
> org.springframework.boot:spring-boot-starter:jar:2.0.0.RC1:compile
> [INFO] | | +- org.springframework.boot:spring-boot:jar:2.0.0.RC1:compile
> [INFO] | | | \- org.springframework:spring-context:jar:5.0.3.RELEASE:compile
> [INFO] | | | +- org.springframework:spring-aop:jar:5.0.3.RELEASE:compile
> [INFO] | | | \-
> org.springframework:spring-expression:jar:5.0.3.RELEASE:compile
> [INFO] | | +-
> org.springframework.boot:spring-boot-autoconfigure:jar:2.0.0.RC1:compile
> [INFO] | | +-
> org.springframework.boot:spring-boot-starter-logging:jar:2.0.0.RC1:compile
> [INFO] | | | +- ch.qos.logback:logback-classic:jar:1.2.3:compile
> [INFO] | | | | \- ch.qos.logback:logback-core:jar:1.2.3:compile
> [INFO] | | | +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.10.0:compile
> [INFO] | | | | \- org.apache.logging.log4j:log4j-api:jar:2.10.0:compile
> [INFO] | | | \- org.slf4j:jul-to-slf4j:jar:1.7.25:compile
> [INFO] | | +- javax.annotation:javax.annotation-api:jar:1.3.1:compile
> [INFO] | | \- org.yaml:snakeyaml:jar:1.19:runtime
> [INFO] | +-
> org.springframework.boot:spring-boot-starter-json:jar:2.0.0.RC1:compile
> [INFO] | | +-
> com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.9.2:compile
> [INFO] | | +-
> com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.9.2:compile
> [INFO] | |
[jira] [Commented] (BEAM-3718) ClassNotFoundException on CloudResourceManager$Builder
[
https://issues.apache.org/jira/browse/BEAM-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387284#comment-16387284
]
Kenneth Knowles commented on BEAM-3718:
---
It looks like it has to do with GCP generally but since you mentioned Pubsub
I'm handing it to someone who knows a lot about it. [~chamikara] might be
another good person.
> ClassNotFoundException on CloudResourceManager$Builder
> --
>
> Key: BEAM-3718
> URL: https://issues.apache.org/jira/browse/BEAM-3718
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
>Reporter: Yunis Arif Said
>Assignee: Raghu Angadi
>Priority: Trivial
>
> In a spring boot application running google cloud dataflow code. The dataflow
> takes data from google PubSub, transform incoming data and output result to
> bigquery for storage. The code does not have any syntax errors. The problem
> is when the application is run, the following exception is thrown.
>
> {code:java}
> Exception in thread "main" java.lang.RuntimeException: Failed to construct
> instance from factory method DataflowRunner#fromOptions(interface
> org.apache.beam.sdk.options.PipelineOptions)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:233)
> at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:162)
> at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:52)
> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:142)
> at com.trackers.exlon.ExlonApplication.main(ExlonApplication.java:69)
>
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:222)
> ... 4 more
> Caused by: java.lang.NoClassDefFoundError:
> com/google/api/services/cloudresourcemanager/CloudResourceManager$Builder
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.newCloudResourceManagerClient(GcpOptions.java:369)
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:240)
> at
> org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:228)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:592)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:533)
> at
> org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:156)
> at com.sun.proxy.$Proxy85.getGcpTempLocation(Unknown Source)
> at
> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:223)
> ... 9 more
> Caused by: java.lang.ClassNotFoundException:
> com.google.api.services.cloudresourcemanager.CloudResourceManager$Builder
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 17 more
> {code}
> Maven dependency tree:
> {code:java}
> [INFO] +-
> org.springframework.boot:spring-boot-starter-webflux:jar:2.0.0.RC1:compile
> [INFO] | +-
> org.springframework.boot:spring-boot-starter:jar:2.0.0.RC1:compile
> [INFO] | | +- org.springframework.boot:spring-boot:jar:2.0.0.RC1:compile
> [INFO] | | | \- org.springframework:spring-context:jar:5.0.3.RELEASE:compile
> [INFO] | | | +- org.springframework:spring-aop:jar:5.0.3.RELEASE:compile
> [INFO] | | | \-
> org.springframework:spring-expression:jar:5.0.3.RELEASE:compile
> [INFO] | | +-
> org.springframework.boot:spring-boot-autoconfigure:jar:2.0.0.RC1:compile
> [INFO] | | +-
> org.springframework.boot:spring-boot-starter-logging:jar:2.0.0.RC1:compile
> [INFO] | | | +- ch.qos.logback:logback-classic:jar:1.2.3:compile
> [INFO] | | | | \- ch.qos.logback:logback-core:jar:1.2.3:compile
> [INFO] | | | +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.10.0:compile
> [INFO] | | | | \- org.apache.logging.log4j:log4j-api:jar:2.10.0:compile
> [INFO] | | | \- org.slf4j:jul-to-slf4j:jar:1.7.25:compile
> [INFO] | | +- javax.annotation:javax.annotation-api:jar:1.3.1:compile
> [INFO] | | \- org.yaml:snakeyaml:jar:1.19:runtime
> [INFO] | +-
> org.springframework.boot:spring-boot-starter-json:jar:2.0.0.RC1:compile
> [INFO] | | +-
> com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.9.2:compile
> [INFO] | | +-
>
