pranjal5215 opened a new issue, #29314:
URL: https://github.com/apache/beam/issues/29314
### What happened?
Command trying to run
```
mvn -e compile exec:java
-Dexec.mainClass=org.example.CurrentMedications
-Dexec.cleanupDaemonThreads=false
-Dexec.args="--runner=DataflowRunner \
--project=livewel-prod \
--stagingLocation=gs://g-prod-dataplatform/dataflow_temp/ \
--templateLocation=gs://g-prod-dataplatform/dataflow_scripts/pubsub_schema_metadata
\
--tempLocation=gs://g-prod-dataplatform/dataflow_temp/ \
--region=asia-south1" -P dataflow-runner
```
Maven Version
```
mvn --version
Apache Maven 3.9.5 (57804ffe001d7215b5e7bcb531cf83df38f93546)
Maven home: /usr/local/bin/apache-maven-3.9.5
Java version: 17.0.9, vendor: Oracle Corporation, runtime:
/usr/lib/jvm/jdk-17-oracle-x64
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "3.10.0-1160.90.1.el7.x86_64", arch: "amd64",
family: "unix"
```
Cent OS version
```
cat /etc/centos-release command
CentOS Linux release 7.9.2009 (Core)
cat: command: No such file or directory
```
Trying to execute
```
public static void main(String[] args) throws IOException {
StreamingSQLOptions options =
PipelineOptionsFactory.fromArgs(args).withValidation().as(StreamingSQLOptions.class);
options.setPlannerName("org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner");
final DateTimeFormatter TIMEFORMAT =
DateTimeFormatter.ofPattern("yyyy-MM-dd HH:mm:ss.SSS");
options.setTempLocation("gs://g-prod-dataplatform/dataflow_temp/");
options.setGcpTempLocation("gs://g-prod-dataplatform/dataflow_temp/");
Pipeline p = Pipeline.create(options);
.....
PCollectionTuple mergedJoinedData =
PCollectionTuple.of("PUBSUBSOURCE", pubSubSource).
.and("BQTABLE", bqTable);
PCollection<Row> result = mergedJoinedData
.apply("Join All Data", SqlTransform.query(
"select * from PUBSUBSOURCE JOIN BQTABLE"
);
```
Running mvn command above is failing with error
```
[ERROR] Failed to execute goal
org.codehaus.mojo:exec-maven-plugin:3.1.0:java (default-cli) on project
latest-dataflow-cookbook: An exception occurred while executing the Java class.
com.google.zetasql.ClientChannelProvider: Provider
com.google.zetasql.JniChannelProvider could not be instantiated:
/tmp/nativeutils11328790857771544/liblocal_service_jni.so: /lib64/libc.so.6:
version `GLIBC_2.25' not found (required by
/tmp/nativeutils11328790857771544/liblocal_service_jni.so) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.codehaus.mojo:exec-maven-plugin:3.1.0:java (default-cli) on project
latest-dataflow-cookbook: An exception occurred while executing the Java class.
com.google.zetasql.ClientChannelProvider: Provider
com.google.zetasql.JniChannelProvider could not be instantiated
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2
(MojoExecutor.java:333)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute
(MojoExecutor.java:316)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:174)
at org.apache.maven.lifecycle.internal.MojoExecutor.access$000
(MojoExecutor.java:75)
at org.apache.maven.lifecycle.internal.MojoExecutor$1.run
(MojoExecutor.java:162)
at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute
(DefaultMojosExecutionStrategy.java:39)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:159)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:105)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:73)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:53)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:118)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:77)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:568)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:283)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:226)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:407)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:348)
Caused by: org.apache.maven.plugin.MojoExecutionException: An exception
occurred while executing the Java class.
com.google.zetasql.ClientChannelProvider: Provider
com.google.zetasql.JniChannelProvider could not be instantiated
at org.codehaus.mojo.exec.ExecJavaMojo.execute (ExecJavaMojo.java:349)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:126)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2
(MojoExecutor.java:328)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute
(MojoExecutor.java:316)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:174)
at org.apache.maven.lifecycle.internal.MojoExecutor.access$000
(MojoExecutor.java:75)
at org.apache.maven.lifecycle.internal.MojoExecutor$1.run
(MojoExecutor.java:162)
at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute
(DefaultMojosExecutionStrategy.java:39)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:159)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:105)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:73)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:53)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:118)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:77)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:568)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:283)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:226)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:407)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:348)
Caused by: java.util.ServiceConfigurationError:
com.google.zetasql.ClientChannelProvider: Provider
com.google.zetasql.JniChannelProvider could not be instantiated
at java.util.ServiceLoader.fail (ServiceLoader.java:586)
at java.util.ServiceLoader$ProviderImpl.newInstance
(ServiceLoader.java:813)
at java.util.ServiceLoader$ProviderImpl.get (ServiceLoader.java:729)
at java.util.ServiceLoader$3.next (ServiceLoader.java:1403)
at com.google.zetasql.ClientChannelProvider.loadChannel
(ClientChannelProvider.java:31)
at com.google.zetasql.Client.getStub (Client.java:29)
at com.google.zetasql.LanguageOptions.getDefaultFeatures
(LanguageOptions.java:57)
at com.google.zetasql.LanguageOptions.<init> (LanguageOptions.java:65)
at com.google.zetasql.AnalyzerOptions.<init> (AnalyzerOptions.java:56)
at
org.apache.beam.sdk.extensions.sql.zetasql.SqlAnalyzer.baseAnalyzerOptions
(SqlAnalyzer.java:138)
at
org.apache.beam.sdk.extensions.sql.zetasql.SqlAnalyzer.getAnalyzerOptions
(SqlAnalyzer.java:162)
at org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLPlannerImpl.rel
(ZetaSQLPlannerImpl.java:80)
at
org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner.convertToBeamRelInternal
(ZetaSQLQueryPlanner.java:199)
at
org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner.convertToBeamRel
(ZetaSQLQueryPlanner.java:187)
at org.apache.beam.sdk.extensions.sql.impl.BeamSqlEnv.parseQuery
(BeamSqlEnv.java:112)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand
(SqlTransform.java:171)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand
(SqlTransform.java:110)
at org.apache.beam.sdk.Pipeline.applyInternal (Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform (Pipeline.java:499)
at org.apache.beam.sdk.values.PCollectionTuple.apply
(PCollectionTuple.java:263)
at org.example.CurrentMedications.main (CurrentMedications.java:204)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:279)
at java.lang.Thread.run (Thread.java:842)
Caused by: java.lang.UnsatisfiedLinkError:
/tmp/nativeutils11328790857771544/liblocal_service_jni.so: /lib64/libc.so.6:
version `GLIBC_2.25' not found (required by
/tmp/nativeutils11328790857771544/liblocal_service_jni.so)
at jdk.internal.loader.NativeLibraries.load (Native Method)
at jdk.internal.loader.NativeLibraries$NativeLibraryImpl.open
(NativeLibraries.java:388)
at jdk.internal.loader.NativeLibraries.loadLibrary
(NativeLibraries.java:232)
at jdk.internal.loader.NativeLibraries.loadLibrary
(NativeLibraries.java:174)
at java.lang.ClassLoader.loadLibrary (ClassLoader.java:2389)
at java.lang.Runtime.load0 (Runtime.java:755)
at java.lang.System.load (System.java:1953)
at com.google.zetasql.cz.adamh.utils.NativeUtils.loadLibraryFromJar
(NativeUtils.java:109)
at com.google.zetasql.JniChannelProvider.<clinit>
(JniChannelProvider.java:66)
at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0
(Native Method)
at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance
(NativeConstructorAccessorImpl.java:77)
at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance
(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstanceWithCaller
(Constructor.java:499)
at java.lang.reflect.Constructor.newInstance (Constructor.java:480)
at java.util.ServiceLoader$ProviderImpl.newInstance
(ServiceLoader.java:789)
at java.util.ServiceLoader$ProviderImpl.get (ServiceLoader.java:729)
at java.util.ServiceLoader$3.next (ServiceLoader.java:1403)
at com.google.zetasql.ClientChannelProvider.loadChannel
(ClientChannelProvider.java:31)
at com.google.zetasql.Client.getStub (Client.java:29)
at com.google.zetasql.LanguageOptions.getDefaultFeatures
(LanguageOptions.java:57)
at com.google.zetasql.LanguageOptions.<init> (LanguageOptions.java:65)
at com.google.zetasql.AnalyzerOptions.<init> (AnalyzerOptions.java:56)
at
org.apache.beam.sdk.extensions.sql.zetasql.SqlAnalyzer.baseAnalyzerOptions
(SqlAnalyzer.java:138)
at
org.apache.beam.sdk.extensions.sql.zetasql.SqlAnalyzer.getAnalyzerOptions
(SqlAnalyzer.java:162)
at org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLPlannerImpl.rel
(ZetaSQLPlannerImpl.java:80)
at
org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner.convertToBeamRelInternal
(ZetaSQLQueryPlanner.java:199)
at
org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner.convertToBeamRel
(ZetaSQLQueryPlanner.java:187)
at org.apache.beam.sdk.extensions.sql.impl.BeamSqlEnv.parseQuery
(BeamSqlEnv.java:112)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand
(SqlTransform.java:171)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand
(SqlTransform.java:110)
at org.apache.beam.sdk.Pipeline.applyInternal (Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform (Pipeline.java:499)
at org.apache.beam.sdk.values.PCollectionTuple.apply
(PCollectionTuple.java:263)
at org.example.CurrentMedications.main (CurrentMedications.java:204)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:279)
at java.lang.Thread.run (Thread.java:842)
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
```
### Issue Priority
Priority: 3 (minor)
### Issue Components
- [ ] Component: Python SDK
- [X] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
