Hi,
i was running the apache beam pipeline in my local which was running well
and good. But when i try to run from emr cluster, i am getting the below
error. Can you please provide some suggestions on this?
Caused by: java.lang.Exception: The user defined 'open()' method caused an
exception: java.lang.NoClassDefFoundError: Could not initialize class
com.google.common.io.BaseEncoding
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:498)
at
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:368)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.beam.sdk.util.UserCodeException:
java.lang.NoClassDefFoundError: Could not initialize class
com.google.common.io.BaseEncoding
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:34)
at
io.condenast.de.ProcessDestinationSegmentsFn$DoFnInvoker.invokeSetup(Unknown
Source)
at
org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction.open(FlinkDoFnFunction.java:137)
at
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:494)
... 3 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class
com.google.common.io.BaseEncoding
at com.google.api.client.util.Base64.decodeBase64(Base64.java:101)
at
com.google.api.client.util.PemReader.readNextSection(PemReader.java:99)
at
com.google.api.client.util.PemReader.readFirstSectionAndClose(PemReader.java:128)
at
com.google.auth.oauth2.ServiceAccountCredentials.privateKeyFromPkcs8(ServiceAccountCredentials.java:255)
at
com.google.auth.oauth2.ServiceAccountCredentials.fromPkcs8(ServiceAccountCredentials.java:245)
at
com.google.auth.oauth2.ServiceAccountCredentials.fromJson(ServiceAccountCredentials.java:169)
at
com.google.auth.oauth2.GoogleCredentials.fromStream(GoogleCredentials.java:162)
at
com.google.auth.oauth2.GoogleCredentials.fromStream(GoogleCredentials.java:129)
at
io.condenast.de.ProcessDestinationSegmentsFn.setup(ProcessDestinationSegmentsFn.java:41)
Regards,
Jitendra Sharma
