dubeyx commented on issue #12070:
URL: https://github.com/apache/hudi/issues/12070#issuecomment-2401880102
Hi @rangareddy thank you for suggesting but i got this error again with lots
of other logs
java.io.IOException: Could not load transformer class(es)
[com.example.mbk_transformer.hudi.DayTransform]
at
org.apache.hudi.utilities.UtilHelpers.createTransformer(UtilHelpers.java:218)
at
org.apache.hudi.utilities.streamer.StreamSync.<init>(StreamSync.java:304)
at
org.apache.hudi.utilities.streamer.HoodieStreamer$StreamSyncService.<init>(HoodieStreamer.java:707)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.<init>(HoodieStreamer.java:159)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.<init>(HoodieStreamer.java:131)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.main(HoodieStreamer.java:584)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1020)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:192)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:215)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1111)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1120)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.hudi.exception.HoodieException: Unable to load class
at
org.apache.hudi.common.util.ReflectionUtils.getClass(ReflectionUtils.java:58)
at
org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:68)
at
org.apache.hudi.utilities.transform.ChainedTransformer.<init>(ChainedTransformer.java:78)
at
org.apache.hudi.utilities.UtilHelpers.lambda$createTransformer$0(UtilHelpers.java:214)
at
org.apache.hudi.utilities.UtilHelpers.lambda$createTransformer$1(UtilHelpers.java:216)
at org.apache.hudi.common.util.Option.map(Option.java:108)
at
org.apache.hudi.utilities.UtilHelpers.createTransformer(UtilHelpers.java:216)
... 17 more
Caused by: java.lang.ClassNotFoundException:
com.example.mbk_transformer.hudi.DayTransform
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:594)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:315)
at
org.apache.hudi.common.util.ReflectionUtils.getClass(ReflectionUtils.java:55)
... 23 more
[8.945s][info][class,load ]
java.util.IdentityHashMap$IdentityHashMapIterator source: shared objects file
[8.945s][info][class,load ] java.util.IdentityHashMap$KeyIterator source:
shared objects file
[8.947s][info][class,load ] org.apache.hadoop.util.ShutdownHookManager$2
source:
file:/data/debezium/spark/spark-3.4.3-bin-hadoop3/jars/hadoop-client-api-3.3.4.jar
[8.947s][info][class,load ]
org.apache.spark.util.SparkShutdownHookManager$$Lambda$1264/0x0000000840a21040
source: org.apache.spark.util.SparkShutdownHookManager
[8.948s][info][class,load ]
org.apache.spark.util.SparkShutdownHookManager$$Lambda$1265/0x0000000840a21440
source: org.apache.spark.util.SparkShutdownHookManager
[8.948s][info][class,load ]
org.apache.spark.util.ShutdownHookManager$$$Lambda$1266/0x0000000840a21840
source: org.apache.spark.util.ShutdownHookManager$
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
