Zouxxyy commented on issue #6543: URL: https://github.com/apache/hudi/issues/6543#issuecomment-1236348644
> @Zouxxyy I try your method in #6563. The classloader result looks correct, AppClassLoader load the special class > > [arthas@14524]$ classloader -t +-BootstrapClassLoader +-sun.misc.Launcher$ExtClassLoader@7f77e91b +-com.taobao.arthas.agent.ArthasClassloader@67e8d194 +-sun.misc.Launcher$AppClassLoader@3fb4f649 +-org.apache.spark.util.MutableURLClassLoader@6f44a157 > > [arthas@14524]$ classloader -c 7f77e91b -load us.zoom.op.utils.OrderlyMergeRecordPayload load class error, class: us.zoom.op.utils.OrderlyMergeRecordPayload, error: java.lang.ClassNotFoundException: us.zoom.op.utils.OrderlyMergeRecordPayload > > [arthas@14524]$ classloader -c 3fb4f649 -load us.zoom.op.utils.OrderlyMergeRecordPayload load class success. class-info us.zoom.op.utils.OrderlyMergeRecordPayload name us.zoom.op.utils.OrderlyMergeRecordPayload super-class +-org.apache.hudi.common.model.OverwriteWithLatestAvroPayload +-org.apache.hudi.common.model.BaseAvroPayload +-java.lang.Object class-loader +-sun.misc.Launcher$AppClassLoader@3fb4f649 +-sun.misc.Launcher$ExtClassLoader@7f77e91b classLoaderHash 3fb4f649 > > [arthas@14524]$ classloader -c 6f44a157 -load us.zoom.op.utils.OrderlyMergeRecordPayload load class success. class-info us.zoom.op.utils.OrderlyMergeRecordPayload super-class +-org.apache.hudi.common.model.OverwriteWithLatestAvroPayload +-org.apache.hudi.common.model.BaseAvroPayload +-java.lang.Object class-loader +-sun.misc.Launcher$AppClassLoader@3fb4f649 +-sun.misc.Launcher$ExtClassLoader@7f77e91b classLoaderHash 3fb4f649 > > But my job result is still error Caused by: java.lang.ClassNotFoundException: us.zoom.op.utils.OrderlyMergeRecordPayload at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hudi.common.util.ReflectionUtils.getClass(ReflectionUtils.java:54) where do you add your customer jar? You can try putting it where your hudi-spark-bundle.jar is -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
