Raja10D commented on issue #4752: URL: https://github.com/apache/hop/issues/4752#issuecomment-2572428433
![Uploading Screenshot from 2025-01-06 12-31-38.png…]() If I am running my pipeline Hop-Gui itself it is causing error with Beam Spark Pipeline Engine **![Uploading Screenshot from 2025-01-06 12-31-53.png…]()** **Error in Hop-Gui:** 2025/01/06 12:17:47 - Hop - Pipeline opened. 2025/01/06 12:17:47 - Hop - Launching pipeline [hop_trans2]... 2025/01/06 12:17:47 - Hop - Started the pipeline execution. 2025/01/06 12:17:53 - Hop - ERROR: hop_trans2: preparing pipeline execution failed 2025/01/06 12:17:53 - Hop - ERROR: org.apache.hop.core.exception.HopException: 2025/01/06 12:17:53 - Hop - Error preparing remote pipeline 2025/01/06 12:17:53 - Hop - Error converting Hop pipeline to Beam 2025/01/06 12:17:53 - Hop - 2025/01/06 12:17:53 - Hop - at org.apache.hop.beam.engines.BeamPipelineEngine.prepareExecution(BeamPipelineEngine.java:296) 2025/01/06 12:17:53 - Hop - at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$preparePipeline$15(HopGuiPipelineGraph.java:4532) 2025/01/06 12:17:53 - Hop - at java.base/java.lang.Thread.run(Thread.java:840) 2025/01/06 12:17:53 - Hop - Caused by: java.lang.Exception: Error converting Hop pipeline to Beam 2025/01/06 12:17:53 - Hop - at org.apache.hop.beam.pipeline.HopPipelineMetaToBeamPipelineConverter.createPipeline(HopPipelineMetaToBeamPipelineConverter.java:308) 2025/01/06 12:17:53 - Hop - at org.apache.hop.beam.engines.BeamPipelineEngine.prepareExecution(BeamPipelineEngine.java:265) 2025/01/06 12:17:53 - Hop - ... 2 more 2025/01/06 12:17:53 - Hop - Caused by: java.lang.NoClassDefFoundError: org/apache/spark/metrics/source/Source 2025/01/06 12:17:53 - Hop - at java.base/java.lang.Class.getDeclaredMethods0(Native Method) 2025/01/06 12:17:53 - Hop - at java.base/java.lang.Class.privateGetDeclaredMethods(Class.java:3402) 2025/01/06 12:17:53 - Hop - at java.base/java.lang.Class.getDeclaredMethod(Class.java:2673) 2025/01/06 12:17:53 - Hop - at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:194) 2025/01/06 12:17:53 - Hop - at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:158) 2025/01/06 12:17:53 - Hop - at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55) 2025/01/06 12:17:53 - Hop - at org.apache.beam.sdk.Pipeline.create(Pipeline.java:158) 2025/01/06 12:17:53 - Hop - at org.apache.hop.beam.pipeline.HopPipelineMetaToBeamPipelineConverter.createPipeline(HopPipelineMetaToBeamPipelineConverter.java:283) 2025/01/06 12:17:53 - Hop - ... 3 more 2025/01/06 12:17:53 - Hop - Caused by: java.lang.ClassNotFoundException: org.apache.spark.metrics.source.Source 2025/01/06 12:17:53 - Hop - at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641) 2025/01/06 12:17:53 - Hop - at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188) 2025/01/06 12:17:53 - Hop - at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525) 2025/01/06 12:17:53 - Hop - ... 11 more -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
