Raja10D opened a new issue, #4752:
URL: https://github.com/apache/hop/issues/4752
### Apache Hop version?
2.61.0
### Java version?
17
### Operating system
Linux
### What happened?
I am reaching out to seek your assistance with an issue I am encountering
while running a simple Hop pipeline using the Beam Spark pipeline engine. The
pipeline executes without any issues when using the default local runner, but
it fails when I switch to the Beam Spark engine.
Below are the details of my setup:
Apache Beam Version: 2.61.0
Apache Spark Version: 3.5.1
Apache Hop Version: apache-hop-client-2.11.0
The error logs are as follows:
**Error:**
2025/01/02 15:30:53 - Hop - Pipeline opened.
2025/01/02 15:30:53 - Hop - Launching pipeline [hop_trans2]...
2025/01/02 15:30:53 - Hop - Started the pipeline execution.
java.lang.NoClassDefFoundError: org/apache/spark/metrics/source/Source
at java.base/java.lang.Class.getDeclaredMethods0(Native Method)
...
2025/01/02 15:30:53 - Hop - ERROR: hop_trans2: preparing pipeline execution
failed
2025/01/02 15:30:53 - Hop - ERROR:
org.apache.hop.core.exception.HopException:
2025/01/02 15:30:53 - Hop - Error preparing remote pipeline
2025/01/02 15:30:53 - Hop - Error converting Hop pipeline to Beam
2025/01/02 15:30:53 - Hop -
2025/01/02 15:30:53 - Hop - Caused by: java.lang.NoClassDefFoundError:
org/apache/spark/metrics/source/Source
2025/01/02 15:30:53 - Hop - at
java.base/java.lang.Class.getDeclaredMethods0(Native Method)
...
It appears that the issue is related to the
org.apache.spark.metrics.source.Source class not being found.
### Issue Priority
Priority: 3
### Issue Component
Component: Hop Config
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
