mattcasters opened a new issue, #8909:
URL: https://github.com/apache/hop/issues/8909
### Apache Hop version?
2.20.0-SNAPSHOT
### Java version?
21
### Operating system
Linux
### What happened?
The Marketplace plugin classpath job fails on `hop-engines-spark`. It
installs each marketplace plugin onto the plain client and runs jdeps. The
Spark engine jar references `org.apache.hop.lakehouse`, and that package is not
on the classpath.
```
FAIL hop-engines-spark
org.apache.hop.spark.pipeline.handler ->
org.apache.hop.lakehouse.transforms
org.apache.hop.spark.table -> org.apache.hop.lakehouse
org.apache.hop.spark.table -> org.apache.hop.lakehouse.metadata
org.apache.hop.spark.table -> org.apache.hop.lakehouse.transforms
org.apache.hop.spark.util -> org.apache.hop.lakehouse
```
Those classes are in `hop-tech-lakehouse`. The plain client does not ship
that plugin, and the check does not install other marketplace plugins. The
engine links `LakeCatalog` and the lake table metadata classes when it builds a
session, so Spark does not start unless that jar is present.
The lakehouse plugin still has to be installed to register the lake table
transforms. The engine zip needs its own copy of the metadata jar so the check,
and a Spark-only install, can resolve the classes.
### Issue Priority
Priority: 2
### Issue Component
Component: Marketplace
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
