LPETIT458 opened a new issue, #7209:
URL: https://github.com/apache/hop/issues/7209
### Apache Hop version?
2.17.0
### Java version?
openjdk 17.0.14 2025-01-21 LTS
### Operating system
Linux
### What happened?
Description
When executing a pipeline on a remote Apache Hop Server, file paths used by
transforms are incorrectly resolved due to missing or improperly substituted
variables.
This results in invalid paths being used at runtime, even though the
variables are correctly defined in the local development environment.
Even when using:
Variables in paths → substitution fails or is incomplete
Hardcoded absolute paths → unexpected substitution still occurs
Environment variables
Project / environment configuration : variables only on env environment
(used or not in the pipeline)
Pipeline parameters : no variables
The resolved file path should match the one observed when running locally.
Actual Behavior
On the remote Hop Server:
Variables in file paths are not substituted correctly
In some cases, they appear empty or undefined with variables ${HOP_HOME} and
sometimes ${DATA_PATH_1} after???
This leads to incorrect or non-existent paths (e.g. /data//file.csv or raw
${VAR_NAME})
Steps to Reproduce:
Define a variable (e.g. ${INPUT_DIR}) in the project environment or
configuration
Use this variable inside a transform (e.g. Text File Input, CSV Input, etc.)
Deploy and execute the pipeline on a remote Hop Server
Observe that:
Variable substitution fails or is incomplete
The resulting path is invalid
Environment:
Apache Hop version: 2.17.0
Hop Server: Remote VM
OS: Linux
Execution mode: pipeline run configuration with hop remote pipeline engine,
hop server and run configuration = local
Project config: configuration without variables and path relative with
${PROJECT_HOME. Only use environment configuration file.
Additional Context :
The issue does not occur locally
It appears related to how variables are propagated or initialized on the Hop
Server
Example : with transformer "Text file output"
In the field Filename, if i enter in field Filename : "/path/filname.txt" or
"${PATH_DIR}/filename.txt with ${PATH_DIR} in env_config.json
It's OK in local run pipeline but in hop server, the path used is
${HOP_HOME]/${DATA_PATH_1}/filename.txt
Questions:
Why?
Is there a workaround for this problem?
### Issue Priority
Priority: 1
### Issue Component
Component: Hop Server
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
