pauloricardoferreira opened a new issue, #9100: URL: https://github.com/apache/hop/issues/9100
### Apache Hop version? 2.18.1 ### Java version? 21.0.11 ### Operating system Docker ### What happened? When executing a pipeline on a remote Hop Server using the Remote Pipeline Engine, the execution fails because the REST Client transform cannot find an existing REST Connection metadata definition. The REST Connection metadata was created and configured in Apache Hop GUI, and the pipeline was configured to execute on a remote Hop Server running inside a Docker container. The Docker environment has the necessary directories and configurations mapped through volumes. However, during remote execution, the REST Client transform fails to initialize because the REST Connection metadata cannot be found. Environment Apache Hop version: 2.18.1 Execution engine: Remote Pipeline Engine Remote server: Apache Hop Server Deployment: Docker container Hop Server authentication: Basic Authentication enabled Hop Server project: default Remote run configuration: hop-server-pipeline Steps to Reproduce Open Apache Hop GUI (version 2.18.1). Create a new REST Connection under the Metadata section. Configure the REST Connection with the required endpoint and authentication settings. Create and configure a connection to a remote Hop Server. Create a pipeline containing a REST Client transform. Configure the REST Client transform to use the previously created REST Connection metadata. Configure the pipeline to execute using the Remote Pipeline Engine. Execute the pipeline on the remote Hop Server running in Docker. Expected Behavior The remote Hop Server should be able to resolve and load the REST Connection metadata, provided that the corresponding metadata is available in the configured project/environment. The REST Client transform should initialize successfully, allowing the pipeline to execute. Actual Behavior The pipeline fails during initialization because the REST Client transform cannot locate the configured REST Connection metadata. The following error is returned: Error preparing remote pipeline There was an error preparing the pipeline for execution on the remote server: Initialisation of pipeline failed REST client 2.0 - ERROR: Error initializing transform [REST client 2] org.apache.hop.core.exception.HopRuntimeException: REST connection ENVIAR_EMAIL_NAO_RESPONSA_AGROTERENAS could not be found at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:921) Transform [REST client 2.0] failed to initialize! HopException: We failed to initialize at least one transform. Execution can not begin! The remote Hop Server itself starts successfully and accepts the pipeline execution request. The failure occurs during REST Client transform initialization. Additional Information The Hop Server is running inside a Docker container. The required directories and configurations are mapped using Docker volumes. The REST Connection metadata is configured in Apache Hop GUI. The remote pipeline execution reaches the Hop Server, but fails when resolving the REST Connection metadata. The error occurs before the pipeline begins processing data. Questions Is REST Connection metadata expected to be automatically transferred to the remote Hop Server when executing a pipeline using the Remote Pipeline Engine? Does REST Connection metadata require additional configuration or explicit registration on the remote Hop Server? Could this behavior indicate an issue with metadata resolution in Apache Hop 2.18.1? Are there additional configuration requirements for loading REST Connection metadata when running Hop Server inside Docker? Attachments Screenshots will be attached showing: REST Connection metadata configuration <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/10f5b29e-21cc-4ef3-af28-f08dffb04bc3"; /> Remote Hop Server connection configuration <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/3feb9f43-b1b7-44fc-930d-6e11e10d5b3e"; /> Pipeline and REST Client transform configuration <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/f3b8ce43-0dbb-45bf-a004-4fe79814dfeb"; /> Remote pipeline execution configuration <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/607f78a3-87c7-4644-9d12-4ee01cabe61a"; /> Error message and execution logs 2026/10/23 19:48:00 [Basic] Hop - Pipeline opened. 2026/10/23 19:48:00 [Basic] Hop - Launching pipeline [INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR]... 2026/10/23 19:48:00 [Basic] Hop - Started executing pipeline 'INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR'. 2026/10/23 19:48:00 [Basic] INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Executing this pipeline using the Remote Pipeline Engine with run configuration 'hop-server-pipeline' 2026/10/23 19:48:00 [Error] Hop - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR: preparing pipeline execution failed 2026/10/23 19:48:00 [Error] Hop - org.apache.hop.core.exception.HopException: 2026/10/23 19:48:00 [Error] Hop - Error preparing remote pipeline 2026/10/23 19:48:00 [Error] Hop - 2026/10/23 19:48:00 [Error] Hop - There was an error preparing the pipeline for execution on the remote server: 2026/10/23 19:48:00 [Error] Hop - Initialisation of pipeline failed: 2026/10/23 19:44:41 - HopServer - Enabling project 'default'2026/10/23 19:44:41 - HopServer - Installing timer to purge stale objects after 1440 minutes.2026/10/23 19:44:42 - HopServer - Hop Server: Basic authentication is ENABLED2026/10/23 19:44:42 - HopServer - Created listener for webserver @ address : 0.0.0.0:80802026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Execution started for pipeline [INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR]2026/10/23 19:48:00 - REST client 2.0 - ERROR: Error initializing transform [REST client 2]2026/10/23 19:48:00 - REST client 2.0 - ERROR: org.apache.hop.core.exception.HopRuntimeException: REST connection ENVIAR_EMAIL_NAO_RESPONSA_AGROTERENAS could not be found2026/10/23 19:48:00 - REST client 2. 0 - 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:921)2026/10/23 19:48:00 - REST client 2.0 - 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:74)2026/10/23 19:48:00 - REST client 2.0 - 2026/10/23 19:48:00 [Error] Hop - at java.base/java.lang.Thread.run(Thread.java:1583)2026/10/23 19:48:00 - Table output.0 - Connected to database [BASEMYSQL_PROJURIS] (commit=1000)2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - ERROR: Transform [REST client 2.0] failed to initialize!2026/10/23 19:48:00 - Table input.0 - Finished reading query, closing connection.HopException: We failed to initialize at least one transform. Execution can not begin!Root cause: HopException: We failed to initialize at least one transform. Execution can not begin!org.apache.hop.core.exception.HopException: We failed to initialize at least one transform. Execution can not begin! 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.Pipeline.prepareExecution(Pipeline.java:1117) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.prepareExecution(LocalPipelineEngine.java:236) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.www.PrepareExecutionPipelineServlet.doGet(PrepareExecutionPipelineServlet.java:145) 2026/10/23 19:48:00 [Error] Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:633) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.www.BaseHttpServlet.service(BaseHttpServlet.java:112) 2026/10/23 19:48:00 [Error] Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:723) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHolder.handle(ServletHolder.java:750) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1668) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$MappedServlet.handle(ServletHandler.java:1602) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.dispatch(ServletChannel.java:868) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.handle(ServletChannel.java:449) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler.handle(ServletHandler.java:470) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.SessionHandler.handle(SessionHandler.java:763) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1224) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:178) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.Handler$Sequence.handle(Handler.java:859) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:546) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.Server.handle(Server.java:197) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:787) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:420) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.internal.HttpConnection$FillableCallback.succeeded(HttpConnection.java:1809) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:54) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:492) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.epcRunTask(AdaptiveExecutionStrategy.java:428) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:401) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:255) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:204) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:317) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:1009) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1239) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1194) 2026/10/23 19:48:00 [Error] Hop - at java.base/java.lang.Thread.run(Thread.java:1583) 2026/10/23 19:48:00 [Error] Hop - 2026/10/23 19:48:00 [Error] Hop - 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.engines.remote.RemotePipelineEngine.prepareExecution(RemotePipelineEngine.java:266) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$preparePipeline$21(HopGuiPipelineGraph.java:4828) 2026/10/23 19:48:00 [Error] Hop - at java.base/java.lang.Thread.run(Thread.java:1583) 2026/10/23 19:48:00 [Error] Hop - Caused by: org.apache.hop.core.exception.HopException: 2026/10/23 19:48:00 [Error] Hop - There was an error preparing the pipeline for execution on the remote server: 2026/10/23 19:48:00 [Error] Hop - Initialisation of pipeline failed: 2026/10/23 19:44:41 - HopServer - Enabling project 'default'2026/10/23 19:44:41 - HopServer - Installing timer to purge stale objects after 1440 minutes.2026/10/23 19:44:42 - HopServer - Hop Server: Basic authentication is ENABLED2026/10/23 19:44:42 - HopServer - Created listener for webserver @ address : 0.0.0.0:80802026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Execution started for pipeline [INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR]2026/10/23 19:48:00 - REST client 2.0 - ERROR: Error initializing transform [REST client 2]2026/10/23 19:48:00 - REST client 2.0 - ERROR: org.apache.hop.core.exception.HopRuntimeException: REST connection ENVIAR_EMAIL_NAO_RESPONSA_AGROTERENAS could not be found2026/10/23 19:48:00 - REST client 2. 0 - 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:921)2026/10/23 19:48:00 - REST client 2.0 - 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:74)2026/10/23 19:48:00 - REST client 2.0 - 2026/10/23 19:48:00 [Error] Hop - at java.base/java.lang.Thread.run(Thread.java:1583)2026/10/23 19:48:00 - Table output.0 - Connected to database [BASEMYSQL_PROJURIS] (commit=1000)2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - ERROR: Transform [REST client 2.0] failed to initialize!2026/10/23 19:48:00 - Table input.0 - Finished reading query, closing connection.HopException: We failed to initialize at least one transform. Execution can not begin!Root cause: HopException: We failed to initialize at least one transform. Execution can not begin!org.apache.hop.core.exception.HopException: We failed to initialize at least one transform. Execution can not begin! 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.Pipeline.prepareExecution(Pipeline.java:1117) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.prepareExecution(LocalPipelineEngine.java:236) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.www.PrepareExecutionPipelineServlet.doGet(PrepareExecutionPipelineServlet.java:145) 2026/10/23 19:48:00 [Error] Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:633) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.www.BaseHttpServlet.service(BaseHttpServlet.java:112) 2026/10/23 19:48:00 [Error] Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:723) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHolder.handle(ServletHolder.java:750) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1668) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$MappedServlet.handle(ServletHandler.java:1602) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.dispatch(ServletChannel.java:868) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.handle(ServletChannel.java:449) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler.handle(ServletHandler.java:470) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.ee11.servlet.SessionHandler.handle(SessionHandler.java:763) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1224) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:178) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.Handler$Sequence.handle(Handler.java:859) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:546) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.Server.handle(Server.java:197) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:787) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:420) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.server.internal.HttpConnection$FillableCallback.succeeded(HttpConnection.java:1809) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:54) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:492) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.epcRunTask(AdaptiveExecutionStrategy.java:428) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:401) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:255) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:204) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:317) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:1009) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1239) 2026/10/23 19:48:00 [Error] Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1194) 2026/10/23 19:48:00 [Error] Hop - at java.base/java.lang.Thread.run(Thread.java:1583) 2026/10/23 19:48:00 [Error] Hop - 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.engines.remote.RemotePipelineEngine.sendToHopServer(RemotePipelineEngine.java:395) 2026/10/23 19:48:00 [Error] Hop - at org.apache.hop.pipeline.engines.remote.RemotePipelineEngine.prepareExecution(RemotePipelineEngine.java:262) 2026/10/23 19:48:00 [Error] Hop - ... 2 more Thank you for your assistance! ### Issue Priority Priority: 3 ### Issue Component Component: Other, Component: Containers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
