CarlosJuncher03 commented on issue #7992: URL: https://github.com/apache/hop/issues/7992#issuecomment-5327887367
This process would allow me to isolate a specific instance on a Kubernetes node. Imagine, for example, needing to extract a large volume of data from a database or an API—tasks that might involve multiple tables or endpoints. If I can distribute the workload so that specific pipeline tasks run on different nodes, each node processes a portion of the task instead of a single node handling everything. This way, I don't need to double the capacity of a single node; instead, I can use multiple smaller machines working in tandem. I actually tried setting this up using a Hop server, but since there is no automatic distribution, I would have to change my entire pipeline structure; plus, I would need to register separate metadata for each node and essentially use a `CASE` statement to direct the processing to each specific Hop server. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
