Re: Load balancing strategy/thoughts

2019-04-01 Thread Jean-Sebastien Vachon
Hi, The few final steps/processes of my flow is to produce a final file containing the information that was computed in the various processors and save them into a single file to be delivered to a customer. I would rather send them one larger file instead of many small ones. Thanks for your co

Re: Load balancing strategy/thoughts

2019-04-01 Thread Bryan Bende
Hello, Is there a reason why it has to be brought back to the same original node? As long as MergeContent is scheduled on all nodes, then you can choose "Single node" strategy for the queue leading into MergeContent, and one of the nodes will get all the pieces and can do the merge/defragment. -

Load balancing strategy/thoughts

2019-04-01 Thread Jean-Sebastien Vachon
Hi all, over the last couple of days, I've been playing with the different load balancing options. They all seem to do what they are designed for but I have a small issue and I am not sure how to deal with this... Let's say I have a process A which output is load balanced on all the nodes wit