hi @luqmanahmad
I was thinking about it as well a little bit in my project... and I'm not
sure if the cluster group is the best direction here. One way to think
(probably) about efficient resource usage is to bring job stealing into your
cluster. In this case you do a "default" setup where data
Hi Christos,
Thanks for getting back to me.
There is no specific need for it - I am just trying to get my head around
for the best practices in that case data nodes does make sense to me to
perform the computation. To be honest just a bit confused with the Cluster
groups and trying to find a
Hi Luqman,
Is there a specific reason why you want to keep the data nodes separate from
the compute nodes?
As you say this beats the point of collocation. You should use the data nodes
for compute and ensure you have a way to monitor and kill spurious tasks that
may be executed on the grid.
Hi there,
Just trying to clarify few bits in my head around data nodes and compute
nodes.
Let's say we have 10 data nodes which are solely storing the data using
affinity collocation and we have 10 compute nodes as well for computing
different tasks on the cluster.
Now we know that if we want
