Hi Kyriako, - If I want to pass data to callables, for example Lists of objects, small to -medium size (collections from 2000 to 6000 objects maximum, with average object size some ~200KBs) what is the best way to do this: to pass them as argument in callables or put them in the distributed cache for the callables to pick them up from there?
Regarding the question you ask about including the data with a job vs using the cache: ideally what you would like to do is use compute and data affinity collocation such that your computations are executed on nodes with the relevant data. I.e you should insert data into the cache with a certain affinity and then use an affinity run compute task to send the job to the correct node. Have a read here: https://apacheignite.readme.io/docs/affinity-collocation If you share more on your use case I should be able to help you! Regards, Christos On Wed, 15 Mar 2017 at 12:13, kmandalas <kyriakos.manda...@iriworldwide.com> wrote: Hello Ignite team, As we are evaluating potential usage of Ignite for our Analytics projects, I would like to ask the following: - *Compute Grid*: what is in practical difference between Distributed Closures and Executor Service? For example if I have computations that I want to distribute (multiple callables) and I want to take advantage of all cores of the cluster (based on the existing load of course) so I get *fast results*, is there a difference between using exec.submit() VS ignite.compute().call()? Moreover, if some distributed calculation is in progress and occupies all the cores of the cluster and in the meantime a new distributed calculation is requested, then what will happen? Is there some queue mechanism and how is it configured? Which is the best way to implement this? Is there need for a messaging queue or we could rely to thread pool sizes configurations etc. ? - If I want to pass data to callables, for example Lists of objects, small to -medium size (collections from 2000 to 6000 objects maximum, with average object size some ~200KBs) what is the best way to do this: to pass them as argument in callables or put them in the distributed cache for the callables to pick them up from there? Thank you. ------------------------------ View this message in context: Distributed Closures VS Executor Service <http://apache-ignite-users.70518.x6.nabble.com/Distributed-Closures-VS-Executor-Service-tp11192.html> Sent from the Apache Ignite Users mailing list archive <http://apache-ignite-users.70518.x6.nabble.com/> at Nabble.com.
