Thanks Nikolai! Re: dynamic allocation - I was imagining that we would be
able to dynamically scale the number of Ignite nodes up and down depending
on the free resources available on your YARN cluster (similar to what Spark
does). Bonus points if it leverages the YARN auxiliary service framework to
persist/recover from local disk in case of preemption (Spark also does this
with the external shuffle service).

Reply via email to