Thanks Nikolai! Re: dynamic allocation - I was imagining that we would be able to dynamically scale the number of Ignite nodes up and down depending on the free resources available on your YARN cluster (similar to what Spark does). Bonus points if it leverages the YARN auxiliary service framework to persist/recover from local disk in case of preemption (Spark also does this with the external shuffle service).
- IGFS YARN setup Haithem Turki
- Re: IGFS YARN setup Haithem Turki
- Re: IGFS YARN setup Nikolai Tikhonov
- Re: IGFS YARN setup Haithem Turki
