Re: [DISCUSS] Dependencies resolution and action level dependencies

2018-10-23 Thread Yaniv Rodenski
Excellent, I've added: AMATERASU-53 - Support action level dependencies AMATERASU-54 - Use Docker for Mesos containerization I suggest we review after AMATERASU-54 how to approach the YARN

[DISCUSS] Dependencies resolution and action level dependencies

2018-10-20 Thread Nadav Har Tzvi
Hey everyone, Yaniv and I were just discussing how to resolve dependencies in the new frameworks architecture and integrate the dependencies with the concrete cluster resource manager (Mesos/YARN) We rolled with the idea of each runner (or base runner) performing the dependencies resolution on