[GitHub] roadan opened a new pull request #35: Adding getActionResources and getActionDependencies

2018-10-20 Thread GitBox
roadan opened a new pull request #35: Adding getActionResources and getActionDependencies URL: https://github.com/apache/incubator-amaterasu/pull/35 This is an automated message from the Apache Git Service. To respond to

[DISCUSS] Common dependencies formats

2018-10-20 Thread Nadav Har Tzvi
Hey everyone, In both conventions I spoke in (PyCon-IL and SDP) the participants were inquiring about why we don't use common formats to specify job dependencies (e.g. - requirements.txt in Python). I want to bring this matter for discussion. What can we do to conform better with the developers

[DISCUSS] Dependencies resolution and action level dependencies

2018-10-20 Thread Nadav Har Tzvi
Hey everyone, Yaniv and I were just discussing how to resolve dependencies in the new frameworks architecture and integrate the dependencies with the concrete cluster resource manager (Mesos/YARN) We rolled with the idea of each runner (or base runner) performing the dependencies resolution on