Re: Speeding up Anaconda deployment on executors

2018-05-27 Thread Nadav Har Tzvi
I am kinda inclined towards a solution that could be performed at setup time. Let's try to explore in that direction. If we manage to nail this at setup time, it means that the runtime will be lightning fast (compared to what it is now :)) Cheers, Nadav On 28 May 2018 at 00:17, Nadav Har Tzvi

Re: AMATERASU-24

2018-05-27 Thread Arun Manivannan
Hi Yaniv, Nadiv and all, Not sure if PR is the best way to initiate a discussion on the code but I just managed to raise one based on my forked remote branch. https://github.com/apache/incubator-amaterasu/pull/22 https://github.com/arunma/incubator-amaterasu/tree/AMATERASU-24-FrameworkRefactor

[jira] [Commented] (AMATERASU-24) Refactor Spark out of Amaterasu executor to it's own project

2018-05-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AMATERASU-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491973#comment-16491973 ] ASF GitHub Bot commented on AMATERASU-24: - arunma opened a new pull request #22: AMATERASU-24

Re: Amaterasu PyCon il Presentation

2018-05-27 Thread Arun Manivannan
Looks great !! I suppose this will be accompanied by a Demo. On Sun, May 27, 2018 at 5:49 PM Yaniv Rodenski wrote: > Hi All, > > @Nadav is giving an intro to Amaterasu @ PyCon Israel next week and we > thought everyone here might like to have the deck > < >

[GitHub] arunma opened a new pull request #22: AMATERASU-24 Refactor Spark out of Amaterasu executor to it's own pro…

2018-05-27 Thread GitBox
arunma opened a new pull request #22: AMATERASU-24 Refactor Spark out of Amaterasu executor to it's own pro… URL: https://github.com/apache/incubator-amaterasu/pull/22 …ject This is an automated message from the Apache Git

Amaterasu PyCon il Presentation

2018-05-27 Thread Yaniv Rodenski
Hi All, @Nadav is giving an intro to Amaterasu @ PyCon Israel next week and we thought everyone here might like to have the deck and may be present somewhere :) Cheers, -- Yaniv Rodenski +61 477 778 405

Re: AMATERASU-24

2018-05-27 Thread Arun Manivannan
Hi Nadav, Absolutely. This sounds fantastic. I am really keen to understand more on this and would be happy to help where I can to move this forward. Yes, It would be great if we could have a different discussion thread on this (or preferably a meeting). Let me quickly push a branch for your