Re: Implementation of RNN/LSTM in Spark

2017-02-27 Thread Yuhao Yang
Welcome to try and contribute to our BigDL: https://github.com/intel-analytics/BigDL It's native on Spark and fast by leveraging Intel MKL. 2017-02-23 4:51 GMT-08:00 Joeri Hermans : > Hi Nikita, > > We are actively working on this: https://github.com/cerndb/dist-keras > This will allow you to ru

Re: [build system] emergency jenkins master reboot, got some wedged processes

2017-02-27 Thread shane knapp
we're back and things are much snappier! sorry for the downtime. On Mon, Feb 27, 2017 at 1:58 PM, shane knapp wrote: > the jenkins master is wedged and i'm going to reboot it to increase > it's happiness. > > more updates as they come. ---

[build system] emergency jenkins master reboot, got some wedged processes

2017-02-27 Thread shane knapp
the jenkins master is wedged and i'm going to reboot it to increase it's happiness. more updates as they come. - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Spark Improvement Proposals

2017-02-27 Thread Sean Owen
To me, no new process is being invented here, on purpose, and so we should just rely on whatever governs any large JIRA or vote, because SPIPs are really just guidance for making a big JIRA. http://apache.org/foundation/voting.html suggests that PMC members have the binding votes in general, and f

Re: Spark Improvement Proposals

2017-02-27 Thread Ryan Blue
I'd like to see more discussion on the issues I raised. I don't think there was a response for why voting is limited to PMC members. Tim was kind enough to reply with his rationale for a shepherd, but I don't think that it justifies failing proposals. I think it boiled down to "shepherds can be he

[Spark Core] How do Spark workers exchange data in standalone mode?

2017-02-27 Thread vdukic
Hello All, I want to know more about data exchange between Spark workers in standalone mode. Every time a task wants to read result of another task, I want to log that event. Information I need: source task / stage destination task / stage size of the data transfer So far I've manage