Re: Beam ML

2017-01-09 Thread Andrew Musselman
Hello Beam Team, Thought you might be interested in the work we've been doing on Mahout, such as the distributed linear algebra DSL/front-end that can use multiple back-ends for compute (Spark, Flink, H2O now). See https://mahout.apache.org/users/environment/out-of-core-reference.html for an intro

Re: splitIntoBundles vs. generateInitialSplits

2017-01-09 Thread Stas Levin
Definitely seems like the formatting got lost in translation, sorry about that :) I guess both cases (methods) create splits, which are essentially a list of bounded/unbounded source instances, each responsible for reading certain segments (physical or otherwise) of the data. On Mon, Jan 9, 2017

Re: splitIntoBundles vs. generateInitialSplits

2017-01-09 Thread Stephen Sisk
hi! I think your strikethrough got lost due to this being a text-only email list. To make sure, I think you're asking the following: " would it be reasonable to think of splitIntoBundles as generateSplits? " (ie, you strikethrough'd Initial) They are very similar and I definitely also think of th

Re: Beam ML

2017-01-09 Thread Kam Kasravi
Hi Vladisav I'm the author of the design document. An area we stalled on was creating a common low level linear algebra library that would also include optimizations like MKL but across platforms and GPUs. Additionally there are efforts underway that provide a scoring API vs a training API. -

Re: Better developer instructions for using Maven?

2017-01-09 Thread Robert Bradshaw
On Mon, Jan 9, 2017 at 3:49 AM, Aljoscha Krettek wrote: > I also usually prefer "mvn verify" to to the expected thing but I see that > quick iteration times are key. I see https://maven.apache.org/guides/introduction/introduction-to-the-lifecycle.html verify - run any checks on results of i

Re: Better developer instructions for using Maven?

2017-01-09 Thread Aljoscha Krettek
I also usually prefer "mvn verify" to to the expected thing but I see that quick iteration times are key. As long as the pre-commit hooks still check everything I'm ok with making the default a little more lightweight. On Thu, 5 Jan 2017 at 21:49 Lukasz Cwik wrote: > I was hoping that the defau