Thanks Andrew
I think more information about the DRM operations and how persistence would be
done at the runner level. It looks like HDFS or spark caching is currently
being used?
On Monday, January 9, 2017 6:04 PM, Andrew Musselman <a...@apache.org>
wrote:
Hello Beam Team,
Thought you might be interested in the work we've been doing on Mahout,
such as the distributed linear algebra DSL/front-end that can use multiple
back-ends for compute (Spark, Flink, H2O now). See
https://mahout.apache.org/users/environment/out-of-core-reference.html for
an intro.
We also are working on native CPU/GPU hybrid support and we're close to an
initial release. Let us know if you'd like to know more.
Thanks and best of luck!
Best
Andrew Musselman
On 2017-01-09 12:00 (-0800), Kam Kasravi <kamkasr...@gmail.com> wrote:
> Hi Vladisav
>
> I'm the author of the design document. An area we stalled on was creating
a
> common low level linear algebra library that would also include
> optimizations like MKL but across platforms and GPUs.
> Additionally there are efforts underway that provide a scoring API vs a
> training API.
>
> - PredictionIO http://predictionio.incubator.apache.org/ (now part of
> Salesforce)
> - MLeap https://github.com/combust/mleap
> - PFA - Portable Format for Analytics http://dmg.org/pfa/
>
> Any ML effort needs to also include deep learning and the ability to
> integrate various types of neural networks. Apache has several early
> efforts in this regard (mxnet, singa).
>
> Thanks
> Kam
>
> On Fri, Jan 6, 2017 at 7:07 AM, Vladisav Jelisavcic <vladis...@gmail.com>
> wrote:
>
> > Hi everyone,
> >
> > what is the current status on BEAM-478 and BEAM-303 (machine learning
> > learning DSL and related functions)?
> > I would like to start contributing in this direction.
> >
> > I found this design document:
> > https://docs.google.com/document/d/17cRZk_yqHm3C0fljivjN66MbLkeKS1yjo4PB
> > ECHb-xA/edit#heading=h.n51rhya8bv4f
> >
> > Are there any other docs/advances related to this?
> >
> >
> > Best regards,
> > Vladisav
> >
>
