Re: Is Mahout obsolete now?

2015-10-19 Thread Suneel Marthi
Thanks Sean. Samsara is the new distributed linear algebra DSL that is engine agnostic and presently support Spark and H2O (Flink is in the works). We do have Recommenders built on top of Samsara today. On Mon, Oct 19, 2015 at 3:42 PM, Sean Owen wrote: > No, this is pretty

Is Mahout obsolete now?

2015-10-19 Thread Prasad Priyadarshana Fernando
Hi, If I have used Mahout for my recommendation application, should I migrate into Spark MLib technology? Is the mahout still supported and migrated? Thanks *Prasad Priyadarshana Fernando * Mobile: +1 330 283 5827

Re: Is Mahout obsolete now?

2015-10-19 Thread Ankit Goel
Hi, I had asked something similar in the past, and I got a reply which helped me make my decision. Mahout started out as a ML library, but the direction it is taking now is to allow people to make their own math. So its becoming more of a platform that supports Spark library among others, and

Re: Is Mahout obsolete now?

2015-10-19 Thread Suneel Marthi
This is so inaccurate and not true. You obviously have not been following Mahout project. Mahout has long moved away from MapReduce and presently support Spark, H2O and in future Flink as execution engines. I would suggest you look at the recent Mahout 0.11.0 and see where the project is before

Re: Is Mahout obsolete now?

2015-10-19 Thread Suneel Marthi
Hi Prasad, As Sean has explained in an earlier posting on this thread, Mahout 0.9 and earlier which were MapReduce based are not supported anymore. We do have recommenders in Mahout 0.11.0 that have been built on the new Samsara Math DSL. Definitely would suggest that you check out the latest

Re: Is Mahout obsolete now?

2015-10-19 Thread Fei Shan
Spark is a in memory , near realtime Machine Learning frameowork , has scala and java interface Mahout is an offline Machine Learning framework, no scala apis they both built on the HDFS and Hadoop engine Spark has an ecosystem like Hadoop Mahout is part of of Hadoop ecosystem Spark could beat

Re: Is Mahout obsolete now?

2015-10-19 Thread Sean Owen
No, this is pretty wrong. Spark is not, in general, a real-time anything. Spark Streaming is a near-real-time streaming framework, but it is not something you can build models with. Spark MLlib / ML are offline / batch. Not sure what you mean by Hadoop engine, but Spark does not build on

Re: Is Mahout obsolete now?

2015-10-19 Thread Dmitriy Lyubimov
On Mon, Oct 19, 2015 at 3:29 PM, Pat Ferrel wrote: > Even have code running using the PredicitonIO framework. This includesa > SDK to event store to realtime query. Loosely speaking a lambda > architecture. Most of the whole enchilada running except the content part > of

Re: Is Mahout obsolete now?

2015-10-19 Thread Pat Ferrel
BTW this use of Mahout-Samsara on Spark for recs has really expanded. The Samsara part I’m calling a Correlation Engine, it can be used to mix usage, content, and context to make recs. I look back on 2 years ago as pretty much groping around for solutions. Things are much clearer now (for me at

Re: Is Mahout obsolete now?

2015-10-19 Thread Dmitriy Lyubimov
Both. as before though with mapreduce, distributed algorithms are not just naive translations of traditional in-memory algorithms. On Mon, Oct 19, 2015 at 8:46 PM, go canal wrote: > I am now curious to know if Spark or Mahout is Out-Of-Core or In-Core > solution ?

Re: Is Mahout obsolete now?

2015-10-19 Thread go canal
I am now curious to know if Spark or Mahout is Out-Of-Core or In-Core solution ? Specifically, for matrix multiplication and factorization. thanks, canal On Tuesday, October 20, 2015 6:37 AM, Dmitriy Lyubimov wrote: On Mon, Oct 19, 2015 at 3:29 PM, Pat Ferrel