On Thu, Mar 12, 2015 at 06:04AM, jay vyas wrote: > Hi david ! > > We found that mahout 0.9 , iirc, was released incompatible with Yarn at the > time, and there wasn't any commandline option that you could run when > compiling which fixed that issue. So that really made us realize we needed > community to participate with us. > > 1) I've reached out to the mahout community, and maybe they will join > forces with us before it is dropped, but for us, we simply have too many > other priorities and nobody from the mahout community was interested in > collaborating with us on package testing in bigtop... So much like fedora, > debian, and so , once the curators of the have no interest in packaging it, > it becomes hard to keep in the distro. > > 2) Are you interested in maintaining mahout packaging in bigtop? That > might be a nice addition to your thesis . It also would give you some > interesting insight into the libraries that mahout uses, and how it uses > hadoop APIs, etc... I'd be able to help you get up to speed with the basics > of building bigtop if you have that interest. > > 3) RE: W/o bigtop, you can always build/compile/install mahout from source > or from tarballs if need be. however this tends to be an annoying thing to > maintain and manually make sure it interoperates with your yarn distro > etc....
Not to say that the same compatiblity issue between Hadoop 2.x and Mahout will still be there when you build it yourself. Cos > On Thu, Mar 12, 2015 at 1:57 AM, David Starina <[email protected]> > wrote: > > > Hi guys, > > > > I'm just an observer, a passer-by you might say (for now) of this mailing > > list, so I hope you won't mind me commenting on this. I was planning to use > > Hadoop with Mahout in my thesis, so this thread kind of freaked me out. > > Since you are mentioning the two pieces of software are incompatible - does > > that mean it is not possible to get them to work together, or just that it > > requires some extra effort? Also, there are some algorithms that work with > > Spark - do you know whether those still work with recent versions of Spark? > > Is there a lot of work to manually install Mahout without Bigtop? > > > > Anyhow, hope the Mahout guys find their focus again. > > > > Best regards, > > David > > > > > > On Thursday, March 12, 2015, jay vyas <[email protected]> wrote: > > > >> okay, lets drop it... Im fine with that. > >> > >> On Wed, Mar 11, 2015 at 7:49 PM, Konstantin Boudnik <[email protected]> > >> wrote: > >> > >>> But the last time, back in 0.8, we found that runtime is pretty broken. > >>> So, is > >>> there any real reason to keep on pushing an incompatible piece of > >>> software? > >>> > >>> Cos > >>> > >>> On Tue, Mar 10, 2015 at 09:42AM, jay vyas wrote: > >>> > At this point we can just keep packaging as is, but if bugs crop > >>> up, drop > >>> > it unless we can get help > >>> > On Mon, Mar 9, 2015 at 11:49 PM, Konstantin Boudnik <[email protected] > >>> > > >>> > wrote: > >>> > > >>> > Should read > >>> > > >>> > So, anyone is interested to maintain Mahout OR a thing of similar > >>> > nature? > >>> > > >>> > Sorry > >>> > On Mon, Mar 09, 2015 at 08:45PM, Konstantin Boudnik wrote: > >>> > > So, anyone is interested to maintain Mahout and a thing of > >>> similar > >>> > nature? > >>> > > >>> > > > >>> > > Cos > >>> > > > >>> > > On Sat, Mar 07, 2015 at 02:13AM, Konstantin Boudnik wrote: > >>> > > > I think it eventually boils down to who will be maintaining > >>> the > >>> > component. > >>> > > > > >>> > > > As Jay said - there's maintainer for the component and if it > >>> will > >>> > continue > >>> > > > like this we might have no choice but delete it: I think > >>> right now > >>> > it blocks > >>> > > > the release. > >>> > > > > >>> > > > Cos > >>> > > > > >>> > > > On Fri, Mar 06, 2015 at 02:29PM, Ed - 0x1b wrote: > >>> > > > > some links to some of Mahout's replacements - not all Apache > >>> > projects. > >>> > > > > > >>> > > > > > >>> > > >>> https://gigaom.com/2014/03/27/apache-mahout-hadoops-original-machine-learning-project-is-moving-on-from-mapreduce/ > >>> > > > > http://0xdata.com/ > >>> > > > > https://spark.apache.org/mllib/ > >>> > > > > > >>> > > >>> https://databricks.com/blog/2014/06/30/sparkling-water-h20-spark.html > >>> > > > > https://github.com/apache/mahout/tree/master/h2o > >>> > > > > > >>> > > > > and > >>> > > > > > >>> > > > > > >>> > > >>> https://gigaom.com/2014/02/28/cloudera-is-rebuilding-machine-learning-for-hadoop-with-oryx/ > >>> > > > > > >>> > > > > On Fri, Mar 6, 2015 at 12:47 PM, Konstantin Boudnik > >>> > <[email protected]> wrote: > >>> > > > > > Thanks man! I've heard that there's a new project that > >>> picks up > >>> > where Mahout > >>> > > > > > left of wrt Hadoop2.x support. But might be I am just > >>> delusional > >>> > from > >>> > > > > > hunger...? > >>> > > > > > > >>> > > > > > On Fri, Mar 06, 2015 at 02:32PM, jay vyas wrote: > >>> > > > > >>A A i sent a email to mahout-dev... maybe someone will > >>> ping > >>> > back :) > >>> > > > > >>A A On Fri, Mar 6, 2015 at 2:25 PM, Jay Vyas > >>> > <[email protected]> > >>> > > > > >>A A wrote: > >>> > > > > >> > >>> > > > > >>A A A Iirc we don't have any maintainers for it. > >>> > > > > >>A A A Is anyone interested in maintaining it? > >>> > > > > >>A A A > On Mar 6, 2015, at 2:23 PM, Konstantin Boudnik > >>> > <[email protected]> wrote: > >>> > > > > >>A A A > > >>> > > > > >>A A A > Does anyone know what's the story with Mahout? > >>> Has it > >>> > been fixed to be > >>> > > > > >>A A A working > >>> > > > > >>A A A > with Hadoop2 or shall we remove it from the > >>> BOM? > >>> > > > > >>A A A > > >>> > > > > >>A A A > Cos > >>> > > > > >>A A A > > >>> > > > > >>A A A >> On Sat, Feb 28, 2015 at 06:56PM, Konstantin > >>> Boudnik > >>> > wrote: > >>> > > > > >>A A A >> Guys, > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> It'd be great if we can have the next release > >>> ready > >>> > by ApacheCon in > >>> > > > > >>A A A April. > >>> > > > > >>A A A >> Think about all the PR and publicity we can > >>> get > >>> > without any effort on > >>> > > > > >>A A A our own. > >>> > > > > >>A A A >> And perhaps from the tactical standpoint we > >>> shall > >>> > call this release > >>> > > > > >>A A A 1.0? > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> I believe the only major hurdle between us > >>> and the > >>> > release is CI. > >>> > > > > >>A A A Roman, I > >>> > > > > >>A A A >> understand you're busy elsewhere, but could > >>> you > >>> > please let us know > >>> > > > > >>A A A what else > >>> > > > > >>A A A >> needs to be done before we can start doing the > >>> > regular builds and how > >>> > > > > >>A A A the > >>> > > > > >>A A A >> community can help. That's the highest > >>> priority, > >>> > IMO. > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> There a couple of the tickets left > >>> > unfixed/unassigned on BIGTOP-1480, > >>> > > > > >>A A A and if > >>> > > > > >>A A A >> they aren't resolved on time we can move them > >>> > farther. There's lesser > >>> > > > > >>A A A than a > >>> > > > > >>A A A >> half-dozen blockers and none of them look too > >>> big, > >>> > honestly. And we > >>> > > > > >>A A A have a > >>> > > > > >>A A A >> whole lot of active committers and > >>> contributors to > >>> > wrap-up the > >>> > > > > >>A A A release in a > >>> > > > > >>A A A >> couple of weeks. > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> Do we want to try upgrade to HBase 1.x for > >>> this > >>> > release or it might > >>> > > > > >>A A A be too big > >>> > > > > >>A A A >> of a distortion? Andrew, what do you think > >>> and do > >>> > you have cycles to > >>> > > > > >>A A A do that? > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> What else we need to get done for this > >>> release? > >>> > Suggestions? > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> Is there anyone who wants to step up as the > >>> RM this > >>> > time around? RM > >>> > > > > >>A A A doesn't > >>> > > > > >>A A A >> mean that you have to do all the job, but > >>> rather be > >>> > an efficient with > >>> > > > > >>A A A a stick ;) > >>> > > > > >>A A A >> > >>> > > > > >>A A A >> Thoughts? > >>> > > > > >>A A A >>AA Cos > >>> > > > > >> > >>> > > > > >>A A -- > >>> > > > > >>A A jay vyas > >>> > > >>> > -- > >>> > jay vyas > >>> > >> > >> > >> > >> -- > >> jay vyas > >> > > > > > -- > jay vyas
