In Mahout parent module pom following property is defined:
hadoop.version=1.1.2
In Mahout core module pom there are two profiles:
<profiles>
<profile>
<id>hadoop-0.20</id>
<activation>
<property>
<name>!hadoop.version</name>
</property>
</activation>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
</dependency>
</dependencies>
</profile>
<profile>
<id>hadoop-0.23</id>
<activation>
<property>
<name>hadoop.version</name>
</property>
</activation>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-common</artifactId>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-core</artifactId>
</dependency>
</dependencies>
</profile>
</profiles>
Since hadoop.version property is always defined, I don't think profile
hadoop-0.20 is ever explicitly activated (like in a CI build job), at least
not without hadoop-0.23 profile being active too.
If so, should we remove hadoop-0.20 profile and associated dependencies?
Maybe for 0.9?
Kind regards,
Stevo Slavic.
On Wed, Jul 10, 2013 at 5:32 PM, Suneel Marthi <suneel_mar...@yahoo.com>wrote:
> I don't think we are presently supporting Hadoop 2.0.0, still on Hadoop
> 1.x.
> Please correct me here.
>
>
>
> ________________________________
> From: Andrew Musselman <andrew.mussel...@gmail.com>
> To: dev@mahout.apache.org
> Sent: Wednesday, July 10, 2013 11:16 AM
> Subject: Re: 0.8 progress
>
>
> Getting this error when I run the mahout program on a cluster
> running Hadoop 2.0.0-cdh4.2.1; are we not supporting that new a version of
> Hadoop?
>
> $ ./bin/mahout
> Running on hadoop, using /usr/bin/hadoop and HADOOP_CONF_DIR=
> MAHOUT-JOB:
> /home/amusselman/mahout-0.8/examples/target/mahout-examples-0.8-job.jar
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.util.ProgramDriver.driver([Ljava/lang/String;)V
> at
> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:122)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
>
>
> On Tue, Jul 9, 2013 at 1:50 PM, Ted Dunning <ted.dunn...@gmail.com> wrote:
>
> > In meetings back to back 9-11 hours a day this wek.
> >
> >
> > On Tue, Jul 9, 2013 at 12:37 PM, Andrew Musselman <
> > andrew.mussel...@gmail.com> wrote:
> >
> > > No time yet today to run stuff on a cluster but I will do it tonight.
> > >
> > >
> > > On Tue, Jul 9, 2013 at 1:22 PM, Grant Ingersoll <gsing...@apache.org>
> > > wrote:
> > >
> > > > Any feedback yet on the RCs?
> > > >
> > > > -Grant
> > > >
> > > > On Jul 8, 2013, at 1:51 PM, Peng Cheng <pc...@uowmail.edu.au> wrote:
> > > >
> > > > > Hi Sebastian,
> > > > >
> > > > > I'm sorry for the entirely noobish questions: where can I download
> > the
> > > > judging.txt ground truth set? (netflix is pulling it off everywhere,
> so
> > > far
> > > > I can only get the legacy trainingSet and qualifying.txt)
> > > > > and how do I inject the ParallelAlsFactorizationJob into a common
> > > > recommender class?
> > > > > I was trying to reproduce your result (I own a small cluster), but
> > > don't
> > > > even know where to start. The only related thing i found in
> > > mahout-example
> > > > is a format converter.
> > > > >
> > > > > Thanks a lot if you can give me a hint.
> > > > >
> > > > > - Yours Peng
> > > > >
> > > > > On 13-07-01 01:24 AM, Sebastian Schelter wrote:
> > > > >> I successfully ran the ALS and cooccurrence-based recommenders on
> > the
> > > > >> Netflix dataset on a 26 machine cluster using Hadoop 1.0.4.
> > > > >>
> > > > >> --sebastian
> > > > >>
> > > > >>
> > > > >> On 28.06.2013 21:31, Jake Mannix wrote:
> > > > >>> I can run LDA on Twitter's cluster, on both reuters and some
> "real
> > > > data",
> > > > >>> as well as LR/SGD.
> > > > >>>
> > > > >>>
> > > > >>> On Fri, Jun 28, 2013 at 11:51 AM, Grant Ingersoll <
> > > gsing...@apache.org
> > > > >wrote:
> > > > >>>
> > > > >>>> We really should setup a VM that we can run a couple of nodes
> > > > (perhaps at
> > > > >>>> ASF?) on that we can share w/ everyone that makes it easy to
> test
> > > our
> > > > stuff
> > > > >>>> on Hadoop for the specific version that we ship.
> > > > >>>>
> > > > >>>> On Jun 28, 2013, at 2:41 PM, Robin Anil <robin.a...@gmail.com>
> > > wrote:
> > > > >>>>
> > > > >>>>> Can someone (if you have time and experience). Write a small
> shim
> > > to
> > > > run
> > > > >>>>> all examples one after the other on a cluster and write up
> > > > instructions
> > > > >>>> on
> > > > >>>>> how to do it.?
> > > > >>>>>
> > > > >>>>> Robin Anil | Software Engineer | +1 312 869 2602 | Google Inc.
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> On Fri, Jun 28, 2013 at 1:11 PM, Sebastian Schelter <
> > > s...@apache.org>
> > > > >>>> wrote:
> > > > >>>>>> Its crucial that we retest everything on a real cluster before
> > the
> > > > >>>> release.
> > > > >>>>>> I will do this for the recommenders code next week.
> > > > >>>>>>
> > > > >>>>>> --sebastian
> > > > >>>>>> Am 28.06.2013 14:03 schrieb "Grant Ingersoll" <
> > > gsing...@apache.org
> > > > >:
> > > > >>>>>>
> > > > >>>>>>> I should have time next week to do the release, if we can get
> > > these
> > > > >>>>>>> knocked out. If not next week, the following.
> > > > >>>>>>>
> > > > >>>>>>> On Jun 28, 2013, at 5:46 AM, Suneel Marthi <
> > > > suneel_mar...@yahoo.com>
> > > > >>>>>>> wrote:
> > > > >>>>>>>
> > > > >>>>>>>> 1. Could someone look at Mahout-1257? There is a patch
> that's
> > > been
> > > > >>>>>>> submitted but I am not sure if this has been superseded by
> > Sean's
> > > > >>>> against
> > > > >>>>>>> Mahout-1239.
> > > > >>>>>>>> 2. Stevo, I am for fixing the findbugs excludes as part of
> 0.8
> > > > >>>> release,
> > > > >>>>>>> I see that the number of warnings has gone up over the last
> few
> > > > builds.
> > > > >>>>>>>> 3. I am more concerned about the cause of the mysterious
> > cosmic
> > > > rays
> > > > >>>>>>> that randomly fail unit tests (since we have moved to running
> > > > parallel
> > > > >>>>>>> tests). I see that happening on my local repository too.
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>> ________________________________
> > > > >>>>>>>> From: Stevo Slavić <ssla...@gmail.com>
> > > > >>>>>>>> To: dev@mahout.apache.org
> > > > >>>>>>>> Sent: Friday, June 28, 2013 3:21 AM
> > > > >>>>>>>> Subject: Re: 0.8 progress
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>> Well done team!
> > > > >>>>>>>>
> > > > >>>>>>>> Build is unstable, oscillates, IMO regardless of changes
> made.
> > > > Judging
> > > > >>>>>>> from
> > > > >>>>>>>> logs I suspect that some of the Jenkins nodes are not
> > configured
> > > > well,
> > > > >>>>>>> /tmp
> > > > >>>>>>>> directory security related issues, and file size
> constraints.
> > > > Could be
> > > > >>>>>>> also
> > > > >>>>>>>> issue with our tests.
> > > > >>>>>>>>
> > > > >>>>>>>> Javadoc was reported earlier not to be OK (not all modules
> in
> > > > >>>>>> aggregated
> > > > >>>>>>>> javadoc), and code quality reports are not working OK, e.g.
> > > > findbugs
> > > > >>>>>>>> doesn't respect excludes - plan to work on this during
> > weekend.
> > > > >>>>>>>>
> > > > >>>>>>>> Do we want to fix these before or after 0.8 release?
> > > > >>>>>>>>
> > > > >>>>>>>> Kind regards,
> > > > >>>>>>>> Stevo Slavić.
> > > > >>>>>>>>
> > > > >>>>>>>>
> > > > >>>>>>>> On Fri, Jun 28, 2013 at 12:32 AM, Robin Anil <
> > > > robin.a...@gmail.com>
> > > > >>>>>>> wrote:
> > > > >>>>>>>>> All Done
> > > > >>>>>>>>>
> > > > >>>>>>>>> Robin Anil | Software Engineer | +1 312 869 2602 | Google
> > Inc.
> > > > >>>>>>>>>
> > > > >>>>>>>>>
> > > > >>>>>>>>> On Sun, Jun 23, 2013 at 11:36 PM, Robin Anil <
> > > > robin.a...@gmail.com>
> > > > >>>>>>> wrote:
> > > > >>>>>>>>>> I sent the comments. The code is good. But without the
> > > > matrix/vector
> > > > >>>>>>>>> input
> > > > >>>>>>>>>> we cant ship it in the release. Hope Yiqun and Da Zhang
> can
> > > make
> > > > >>>>>> those
> > > > >>>>>>>>>> changes quickly.
> > > > >>>>>>>>>>
> > > > >>>>>>>>>>
> > > > >>>>>>>>>> Robin Anil | Software Engineer | +1 312 869 2602 | Google
> > Inc.
> > > > >>>>>>>>>>
> > > > >>>>>>>>>>
> > > > >>>>>>>>>> On Sun, Jun 23, 2013 at 8:46 PM, Grant Ingersoll <
> > > > >>>>>> gsing...@apache.org
> > > > >>>>>>>>>> wrote:
> > > > >>>>>>>>>>
> > > > >>>>>>>>>>> I see 1 issue left: MAHOUT-1214. It is assigned to
> Robin.
> > > Any
> > > > >>>>>> chance
> > > > >>>>>>>>> we
> > > > >>>>>>>>>>> can finish this up this week?
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>> -Grant
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>> On Jun 23, 2013, at 9:26 AM, Suneel Marthi <
> > > > >>>> suneel_mar...@yahoo.com
> > > > >>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>> Finally got to finishing up M-833, the changes can be
> > > > reviewed at
> > > > >>>>>>>>>>> https://reviews.apache.org/r/11774/diff/3/.
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>> ________________________________
> > > > >>>>>>>>>>>> From: Grant Ingersoll <gsing...@apache.org>
> > > > >>>>>>>>>>>> To: dev@mahout.apache.org
> > > > >>>>>>>>>>>> Sent: Tuesday, June 11, 2013 10:09 AM
> > > > >>>>>>>>>>>> Subject: Re: 0.8 progress
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>> I pushed M-1030 and M-1233. If we can get M-833 and
> > M-1214
> > > > in by
> > > > >>>>>>>>>>> Thursday, I can roll an RC on Thursday.
> > > > >>>>>>>>>>>> -Grant
> > > > >>>>>>>>>>>>
> > > > >>>>>>>>>>>> On Jun 11, 2013, at 8:56 AM, Grant Ingersoll <
> > > > gsing...@apache.org
> > > > >>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>> Down to 4 issues! I would say what they are, but JIRA
> is
> > > > flaking
> > > > >>>>>>> out
> > > > >>>>>>>>>>> again.
> > > > >>>>>>>>>>>>> My instinct is that 1030 and 1233 can be pushed.
> Suneel
> > > has
> > > > been
> > > > >>>>>>>>>>> working hard to get M-833 in. Not sure on M-1214, Robin?
> > > > >>>>>>>>>>>>> -G
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>>> On Jun 9, 2013, at 6:10 PM, Grant Ingersoll <
> > > > gsing...@apache.org
> > > > >>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>> On Jun 9, 2013, at 6:02 PM, Grant Ingersoll <
> > > > >>>> gsing...@apache.org
> > > > >>>>>>>>>>> wrote:
> > > > >>>>>>>>>>>>>>>> M-1067 -- Dmitriy -- This is an enhancement,
> should
> > we
> > > > push?
> > > > >>>>>>>>>>>>>> Looks like this was committed already.
> > > > >>>>>>>>>>>>>>
> > > > >>>>>>>>>>>>>
> > > > >>>>>>>>>>>> --------------------------------------------
> > > > >>>>>>>>>>>> Grant Ingersoll | @gsingers
> > > > >>>>>>>>>>>> http://www.lucidworks.com
> > > > >>>>>>>>>>> --------------------------------------------
> > > > >>>>>>>>>>> Grant Ingersoll | @gsingers
> > > > >>>>>>>>>>> http://www.lucidworks.com
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>>>>>>
> > > > >>>>>>> --------------------------------------------
> > > > >>>>>>> Grant Ingersoll | @gsingers
> > > > >>>>>>> http://www.lucidworks.com
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>> --------------------------------------------
> > > > >>>> Grant Ingersoll | @gsingers
> > > > >>>> http://www.lucidworks.com
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>
> > > > >
> > > > >
> > > >
> > > > --------------------------------------------
> > > > Grant Ingersoll | @gsingers
> > > > http://www.lucidworks.com
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> >
>
