Thanks, Paritosh. I'll give this a try. Though looking at this briefly
I don't think we should need these deletes (in either case), which is
bothersome. As is the fact that we're seeing different results on
different OS/JVM combos. Would be good to get to the bottom of this
problem.
-t
On 03/13/2012 11:17 AM, Paritosh Ranjan wrote:
And its ubuntu 11.10, 32 bit ( running as a vm on windows 7, 64 bit ).
On 13-03-2012 20:22, Paritosh Ranjan wrote:
I am not able to reproduce it, however I did face similar problem once.
Look into ClusterClassificationDriverTest's
testVectorClassificationWithOutlierRemovalMR method. Here I am
explicitly deleting the classifiedOutputPath.
If I don't delete it, I get a similar error ( similar to
Output directory
file:/tmp/mahout-TestDistributedRowMatrix-1962901348178391040/testdata/transpose-65
already exists).
when I run it for second time.
Explicitly deleting the file might help in the test case ( I agree
that this is not the best solution, but, I am not able to find the
actual problem for such behavior ).
Paritosh
On 13-03-2012 19:12, tom pierce wrote:
Unfortunately, I can't duplicate this test failure. Is this
something that may clear itself up when the next timer-initiated
build starts?
If anyone out there can duplicate the test failure, please let me
know what OS/Java version you are using. You can run just the one
test with:
mvn -U -DfailIfNoTests=false -Dtest=TestDistributedRowMatrix test
-tom
On 03/13/2012 08:21 AM, Hudson (Commented) (JIRA) wrote:
[
https://issues.apache.org/jira/browse/MAHOUT-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228353#comment-13228353
]
Hudson commented on MAHOUT-822:
-------------------------------
Integrated in Mahout-Quality #1392 (See
[https://builds.apache.org/job/Mahout-Quality/1392/])
MAHOUT-822: Make Mahout compatible with Hadoop 0.23.1.
(Revision 1299770)
Result = FAILURE
tcp :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1299770
Files :
* /mahout/trunk/core/pom.xml
*
/mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/classifier/df/mapreduce/partial/MockContext.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/classifier/df/mapreduce/partial/PartialSequentialBuilder.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/classifier/df/mapreduce/partial/Step1MapperTest.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/clustering/canopy/TestCanopyCreation.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/clustering/classify/ClusterClassificationDriverTest.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/clustering/kmeans/TestKmeansClustering.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/clustering/meanshift/TestMeanShift.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/common/DummyCounter.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/common/DummyStatusReporter.java
*
/mahout/trunk/core/src/test/java/org/apache/mahout/math/hadoop/TestDistributedRowMatrix.java
*
/mahout/trunk/integration/src/test/java/org/apache/mahout/clustering/TestClusterDumper.java
* /mahout/trunk/pom.xml
Mahout needs to be made compatible with Hadoop .23 releases
-----------------------------------------------------------
Key: MAHOUT-822
URL:
https://issues.apache.org/jira/browse/MAHOUT-822
Project: Mahout
Issue Type: Improvement
Components: build
Affects Versions: 0.6
Reporter: Roman Shaposhnik
Assignee: tom pierce
Labels: bigtop
Attachments: MAHOUT-822-build.patch.txt,
MAHOUT-822.patch, MAHOUT-822.patch, MAHOUT-822.patch,
MAHOUT-822.patch, MAHOUT-822.patch, MAHOUT-822.patch,
MAHOUT-822.patch, MAHOUT-822.patch
As part of the Hadoop stack integration project (Apache Bigtop) we
are now trying to compile Mahout's upcoming 0.6 release against
Hadoop 0.22 and 0.23.
I'm attaching the patch to Mahout's Maven build system that made
it possible. I would also like to request help in solving the real
issues that poped
up when we tried to compile Mahout:
http://bigtop01.cloudera.org:8080/job/Bigtop-hadoop22/COMPONENT=mahout,label=centos5/6/console
{noformat}
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[182,33]
org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot
be instantiated
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[218,9]
org.apache.mahout.df.mapreduce.partial.Step0JobTest.Step0Context
is not abstract and does not override abstract method
getInputSplit() in org.apache.hadoop.mapreduce.MapContext
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[229,12]
cannot find symbol
[ERROR] symbol : constructor
Context(org.apache.hadoop.conf.Configuration,org.apache.hadoop.mapreduce.TaskAttemptID,<nulltype>,<nulltype>,<nulltype>,<nulltype>,<nulltype>)
[ERROR] location: class org.apache.hadoop.mapreduce.Mapper.Context
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java:[68,18]
org.apache.hadoop.mapreduce.Mapper.Context is abstract; cannot be
instantiated
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java:[77,19]
org.apache.hadoop.mapreduce.Reducer.Context is abstract; cannot be
instantiated
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[110,30]
org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot
be instantiated
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[206,28]
org.apache.hadoop.mapreduce.JobContext is abstract; cannot be
instantiated
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[227,30]
org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot
be instantiated
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/MockContext.java:[30,6]
org.apache.mahout.df.mapreduce.partial.MockContext is not abstract
and does not override abstract method getInputSplit() in
org.apache.hadoop.mapreduce.MapContext
[ERROR]
/mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/MockContext.java:[38,10]
cannot find symbol
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA
administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see:
http://www.atlassian.com/software/jira
