Hi Kumar I've also experienced this situation a while ago on Hadoop 0.20.203 in Cygwin environment. I've learned that this was due to incompatibility of Java I/O class feature against Windows I/O operation when Hadoop tries to change the permission against directories.
I now use CentOS with VMWare Player on Windows machine and works perfect. You need to deal with LINUX anyway ,so why not. It's much easier way to go. Regards,,, Y.Mandai iPhoneから送信⌘ On 2013/09/27, at 14:25, abhishek kumar <[email protected]> wrote: > Hi, > > > > I ‘m trying to work with Apache Mahout on Windows 7 platform. I have > already installed cygwin and also configured Apache Hadoop (Version > 0.20.2) both are working fine and I’m able to run examples. But when I > try to build Mahout(0.7) core by : > > mvn install > > I get error : > > *Results :* >> >> *Tests in error:* > - Hide quoted text - >> >> >> completeJobImplicitToyExample(org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-2126149544\.staging to 0700 >> >> >> completeJobToyExample(org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1984042984\.staging to 0700 >> >> >> testCompleteJobBoolean(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921152305392\.staging to 0700 >> >> >> testCompleteJobWithFiltering(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-281875087\.staging to 0700 >> >> testCompleteJob(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-814372738\.staging to 0700 >> >> >> testMaxSimilaritiesPerItem(org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092400101969\.staging to 0700 >> >> >> testCompleteJob(org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921827314851\.staging to 0700 >> toyData(org.apache.mahout.classifier.naivebayes.NaiveBayesTest): Failed >> to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1572356974\.staging to 0700 >> >> >> toyDataComplementary(org.apache.mahout.classifier.naivebayes.NaiveBayesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1069829127\.staging to 0700 >> >> >> testClusteringEuclideanWithOutlierRemovalMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109266940003\.staging to 0700 >> >> >> testCanopyGenManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10922023138010\.staging to 0700 >> >> >> testCanopyGenEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-357829944\.staging to 0700 >> >> >> testClusteringManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921143536426\.staging to 0700 >> >> >> testClusteringEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1208034731\.staging to 0700 >> >> >> testVectorClassificationWithOutlierRemovalMR(org.apache.mahout.clustering.classify.ClusterClassificationDriverTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1690888785\.staging to 0700 >> >> >> testDirichletClusteringMR(org.apache.mahout.clustering.dirichlet.TestDirichletClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-2082101206\.staging to 0700 >> >> >> testDriverIterationsMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109246645983\.staging to 0700 >> >> >> testDriverIterationsMahalanobisMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921179254453\.staging to 0700 >> >> >> testFuzzyKMeansSeqJob(org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering): >> Index: 0, Size: 0 >> >> >> testFuzzyKMeansMRJob(org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1934923652\.staging to 0700 >> >> >> testMRFileClusterIteratorKMeans(org.apache.mahout.clustering.iterator.TestClusterClassifier): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921761790524\.staging to 0700 >> >> testKMeansSeqJob(org.apache.mahout.clustering.kmeans.TestKmeansClustering): >> Index: 0, Size: 0 >> >> testKMeansMRJob(org.apache.mahout.clustering.kmeans.TestKmeansClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921816079617\.staging to 0700 >> >> >> testKMeansWithCanopyClusterInput(org.apache.mahout.clustering.kmeans.TestKmeansClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921905738619\.staging to 0700 >> >> >> testRandomStructuredModelViaMR(org.apache.mahout.clustering.lda.cvb.TestCVBModelTrainer): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921121862826\.staging to 0700 >> >> >> testCanopyEuclideanMRJobNoClustering(org.apache.mahout.clustering.meanshift.TestMeanShift): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1564566061\.staging to 0700 >> >> >> testCanopyEuclideanMRJob(org.apache.mahout.clustering.meanshift.TestMeanShift): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921818281131\.staging to 0700 >> >> >> testLinearMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921237307264\.staging to 0700 >> >> >> testPolynomialMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-233386368\.staging to 0700 >> >> >> testMurmurMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092277684080\.staging to 0700 >> >> >> testMurmur3MinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092743409291\.staging to 0700 >> >> >> testRetailDataMinSup100(org.apache.mahout.fpm.pfpgrowth.PFPGrowthRetailDataTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-245217863\.staging to 0700 >> >> >> testRetailDataMinSup100InSteps(org.apache.mahout.fpm.pfpgrowth.PFPGrowthRetailDataTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109219987323\.staging to 0700 >> testStartParallelFPGrowth(org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921014328316\.staging to 0700 >> >> >> testStartParallelFPGrowthInSteps(org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10922027417931\.staging to 0700 >> >> >> testDistributedLanczosSolverCLI(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921224121926\.staging to 0700 >> >> >> testDistributedLanczosSolverEVJCLI(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921862515497\.staging to 0700 >> >> >> toyIntegration(org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1199234577\.staging to 0700 >> >> >> toyIntegrationWithThreshold(org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1460378563\.staging to 0700 >> >> >> toyIntegrationMaxSimilaritiesPerRow(org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921363953156\.staging to 0700 >> >> >> testRunInverted(org.apache.mahout.math.hadoop.similarity.TestVectorDistanceSimilarityJob): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092164430593\.staging to 0700 >> >> >> testRun(org.apache.mahout.math.hadoop.similarity.TestVectorDistanceSimilarityJob): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-553795099\.staging to 0700 >> >> >> testSolver(org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolver): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-860762481\.staging to 0700 >> >> >> testSolver(org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolverCLI): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-697526539\.staging to 0700 >> testVar(org.apache.mahout.math.hadoop.stats.BasicStatsTest): Failed to >> set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921400971703\.staging to 0700 >> testStdDev(org.apache.mahout.math.hadoop.stats.BasicStatsTest): Failed to >> set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092932240441\.staging to 0700 >> testStdDev2(org.apache.mahout.math.hadoop.stats.BasicStatsTest): Failed >> to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092389959603\.staging to 0700 >> >> testStdDevForGivenMean(org.apache.mahout.math.hadoop.stats.BasicStatsTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109237616064\.staging to 0700 >> >> >> runPCATest1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDPCADenseTest): >> Failed to set permissions of path: >> >> C:\cygwin\tmp\mahout-LocalSSVDPCADenseTest-6652731536639547392\svdtmp\mapred\staging\ABHI1092625678283\.staging >> to 0700 >> >> >> testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): >> Failed to set permissions of path: >> >> C:\cygwin\tmp\mahout-LocalSSVDSolverDenseTest-7997144322469359616\svdtmp\mapred\staging\ABHI1092-1194998760\.staging >> to 0700 >> >> >> testSSVDSolverDense(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): >> Failed to set permissions of path: >> >> C:\cygwin\tmp\mahout-LocalSSVDSolverDenseTest-7806123421490751488\svdtmp\mapred\staging\ABHI1092185333360\.staging >> to 0700 >> >> >> testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest): >> Failed to set permissions of path: >> >> C:\cygwin\tmp\mahout-LocalSSVDSolverSparseSequentialTest-5548826336347703296\svdtmp\mapred\staging\ABHI1092340176135\.staging >> to 0700 >> testTranspose(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092756232646\.staging to 0700 >> >> >> testTimesVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109293746409\.staging to 0700 >> >> >> testMatrixColumnMeansJob(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921347129681\.staging to 0700 >> >> >> testNullMatrixColumnMeansJob(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921159425120\.staging to 0700 >> >> >> testMatrixTimesVector(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1937308041\.staging to 0700 >> >> >> testMatrixTimesSquaredVector(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092835197328\.staging to 0700 >> >> >> testMatrixTimesMatrix(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1662890862\.staging to 0700 >> >> >> testTimesSquaredVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >> java.io.IOException: Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921145502152\.staging to 0700 >> >> >> testConditionalEntropy(org.apache.mahout.math.stats.entropy.ConditionalEntropyTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092948310087\.staging to 0700 >> testLetters(org.apache.mahout.math.stats.entropy.EntropyTest): Failed to >> set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-294535128\.staging to 0700 >> testYN(org.apache.mahout.math.stats.entropy.EntropyTest): Failed to set >> permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921026166654\.staging to 0700 >> >> >> testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainRatioTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092538696827\.staging to 0700 >> >> >> testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-868476842\.staging to 0700 >> >> >> testCreateTermFrequencyVectors(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1178759626\.staging to 0700 >> >> >> testCreateTermFrequencyVectorsNam(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1697391653\.staging to 0700 >> >> >> testCreateTermFrequencyVectorsSeq(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921634700048\.staging to 0700 >> >> >> testCreateTermFrequencyVectorsSeqNam(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921528847425\.staging to 0700 >> >> testTokenizeDocuments(org.apache.mahout.vectorizer.DocumentProcessorTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10922052300690\.staging to 0700 >> >> >> testCreate(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1281318738\.staging to 0700 >> >> >> testCreateNamed(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092247293717\.staging to 0700 >> >> >> testCreateSeq(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-811529140\.staging to 0700 >> >> >> testCreateSeqNamed(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-2068919933\.staging to 0700 >> >> >> testHighDFWordsPreserving(org.apache.mahout.vectorizer.HighDFWordsPrunerTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092966737539\.staging to 0700 >> >> testHighDFWordsPruning(org.apache.mahout.vectorizer.HighDFWordsPrunerTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1380232867\.staging to 0700 >> >> >> testCreateTermFrequencyVectors(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092688926284\.staging to 0700 >> >> >> testCreateTermFrequencyVectorsNam(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092647545786\.staging to 0700 >> >> >> testCreateTermFrequencyVectorsSeq(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-143322241\.staging to 0700 >> >> >> testCreateTermFrequencyVectorsSeqNam(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092273209808\.staging to 0700 >> >> >> testPruningTF(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092489802106\.staging to 0700 >> >> >> testPruning(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >> Failed to set permissions of path: >> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-61697150\.staging to 0700 >> >> *Tests run: 670, Failures: 0, Errors: 82, Skipped: 0* > > I have already tried the patch here > https://github.com/congainc/patch-hadoop_7682-1.0.x-win. > Please help me through this. Also I want to know that how maven knows > the path for hadoop while building Mahout. > > Thanks in advance!
