I can confirm cygwin is more headache than its worth, - best option is to do as said, grab a vm with a linux distro you like, and run everything you need from there, i had so many IO issues under cygwin which cost a few days to resolve, - in comparison to half a day configuring up on a linux distro.
On 25 Oct 2013, at 03:17, Yutaka Mandai <[email protected]> wrote: > Hi Kumar > I've also experienced this situation a while ago on Hadoop 0.20.203 in Cygwin > environment. > I've learned that this was due to incompatibility of Java I/O class feature > against Windows I/O operation when Hadoop tries to change the permission > against directories. > > I now use CentOS with VMWare Player on Windows machine and works perfect. > You need to deal with LINUX anyway ,so why not. It's much easier way to go. > > Regards,,, > Y.Mandai > > iPhoneから送信⌘ > > On 2013/09/27, at 14:25, abhishek kumar <[email protected]> > wrote: > >> Hi, >> >> >> >> I ‘m trying to work with Apache Mahout on Windows 7 platform. I have >> already installed cygwin and also configured Apache Hadoop (Version >> 0.20.2) both are working fine and I’m able to run examples. But when I >> try to build Mahout(0.7) core by : >> >> mvn install >> >> I get error : >> >> *Results :* >>> >>> *Tests in error:* >> - Hide quoted text - >>> >>> >>> completeJobImplicitToyExample(org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-2126149544\.staging to 0700 >>> >>> >>> completeJobToyExample(org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1984042984\.staging to 0700 >>> >>> >>> testCompleteJobBoolean(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921152305392\.staging to 0700 >>> >>> >>> testCompleteJobWithFiltering(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-281875087\.staging to 0700 >>> >>> testCompleteJob(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-814372738\.staging to 0700 >>> >>> >>> testMaxSimilaritiesPerItem(org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092400101969\.staging to 0700 >>> >>> >>> testCompleteJob(org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921827314851\.staging to 0700 >>> toyData(org.apache.mahout.classifier.naivebayes.NaiveBayesTest): Failed >>> to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1572356974\.staging to 0700 >>> >>> >>> toyDataComplementary(org.apache.mahout.classifier.naivebayes.NaiveBayesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1069829127\.staging to 0700 >>> >>> >>> testClusteringEuclideanWithOutlierRemovalMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109266940003\.staging to 0700 >>> >>> >>> testCanopyGenManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10922023138010\.staging to 0700 >>> >>> >>> testCanopyGenEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-357829944\.staging to 0700 >>> >>> >>> testClusteringManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921143536426\.staging to 0700 >>> >>> >>> testClusteringEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1208034731\.staging to 0700 >>> >>> >>> testVectorClassificationWithOutlierRemovalMR(org.apache.mahout.clustering.classify.ClusterClassificationDriverTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1690888785\.staging to 0700 >>> >>> >>> testDirichletClusteringMR(org.apache.mahout.clustering.dirichlet.TestDirichletClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-2082101206\.staging to 0700 >>> >>> >>> testDriverIterationsMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109246645983\.staging to 0700 >>> >>> >>> testDriverIterationsMahalanobisMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921179254453\.staging to 0700 >>> >>> >>> testFuzzyKMeansSeqJob(org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering): >>> Index: 0, Size: 0 >>> >>> >>> testFuzzyKMeansMRJob(org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1934923652\.staging to 0700 >>> >>> >>> testMRFileClusterIteratorKMeans(org.apache.mahout.clustering.iterator.TestClusterClassifier): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921761790524\.staging to 0700 >>> >>> testKMeansSeqJob(org.apache.mahout.clustering.kmeans.TestKmeansClustering): >>> Index: 0, Size: 0 >>> >>> testKMeansMRJob(org.apache.mahout.clustering.kmeans.TestKmeansClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921816079617\.staging to 0700 >>> >>> >>> testKMeansWithCanopyClusterInput(org.apache.mahout.clustering.kmeans.TestKmeansClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921905738619\.staging to 0700 >>> >>> >>> testRandomStructuredModelViaMR(org.apache.mahout.clustering.lda.cvb.TestCVBModelTrainer): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921121862826\.staging to 0700 >>> >>> >>> testCanopyEuclideanMRJobNoClustering(org.apache.mahout.clustering.meanshift.TestMeanShift): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1564566061\.staging to 0700 >>> >>> >>> testCanopyEuclideanMRJob(org.apache.mahout.clustering.meanshift.TestMeanShift): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921818281131\.staging to 0700 >>> >>> >>> testLinearMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921237307264\.staging to 0700 >>> >>> >>> testPolynomialMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-233386368\.staging to 0700 >>> >>> >>> testMurmurMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092277684080\.staging to 0700 >>> >>> >>> testMurmur3MinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092743409291\.staging to 0700 >>> >>> >>> testRetailDataMinSup100(org.apache.mahout.fpm.pfpgrowth.PFPGrowthRetailDataTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-245217863\.staging to 0700 >>> >>> >>> testRetailDataMinSup100InSteps(org.apache.mahout.fpm.pfpgrowth.PFPGrowthRetailDataTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109219987323\.staging to 0700 >>> testStartParallelFPGrowth(org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921014328316\.staging to 0700 >>> >>> >>> testStartParallelFPGrowthInSteps(org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10922027417931\.staging to 0700 >>> >>> >>> testDistributedLanczosSolverCLI(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921224121926\.staging to 0700 >>> >>> >>> testDistributedLanczosSolverEVJCLI(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921862515497\.staging to 0700 >>> >>> >>> toyIntegration(org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1199234577\.staging to 0700 >>> >>> >>> toyIntegrationWithThreshold(org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1460378563\.staging to 0700 >>> >>> >>> toyIntegrationMaxSimilaritiesPerRow(org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921363953156\.staging to 0700 >>> >>> >>> testRunInverted(org.apache.mahout.math.hadoop.similarity.TestVectorDistanceSimilarityJob): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092164430593\.staging to 0700 >>> >>> >>> testRun(org.apache.mahout.math.hadoop.similarity.TestVectorDistanceSimilarityJob): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-553795099\.staging to 0700 >>> >>> >>> testSolver(org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolver): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-860762481\.staging to 0700 >>> >>> >>> testSolver(org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolverCLI): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-697526539\.staging to 0700 >>> testVar(org.apache.mahout.math.hadoop.stats.BasicStatsTest): Failed to >>> set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921400971703\.staging to 0700 >>> testStdDev(org.apache.mahout.math.hadoop.stats.BasicStatsTest): Failed to >>> set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092932240441\.staging to 0700 >>> testStdDev2(org.apache.mahout.math.hadoop.stats.BasicStatsTest): Failed >>> to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092389959603\.staging to 0700 >>> >>> testStdDevForGivenMean(org.apache.mahout.math.hadoop.stats.BasicStatsTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109237616064\.staging to 0700 >>> >>> >>> runPCATest1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDPCADenseTest): >>> Failed to set permissions of path: >>> >>> C:\cygwin\tmp\mahout-LocalSSVDPCADenseTest-6652731536639547392\svdtmp\mapred\staging\ABHI1092625678283\.staging >>> to 0700 >>> >>> >>> testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): >>> Failed to set permissions of path: >>> >>> C:\cygwin\tmp\mahout-LocalSSVDSolverDenseTest-7997144322469359616\svdtmp\mapred\staging\ABHI1092-1194998760\.staging >>> to 0700 >>> >>> >>> testSSVDSolverDense(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): >>> Failed to set permissions of path: >>> >>> C:\cygwin\tmp\mahout-LocalSSVDSolverDenseTest-7806123421490751488\svdtmp\mapred\staging\ABHI1092185333360\.staging >>> to 0700 >>> >>> >>> testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest): >>> Failed to set permissions of path: >>> >>> C:\cygwin\tmp\mahout-LocalSSVDSolverSparseSequentialTest-5548826336347703296\svdtmp\mapred\staging\ABHI1092340176135\.staging >>> to 0700 >>> testTranspose(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092756232646\.staging to 0700 >>> >>> >>> testTimesVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI109293746409\.staging to 0700 >>> >>> >>> testMatrixColumnMeansJob(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921347129681\.staging to 0700 >>> >>> >>> testNullMatrixColumnMeansJob(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921159425120\.staging to 0700 >>> >>> >>> testMatrixTimesVector(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1937308041\.staging to 0700 >>> >>> >>> testMatrixTimesSquaredVector(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092835197328\.staging to 0700 >>> >>> >>> testMatrixTimesMatrix(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1662890862\.staging to 0700 >>> >>> >>> testTimesSquaredVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): >>> java.io.IOException: Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921145502152\.staging to 0700 >>> >>> >>> testConditionalEntropy(org.apache.mahout.math.stats.entropy.ConditionalEntropyTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092948310087\.staging to 0700 >>> testLetters(org.apache.mahout.math.stats.entropy.EntropyTest): Failed to >>> set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-294535128\.staging to 0700 >>> testYN(org.apache.mahout.math.stats.entropy.EntropyTest): Failed to set >>> permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921026166654\.staging to 0700 >>> >>> >>> testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainRatioTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092538696827\.staging to 0700 >>> >>> >>> testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-868476842\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectors(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1178759626\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectorsNam(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1697391653\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectorsSeq(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921634700048\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectorsSeqNam(org.apache.mahout.vectorizer.DictionaryVectorizerTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10921528847425\.staging to 0700 >>> >>> testTokenizeDocuments(org.apache.mahout.vectorizer.DocumentProcessorTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI10922052300690\.staging to 0700 >>> >>> >>> testCreate(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1281318738\.staging to 0700 >>> >>> >>> testCreateNamed(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092247293717\.staging to 0700 >>> >>> >>> testCreateSeq(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-811529140\.staging to 0700 >>> >>> >>> testCreateSeqNamed(org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-2068919933\.staging to 0700 >>> >>> >>> testHighDFWordsPreserving(org.apache.mahout.vectorizer.HighDFWordsPrunerTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092966737539\.staging to 0700 >>> >>> testHighDFWordsPruning(org.apache.mahout.vectorizer.HighDFWordsPrunerTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-1380232867\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectors(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092688926284\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectorsNam(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092647545786\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectorsSeq(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-143322241\.staging to 0700 >>> >>> >>> testCreateTermFrequencyVectorsSeqNam(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092273209808\.staging to 0700 >>> >>> >>> testPruningTF(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092489802106\.staging to 0700 >>> >>> >>> testPruning(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest): >>> Failed to set permissions of path: >>> \tmp\hadoop-ABHI1092\mapred\staging\ABHI1092-61697150\.staging to 0700 >>> >>> *Tests run: 670, Failures: 0, Errors: 82, Skipped: 0* >> >> I have already tried the patch here >> https://github.com/congainc/patch-hadoop_7682-1.0.x-win. >> Please help me through this. Also I want to know that how maven knows >> the path for hadoop while building Mahout. >> >> Thanks in advance!
