See <https://builds.apache.org/job/Mahout-Examples-Classify-20News/239/changes>
Changes: [gsingers] MAHOUT-1211: clean up use of deprecated closeQuietly api ------------------------------------------ [...truncated 4538 lines...] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory] Jun 9, 2013 2:04:22 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Maximum n-gram size is: 1 Jun 9, 2013 2:04:22 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Minimum LLR value: 1.0 Jun 9, 2013 2:04:22 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Number of reduce tasks: 1 Jun 9, 2013 2:04:22 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Tokenizing documents in /tmp/mahout-work-jenkins/20news-seq Jun 9, 2013 2:04:22 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Deleting /tmp/mahout-work-jenkins/20news-vectors/tokenized-documents Jun 9, 2013 2:04:22 PM org.apache.hadoop.util.NativeCodeLoader <clinit> WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Jun 9, 2013 2:04:22 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 9, 2013 2:04:23 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0001 Jun 9, 2013 2:04:23 PM org.apache.hadoop.util.ProcessTree isSetsidSupported INFO: setsid exited with exit code 0 Jun 9, 2013 2:04:23 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@19b46dc Jun 9, 2013 2:04:24 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 9, 2013 2:04:27 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting Jun 9, 2013 2:04:27 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 9, 2013 2:04:27 PM org.apache.hadoop.mapred.Task commit INFO: Task attempt_local_0001_m_000000_0 is allowed to commit now Jun 9, 2013 2:04:27 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask INFO: Saved output of task 'attempt_local_0001_m_000000_0' to /tmp/mahout-work-jenkins/20news-vectors/tokenized-documents Jun 9, 2013 2:04:27 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 9, 2013 2:04:27 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0001_m_000000_0' done. Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 0% Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0001 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 12 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=27718400 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=36979561 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=79434694 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=70554484 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=18846 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=0 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=124256256 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=113 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=18846 Jun 9, 2013 2:04:28 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Creating Term Frequency Vectors Jun 9, 2013 2:04:28 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Creating dictionary from /tmp/mahout-work-jenkins/20news-vectors/tokenized-documents and saving at /tmp/mahout-work-jenkins/20news-vectors/wordcount Jun 9, 2013 2:04:28 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Deleting /tmp/mahout-work-jenkins/20news-vectors/wordcount Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0002 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@9abc69 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: io.sort.mb = 100 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: data buffer = 79691776/99614720 Jun 9, 2013 2:04:28 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: record buffer = 262144/327680 Jun 9, 2013 2:04:29 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:29 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 0; bufend = 3959167; bufvoid = 99614720 Jun 9, 2013 2:04:29 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 0; kvend = 262144; length = 327680 Jun 9, 2013 2:04:29 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 9, 2013 2:04:29 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 0 Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 3959167; bufend = 7825252; bufvoid = 99614720 Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 262144; kvend = 196607; length = 327680 Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 1 Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 7825252; bufend = 11706775; bufvoid = 99614720 Jun 9, 2013 2:04:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 196607; kvend = 131070; length = 327680 Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 2 Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 11706775; bufend = 15612671; bufvoid = 99614720 Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 131070; kvend = 65533; length = 327680 Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 3 Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 15612671; bufend = 19526382; bufvoid = 99614720 Jun 9, 2013 2:04:31 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 65533; kvend = 327677; length = 327680 Jun 9, 2013 2:04:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 4 Jun 9, 2013 2:04:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 19526382; bufend = 23422279; bufvoid = 99614720 Jun 9, 2013 2:04:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 327677; kvend = 262140; length = 327680 Jun 9, 2013 2:04:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 5 Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 23422279; bufend = 27275195; bufvoid = 99614720 Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 262140; kvend = 196603; length = 327680 Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 6 Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 27275195; bufend = 31166229; bufvoid = 99614720 Jun 9, 2013 2:04:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 196603; kvend = 131066; length = 327680 Jun 9, 2013 2:04:34 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 7 Jun 9, 2013 2:04:34 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 9, 2013 2:04:34 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:34 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 31166229; bufend = 35035125; bufvoid = 99614720 Jun 9, 2013 2:04:34 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 131066; kvend = 65529; length = 327680 Jun 9, 2013 2:04:34 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 8 Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer collect INFO: Spilling map output: record full = true Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: bufstart = 35035125; bufend = 38832627; bufvoid = 99614720 Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer startSpill INFO: kvstart = 65529; kvend = 327673; length = 327680 Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush INFO: Starting flush of map output Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 87% reduce 0% Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 9 Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 10 Jun 9, 2013 2:04:35 PM org.apache.hadoop.mapred.LocalJobRunner$Job run WARNING: job_local_0002 org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/spill0.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:429) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:160) at org.apache.hadoop.mapred.MapOutputFile.getSpillFile(MapOutputFile.java:107) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:1614) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1323) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:699) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214) Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0002 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 15 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=24154112 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=146039872 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=118142355 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Map output materialized bytes=0 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Combine output records=257326 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=16915 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=257326 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Map output bytes=34703703 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=296550400 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=142 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=2336188 Jun 9, 2013 2:04:36 PM org.apache.hadoop.mapred.Counters log INFO: Combine input records=2097146 Exception in thread "main" java.lang.IllegalStateException: Job failed! at org.apache.mahout.vectorizer.DictionaryVectorizer.startWordCounting(DictionaryVectorizer.java:364) at org.apache.mahout.vectorizer.DictionaryVectorizer.createTermFrequencyVectors(DictionaryVectorizer.java:175) at org.apache.mahout.vectorizer.SparseVectorsFromSequenceFiles.run(SparseVectorsFromSequenceFiles.java:273) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.mahout.vectorizer.SparseVectorsFromSequenceFiles.main(SparseVectorsFromSequenceFiles.java:56) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195) Build step 'Execute shell' marked build as failure
