See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/323/changes>
Changes: [ssc] MAHOUT-1228 Cleanup .gitignore ------------------------------------------ [...truncated 1996 lines...] Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=1524105216 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Combine input records=0 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Reduce input records=20 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Reduce input groups=20 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Combine output records=0 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Reduce output records=20 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log INFO: Map output records=20 Jun 02, 2013 10:26:25 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Clustering data Jun 02, 2013 10:26:25 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Running Clustering Jun 02, 2013 10:26:25 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure@2280438b Jun 02, 2013 10:26:26 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 02, 2013 10:26:26 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0003 Jun 02, 2013 10:26:26 AM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5e47e8e2 Jun 02, 2013 10:26:27 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 02, 2013 10:26:32 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:33 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 67% reduce 0% Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Task commit INFO: Task attempt_local_0003_m_000000_0 is allowed to commit now Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask INFO: Saved output of task 'attempt_local_0003_m_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0003_m_000000_0' done. Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 0% Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0003 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Counters: 12 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=16917975 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=17156391 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=239425235 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=180784906 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=0 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=816971776 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log INFO: Map output records=21578 Jun 02, 2013 10:26:34 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Program took 34951 ms (Minutes: 0.5825166666666667) hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/ws/trunk/examples/target/mahout-examples-0.8-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/ws/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory] Jun 02, 2013 10:26:40 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Command line arguments: {--dictionary=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --evaluate=null, --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-2-final], --numWords=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans/clusterdump], --outputFormat=[TEXT], --pointsDir=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --samplePoints=[0], --startPhase=[0], --substring=[100], --tempDir=[temp]} Jun 02, 2013 10:26:48 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Deleting tmp/representative Jun 02, 2013 10:26:49 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Command line arguments: {--clusteredPoints=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-2-final], --maxIter=[5], --method=[mapreduce], --output=[tmp/representative], --startPhase=[0], --tempDir=[temp]} Jun 02, 2013 10:26:49 AM org.apache.hadoop.util.NativeCodeLoader <clinit> WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Jun 02, 2013 10:26:49 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Representative Points Iteration 0 Jun 02, 2013 10:26:53 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 02, 2013 10:26:53 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0001 Jun 02, 2013 10:26:54 AM org.apache.hadoop.util.ProcessTree isSetsidSupported INFO: setsid exited with exit code 0 Jun 02, 2013 10:26:54 AM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1cf15580 Jun 02, 2013 10:26:54 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: io.sort.mb = 100 Jun 02, 2013 10:26:55 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: data buffer = 79691776/99614720 Jun 02, 2013 10:26:55 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 02, 2013 10:26:55 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: record buffer = 262144/327680 Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush INFO: Starting flush of map output Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 0 Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0001_m_000000_0' done. Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@450fdc46 Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Merger$MergeQueue merge INFO: Merging 1 sorted segments Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Merger$MergeQueue merge INFO: Down to the last merge-pass, with 1 segments left of total size: 4114 bytes Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task commit INFO: Task attempt_local_0001_r_000000_0 is allowed to commit now Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask INFO: Saved output of task 'attempt_local_0001_r_000000_0' to tmp/representative/representativePoints-1 Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: reduce > reduce Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0001_r_000000_0' done. Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 100% Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0001 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Counters: 20 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=1918542 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=185380521 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=101575498 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=16917975 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Map output materialized bytes=4118 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Reduce shuffle bytes=0 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=40 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Map output bytes=4053 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=892207104 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=138 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Combine input records=0 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Reduce input records=20 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Reduce input groups=20 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Combine output records=0 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Reduce output records=40 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log INFO: Map output records=20 Jun 02, 2013 10:26:58 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Representative Points Iteration 1 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0002 Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5b47d62e Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.LocalJobRunner$Job run WARNING: job_local_0002 java.lang.ClassCastException: org.apache.hadoop.mapreduce.lib.input.FileSplit cannot be cast to org.apache.hadoop.mapred.InputSplit at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214) Jun 02, 2013 10:26:59 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 02, 2013 10:26:59 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0002 Jun 02, 2013 10:26:59 AM org.apache.hadoop.mapred.Counters log INFO: Counters: 0 Exception in thread "main" java.lang.IllegalStateException: Job failed! at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIterationMR(RepresentativePointsDriver.java:249) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIteration(RepresentativePointsDriver.java:162) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:127) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:90) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.main(RepresentativePointsDriver.java:67) at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:198) at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:156) at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195) Build step 'Execute shell' marked build as failure
