See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/374/changes>
Changes: [srowen] More from IntelliJ inspection ------------------------------------------ [...truncated 2192 lines...] Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=40 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Map output bytes=3716787 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=911343616 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Combine input records=0 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input records=20 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input groups=20 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Combine output records=0 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Reduce output records=20 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=20 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0002 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@18e73d0 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: io.sort.mb = 100 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: data buffer = 79691776/99614720 Jun 22, 2013 3:06:59 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: record buffer = 262144/327680 Jun 22, 2013 3:07:00 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush INFO: Starting flush of map output Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 0 Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0002_m_000000_0' done. Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3b55b707 Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Merger$MergeQueue merge INFO: Merging 1 sorted segments Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Merger$MergeQueue merge INFO: Down to the last merge-pass, with 1 segments left of total size: 7243048 bytes Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 0% Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Task commit INFO: Task attempt_local_0002_r_000000_0 is allowed to commit now Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask INFO: Saved output of task 'attempt_local_0002_r_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusters-2 Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: reduce > reduce Jun 22, 2013 3:07:05 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0002_r_000000_0' done. Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 100% Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0002 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 20 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=3571063 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=300366601 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=204544269 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=17156391 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Map output materialized bytes=7243052 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Reduce shuffle bytes=0 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=40 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Map output bytes=7242946 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=1535901696 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Combine input records=0 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input records=20 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input groups=20 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Combine output records=0 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Reduce output records=20 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 22, 2013 3:07:06 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=20 Jun 22, 2013 3:07:06 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Clustering data Jun 22, 2013 3:07:06 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Running Clustering Jun 22, 2013 3:07:06 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure@700081cb Jun 22, 2013 3:07:07 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 22, 2013 3:07:07 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0003 Jun 22, 2013 3:07:07 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@265b843d Jun 22, 2013 3:07:08 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Task commit INFO: Task attempt_local_0003_m_000000_0 is allowed to commit now Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask INFO: Saved output of task 'attempt_local_0003_m_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0003_m_000000_0' done. Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 0% Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0003 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 12 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=16917975 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=17156391 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=222449073 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=163837006 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=0 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=770965504 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jun 22, 2013 3:07:13 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=21578 Jun 22, 2013 3:07:13 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Program took 25338 ms (Minutes: 0.4223) hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/ws/trunk/examples/target/mahout-examples-0.8-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/ws/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory] Jun 22, 2013 3:07:15 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Command line arguments: {--dictionary=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --evaluate=null, --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-2-final], --numWords=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans/clusterdump], --outputFormat=[TEXT], --pointsDir=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --samplePoints=[0], --startPhase=[0], --substring=[100], --tempDir=[temp]} Jun 22, 2013 3:07:22 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Deleting tmp/representative Jun 22, 2013 3:07:23 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Command line arguments: {--clusteredPoints=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-2-final], --maxIter=[5], --method=[mapreduce], --output=[tmp/representative], --startPhase=[0], --tempDir=[temp]} Jun 22, 2013 3:07:23 PM org.apache.hadoop.util.NativeCodeLoader <clinit> WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Jun 22, 2013 3:07:23 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Representative Points Iteration 0 Jun 22, 2013 3:07:24 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jun 22, 2013 3:07:24 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0001 Jun 22, 2013 3:07:24 PM org.apache.hadoop.util.ProcessTree isSetsidSupported INFO: setsid exited with exit code 0 Jun 22, 2013 3:07:24 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@b714ea1 Jun 22, 2013 3:07:24 PM org.apache.hadoop.mapred.LocalJobRunner$Job run WARNING: job_local_0001 java.lang.ClassCastException: org.apache.hadoop.mapreduce.lib.input.FileSplit cannot be cast to org.apache.hadoop.mapred.InputSplit at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214) Jun 22, 2013 3:07:25 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jun 22, 2013 3:07:25 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0001 Jun 22, 2013 3:07:25 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 0 Exception in thread "main" java.lang.IllegalStateException: Job failed! at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIterationMR(RepresentativePointsDriver.java:252) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIteration(RepresentativePointsDriver.java:165) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:127) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:90) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.main(RepresentativePointsDriver.java:67) at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:198) at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:156) at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:194) Build step 'Execute shell' marked build as failure
