See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/248/changes>
Changes:
[ssc] MAHOUT-1151, a few more fixes
[ssc] MAHOUT-1151, a few more fixes
------------------------------------------
[...truncated 1177 lines...]
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=6
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=937164800
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=150
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=0
Mar 7, 2013 11:07:50 AM org.apache.hadoop.mapred.Counters log
INFO: Map output records=0
Mar 7, 2013 11:07:51 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat
listStatus
INFO: Total input paths to process : 1
Mar 7, 2013 11:07:51 AM
org.apache.hadoop.filecache.TrackerDistributedCacheManager downloadCacheObject
INFO: Creating frequency.file-0 in
/tmp/hadoop-hudson/mapred/local/archive/3203557375951414632_1334525619_1149837802/file/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans-work--6007572216488249578
with rwxr-xr-x
Mar 7, 2013 11:07:51 AM
org.apache.hadoop.filecache.TrackerDistributedCacheManager downloadCacheObject
INFO: Cached
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0 as
/tmp/hadoop-hudson/mapred/local/archive/3203557375951414632_1334525619_1149837802/file/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0
Mar 7, 2013 11:07:51 AM
org.apache.hadoop.filecache.TrackerDistributedCacheManager
localizePublicCacheObject
INFO: Cached
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0 as
/tmp/hadoop-hudson/mapred/local/archive/3203557375951414632_1334525619_1149837802/file/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0
Mar 7, 2013 11:07:51 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0006
Mar 7, 2013 11:07:51 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Mar 7, 2013 11:07:51 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0006_m_000000_0 is done. And is in the process of
commiting
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0006_m_000000_0' done.
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0006_r_000000_0 is done. And is in the process of
commiting
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0006_r_000000_0 is allowed to commit now
Mar 7, 2013 11:07:52 AM
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0006_r_000000_0' to
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0006_r_000000_0' done.
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0006
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Counters: 17
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=102
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=753404745
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=759733958
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=102
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=6
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1137442816
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=150
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=0
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Counters log
INFO: Map output records=0
Mar 7, 2013 11:07:52 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat
listStatus
INFO: Total input paths to process : 1
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0007
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Mar 7, 2013 11:07:52 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0007_m_000000_0 is done. And is in the process of
commiting
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0007_m_000000_0' done.
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0007_r_000000_0 is done. And is in the process of
commiting
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0007_r_000000_0 is allowed to commit now
Mar 7, 2013 11:07:53 AM
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0007_r_000000_0' to
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0007_r_000000_0' done.
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0007
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Counters: 17
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=102
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=878972146
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=886355572
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=102
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=6
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1340866560
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=157
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=0
Mar 7, 2013 11:07:53 AM org.apache.hadoop.mapred.Counters log
INFO: Map output records=0
Mar 7, 2013 11:07:53 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
Mar 7, 2013 11:07:53 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Program took 13305 ms (Minutes: 0.22175)
hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally
Mar 7, 2013 11:07:55 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--clustering=null,
--clusters=[/tmp/mahout-work-hudson/reuters-kmeans-clusters],
--convergenceDelta=[0.5],
--distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure],
--endPhase=[2147483647],
--input=[/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors/],
--maxIter=[10], --method=[mapreduce], --numClusters=[20],
--output=[/tmp/mahout-work-hudson/reuters-kmeans], --overwrite=null,
--startPhase=[0], --tempDir=[temp]}
Mar 7, 2013 11:07:55 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting /tmp/mahout-work-hudson/reuters-kmeans-clusters
Mar 7, 2013 11:07:55 AM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
Mar 7, 2013 11:07:55 AM org.apache.hadoop.io.compress.CodecPool getCompressor
INFO: Got brand-new compressor
Mar 7, 2013 11:07:55 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Wrote 20 Klusters to
/tmp/mahout-work-hudson/reuters-kmeans-clusters/part-randomSeed
Mar 7, 2013 11:07:55 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Input:
/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters
In: /tmp/mahout-work-hudson/reuters-kmeans-clusters/part-randomSeed Out:
/tmp/mahout-work-hudson/reuters-kmeans Distance:
org.apache.mahout.common.distance.CosineDistanceMeasure
Mar 7, 2013 11:07:55 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: convergence: 0.5 max Iterations: 10 num Reduce Tasks:
org.apache.mahout.math.VectorWritable Input Vectors: {}
Mar 7, 2013 11:07:55 AM org.apache.hadoop.io.compress.CodecPool getDecompressor
INFO: Got brand-new decompressor
Exception in thread "main" java.lang.IllegalStateException: No input clusters
found in /tmp/mahout-work-hudson/reuters-kmeans-clusters/part-randomSeed. Check
your -c argument.
at
org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:216)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:147)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure
