See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/395/changes>
Changes: [sslavic] MAHOUT-1294: Failure to cleanup previously installed artifacts from Jenkins node local repository will not fail build ------------------------------------------ [...truncated 4012 lines...] INFO: FILE_BYTES_WRITTEN=97078837 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=17156391 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Map output materialized bytes=3712226 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Reduce shuffle bytes=0 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=40 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Map output bytes=3712121 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=1349124096 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Combine input records=0 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input records=20 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input groups=20 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Combine output records=0 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Reduce output records=20 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=20 Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0002 Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@9efa1f8 Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: io.sort.mb = 100 Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: data buffer = 79691776/99614720 Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init> INFO: record buffer = 262144/327680 Jul 26, 2013 10:10:49 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush INFO: Starting flush of map output Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill INFO: Finished spill 0 Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0002_m_000000_0' done. Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d9cef21 Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Merger$MergeQueue merge INFO: Merging 1 sorted segments Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Merger$MergeQueue merge INFO: Down to the last merge-pass, with 1 segments left of total size: 7368432 bytes Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task commit INFO: Task attempt_local_0002_r_000000_0 is allowed to commit now Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask INFO: Saved output of task 'attempt_local_0002_r_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusters-2 Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: reduce > reduce Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0002_r_000000_0' done. Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 100% Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0002 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 20 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=3703721 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=299675437 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=205017929 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=17156391 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Map output materialized bytes=7368436 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Reduce shuffle bytes=0 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=40 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Map output bytes=7368330 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=1732116480 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Combine input records=0 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input records=20 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Reduce input groups=20 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Combine output records=0 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Reduce output records=20 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=20 Jul 26, 2013 10:10:51 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Clustering data Jul 26, 2013 10:10:51 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Running Clustering Jul 26, 2013 10:10:51 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure@36216806 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus INFO: Total input paths to process : 1 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Running job: job_local_0003 Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Task initialize INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1aa60bf5 Jul 26, 2013 10:10:52 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 0% reduce 0% Jul 26, 2013 10:10:53 PM org.apache.hadoop.mapred.Task done INFO: Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting Jul 26, 2013 10:10:53 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate INFO: Jul 26, 2013 10:10:53 PM org.apache.hadoop.mapred.Task sendDone INFO: Task 'attempt_local_0003_m_000000_0' done. Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: map 100% reduce 0% Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob INFO: Job complete: job_local_0003 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Counters: 12 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: File Output Format Counters Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Written=16917975 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: File Input Format Counters Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Bytes Read=17156391 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: FileSystemCounters Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_READ=222452541 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: FILE_BYTES_WRITTEN=164164534 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Map-Reduce Framework Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Map input records=21578 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Physical memory (bytes) snapshot=0 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Spilled Records=0 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Total committed heap usage (bytes)=1057554432 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: CPU time spent (ms)=0 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Virtual memory (bytes) snapshot=0 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: SPLIT_RAW_BYTES=154 Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log INFO: Map output records=21578 Jul 26, 2013 10:10:54 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Program took 12041 ms (Minutes: 0.20068333333333332) hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/x1/jenkins/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/mahout-examples-0.9-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/x1/jenkins/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory] Jul 26, 2013 10:10:55 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Command line arguments: {--dictionary=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --evaluate=null, --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-*-final], --numWords=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans/clusterdump], --outputFormat=[TEXT], --pointsDir=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --samplePoints=[0], --startPhase=[0], --substring=[100], --tempDir=[temp]} Jul 26, 2013 10:10:55 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Command line arguments: {--clusteredPoints=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-*-final], --maxIter=[5], --method=[mapreduce], --output=[tmp/representative], --startPhase=[0], --tempDir=[temp]} Jul 26, 2013 10:10:55 PM org.slf4j.impl.JCLLoggerAdapter info INFO: Representative Points Iteration 0 Jul 26, 2013 10:10:55 PM org.apache.hadoop.util.NativeCodeLoader <clinit> WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Jul 26, 2013 10:10:55 PM org.apache.hadoop.mapred.JobClient$2 run INFO: Cleaning up the staging area file:/tmp/hadoop-jenkins/mapred/staging/jenkins-1716896176/.staging/job_local_0001 Jul 26, 2013 10:10:55 PM org.apache.hadoop.security.UserGroupInformation doAs SEVERE: PriviledgedActionException as:jenkins cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:235) at org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:55) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:252) at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1024) at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1041) at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:959) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912) at org.apache.hadoop.mapreduce.Job.submit(Job.java:500) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIterationMR(RepresentativePointsDriver.java:250) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIteration(RepresentativePointsDriver.java:165) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:127) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:90) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.main(RepresentativePointsDriver.java:67) at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:198) at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:156) at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195) Build step 'Execute shell' marked build as failure
