Yes this problem has been pretty much beaten to shreds. In fact so much so
i wrote it into troubleshooting in section 5 of the manual (
https://cwiki.apache.org/confluence/download/attachments/27832158/SSVD-CLI.pdf?version=17&modificationDate=1349999085000
).
Are you sure those are not you problems? In short, it means rank deficiency
in your input or its splits.
Also perhaps it would be great if you post to the user list so others could
benefit.
Thank you.
-Dmitriy
On Mon, Feb 11, 2013 at 5:40 PM, K.D.P. Ross <k...@quixey.com> wrote:
> Hello–
>
> I am trying to use the Mahout SSVD to decompose
> a modest-sized matrix, but I get an error when I try to run
> it … I am primarily interested in using the ‘SVDSolver’
> entry point, but I encounter the same problem when I use the
> CLI.
>
> I am generating random data for the moment (code included
> below) and invoking the CLI with the following arguments:
>
> mahout ssvd -k 100 -p 10 -q 1 --input /tmp/foo.txt --output
> /tmp/output --tempDir /tmp/temp --reduceTasks 4
>
> (where ‘/tmp/foo.txt’ is generated by the code below,
> and neither ‘/tmp/output’ nor ‘/tmp/temp’ exists.)
>
> Specifically, I receive an ‘IllegalArgumentException’
> saying that ‘new m can't be less than n’ … which, at
> best, is confusing because ‘m’ and ‘n’ appear to be
> variables coming from somewhere in the implementation rather
> than from any parameters that I've explicitly provided.
>
> I've searched the Web and found others running into this
> problem … but no solution (e.g., switching to absolute
> paths for everything) that seems to address it for me …
>
> I'm running Mahout 0.7 and Hadoop 1.1.1 on Ubuntu 12.10 with
> version 1.6.0_24 of the AMD64 OpenJDK; I am running
> i7-3820 @ 3.60GHz x 8 with 64GiB RAM.
>
> Any help would be much appreciated!
>
> //sincerely
> K.D.P.Ross | Principal Engineer, Data Sciences
> (206) 817.0090 | www.quixey.com
> 278 Castro Street, Mountain View, CA 94041
>
> [begin code used to generate matrix-
> import org.apache.hadoop.conf.Configuration;
> import org.apache.hadoop.fs.FileSystem;
> import org.apache.hadoop.fs.Path;
> import org.apache.hadoop.io.IntWritable;
> import org.apache.hadoop.io.SequenceFile;
> import org.apache.mahout.math.DenseVector;
> import org.apache.mahout.math.VectorWritable;
> import java.util.Random;
>
> public class GenMatrix {
> public static double[][] fabricateRandomMatrix(final int rMax, final
> int cMax) {
> Random rand = new Random();
> double [][] xs = new double[rMax][cMax];
>
> for (int r = 0; r < rMax; ++ r) {
> for (int c = 0; c < cMax; ++ c) {
> xs[r][c] = rand.nextDouble();
> }
> }
>
> return xs;
> }
>
> public static void write(final String f, final double[][]
> matrixvalues) throws Exception
> {
> Configuration cfg = new Configuration();
> FileSystem fs = FileSystem.get(cfg);
> SequenceFile.Writer writer = SequenceFile.createWriter(fs, cfg,
> new Path(f),IntWritable.class, VectorWritable.class) ;
>
> for (int i = 0; i < matrixvalues.length; ++i) {
> final DenseVector row = new DenseVector(matrixvalues[ i ]);
> writer.append(new IntWritable(i), new VectorWritable(row));
> }
>
> writer.close();
> }
>
> public static void main(String[] args) {
> final int r = 25000;
> final int c = 10000;
>
> try {
> write("/tmp/foo.txt", fabricateRandomMatrix(r, c));
> }
> catch (Exception e) {
> System.err.println("Unable to write data ... " + e.getMessage());
> }
> }
> }
> -end code used to generate matrix]
>
> [begin mahout output-
> 13/02/11 17:03:16 INFO common.AbstractJob: Command line arguments:
> {--abtBlockHeight=[200000], --blockHeight=[10000], --broadcast=[true],
> --computeU=[true], --computeV=[true], --endPhase=[2147483647],
> --input=[foo.txt], --minSplitSize=[-1],
> --outerProdBlockHeight=[30000], --output=[output],
> --oversampling=[10], --pca=[false], --powerIter=[1], --rank=[100],
> --reduceTasks=[4], --startPhase=[0], --tempDir=[temp],
> --uHalfSigma=[false], --vHalfSigma=[false]}
> 13/02/11 17:03:17 INFO util.NativeCodeLoader: Loaded the native-hadoop
> library
> 13/02/11 17:03:17 INFO zlib.ZlibFactory: Successfully loaded &
> initialized native-zlib library
> 13/02/11 17:03:17 INFO compress.CodecPool: Got brand-new decompressor
> 13/02/11 17:03:17 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/02/11 17:03:17 INFO util.ProcessTree: setsid exited with exit code 0
> 13/02/11 17:03:17 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@60ded0f0
> 13/02/11 17:03:20 INFO compress.CodecPool: Got brand-new compressor
> 13/02/11 17:03:20 INFO compress.CodecPool: Got brand-new compressor
> 13/02/11 17:03:20 INFO mapred.Task: Task:attempt_local_0001_m_000000_0
> is done. And is in the process of commiting
> 13/02/11 17:03:20 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:20 INFO mapred.Task: Task attempt_local_0001_m_000000_0
> is allowed to commit now
> 13/02/11 17:03:20 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000000_0' to temp/Q-job
> 13/02/11 17:03:20 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:20 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
> done.
> 13/02/11 17:03:20 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2322bce
> 13/02/11 17:03:23 INFO mapred.Task: Task:attempt_local_0001_m_000001_0
> is done. And is in the process of commiting
> 13/02/11 17:03:23 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:23 INFO mapred.Task: Task attempt_local_0001_m_000001_0
> is allowed to commit now
> 13/02/11 17:03:23 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000001_0' to temp/Q-job
> 13/02/11 17:03:23 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:23 INFO mapred.Task: Task 'attempt_local_0001_m_000001_0'
> done.
> 13/02/11 17:03:23 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ace16ad
> 13/02/11 17:03:26 INFO mapred.Task: Task:attempt_local_0001_m_000002_0
> is done. And is in the process of commiting
> 13/02/11 17:03:26 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:26 INFO mapred.Task: Task attempt_local_0001_m_000002_0
> is allowed to commit now
> 13/02/11 17:03:26 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000002_0' to temp/Q-job
> 13/02/11 17:03:26 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:26 INFO mapred.Task: Task 'attempt_local_0001_m_000002_0'
> done.
> 13/02/11 17:03:26 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@79f03d7
> 13/02/11 17:03:29 INFO mapred.Task: Task:attempt_local_0001_m_000003_0
> is done. And is in the process of commiting
> 13/02/11 17:03:29 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:29 INFO mapred.Task: Task attempt_local_0001_m_000003_0
> is allowed to commit now
> 13/02/11 17:03:29 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000003_0' to temp/Q-job
> 13/02/11 17:03:29 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:29 INFO mapred.Task: Task 'attempt_local_0001_m_000003_0'
> done.
> 13/02/11 17:03:29 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2d20dbf3
> 13/02/11 17:03:32 INFO mapred.Task: Task:attempt_local_0001_m_000004_0
> is done. And is in the process of commiting
> 13/02/11 17:03:32 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:32 INFO mapred.Task: Task attempt_local_0001_m_000004_0
> is allowed to commit now
> 13/02/11 17:03:32 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000004_0' to temp/Q-job
> 13/02/11 17:03:32 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:32 INFO mapred.Task: Task 'attempt_local_0001_m_000004_0'
> done.
> 13/02/11 17:03:32 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5a943dc4
> 13/02/11 17:03:35 INFO mapred.Task: Task:attempt_local_0001_m_000005_0
> is done. And is in the process of commiting
> 13/02/11 17:03:35 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:35 INFO mapred.Task: Task attempt_local_0001_m_000005_0
> is allowed to commit now
> 13/02/11 17:03:35 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000005_0' to temp/Q-job
> 13/02/11 17:03:35 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:35 INFO mapred.Task: Task 'attempt_local_0001_m_000005_0'
> done.
> 13/02/11 17:03:35 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@b0c0f66
> 13/02/11 17:03:38 INFO mapred.Task: Task:attempt_local_0001_m_000006_0
> is done. And is in the process of commiting
> 13/02/11 17:03:38 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:38 INFO mapred.Task: Task attempt_local_0001_m_000006_0
> is allowed to commit now
> 13/02/11 17:03:38 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000006_0' to temp/Q-job
> 13/02/11 17:03:38 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:38 INFO mapred.Task: Task 'attempt_local_0001_m_000006_0'
> done.
> 13/02/11 17:03:38 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@75d252d
> 13/02/11 17:03:41 INFO mapred.Task: Task:attempt_local_0001_m_000007_0
> is done. And is in the process of commiting
> 13/02/11 17:03:41 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:41 INFO mapred.Task: Task attempt_local_0001_m_000007_0
> is allowed to commit now
> 13/02/11 17:03:41 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000007_0' to temp/Q-job
> 13/02/11 17:03:41 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:41 INFO mapred.Task: Task 'attempt_local_0001_m_000007_0'
> done.
> 13/02/11 17:03:41 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@72e5355f
> 13/02/11 17:03:44 INFO mapred.Task: Task:attempt_local_0001_m_000008_0
> is done. And is in the process of commiting
> 13/02/11 17:03:44 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:44 INFO mapred.Task: Task attempt_local_0001_m_000008_0
> is allowed to commit now
> 13/02/11 17:03:44 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000008_0' to temp/Q-job
> 13/02/11 17:03:44 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:44 INFO mapred.Task: Task 'attempt_local_0001_m_000008_0'
> done.
> 13/02/11 17:03:44 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@172fb0af
> 13/02/11 17:03:47 INFO mapred.Task: Task:attempt_local_0001_m_000009_0
> is done. And is in the process of commiting
> 13/02/11 17:03:47 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:47 INFO mapred.Task: Task attempt_local_0001_m_000009_0
> is allowed to commit now
> 13/02/11 17:03:47 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000009_0' to temp/Q-job
> 13/02/11 17:03:47 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:47 INFO mapred.Task: Task 'attempt_local_0001_m_000009_0'
> done.
> 13/02/11 17:03:47 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@29abc69
> 13/02/11 17:03:50 INFO mapred.Task: Task:attempt_local_0001_m_000010_0
> is done. And is in the process of commiting
> 13/02/11 17:03:50 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:50 INFO mapred.Task: Task attempt_local_0001_m_000010_0
> is allowed to commit now
> 13/02/11 17:03:50 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000010_0' to temp/Q-job
> 13/02/11 17:03:50 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:50 INFO mapred.Task: Task 'attempt_local_0001_m_000010_0'
> done.
> 13/02/11 17:03:50 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@53dafbaf
> 13/02/11 17:03:53 INFO mapred.Task: Task:attempt_local_0001_m_000011_0
> is done. And is in the process of commiting
> 13/02/11 17:03:53 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:53 INFO mapred.Task: Task attempt_local_0001_m_000011_0
> is allowed to commit now
> 13/02/11 17:03:53 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000011_0' to temp/Q-job
> 13/02/11 17:03:53 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:53 INFO mapred.Task: Task 'attempt_local_0001_m_000011_0'
> done.
> 13/02/11 17:03:53 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@38ffd135
> 13/02/11 17:03:56 INFO mapred.Task: Task:attempt_local_0001_m_000012_0
> is done. And is in the process of commiting
> 13/02/11 17:03:56 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:56 INFO mapred.Task: Task attempt_local_0001_m_000012_0
> is allowed to commit now
> 13/02/11 17:03:56 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000012_0' to temp/Q-job
> 13/02/11 17:03:56 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:56 INFO mapred.Task: Task 'attempt_local_0001_m_000012_0'
> done.
> 13/02/11 17:03:56 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4987b287
> 13/02/11 17:03:59 INFO mapred.Task: Task:attempt_local_0001_m_000013_0
> is done. And is in the process of commiting
> 13/02/11 17:03:59 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:59 INFO mapred.Task: Task attempt_local_0001_m_000013_0
> is allowed to commit now
> 13/02/11 17:03:59 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000013_0' to temp/Q-job
> 13/02/11 17:03:59 INFO mapred.LocalJobRunner:
> 13/02/11 17:03:59 INFO mapred.Task: Task 'attempt_local_0001_m_000013_0'
> done.
> 13/02/11 17:03:59 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@13cc0a7f
> 13/02/11 17:04:02 INFO mapred.Task: Task:attempt_local_0001_m_000014_0
> is done. And is in the process of commiting
> 13/02/11 17:04:02 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:02 INFO mapred.Task: Task attempt_local_0001_m_000014_0
> is allowed to commit now
> 13/02/11 17:04:02 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000014_0' to temp/Q-job
> 13/02/11 17:04:02 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:02 INFO mapred.Task: Task 'attempt_local_0001_m_000014_0'
> done.
> 13/02/11 17:04:02 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@327124af
> 13/02/11 17:04:05 INFO mapred.Task: Task:attempt_local_0001_m_000015_0
> is done. And is in the process of commiting
> 13/02/11 17:04:05 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:05 INFO mapred.Task: Task attempt_local_0001_m_000015_0
> is allowed to commit now
> 13/02/11 17:04:05 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000015_0' to temp/Q-job
> 13/02/11 17:04:05 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:05 INFO mapred.Task: Task 'attempt_local_0001_m_000015_0'
> done.
> 13/02/11 17:04:05 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@18682406
> 13/02/11 17:04:08 INFO mapred.Task: Task:attempt_local_0001_m_000016_0
> is done. And is in the process of commiting
> 13/02/11 17:04:08 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:08 INFO mapred.Task: Task attempt_local_0001_m_000016_0
> is allowed to commit now
> 13/02/11 17:04:08 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000016_0' to temp/Q-job
> 13/02/11 17:04:08 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:08 INFO mapred.Task: Task 'attempt_local_0001_m_000016_0'
> done.
> 13/02/11 17:04:08 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c5aebd9
> 13/02/11 17:04:11 INFO mapred.Task: Task:attempt_local_0001_m_000017_0
> is done. And is in the process of commiting
> 13/02/11 17:04:11 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:11 INFO mapred.Task: Task attempt_local_0001_m_000017_0
> is allowed to commit now
> 13/02/11 17:04:11 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000017_0' to temp/Q-job
> 13/02/11 17:04:11 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:11 INFO mapred.Task: Task 'attempt_local_0001_m_000017_0'
> done.
> 13/02/11 17:04:11 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@32d8ca48
> 13/02/11 17:04:14 INFO mapred.Task: Task:attempt_local_0001_m_000018_0
> is done. And is in the process of commiting
> 13/02/11 17:04:14 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:14 INFO mapred.Task: Task attempt_local_0001_m_000018_0
> is allowed to commit now
> 13/02/11 17:04:14 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000018_0' to temp/Q-job
> 13/02/11 17:04:14 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:14 INFO mapred.Task: Task 'attempt_local_0001_m_000018_0'
> done.
> 13/02/11 17:04:14 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c2c9103
> 13/02/11 17:04:17 INFO mapred.Task: Task:attempt_local_0001_m_000019_0
> is done. And is in the process of commiting
> 13/02/11 17:04:17 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:17 INFO mapred.Task: Task attempt_local_0001_m_000019_0
> is allowed to commit now
> 13/02/11 17:04:17 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000019_0' to temp/Q-job
> 13/02/11 17:04:17 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:17 INFO mapred.Task: Task 'attempt_local_0001_m_000019_0'
> done.
> 13/02/11 17:04:17 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5ad75c47
> 13/02/11 17:04:20 INFO mapred.Task: Task:attempt_local_0001_m_000020_0
> is done. And is in the process of commiting
> 13/02/11 17:04:20 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:20 INFO mapred.Task: Task attempt_local_0001_m_000020_0
> is allowed to commit now
> 13/02/11 17:04:20 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000020_0' to temp/Q-job
> 13/02/11 17:04:20 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:20 INFO mapred.Task: Task 'attempt_local_0001_m_000020_0'
> done.
> 13/02/11 17:04:20 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@d522de2
> 13/02/11 17:04:23 INFO mapred.Task: Task:attempt_local_0001_m_000021_0
> is done. And is in the process of commiting
> 13/02/11 17:04:23 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:23 INFO mapred.Task: Task attempt_local_0001_m_000021_0
> is allowed to commit now
> 13/02/11 17:04:23 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000021_0' to temp/Q-job
> 13/02/11 17:04:23 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:23 INFO mapred.Task: Task 'attempt_local_0001_m_000021_0'
> done.
> 13/02/11 17:04:23 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@44aea710
> 13/02/11 17:04:26 INFO mapred.Task: Task:attempt_local_0001_m_000022_0
> is done. And is in the process of commiting
> 13/02/11 17:04:26 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:26 INFO mapred.Task: Task attempt_local_0001_m_000022_0
> is allowed to commit now
> 13/02/11 17:04:26 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000022_0' to temp/Q-job
> 13/02/11 17:04:26 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:26 INFO mapred.Task: Task 'attempt_local_0001_m_000022_0'
> done.
> 13/02/11 17:04:26 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7bafb0c7
> 13/02/11 17:04:29 INFO mapred.Task: Task:attempt_local_0001_m_000023_0
> is done. And is in the process of commiting
> 13/02/11 17:04:29 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:29 INFO mapred.Task: Task attempt_local_0001_m_000023_0
> is allowed to commit now
> 13/02/11 17:04:29 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000023_0' to temp/Q-job
> 13/02/11 17:04:29 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:29 INFO mapred.Task: Task 'attempt_local_0001_m_000023_0'
> done.
> 13/02/11 17:04:29 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@63a5ec6c
> 13/02/11 17:04:32 INFO mapred.Task: Task:attempt_local_0001_m_000024_0
> is done. And is in the process of commiting
> 13/02/11 17:04:32 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:32 INFO mapred.Task: Task attempt_local_0001_m_000024_0
> is allowed to commit now
> 13/02/11 17:04:32 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000024_0' to temp/Q-job
> 13/02/11 17:04:32 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:32 INFO mapred.Task: Task 'attempt_local_0001_m_000024_0'
> done.
> 13/02/11 17:04:32 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1414627a
> 13/02/11 17:04:35 INFO mapred.Task: Task:attempt_local_0001_m_000025_0
> is done. And is in the process of commiting
> 13/02/11 17:04:35 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:35 INFO mapred.Task: Task attempt_local_0001_m_000025_0
> is allowed to commit now
> 13/02/11 17:04:35 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000025_0' to temp/Q-job
> 13/02/11 17:04:35 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:35 INFO mapred.Task: Task 'attempt_local_0001_m_000025_0'
> done.
> 13/02/11 17:04:35 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@729b1670
> 13/02/11 17:04:38 INFO mapred.Task: Task:attempt_local_0001_m_000026_0
> is done. And is in the process of commiting
> 13/02/11 17:04:38 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:38 INFO mapred.Task: Task attempt_local_0001_m_000026_0
> is allowed to commit now
> 13/02/11 17:04:38 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000026_0' to temp/Q-job
> 13/02/11 17:04:38 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:38 INFO mapred.Task: Task 'attempt_local_0001_m_000026_0'
> done.
> 13/02/11 17:04:38 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f3a34af
> 13/02/11 17:04:41 INFO mapred.Task: Task:attempt_local_0001_m_000027_0
> is done. And is in the process of commiting
> 13/02/11 17:04:41 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:41 INFO mapred.Task: Task attempt_local_0001_m_000027_0
> is allowed to commit now
> 13/02/11 17:04:41 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000027_0' to temp/Q-job
> 13/02/11 17:04:41 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:41 INFO mapred.Task: Task 'attempt_local_0001_m_000027_0'
> done.
> 13/02/11 17:04:41 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3823bdd1
> 13/02/11 17:04:44 INFO mapred.Task: Task:attempt_local_0001_m_000028_0
> is done. And is in the process of commiting
> 13/02/11 17:04:44 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:44 INFO mapred.Task: Task attempt_local_0001_m_000028_0
> is allowed to commit now
> 13/02/11 17:04:44 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000028_0' to temp/Q-job
> 13/02/11 17:04:44 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:44 INFO mapred.Task: Task 'attempt_local_0001_m_000028_0'
> done.
> 13/02/11 17:04:44 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3bd840d9
> 13/02/11 17:04:47 INFO mapred.Task: Task:attempt_local_0001_m_000029_0
> is done. And is in the process of commiting
> 13/02/11 17:04:47 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:47 INFO mapred.Task: Task attempt_local_0001_m_000029_0
> is allowed to commit now
> 13/02/11 17:04:47 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000029_0' to temp/Q-job
> 13/02/11 17:04:47 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:47 INFO mapred.Task: Task 'attempt_local_0001_m_000029_0'
> done.
> 13/02/11 17:04:47 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6760bf50
> 13/02/11 17:04:50 INFO mapred.Task: Task:attempt_local_0001_m_000030_0
> is done. And is in the process of commiting
> 13/02/11 17:04:50 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:50 INFO mapred.Task: Task attempt_local_0001_m_000030_0
> is allowed to commit now
> 13/02/11 17:04:50 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000030_0' to temp/Q-job
> 13/02/11 17:04:50 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:50 INFO mapred.Task: Task 'attempt_local_0001_m_000030_0'
> done.
> 13/02/11 17:04:50 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@a2bccb2
> 13/02/11 17:04:53 INFO mapred.Task: Task:attempt_local_0001_m_000031_0
> is done. And is in the process of commiting
> 13/02/11 17:04:53 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:53 INFO mapred.Task: Task attempt_local_0001_m_000031_0
> is allowed to commit now
> 13/02/11 17:04:53 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000031_0' to temp/Q-job
> 13/02/11 17:04:53 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:53 INFO mapred.Task: Task 'attempt_local_0001_m_000031_0'
> done.
> 13/02/11 17:04:53 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4ca68fd8
> 13/02/11 17:04:56 INFO mapred.Task: Task:attempt_local_0001_m_000032_0
> is done. And is in the process of commiting
> 13/02/11 17:04:56 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:56 INFO mapred.Task: Task attempt_local_0001_m_000032_0
> is allowed to commit now
> 13/02/11 17:04:56 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000032_0' to temp/Q-job
> 13/02/11 17:04:56 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:56 INFO mapred.Task: Task 'attempt_local_0001_m_000032_0'
> done.
> 13/02/11 17:04:56 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bab600f
> 13/02/11 17:04:59 INFO mapred.Task: Task:attempt_local_0001_m_000033_0
> is done. And is in the process of commiting
> 13/02/11 17:04:59 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:59 INFO mapred.Task: Task attempt_local_0001_m_000033_0
> is allowed to commit now
> 13/02/11 17:04:59 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000033_0' to temp/Q-job
> 13/02/11 17:04:59 INFO mapred.LocalJobRunner:
> 13/02/11 17:04:59 INFO mapred.Task: Task 'attempt_local_0001_m_000033_0'
> done.
> 13/02/11 17:04:59 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@395d601f
> 13/02/11 17:05:02 INFO mapred.Task: Task:attempt_local_0001_m_000034_0
> is done. And is in the process of commiting
> 13/02/11 17:05:02 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:02 INFO mapred.Task: Task attempt_local_0001_m_000034_0
> is allowed to commit now
> 13/02/11 17:05:02 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000034_0' to temp/Q-job
> 13/02/11 17:05:02 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:02 INFO mapred.Task: Task 'attempt_local_0001_m_000034_0'
> done.
> 13/02/11 17:05:02 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2cc22a3b
> 13/02/11 17:05:05 INFO mapred.Task: Task:attempt_local_0001_m_000035_0
> is done. And is in the process of commiting
> 13/02/11 17:05:05 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:05 INFO mapred.Task: Task attempt_local_0001_m_000035_0
> is allowed to commit now
> 13/02/11 17:05:05 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000035_0' to temp/Q-job
> 13/02/11 17:05:05 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:05 INFO mapred.Task: Task 'attempt_local_0001_m_000035_0'
> done.
> 13/02/11 17:05:05 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7ae0c7c3
> 13/02/11 17:05:08 INFO mapred.Task: Task:attempt_local_0001_m_000036_0
> is done. And is in the process of commiting
> 13/02/11 17:05:08 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:08 INFO mapred.Task: Task attempt_local_0001_m_000036_0
> is allowed to commit now
> 13/02/11 17:05:08 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000036_0' to temp/Q-job
> 13/02/11 17:05:08 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:08 INFO mapred.Task: Task 'attempt_local_0001_m_000036_0'
> done.
> 13/02/11 17:05:08 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6ac67a88
> 13/02/11 17:05:11 INFO mapred.Task: Task:attempt_local_0001_m_000037_0
> is done. And is in the process of commiting
> 13/02/11 17:05:11 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:11 INFO mapred.Task: Task attempt_local_0001_m_000037_0
> is allowed to commit now
> 13/02/11 17:05:11 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000037_0' to temp/Q-job
> 13/02/11 17:05:11 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:11 INFO mapred.Task: Task 'attempt_local_0001_m_000037_0'
> done.
> 13/02/11 17:05:11 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@30d647d8
> 13/02/11 17:05:14 INFO mapred.Task: Task:attempt_local_0001_m_000038_0
> is done. And is in the process of commiting
> 13/02/11 17:05:14 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:14 INFO mapred.Task: Task attempt_local_0001_m_000038_0
> is allowed to commit now
> 13/02/11 17:05:14 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000038_0' to temp/Q-job
> 13/02/11 17:05:14 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:14 INFO mapred.Task: Task 'attempt_local_0001_m_000038_0'
> done.
> 13/02/11 17:05:14 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@77b5c22f
> 13/02/11 17:05:17 INFO mapred.Task: Task:attempt_local_0001_m_000039_0
> is done. And is in the process of commiting
> 13/02/11 17:05:17 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:17 INFO mapred.Task: Task attempt_local_0001_m_000039_0
> is allowed to commit now
> 13/02/11 17:05:17 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000039_0' to temp/Q-job
> 13/02/11 17:05:17 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:17 INFO mapred.Task: Task 'attempt_local_0001_m_000039_0'
> done.
> 13/02/11 17:05:17 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4c2d0479
> 13/02/11 17:05:19 INFO mapred.Task: Task:attempt_local_0001_m_000040_0
> is done. And is in the process of commiting
> 13/02/11 17:05:19 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:19 INFO mapred.Task: Task attempt_local_0001_m_000040_0
> is allowed to commit now
> 13/02/11 17:05:19 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000040_0' to temp/Q-job
> 13/02/11 17:05:19 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:19 INFO mapred.Task: Task 'attempt_local_0001_m_000040_0'
> done.
> 13/02/11 17:05:19 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@64d22462
> 13/02/11 17:05:22 INFO mapred.Task: Task:attempt_local_0001_m_000041_0
> is done. And is in the process of commiting
> 13/02/11 17:05:22 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:22 INFO mapred.Task: Task attempt_local_0001_m_000041_0
> is allowed to commit now
> 13/02/11 17:05:22 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000041_0' to temp/Q-job
> 13/02/11 17:05:22 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:22 INFO mapred.Task: Task 'attempt_local_0001_m_000041_0'
> done.
> 13/02/11 17:05:22 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f758cd1
> 13/02/11 17:05:25 INFO mapred.Task: Task:attempt_local_0001_m_000042_0
> is done. And is in the process of commiting
> 13/02/11 17:05:25 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:25 INFO mapred.Task: Task attempt_local_0001_m_000042_0
> is allowed to commit now
> 13/02/11 17:05:25 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000042_0' to temp/Q-job
> 13/02/11 17:05:25 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:25 INFO mapred.Task: Task 'attempt_local_0001_m_000042_0'
> done.
> 13/02/11 17:05:25 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1e1ec86
> 13/02/11 17:05:28 INFO mapred.Task: Task:attempt_local_0001_m_000043_0
> is done. And is in the process of commiting
> 13/02/11 17:05:28 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:28 INFO mapred.Task: Task attempt_local_0001_m_000043_0
> is allowed to commit now
> 13/02/11 17:05:28 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000043_0' to temp/Q-job
> 13/02/11 17:05:28 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:28 INFO mapred.Task: Task 'attempt_local_0001_m_000043_0'
> done.
> 13/02/11 17:05:28 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@69f94884
> 13/02/11 17:05:31 INFO mapred.Task: Task:attempt_local_0001_m_000044_0
> is done. And is in the process of commiting
> 13/02/11 17:05:31 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:31 INFO mapred.Task: Task attempt_local_0001_m_000044_0
> is allowed to commit now
> 13/02/11 17:05:31 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000044_0' to temp/Q-job
> 13/02/11 17:05:31 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:31 INFO mapred.Task: Task 'attempt_local_0001_m_000044_0'
> done.
> 13/02/11 17:05:31 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@488ddb93
> 13/02/11 17:05:34 INFO mapred.Task: Task:attempt_local_0001_m_000045_0
> is done. And is in the process of commiting
> 13/02/11 17:05:34 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:34 INFO mapred.Task: Task attempt_local_0001_m_000045_0
> is allowed to commit now
> 13/02/11 17:05:34 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000045_0' to temp/Q-job
> 13/02/11 17:05:34 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:34 INFO mapred.Task: Task 'attempt_local_0001_m_000045_0'
> done.
> 13/02/11 17:05:34 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@52c4c57
> 13/02/11 17:05:37 INFO mapred.Task: Task:attempt_local_0001_m_000046_0
> is done. And is in the process of commiting
> 13/02/11 17:05:37 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:37 INFO mapred.Task: Task attempt_local_0001_m_000046_0
> is allowed to commit now
> 13/02/11 17:05:37 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000046_0' to temp/Q-job
> 13/02/11 17:05:37 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:37 INFO mapred.Task: Task 'attempt_local_0001_m_000046_0'
> done.
> 13/02/11 17:05:37 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5d185844
> 13/02/11 17:05:40 INFO mapred.Task: Task:attempt_local_0001_m_000047_0
> is done. And is in the process of commiting
> 13/02/11 17:05:40 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:40 INFO mapred.Task: Task attempt_local_0001_m_000047_0
> is allowed to commit now
> 13/02/11 17:05:40 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000047_0' to temp/Q-job
> 13/02/11 17:05:40 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:40 INFO mapred.Task: Task 'attempt_local_0001_m_000047_0'
> done.
> 13/02/11 17:05:40 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@66de609
> 13/02/11 17:05:43 INFO mapred.Task: Task:attempt_local_0001_m_000048_0
> is done. And is in the process of commiting
> 13/02/11 17:05:43 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:43 INFO mapred.Task: Task attempt_local_0001_m_000048_0
> is allowed to commit now
> 13/02/11 17:05:43 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000048_0' to temp/Q-job
> 13/02/11 17:05:43 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:43 INFO mapred.Task: Task 'attempt_local_0001_m_000048_0'
> done.
> 13/02/11 17:05:43 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@59050a0
> 13/02/11 17:05:46 INFO mapred.Task: Task:attempt_local_0001_m_000049_0
> is done. And is in the process of commiting
> 13/02/11 17:05:46 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:46 INFO mapred.Task: Task attempt_local_0001_m_000049_0
> is allowed to commit now
> 13/02/11 17:05:46 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000049_0' to temp/Q-job
> 13/02/11 17:05:46 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:46 INFO mapred.Task: Task 'attempt_local_0001_m_000049_0'
> done.
> 13/02/11 17:05:46 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@56a6cbf7
> 13/02/11 17:05:49 INFO mapred.Task: Task:attempt_local_0001_m_000050_0
> is done. And is in the process of commiting
> 13/02/11 17:05:49 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:49 INFO mapred.Task: Task attempt_local_0001_m_000050_0
> is allowed to commit now
> 13/02/11 17:05:49 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000050_0' to temp/Q-job
> 13/02/11 17:05:49 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:49 INFO mapred.Task: Task 'attempt_local_0001_m_000050_0'
> done.
> 13/02/11 17:05:49 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5c5ddd3
> 13/02/11 17:05:52 INFO mapred.Task: Task:attempt_local_0001_m_000051_0
> is done. And is in the process of commiting
> 13/02/11 17:05:52 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:52 INFO mapred.Task: Task attempt_local_0001_m_000051_0
> is allowed to commit now
> 13/02/11 17:05:52 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000051_0' to temp/Q-job
> 13/02/11 17:05:52 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:52 INFO mapred.Task: Task 'attempt_local_0001_m_000051_0'
> done.
> 13/02/11 17:05:52 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5ae8a0cd
> 13/02/11 17:05:55 INFO mapred.Task: Task:attempt_local_0001_m_000052_0
> is done. And is in the process of commiting
> 13/02/11 17:05:55 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:55 INFO mapred.Task: Task attempt_local_0001_m_000052_0
> is allowed to commit now
> 13/02/11 17:05:55 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000052_0' to temp/Q-job
> 13/02/11 17:05:55 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:55 INFO mapred.Task: Task 'attempt_local_0001_m_000052_0'
> done.
> 13/02/11 17:05:55 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4c6127da
> 13/02/11 17:05:58 INFO mapred.Task: Task:attempt_local_0001_m_000053_0
> is done. And is in the process of commiting
> 13/02/11 17:05:58 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:58 INFO mapred.Task: Task attempt_local_0001_m_000053_0
> is allowed to commit now
> 13/02/11 17:05:58 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000053_0' to temp/Q-job
> 13/02/11 17:05:58 INFO mapred.LocalJobRunner:
> 13/02/11 17:05:58 INFO mapred.Task: Task 'attempt_local_0001_m_000053_0'
> done.
> 13/02/11 17:05:58 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2e8932e8
> 13/02/11 17:06:01 INFO mapred.Task: Task:attempt_local_0001_m_000054_0
> is done. And is in the process of commiting
> 13/02/11 17:06:01 INFO mapred.LocalJobRunner:
> 13/02/11 17:06:01 INFO mapred.Task: Task attempt_local_0001_m_000054_0
> is allowed to commit now
> 13/02/11 17:06:01 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000054_0' to temp/Q-job
> 13/02/11 17:06:01 INFO mapred.LocalJobRunner:
> 13/02/11 17:06:01 INFO mapred.Task: Task 'attempt_local_0001_m_000054_0'
> done.
> 13/02/11 17:06:01 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@644ca6b6
> 13/02/11 17:06:04 INFO mapred.Task: Task:attempt_local_0001_m_000055_0
> is done. And is in the process of commiting
> 13/02/11 17:06:04 INFO mapred.LocalJobRunner:
> 13/02/11 17:06:04 INFO mapred.Task: Task attempt_local_0001_m_000055_0
> is allowed to commit now
> 13/02/11 17:06:04 INFO output.FileOutputCommitter: Saved output of
> task 'attempt_local_0001_m_000055_0' to temp/Q-job
> 13/02/11 17:06:04 INFO mapred.LocalJobRunner:
> 13/02/11 17:06:04 INFO mapred.Task: Task 'attempt_local_0001_m_000055_0'
> done.
> 13/02/11 17:06:04 INFO mapred.Task: Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1ff243d1
> 13/02/11 17:06:05 ERROR common.IOUtils: new m can't be less than n
> java.lang.IllegalArgumentException: new m can't be less than n
> at
> org.apache.mahout.math.hadoop.stochasticsvd.qr.GivensThinSolver.adjust(GivensThinSolver.java:109)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.qr.QRFirstStep.cleanup(QRFirstStep.java:233)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.qr.QRFirstStep.close(QRFirstStep.java:89)
> at org.apache.mahout.common.IOUtils.close(IOUtils.java:128)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.QJob$QMapper.cleanup(QJob.java:158)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> 13/02/11 17:06:05 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.IllegalArgumentException: new m can't be less than n
> at
> org.apache.mahout.math.hadoop.stochasticsvd.qr.GivensThinSolver.adjust(GivensThinSolver.java:109)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.qr.QRFirstStep.cleanup(QRFirstStep.java:233)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.qr.QRFirstStep.close(QRFirstStep.java:89)
> at org.apache.mahout.common.IOUtils.close(IOUtils.java:128)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.QJob$QMapper.cleanup(QJob.java:158)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> Exception in thread "main" java.io.IOException: Q job unsuccessful.
> at
> org.apache.mahout.math.hadoop.stochasticsvd.QJob.run(QJob.java:230)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.SSVDSolver.run(SSVDSolver.java:377)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.SSVDCli.run(SSVDCli.java:141)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at
> org.apache.mahout.math.hadoop.stochasticsvd.SSVDCli.main(SSVDCli.java:171)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> at
> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> at
> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> -end mahout output]
>
