Actually, if you are clustering books, the books should be rows. On Fri, Oct 7, 2011 at 8:26 AM, Dan Brickley <[email protected]> wrote:
> Running from recent trunk, I can't get any sign of life from the > 'rowid' command / job. Null Pointer Exception, even when just asking > for --help. Details below. > > Also I tried running this more directly as 'mahout > org.apache.mahout.utils.vectors.RowIdJob --input > sparse3/tfidf-vectors/part-r-00000 --output matrixified/' but no > success there either. > > I'm trying to get my book code sparse vectors into a form that can be > usefully SVD'd, now that I have made some successful / plausible > clusters using those vectors. I think I need first to transpose them > so my columns correspond to records/books not their subject codes, but > the transpose job complained with type errors, and searching on those > led me to discover the 'rowid' task, which I believe I need to use > before I can transpose my matrix. So I seem to be stuck. Is rowid the > thing to be using here? > > Dan > > TellyClub:bin danbri$ ./mahout rowid --help > MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath. > Running on hadoop, using > HADOOP_HOME=/Users/danbri/working/hadoop/hadoop-0.20.2 > HADOOP_CONF_DIR=/Users/danbri/working/hadoop/hadoop-0.20.2/conf > MAHOUT-JOB: > /Users/danbri/working/mahout/trunk/examples/target/mahout-examples-0.6-SNAPSHOT-job.jar > ^CTellyClub:bin danbri$ MAHOUT_LOCAL=true ./mahout rowid --help > MAHOUT_LOCAL is set, so we don't add HADOOP_CONF_DIR to classpath. > MAHOUT_LOCAL is set, running locally > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > > [jar:file:/Users/bandri/working/mahout/trunk/examples/target/mahout-examples-0.6-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > > [jar:file:/Users/bandri/working/mahout/trunk/examples/target/dependency/slf4j-jcl-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > > [jar:file:/Users/bandri/working/mahout/trunk/examples/target/dependency/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > Exception in thread "main" java.lang.NullPointerException > at org.apache.hadoop.fs.Path.<init>(Path.java:61) > at org.apache.hadoop.fs.Path.<init>(Path.java:50) > at org.apache.mahout.utils.vectors.RowIdJob.run(RowIdJob.java:49) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) > at org.apache.mahout.utils.vectors.RowIdJob.main(RowIdJob.java:89) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) > at > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) > at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:188) >
