[
https://issues.apache.org/jira/browse/MAHOUT-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Summer Lee updated MAHOUT-1231:
-------------------------------
Description:
.seqdirectory
> mahout seqdirectory --input /user/hdfs/input/new1.csv --output
> /user/hdfs/new1/seqdirectory --tempDir
> /user/hdfs/new1/seqdirectory/tempDir
2.seq2sparse
> mahout seq2sparse --input /user/hdfs/new1/seqdirectory --output
> /user/hdfs/new1/seq2sparse -wt tfidf
3.kmeans
> mahout kmeans --input /user/hdfs/new1/seq2sparse/tfidf-vectors
> --output /user/hdfs/new1/kmeans -c /user/hdfs/new1/clusters/kmeans -x 3 -k 3
> --tempDir /user/hdfs/new1/kmeans/tempDir
and then error is occured
Failing Oozie Launcher, Main class [org.apache.mahout.driver.MahoutDriver],
main() threw exception, No input clusters found in
/user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check your -c
argument.
java.lang.IllegalStateException: No input clusters found in
/user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check your -c
argument.
at
org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Oozie Launcher failed, finishing Hadoop job gracefully
Oozie Launcher ends
=======================================================================================================
When I first tried with this input file, I succeeded on the hadoop in command.
and in Second, also I succeeded.
but in the hadoop with oozie system, Kmeans can't make clusters..
Where is the start point of the error?
I'm really frustrated..
was:
<---seqdirectory output chunk-0 --->
SEQorg.apache.hadoop.io.Textorg.apache.hadoop.io.Textn�甕蛛 �]∬�Y80�/mahout_input_z3.csv�0y1,2,1.31704E+12
1,17,3.23E+16
1,49,1.2863E+13
1,94,6.41839E+11
2,64,18022372449 ....
<---seq2sparse output tfidf-vectors/part-r-00000 --->
SEQorg.apache.hadoop.io.Text%org.apache.mahout.math.VectorWritable�HYM�θ9L�
<---kmeans error--->
Failing Oozie Launcher, Main class [org.apache.mahout.driver.MahoutDriver],
main() threw exception, No input clusters found in
/user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check your -c
argument.
java.lang.IllegalStateException: No input clusters found in
/user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check your -c
argument.
at
org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Oozie Launcher failed, finishing Hadoop job gracefully
Oozie Launcher ends
=======================================================================================================
When I first tried with this input file, I succeeded on the hadoop in command.
and in Second, also I succeeded.
but in the hadoop with oozie system, Kmeans can't make clusters..
Where is the start point of the error?
I'm really frustrated..
> "No input clusters found in " error in clustering
> -------------------------------------------------
>
> Key: MAHOUT-1231
> URL: https://issues.apache.org/jira/browse/MAHOUT-1231
> Project: Mahout
> Issue Type: Question
> Components: Clustering
> Affects Versions: 0.7, 0.8
> Reporter: Summer Lee
>
> .seqdirectory
> > mahout seqdirectory --input /user/hdfs/input/new1.csv --output
> > /user/hdfs/new1/seqdirectory --tempDir
> > /user/hdfs/new1/seqdirectory/tempDir
> 2.seq2sparse
> > mahout seq2sparse --input /user/hdfs/new1/seqdirectory --output
> > /user/hdfs/new1/seq2sparse -wt tfidf
> 3.kmeans
> > mahout kmeans --input /user/hdfs/new1/seq2sparse/tfidf-vectors
> > --output /user/hdfs/new1/kmeans -c /user/hdfs/new1/clusters/kmeans -x 3 -k
> > 3 --tempDir /user/hdfs/new1/kmeans/tempDir
> and then error is occured
> Failing Oozie Launcher, Main class [org.apache.mahout.driver.MahoutDriver],
> main() threw exception, No input clusters found in
> /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check your -c
> argument.
> java.lang.IllegalStateException: No input clusters found in
> /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check your -c
> argument.
> at
> org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
> at
> org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
> at
> org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at
> org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Oozie Launcher failed, finishing Hadoop job gracefully
> Oozie Launcher ends
> =======================================================================================================
> When I first tried with this input file, I succeeded on the hadoop in command.
> and in Second, also I succeeded.
> but in the hadoop with oozie system, Kmeans can't make clusters..
>
> Where is the start point of the error?
> I'm really frustrated..
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
