RE: RE: how to use a custom distance measure with kmeans?

2013-02-19 Thread Mihai Josan
Hello, I managed to resolve the problem without modifying the Mahout script. I inserted my classes into the mahout job jar (mahout-examples-0.7-cdh4.1.2-job.jar) and everything is ok now. Thank you very much for your help, Mihai Josan -Original Message- From: Mihai Josan

Re: how to use a custom distance measure with kmeans?

2013-02-14 Thread Dan Filimon
I can think of only 2 possibilities: - in the script, I think it goes through the if statements to line 251 where the HADOOP_CLASSPATH is being set; that line differs from line 243 where the CLASSPATH you set also gets added. So, it seems that the CLASSPATH you set isn't being passed to hadoop.

RE: how to use a custom distance measure with kmeans?

2013-02-14 Thread Mihai Josan
I modified line 251 like this: export HADOOP_CLASSPATH=$MAHOUT_CONF_DIR:${HADOOP_CLASSPATH}:$CLASSPATH Now I don't have the Class not found exception but I get: Error: java.lang.ClassNotFoundException: org.apache.mahout.math.Vector I found a big discussion regarding this error at

Re: how to use a custom distance measure with kmeans?

2013-02-13 Thread Dan Filimon
Sure, that sounds like an ever better solution! I didn't read the entire script. :) On Wed, Feb 13, 2013 at 6:40 AM, Mahesh Balija balijamahesh@gmail.com wrote: Hi Dan, If we copy the jar containing the custom classes to the MAHOUT_HOME/lib folder wont that work fine?

RE: how to use a custom distance measure with kmeans?

2013-02-13 Thread Mihai Josan
Hello, After I made the changes, I still get the Class not found exception. I created my project using maven and eclipse and the jar is generated from eclipse export jar. Do you have any other idea how to resolve this problem? mahout kmeans -i /user/rhadoop/mahout/abac-out/sequence \

Re: how to use a custom distance measure with kmeans?

2013-02-12 Thread Mahesh Balija
Are you getting any errors? Can you specify fully qualified class name of your distance measure (like com.xxx.MyDistanceMeasure) and check? Best, Mahesh Balija, Calsoft Labs. On Tue, Feb 12, 2013 at 2:28 PM, Mihai Josan mihai.jo...@iquestgroup.comwrote: Hello, Can you please tell me how can

Re: how to use a custom distance measure with kmeans?

2013-02-12 Thread Mihai Josan
This is the error I receive: mahout kmeans -i /user/rhadoop/in/sequence/ \ -c /user/rhadoop/out/canopy-centroids/clusters-0 \ -o /user/rhadoop/out/clusters-out/ \ -x 10 \ -dm

Re: how to use a custom distance measure with kmeans?

2013-02-12 Thread Dan Filimon
You need to add the JAR containing the distance measure you want to the classpath. By default the CLASSPATH is set in line 120 of the mahout script. (the script itself is in the bin/ folder of your Mahout installation). Sadly I don't think that scripts allows you to set the class path by default,

Re: how to use a custom distance measure with kmeans?

2013-02-12 Thread Jeff Eastman
You also need to specify a fully-qualified class name On 2/12/13 11:48 AM, Dan Filimon wrote: You need to add the JAR containing the distance measure you want to the classpath. By default the CLASSPATH is set in line 120 of the mahout script. (the script itself is in the bin/ folder of your

Re: how to use a custom distance measure with kmeans?

2013-02-12 Thread Mahesh Balija
Hi Dan, If we copy the jar containing the custom classes to the MAHOUT_HOME/lib folder wont that work fine? Because at line 147 of mahout script it reads all jars under lib folder and put into classpath. If this won't work prolly there should be some