Re: MLUtils.loadLibSVMFile error

2014-09-25 Thread Liquan Pei
> Date: Wed, 24 Sep 2014 22:13:35 -0700 > Subject: Re: MLUtils.loadLibSVMFile error > From: liquan...@gmail.com > To: ssti...@live.com > CC: so...@cloudera.com; user@spark.apache.org > > > Hi Sameer, > > I think there are two things that you can do > 1)

RE: MLUtils.loadLibSVMFile error

2014-09-25 Thread Sameer Tilak
submitted as an app in spark-submit yarn-client mode. I am not sure whether this is due to difference between spark-shell and spark-submit or yarn vs non-yarn mode. Date: Wed, 24 Sep 2014 22:13:35 -0700 Subject: Re: MLUtils.loadLibSVMFile error From: liquan...@gmail.com To: ssti...@live.com CC

Re: MLUtils.loadLibSVMFile error

2014-09-24 Thread Liquan Pei
ache.spark.scheduler.Task.run(Task.scala:51) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:187) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja

RE: MLUtils.loadLibSVMFile error

2014-09-24 Thread Sameer Tilak
> From: so...@cloudera.com > Date: Wed, 24 Sep 2014 23:07:27 +0100 > Subject: Re: MLUtils.loadLibSVMFile error > To: ssti...@live.com > > Well, why not show some of the file? it's pretty certain there is a > problem with the format. The large repeated stack trace does

Re: MLUtils.loadLibSVMFile error

2014-09-24 Thread Liquan Pei
Hi Sameer, This seems to be a file format issue. Can you make sure that your data satisfies the format? Each line of libsvm format is as follows: : : ... Thanks, Liquan On Wed, Sep 24, 2014 at 3:02 PM, Sameer Tilak wrote: > Hi All, > > > When I try to load dataset using MLUtils.loadLibSV