rishikesh thakur [mailto:rishikeshtha...@hotmail.com]
Sent: Friday, July 17, 2015 12:33 AM
To: Mohammed Guller
Subject: Re: Feature Generation On Spark
Thanks I did look at the example. I am using Spark 1.2. The modules mentioned
there are not in 1.2 I guess. The import is
Take a look at the examples here:
https://spark.apache.org/docs/latest/ml-guide.html
Mohammed
From: rishikesh thakur [mailto:rishikeshtha...@hotmail.com]
Sent: Saturday, July 4, 2015 10:49 PM
To: ayan guha; Michal Čizmazia
Cc: user
Subject: RE: Feature Generation On Spark
I have one document
I have one document per file and each file is to be converted to a feature
vector. Pretty much like standard feature construction for document
classification.
ThanksRishi
Date: Sun, 5 Jul 2015 01:44:04 +1000
Subject: Re: Feature Generation On Spark
From: guha.a...@gmail.com
To: mici
09:37:52 -0400
> Subject: Re: Feature Generation On Spark
> From: mici...@gmail.com
> To: rishikeshtha...@hotmail.com
> CC: user@spark.apache.org
>
> Spark Context has a method wholeTextFiles. Is that what you need?
>
> On 4 July 2015 at 07:04, rishikesh wrote:
> &g
Do you have one document per file or multiple document in the file?
On 4 Jul 2015 23:38, "Michal Čizmazia" wrote:
> Spark Context has a method wholeTextFiles. Is that what you need?
>
> On 4 July 2015 at 07:04, rishikesh wrote:
> > Hi
> >
> > I am new to Spark and am working on document classifi
Spark Context has a method wholeTextFiles. Is that what you need?
On 4 July 2015 at 07:04, rishikesh wrote:
> Hi
>
> I am new to Spark and am working on document classification. Before model
> fitting I need to do feature generation. Each document is to be converted to
> a feature vector. However
