Re: Spark MLlib:Collaborative Filtering

2016-08-24 Thread Praveen Devarao
You could use the string indexer to convert your string userids and product ids numeric value. http://spark.apache.org/docs/latest/ml-features.html#stringindexer Thanking You - Praveen Devarao IBM India Software

Re: removing header from csv file

2016-04-26 Thread Praveen Devarao
- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again" From: Ashu

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
n it and decide how to make use of it. Thanking You --------- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage d

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
ive/api/2.10.6/index.html#scala.collection.mutable.IndexedSeqView Thanking You ----- Praveen Devarao Spark Technology Centre IBM India Software Labs - &quo

Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
Cool!! Thanks for the clarification Mike. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Co

Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
anking You ----- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again"

Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
his that invoke a Job, though they are transformations and not actions? I am on Spark 1.6 Thanking You --------- Praveen Devarao Spark Technology C

Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Praveen Devarao
able to achieve your task. Thanking You --------- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. S

Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Praveen Devarao
will start first though order of ending is not guaranteed with concurrentJobs set to more than 1)... Would be interesting to know your use case...could you share, if possible? Thanking You - Praveen Devarao

Re: Spark structured streaming

2016-03-08 Thread Praveen Devarao
- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try

Spark structured streaming

2016-03-08 Thread Praveen Devarao
a consumability angle. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Some

Re: Guidelines for writing SPARK packages

2016-02-02 Thread Praveen Devarao
share with me...else debugging through would be the way :-) Thanking You Praveen Devarao From: David Russell <themarchoffo...@gmail.com> To: Praveen Devarao/India/IBM@IBMIN Cc: user <user@spark.apache.org> Date: 01/02/2016 07:03 pm Subject:Re: Guidelines for w

Guidelines for writing SPARK packages

2016-02-01 Thread Praveen Devarao
point to docs or links on the above? Thanking You Praveen Devarao