Re: Splitting spark dstream into separate fields

2016-04-26 Thread Mich Talebzadeh
ich Talebzadeh > To: Praveen Devarao/India/IBM@IBMIN, "user @spark" < > user@spark.apache.org> > Date:26/04/2016 04:03 pm > Subject:Re: Splitting spark dstream into separate fields > > -- > > > > Thanks Pr

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
n't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again" From: Mich Talebzadeh To: Praveen Devarao/India/IBM@IBMIN, "user @spark" Date: 26/04/2016 04:03 pm Subject:Re: Splitting spark dstream into separate fields

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Mich Talebzadeh
--- > Praveen Devarao > Spark Technology Centre > IBM India Software Labs > > - > "Courage doesn't always roar. Sometimes courage is the quiet voice at the > end of the day sayi

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
- "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again" From: Mich Talebzadeh To: "user @spark" Date: 26/04/2016 12:58 pm Subject:Splitting spark dstream into separate

Splitting spark dstream into separate fields

2016-04-26 Thread Mich Talebzadeh
Hi, Is there any optimum way of splitting a dstream into components? I am doing Spark streaming and this the dstream I get val dstream = KafkaUtils.createDirectStream[String, String, StringDecoder, StringDecoder](ssc, kafkaParams, topics) Now that dstream consists of 10,00 price lines per seco