Hi, repartition is expensive. Looking for an efficient to do this. Regards,Laeeq
On Friday, March 13, 2015 12:24 PM, Akhil Das <ak...@sigmoidanalytics.com> wrote: Like this? dtream.repartition(1).mapPartitions(it => it.take(5)) ThanksBest Regards On Fri, Mar 13, 2015 at 4:11 PM, Laeeq Ahmed <laeeqsp...@yahoo.com.invalid> wrote: Hi, I normally use dstream.transform whenever I need to use methods which are available in RDD API but not in streaming API. e.g. dstream.transform(x => x.sortByKey(true)) But there are other RDD methods which return types other than RDD. e.g. dstream.transform(x => x.top(5)) top here returns Array. In the second scenario, how can i return RDD rather than array, so that i can perform further steps on dstream. Regards, Laeeq