Hi,
repartition is expensive. Looking for an efficient to do this.
Regards,Laeeq
On Friday, March 13, 2015 12:24 PM, Akhil Das <[email protected]>
wrote:
Like this?
dtream.repartition(1).mapPartitions(it => it.take(5))
ThanksBest Regards
On Fri, Mar 13, 2015 at 4:11 PM, Laeeq Ahmed <[email protected]>
wrote:
Hi,
I normally use dstream.transform whenever I need to use methods which are
available in RDD API but not in streaming API. e.g. dstream.transform(x =>
x.sortByKey(true))
But there are other RDD methods which return types other than RDD. e.g.
dstream.transform(x => x.top(5)) top here returns Array. In the second
scenario, how can i return RDD rather than array, so that i can perform further
steps on dstream.
Regards,
Laeeq
