Re: Parallelism of Custom receiver in spark

2015-07-26 Thread Michal Čizmazia
on the transformations that are used. See https://spark.apache.org/docs/latest/streaming-programming-guide.html#memory-tuning Hope this helps. On 25 July 2015 at 13:43, anshu shukla anshushuk...@gmail.com wrote: 1 - How to increase the level of *parallelism in spark streaming custom RECEIVER* . 2

Parallelism of Custom receiver in spark

2015-07-25 Thread anshu shukla
1 - How to increase the level of *parallelism in spark streaming custom RECEIVER* . 2 - Will ssc.receiverstream(/**anything //) will *delete the data stored in spark memory using store(s) * logic . -- Thanks Regards, Anshu Shukla