Re: Is there any Spark source in Java

2018-11-03 Thread Jeyhun Karimov
Hi Soheil, >From the spark github repo, you can find some classes implemented in Java: https://github.com/apache/spark/search?l=java Cheers, Jeyhun On Sat, Nov 3, 2018 at 6:42 PM Soheil Pourbafrani wrote: > Hi, I want to customize some part of Spark. I was wondering if there any > Spark

Spark streaming crashes with high throughput

2016-10-23 Thread Jeyhun Karimov
Hi, I am getting *Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages.* error with spark streaming job. I am using spark 2.0.0. The job is simple windowed aggregation and the stream is read from socket. Average