Re: Kryo serializer slower than Java serializer for Spark Streaming

es, which Java serialization always would. > > On Thu, Oct 6, 2016 at 2:47 PM Rajkiran Rajkumar > wrote: > >> Hi, >> I am running a Spark Streaming application which reads from a Kinesis >> stream and processes data. The application is run on EMR. Recently, we >

Kryo serializer slower than Java serializer for Spark Streaming

Hi, I am running a Spark Streaming application which reads from a Kinesis stream and processes data. The application is run on EMR. Recently, we tried moving from Java's inbuilt serializer to Kryo serializer. To quantify the performance improvement, I tried pumping 3 input records to the applic

[HELP] Force stop a Spark Streaming application running on EMR

Hi Spark community, I have a Spark streaming application that reads from a Kinesis stream and processes data. It calls some services which can experience transient failures. When such a transient failure happens, a retry mechanism kicks into action. For the shutdown use case, I have a separate th