Re: StreamCorruptedException during deserialization

2016-03-29 Thread Robert Schmidtke
Hafner wrote: > 2016-03-29 11:25 GMT+02:00 Robert Schmidtke : > > Is there a meaningful way for me to find out what exactly is going wrong > > here? Any help and hints are greatly appreciated! > Maybe a version mismatch between the jars on the cluster? > -- My GPG Key ID: 336E2680

StreamCorruptedException during deserialization

2016-03-29 Thread Robert Schmidtke
Hi everyone, I'm running the Intel HiBench TeraSort (1TB) Spark Scala benchmark on Spark 1.6.0. After some time, I'm seeing one task fail too many times, despite being rescheduled on different nodes with the following stacktrace: 16/03/27 22:25:04 WARN scheduler.TaskSetManager: Lost task 97.0 in