Re: IOException running streaming job

2014-09-29 Thread Arun Ahuja
We are also seeing this PARSING_ERROR(2) error due to Caused by: java.io.IOException: failed to uncompress the chunk: PARSING_ERROR(2) at org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:362) at

IOException running streaming job

2014-09-23 Thread Emil Gustafsson
I'm trying out some streaming with spark and I'm getting an error that puzzles me since I'm new to Spark. I get this error all the time but 1-2 batches in the stream are processed before the job stops. but never the complete job and often no batch is processed at all. I use Spark 1.1.0. The job