Re: Spark Streaming : requirement failed: numRecords must not be negative

ement failed: numRecords must not be negative Is it possible to reproduce the condition below with test code ? Thanks On Fri, Jan 22, 2016 at 7:31 AM, Afshartous, Nick mailto:nafshart...@turbine.com>> wrote: Hello, We have a streaming job that consistently fails with the trace belo

Re: Spark Streaming : requirement failed: numRecords must not be negative

Is it possible to reproduce the condition below with test code ? Thanks On Fri, Jan 22, 2016 at 7:31 AM, Afshartous, Nick wrote: > > Hello, > > > We have a streaming job that consistently fails with the trace below. > This is on an AWS EMR 4.2/Spark 1.5.2 cluster. > > > This ticket looks relate

Spark Streaming : requirement failed: numRecords must not be negative

Hello, We have a streaming job that consistently fails with the trace below. This is on an AWS EMR 4.2/Spark 1.5.2 cluster. This ticket looks related SPARK-8112 Received block event count through the StreamingListener can be negative although it appears to have been fixed in 1.5.