Re: SparkStreaming failing with exception Could not compute split, block input

Also my job is map only so there is no shuffle/reduce phase. On Fri, Feb 27, 2015 at 7:10 PM, Mukesh Jha wrote: > I'm streamin data from kafka topic using kafkautils & doing some > computation and writing records to hbase. > > Storage level is memory-and-disk-ser > On 27 Feb 2015 16:20, "Akhil D

Re: SparkStreaming failing with exception Could not compute split, block input

I'm streamin data from kafka topic using kafkautils & doing some computation and writing records to hbase. Storage level is memory-and-disk-ser On 27 Feb 2015 16:20, "Akhil Das" wrote: > You could be hitting this issue > https://issues.apache.org/jira/browse/SPARK-4516 > Apart from that little m

Re: SparkStreaming failing with exception Could not compute split, block input

You could be hitting this issue https://issues.apache.org/jira/browse/SPARK-4516 Apart from that little more information about your job would be helpful. Thanks Best Regards On Wed, Feb 25, 2015 at 11:34 AM, Mukesh Jha wrote: > Hi Experts, > > My Spark Job is failing with below error. > > From

Re: SparkStreaming failing with exception Could not compute split, block input

I don't have an idea, but perhaps a little more context would be helpful. What is the source of your streaming data? What's the storage level you're using? What are you doing? Some kind of windows operations? Regards, Jeff 2015-02-26 18:59 GMT+01:00 Mukesh Jha : > > On Wed, Feb 25, 2015 at 8:09

Re: SparkStreaming failing with exception Could not compute split, block input

On Wed, Feb 25, 2015 at 8:09 PM, Mukesh Jha wrote: > My application runs fine for ~3/4 hours and then hits this issue. > > On Wed, Feb 25, 2015 at 11:34 AM, Mukesh Jha > wrote: > >> Hi Experts, >> >> My Spark Job is failing with below error. >> >> From the logs I can see that input-3-14248423516

Re: SparkStreaming failing with exception Could not compute split, block input

My application runs fine for ~3/4 hours and then hits this issue. On Wed, Feb 25, 2015 at 11:34 AM, Mukesh Jha wrote: > Hi Experts, > > My Spark Job is failing with below error. > > From the logs I can see that input-3-1424842351600 was added at 5:32:32 > and was never purged out of memory. Also

SparkStreaming failing with exception Could not compute split, block input

Hi Experts, My Spark Job is failing with below error. >From the logs I can see that input-3-1424842351600 was added at 5:32:32 and was never purged out of memory. Also the available free memory for the executor is *2.1G*. Please help me figure out why executors cannot fetch this input. Txz for