l" wrote:
>>
>>> The best practice is to set batch interval lesser than processing time.
>>> I'm
>>> sure your application is suffering from constantly increasing of
>>> scheduling
>>> delay.
>>>
>>>
>>>
>>>
;
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous-batch-
reasing of scheduling
> delay.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous-batch-tp25559p25707.html
> Sent from the Apache Spark
The best practice is to set batch interval lesser than processing time. I'm
sure your application is suffering from constantly increasing of scheduling
delay.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-wo
) you process each batch as rdd in parallel.
...Manas
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous-batch-tp25559p25581.html
Sent from the Apache Spark User List ma
-working-on-next-batch-before-completing-on-previous-batch-tp25559.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail
