Re: Graceful stop for spark streaming.

2023-03-22 Thread Mich Talebzadeh
Read this [SPARK-42485] SPIP: Shutting down spark structured streaming when the streaming process completed current process - ASF JIRA (apache.org) HTH Mich Talebzadeh, Lead Solutions Architect

Graceful stop for spark streaming.

2023-03-21 Thread Srinivas Rishindra
Hi Team, Does anyone know about any ongoing work to gracefully stop spark streaming applications externally using "yarn application -stop" or by using any other method? My understanding is that in order to make use of "yarn application -stop", spark needs to implement "org.apache.hadoop.yarn.clie