Gajanan Hebbar created SPARK-31246:

             Summary: GracefulShutdown does not work when application is 
terminated from RestSubmissionClient or YarnClient
                 Key: SPARK-31246
             Project: Spark
          Issue Type: Bug
          Components: Java API
    Affects Versions: 2.4.3
         Environment: spark-2.4.3
            Reporter: Gajanan Hebbar

While starting the Spark Application 
"*spark.streaming.stopGracefullyOnShutdown*" is set to true

try to terminate the application programatically using JAVA API

1 using RestSubmissionClient client = new RestSubmissionClient(masterUrl);
             SubmitRestProtocolResponse statusResponse = 


2. using getYarnClient().killApplication(appId);


In both the cases Application dose not stop gracefully


But killing the Application using  


Kill -SIGTERM <pid>  will shutdown the application gracefully.

Expected : Application should have terminated gracefully in all cases when 
spark.streaming.stopGracefullyOnShutdown is set

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to