[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[Michael Griffiths (Jira)]

Title: Message Title

Michael Griffiths commented on SPARK-34645   Re: [K8S] Driver pod stuck in Running state after job completes v.3.3.0 has resolved this for us when running in Azure. After isolating the root cause, it's due to the websocket not sending pings to the api-server, resulting in the websocket connection silently being dropped. The commit which fixed this was https://github.com/apache/spark/commit/457b75ea2bca6b5811d61ce9f1d28c94b0dde3a2 Backporting this to v3.2.0 also resolved it for that version if anyone is unable to update to v3.3.0. Add Comment   This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9)