mukulmurthy opened a new pull request #28095: [SPARK-31324][SS] Include stream ID in the termination timeout error message URL: https://github.com/apache/spark/pull/28095 ### What changes were proposed in this pull request? Include stream ID in the error thrown when a stream does not stop() in time. ### Why are the changes needed? https://github.com/apache/spark/pull/26771/ added a conf to set a requested timeout for stopping a stream, after which the stop() method throws. From seeing this in a production use case with several streams running, it's helpful to include which stream failed to stop in the error message. ### Does this PR introduce any user-facing change? If a stream times out when terminating, the error message now includes the stream ID. Before: `Stream Execution thread failed to stop within 2000 milliseconds (specified by spark.sql.streaming.stopTimeout). See the cause on what was being executed in the streaming query thread.` After: `Stream Execution thread for stream [id = 8513769d-b9d2-4902-9b36-3668bd022245, runId = 21ed8c35-9bfe-423f-853d-c022d91818bc] failed to stop within 2000 milliseconds (specified by spark.sql.streaming.stopTimeout). See the cause on what was being executed in the streaming query thread.` ### How was this patch tested? Updated existing unit test
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
