liviazhu commented on PR #53411: URL: https://github.com/apache/spark/pull/53411#issuecomment-3638634589
> Please change the misleading PR title. Although the initial intention was about testing time, this PR introduce a major behavior change in `src/main`, @liviazhu . @dongjoon-hyun The only way that functionality changes is by setting the internal conf (`"spark.sql.streaming.stateStore.maintenanceShutdownTimeout"`) lower than 300s (the current default) since we are using the min value between this and the existing 60s. Currently, the only place this can change is in tests. Given this, does this still count as a behavior change? If it still counts as a behavior change, if I instead added another internal conf to configure this second timeout, would that be okay? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
