Abacn commented on PR #40090: URL: https://github.com/apache/beam/pull/40090#issuecomment-5636550764
> the red Spark Versions run on this PR was cancel() stopping the SparkSession while the execution thread was still translating. > It was pre-existing in the shared runner This could be a real bug. Is this a test timing or an issue could affect production? add 60s timeout is just an ad-hoc mitigation and is non-deterministic If multiple tests / pipeline share same Spark session, cancel the session should only happen after all tests completed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
