cfmcgrady commented on PR #1807: URL: https://github.com/apache/incubator-celeborn/pull/1807#issuecomment-1677403639
sorry for misreading before, the `volatile` should guarantees atomicity. cc @waitinfuture After digging into the problem more deeply, I found that the main issue is with something we call "async push". The task thread might get interrupted for various reasons, and one common scenario is when you kill the task in the UI tab. Even though the task thread was stopped, the asynchronous push thread continued running and triggered the `pushData` operation. This led to illegal access to data, ultimately causing a crash in the JVM. I'll share the pieces of code that can show the problem later. Even though I tried to fix it, my attempts didn't work out. Do you have any ideas about this issue? cc @pan3793 @waitinfuture -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
