Arunodoy18 commented on issue #61716: URL: https://github.com/apache/airflow/issues/61716#issuecomment-3901596708
Thanks for the detailed investigation! From the discussion and logs, this does look like a race between cleanup and clone operations across concurrent runs. I’m interested in working on this. My initial thought is to explore adding version-level locking around clone/open operations to ensure only one process prepares a bundle version directory at a time, instead of relying on retries. If that direction sounds reasonable, I’d be happy to prototype a fix and add concurrency tests. Please let me know if you have any preferences on approach. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
