bunnysayzz commented on issue #73858: URL: https://github.com/apache/airflow/issues/73858#issuecomment-5917149071
Can reproduce this from the code. `_find_files_in_bundle` yields the zip archive itself (`my_dags.zip`) since the scanner lists zip entries as files, but `_add_callback_to_queue` keys the callback processor by the path inside the archive (`my_dags.zip/my_dag.py`). On the next bundle refresh `terminate_orphan_processes` compares presence keys, the inner path never matches the archive entry, and the processor gets SIGKILLed even though its Dag is still there. Fix is straightforward: the presence check should treat a path inside a zip as observed while its containing archive is in the scan set. Opening a PR with the fix plus unit tests for the kill and no-kill directions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
