rammmaa opened a new pull request, #74853:
URL: https://github.com/apache/airflow/pull/74853
git-sync publishes each revision by repointing the Dags folder symlink to a
new checkout. When that happens during file discovery, child directories
resolve into the new checkout and no longer find the ignore rules inherited
from their parent, so files under ignored directories are picked up for that
scan.
<!-- SPDX-License-Identifier: Apache-2.0
https://www.apache.org/licenses/LICENSE-2.0 -->
---
##### Was generative AI tooling used to co-author this PR?
- [ ] Yes (please specify the tool below)
---
When git-sync switches the Dag folder symlink during file discovery,
subdirectories can lose the rules inherited from .airflowignore. The rules are
stored under resolved paths, so switching to a new checkout causes subsequent
lookups to miss. Files that should be ignored can then be discovered and parsed.
Key inherited rules by the walked path so they remain available across a
symlink switch. Keep resolved paths in a separate set to preserve the existing
recursive-link detection.
Add a deterministic regression test that atomically switches the symlink
after discovery has stored the parent’s rules. The test fails without the fix
and passes with it. All 35 tests in shared/module_loading/tests/module_loading
pass.
Closes #74851
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]