jedcunningham commented on issue #20196: URL: https://github.com/apache/airflow/issues/20196#issuecomment-991097464
Even then, your pattern won't work without also having persistence enabled, as each component gets its own emptyDir dags volume. There are also race conditions with your plan - think of the delay between syncing a new change from git (which throws away local changes) and your generator DAG running. You'd be better off having something else do the DAG generation (e.g. ci/cd), then using git-sync on that output. Or use a PVC instead of gitsync. I think it's "safer" to only allow read so the wiping behavior isn't surprising. Thoughts @kaxil / @dstandish? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
