potiuk commented on PR #32183: URL: https://github.com/apache/airflow/pull/32183#issuecomment-1609667746
I like the new layout a lot. I have few questions/suggestions though (The image of ours is awfully out-dated and I would like to use the opportunity to fix that): 1) Can you please add Triggerer there? It's been missing for quite some time 2) Can you please also separate DAG file processor from scheduler "optionally" to show that it can run as an independent component? IT would then access both DB and DAG files, while scheduler would not run DAG files. 3) Web server should not need access to DAG files (In modern Airflow the main DAG file source code is stored in the metadata DB and this is where Webserver reads it from) 4) Is it possible to get sources of the image as well and (that might be the next step) a way to generate it automatically ? Not sure how you generated that image - but one of the main reasons it is out-dated is that we always need to re-do the whole image from scratch every time there is a smallest change (and you see what it leads to). So we discussed that we need to get a way to generate the image automatically - https://github.com/apache/airflow/issues/21071 - either rendering it by GitHub (mermaid) or maybe some other way. If you have some way to generate such an image from a text description that would be ideal, second best is to habe some kind of vector diagram sources committed that can be opened and edited using some free-open-source (ideally) or free service (less ideal) tool (+ short readme instructions on what program to use and how. Is it too much to ask as part of the PR ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
