ldacey commented on issue #42371: URL: https://github.com/apache/airflow/issues/42371#issuecomment-2427845796
Looks great. Are there any new views for Datasets/Assets in the works as well? I have been splitting my DAGs up, one (or more) for extracting raw data and the other for processing/transformation. Right now, the dataset view shows a lot of dags instead of just the inlets/outlets for the DAG I am looking at (sometimes for other clients so it is not a view i can use while sharing my screen). (extract DAG): list_files (source dataset) -> extract_files (raw dataset) -> trigger_dag (outlet = raw dataset) (transform DAG): scheduled on raw dataset transform_files (bronze dataset) -> deduplicate (silver dataset) -> finalize (gold dataset) It would be nice to be able to see the lineage **from** the DAG if possible. So if I am within the transform DAG then I would see something like source > raw > bronze > silver > gold and be able to click on a link to the raw DAG. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
