kacpermuda commented on issue #41261: URL: https://github.com/apache/airflow/issues/41261#issuecomment-2269218380
TLDR; I don't think current information about task group is insufficient and we can probably close this issue. I believe when using AirflowJobFacet included in DAG START event you can assign each task to a specific task group and then see all the upstream task groups to that taskgroup, creating a holistic view. So the scenario for the consumer would be something like: we get DAG start event, we extract all the tasks and task groups assigned to them, for each task group we find parent task group, recursively, and that gives that the information about the whole relationship between task groups even if task_group_ids are not present cause the user disabled this with `prefix_group_id=False`. Finally, for each task, we can map the task id from task event and assign this whole structure we created before. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
