GitHub user potiuk added a comment to the discussion: log worker identity
Yep. Details of Airflow architecture are described in https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/overview.html -> there you can understand how Airflow works. You usually also see information about logs in your logging solution that gathers the information about the deployment you - have - either the deployment you manage (in which case you should make sure you add appropriate logging information you miss - following https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/logging-monitoring/advanced-logging-configuration.html or your managed Airflow solution should have (in which case you should raise an issue to whover manges your Airflow) Airflow is deployment agnostic - it can be deployed in many ways https://airflow.apache.org/docs/apache-airflow/stable/installation/index.html -> so Airflow has no notion about ECS, Docker ID, Cluster - because it might be deployed without either of those. It's the role of Deployment Manager (i.e. you if you self-manage airflow or whoever provides you managed airflow) to configure airflow in the way that your monitoring and management of running airflow is good in the context of your deployment. We clearly explain it in the installation pages I quoted above - where responsibility of Deployment Manager is clearly explained. Just follow it. GitHub link: https://github.com/apache/airflow/discussions/59756#discussioncomment-15327914 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
