mjordyn commented on issue #43717: URL: https://github.com/apache/airflow/issues/43717#issuecomment-2599247441
I encountered a very similar issue in Airflow 2.10.1 with apache-airflow-providers-amazon==8.28.0. However, in my case, I was running Airflow in a Docker container (Docker Compose), not using MWAA, and the logs missing from the Airflow UI were the first few from each of my ECS tasks. These logs were present in the ECS task CloudWatch log streams. Adding a 10 second sleep statement before the logger.info calls as a workaround caused those logs to appear as expected in the Airflow UI. All of this held true for a few separate `EcsRunTaskOperator` steps calling different ECS tasks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
