maxcountryman opened a new issue #16025:
URL: https://github.com/apache/airflow/issues/16025


   **Apache Airflow version**: 2.2.0
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl 
version`): N/A (ECS)
   
   **Environment**: Production
   
   - **Cloud provider or hardware configuration**: AWS ECS Fargate
   - **OS** (e.g. from /etc/os-release): Ubuntu
   - **Kernel** (e.g. `uname -a`):
   - **Install tools**: poetry
   - **Others**:
   
   **What happened**:
   
   Since Airflow 2.x we've seen Celery-related failures with exceptions like 
this being the most prominent: `AirflowException: Celery command failed on 
host: ip-10-0-10-110.us-west-2.compute.internal`.
   
   **What you expected to happen**:
   
   No Celery command failures during normal operation.
   
   **How to reproduce it**:
   
   Deploy an Airflow cluster with a Celery + Redis executor to an ECS Fargate 
cluster.
   
   **Anything else we need to know**:
   
   How often does this problem occur? Once? Every time etc?
   
   ~30 times per hour.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to