GitHub user vidma edited a comment on the discussion: Scheduling simultaneous task try before previous try ended
Any update @tarper24 ? did increasing various heartbeat intervals solve the problem for you? I seems very similar issues are still happening on `AWS MWAA` with Airflow 2.7.2, with Celery executors (no kubernetes, Fargate node). Interestingly the weird (seemingly unexpected) repeated killing (or is massacre/slaughter the right word here?) of celery workers with SIGTERMs start exactly after 12h after restart of the MWAA/scheduler, which is exactly the default value of `celery_broker_transport_options.visibility_timeout`. GitHub link: https://github.com/apache/airflow/discussions/33474#discussioncomment-11067020 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
