andreyvital commented on issue #39717: URL: https://github.com/apache/airflow/issues/39717#issuecomment-2122946338
Not sure...it seems related to redis? I have seen other people report similar issues: - https://github.com/apache/airflow/discussions/37129 - https://github.com/apache/airflow/issues/26542#issuecomment-1913058540 - https://github.com/celery/celery/discussions/7276#discussioncomment-8160246 - https://github.com/apache/airflow/pull/31829 - https://github.com/celery/celery/issues/8030 - https://github.com/celery/celery/pull/8796 - https://github.com/celery/celery/issues/8845 Also, a lot of DAGs are failing within the same reason, so that's not entirely tied to Task Mapping at all. Some tasks fail very early...also this server has a lot of RAM, of which I've granted ~12gb to each work and the task is very simple, just HTTP requests, all of them run in less than 2 minutes when they don't fail. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
