The GitHub Actions job "Tests" on airflow.git/onikolas/multi_team_celery_executor has failed. Run started by GitHub user o-nikolas (triggered by o-nikolas).
Head commit for run: f48285b6e5283f4863d8b416ebe85db7d46ea73d / Niko Oliveira <[email protected]> Update Celery Executor to support multi team Updating the Celery executor to read from team based config and also support multiple instances running concurrently. The latter is the largest source of changes. Much of the celery configuration (both Airflow config and Celery config) was module based. Modules are cached and shared in Python. So the majority of the changes are moving that module level config code to be function based (while trying to also maintain backwards compatibility). The way Celery tasks are sent to workers also changed as a consequence of this. Since sending tasks is parallelized with multiple processes (which do not share memory with the parent) the send task logic now re-creates a celery app in the sub processes (since the pickling and unpickling that python does to try pass state to the sub processes was not reliably creating the correct celery app objects). Report URL: https://github.com/apache/airflow/actions/runs/21085670752 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
