peloyeje opened a new issue, #76590:
URL: https://github.com/apache/airflow/issues/76590

   ### Under which category would you file this issue?
   
   Providers
   
   ### Apache Airflow version
   
   3.3.2 (also seen on 2.11.0)
   
   ### What happened and how to reproduce it?
   
   Celery 5.7.0 (released 2026-11-05) removed `retry` from 
`celery.backends.database` in celery/celery#10130. `celery_executor_utils.py` 
still imports it on `main`:
   
   ```python
   from celery.backends.database import DatabaseBackend, Task as TaskDb, retry, 
session_cleanup
   ```
   
   The provider requires `celery[redis]>=5.5.0,<6`, so a fresh install picks 
Celery 5.7.0. The scheduler then fails to load `CeleryExecutor`, and `airflow 
celery worker` is not available.
   
   ```bash
   AIRFLOW_HOME=$(mktemp -d) uv run --no-project --python 3.12 \
     --with apache-airflow==3.3.2 \
     --with apache-airflow-providers-celery==3.26.0 \
     --with celery==5.7.0 \
     python -c "from airflow.providers.celery.executors import 
celery_executor_utils"
   ```
   
   ```
   ImportError: cannot import name 'retry' from 'celery.backends.database'
   ```
   
   The same command with `celery==5.6.3` and `kombu<5.7` imports without error.
   
   ### What you think should happen instead?
   
   The provider should work with every Celery version it allows. `retry` 
decorates `BulkStateFetcher._query_task_cls_from_db_backend`, so the fix needs 
a retry for that query that does not come from Celery's database backend. Until 
then, the provider could cap Celery at `<5.7`.
   
   ### Operating System
   
   Debian 12 (bookworm)
   
   ### Deployment
   
   Other Docker-based deployment
   
   ### Apache Airflow Provider(s)
   
   celery
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-celery==3.26.0 (also 3.17.2)
   
   ### Official Helm Chart version
   
   Not Applicable
   
   ### Kubernetes Version
   
   Not Applicable
   
   ### Helm Chart configuration
   
   Not Applicable
   
   ### Docker Image customizations
   
   None needed to reproduce.
   
   ### Anything else?
   
   Every installation that does not pin Celery hits this. Workaround: pin 
`celery<5.7` and `kombu<5.7`.
   
   ### Are you willing to submit PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to