jonathanjuursema commented on issue #28010: URL: https://github.com/apache/airflow/issues/28010#issuecomment-1339573092
Hey @potiuk, thanks for getting back! I have studied the docs you've linked and did some more Googling. Based on [this Stackoverflow question](https://stackoverflow.com/questions/44979811/adding-extra-celery-configs-to-airflow) I've built an implementation for our usecase, also implementing [this](https://stackoverflow.com/questions/44979811/adding-extra-celery-configs-to-airflow#comment94305165_48075177) syntax for keeping the defaults. However, when I deploy this, the deployment works and both Airflow and Celery seem happy with the config, but it still doesn't work. When inspecting the [actual runtime config in the webinterface](https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#expose-config) I learn that it correctly reads the value for `AIRFLOW__CELERY__CELERY_CONFIG_OPTIONS`, but for `AIRFLOW__CELERY__BROKER_URL` it reverts back to the default. Even though we're specifying our own (Redis Sentinel) broker url in [this place](https://github.com/apache/airflow/blob/1.9.0/airflow/config_templates/default_celery.py#L30) in our own custom dict, the debug logging shows that Celery is trying to connect using the "default" connection string in `AIRFLOW__CELERY__BROKER_URL`. It seems to ignore the value from `AIRFLOW__CELERY__CELERY_CONFIG_OPTIONS`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
