gferrate opened a new issue #8044: celery worker_autoescale option in 
configuration file overrided by default value
URL: https://github.com/apache/airflow/issues/8044
 
 
   **Apache Airflow version**: 1.10.9
   
   **Environment**:
   
   - **OS**: Debian GNU/Linux 10
   - **Kernel**: Linux 4.19.0-8-amd64 #1 SMP Debian 4.19.98-1 (2020-01-26) 
x86_64 GNU/Linux
   
   **What happened**:
   The `worker_autoscale` configuration option in `airflow.cfg` was overridded 
by the default value in `airflow/config_templates/default_airflow.cfg`  when 
left commented in the `airflow.cfg` file.
   
   **What you expected to happen**:
   The `worker_autoscale` option not being overridden by the default value.
   
   **How to reproduce it**:
   - Comment the `worker_autoscale` option in the `[celery]` section in 
`airflow.cfg`.
   - Spawn a worker by running `airflow worker`
   - The celery worker will be spawned with the default autoscale option (16,12)
   
   **Anything else we need to know**:
   - As the `worker_autoscale` option has priority over the `concurrency` 
option, the last one gets ignored even if autoscale is commented in the config 
file.
   - The `worker_autoscale` option is commented in  
`airflow/config_templates/default_airflow.cfg` in the master branch (which 
fixes the issue) but not in the 1.10.9 release.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to