DartVeDroid commented on issue #58053:
URL: https://github.com/apache/airflow/issues/58053#issuecomment-3609407169
It's broken in 3.0.1, too.
Currently upgrading 2.11.0 -> 3.0.1, and startup logs look weird. Lines
starting with `<class` are made by me to debug what's happening - and to me it
seems like:
- Airflow loading configs
- Airflow creating the correct handlers
- Airflow checking configs for deprecations
- ???
- Airflow creating the incorrect handlers
```
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/configuration.py:2252
FutureWarning: The 'log_filename_template' setting in [logging] has the old
default value of 'dag_id={{ ti.dag_id }}/run_id={{ ti.run_id }}/task_id={{
ti.task_id }}/{% if ti.map_index >= 0 %}map_index={{ ti.map_index }}/{% endif
%}attempt={{ try_number }}.log'. This value has been changed to 'dag_id={{
ti.dag_id }}/run_id={{ ti.run_id }}/task_id={{ ti.task_id }}/{% if ti.map_index
>= 0 %}map_index={{ ti.map_index }}/{% endif %}attempt={{
try_number|default(ti.try_number) }}.log' in the running config, but please
update your config.
<class
'logging_config_package.logging_config.ModifiedRedirectStdHandler'>.{'stream':
'sys.stdout'}
<class
'logging_config_package.logging_config.ModifiedElasticsearchTaskHandler'>.{'base_log_folder':
'/usr/tmp/logs/', 'end_of_log_mark': 'end_of_log', 'host':
'https://127.0.0.1:9200', 'frontend': 'https://127.0.0.1:5601', 'write_stdout':
True, 'write_to_es': False, 'target_index': 'airflow-logs', 'json_format':
True, 'json_fields': 'asctime, filename, lineno, levelname, message',
'host_field': 'host', 'offset_field': 'offset'}
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/cli/cli_config.py:591
DeprecationWarning: The web_server_port option in [webserver] has been moved to
the port option in [api] - the old setting has been used, but please update
your config.
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/cli/cli_config.py:597
DeprecationWarning: The workers option in [webserver] has been moved to the
workers option in [api] - the old setting has been used, but please update your
config.
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/cli/cli_config.py:609
DeprecationWarning: The web_server_host option in [webserver] has been moved to
the host option in [api] - the old setting has been used, but please update
your config.
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/cli/cli_config.py:614
DeprecationWarning: The access_logfile option in [webserver] has been moved to
the access_logfile option in [api] - the old setting has been used, but please
update your config.
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/cli/cli_config.py:629
DeprecationWarning: The web_server_ssl_cert option in [webserver] has been
moved to the ssl_cert option in [api] - the old setting has been used, but
please update your config.
/opt/airflow/.venv/lib/python3.11/site-packages/airflow/cli/cli_config.py:634
DeprecationWarning: The web_server_ssl_key option in [webserver] has been moved
to the ssl_key option in [api] - the old setting has been used, but please
update your config.
<class 'logging.StreamHandler'>.{}
<class 'airflow.sdk.log.StdBinaryStreamHandler'>.{'stream': <_io.FileIO
name='<stdout>' mode='wb' closefd=False>}
2025-12-04 00:25:19.976152 [info ] Detected user-defined logging config.
Attempting to load logging_config_package.logging_config.LOGGING_CONFIG
[airflow.utils.serve_logs]
2025-12-04 00:25:19.976556 [info ] Successfully imported user-defined
logging config. Flask App will serve log from /usr/tmp/logs/
[airflow.utils.serve_logs]
2025-12-04 00:25:19.979329 [warning ] The dag_dir_list_interval option in
[scheduler] has been moved to the refresh_interval option in [dag_processor] -
the old setting has been used, but please update your config. [py.warnings]
category=DeprecationWarning
filename=/opt/airflow/.venv/lib/python3.11/site-packages/airflow/dag_processing/bundles/base.py
lineno=257
2025-12-04 00:25:19.980288 [info ] starting stale bundle cleanup process
[airflow.providers.celery.cli.celery_command]
[2025-12-04 00:25:20 +0000] [19] [INFO] Starting gunicorn 23.0.0
[2025-12-04 00:25:20 +0000] [19] [INFO] Listening at: http://[::]:8793 (19)
[2025-12-04 00:25:20 +0000] [19] [INFO] Using worker: sync
[2025-12-04 00:25:20 +0000] [21] [INFO] Booting worker with pid: 21
[2025-12-04 00:25:20 +0000] [22] [INFO] Booting worker with pid: 22
-------------- celery@6f87e09ee399 v5.5.2 (immunity)
--- ***** -----
-- ******* ---- Linux-6.10.11-linuxkit-x86_64-with-glibc2.36 2025-12-04
00:25:20
- *** --- * ---
- ** ---------- [config]
- ** ---------- .> app:
airflow.providers.celery.executors.celery_executor:0x7f0aac693910
- ** ---------- .> transport: redis://airflow:**@redis:6379/0
- ** ---------- .> results: postgresql://airflow:**@postgres/airflow
- *** --- * --- .> concurrency: 16 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this
worker)
--- ***** -----
-------------- [queues]
.> default exchange=default(direct) key=default
[tasks]
. execute_workload
2025-12-04 00:25:22.899541 [info ] Connected to
redis://airflow:**@redis:6379/0 [celery.worker.consumer.connection]
2025-12-04 00:25:22.902008 [info ] mingle: searching for neighbors
[celery.worker.consumer.mingle]
2025-12-04 00:25:23.911176 [info ] mingle: all alone
[celery.worker.consumer.mingle]
2025-12-04 00:25:23.933480 [info ] celery@6f87e09ee399 ready.
[celery.apps.worker]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
