pankajkoti commented on PR #31920: URL: https://github.com/apache/airflow/pull/31920#issuecomment-1623844603
Hi @Owen-CH-Leung The steps to reproduce this would be following: 1. Clone the apache/airflow repo, pull the latest code on main 2. Start airflow locally using breeze, I am using CeleryExecutor locally with postgres backend ```breeze start-airflow --executor CeleryExecutor --backend postgres``` 3. You will get into a tmux session, and you can modify the following keys in the `/root/airflow/airflow.cfg` file ``` [logging] remote_logging = True [elasticsearch] json_format = True host = host.docker.internal:9200 host_field = host.name offset_field = log.offset ``` 4. Restart all your components(especially webserver) in the tmux session, by hitting Ctrl+C and then starting each of the component in it's window pane viz., `airflow scheduler`, `airflow celery worker`, `airflow webserver`. Once your task completes and you try to fetch the logs you will see this error in the webserver. Run the task and go to the task logs to fetch the logs from this remote ES host. I am using Filebeat to ship logs to ES. I am attaching my airflow.cfg for your reference. I had to append the .txt prefix to the file for it to be able to attached here. [airflow.cfg.txt](https://github.com/apache/airflow/files/11969606/airflow.cfg.txt) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
