devashish-parmar opened a new issue, #26201: URL: https://github.com/apache/airflow/issues/26201
### Apache Airflow version 2.3.4 ### What happened We have set up a multi node Airflow configuration. We have the below setup. - 4 nodes - node 1: webserver, rabbitmq, flower - node 2: meta db - node 3: worker 1 - node 4: worker 2 Although the setup is working fine and DAGs are getting distributed among the worker nodes, however the logs generated in the worker nodes are not reflecting in the webserver UI in the master node. Below is the error: ***** Log file does not exist: /home/dvafadm/airflow/logs/dag_id=second_dag/run_id=manual__2022-09-07T10:16:57.050200+00:00/task_id=second_dag/attempt=1.log *** Fetching from: http://<hostname>:8793/log/dag_id=second_dag/run_id=manual__2022-09-07T10:16:57.050200+00:00/task_id=second_dag/attempt=1.log *** !!!! Please make sure that all your Airflow components (e.g. schedulers, webservers and workers) have the same 'secret_key' configured in 'webserver' section and time is synchronized on all your machines (for example with ntpd) !!!!! ****** See more at https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#secret-key ****** Failed to fetch log file from worker. Client error '403 FORBIDDEN' for url 'http://<hostname>:8793/log/dag_id=second_dag/run_id=manual__2022-09-07T10:16:57.050200+00:00/task_id=second_dag/attempt=1.log' For more information check: https://httpstatuses.com/403** We have checked all the folder permission, secret_key, timezone but still the problem persist. can anyone help here? ### What you think should happen instead _No response_ ### How to reproduce _No response_ ### Operating System Linux Red Hat ### Versions of Apache Airflow Providers _No response_ ### Deployment Virtualenv installation ### Deployment details _No response_ ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
