SamWheating commented on issue #18239: URL: https://github.com/apache/airflow/issues/18239#issuecomment-944809282
> worker.abc.com -> Airflow workers (multiple behind a load balancer sharing logs storage) I don't think this is going to work, since each airflow worker runs a background flask application which serves logs from tasks run on that worker at the specified logging port (in this case 8793). https://github.com/apache/airflow/blob/9b3ed1f652fcdf6eaf672e5d15646a0512b852f4/airflow/utils/serve_logs.py#L70-L72 By running the workers behind a load balancer, you're removing the webserver's ability to specify which server the logs are stored on. I suspect that if you reload the page enough times it may work eventually when your request happens to be routed to the correct worker via the load balancer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
