jedcunningham commented on issue #18937: URL: https://github.com/apache/airflow/issues/18937#issuecomment-946984570
Hey @opendatakraken, the webserver should be reading from the log file on the PVC (e.g. you should see a similar line at the top of the log `*** Reading local file: /opt/airflow/logs/long/hello/2021-10-19T18:08:43.081816+00:00/1.log`). We don't start the log server in the KubernetesExecutor worker pods. Even if we did, we'd then be missing a Service to even be able to access it. Instead, it sounds like your PVC isn't being mounted into the webserver, or maybe it's being mounted onto the wrong path? I'd double check something along those lines isn't misconfigured. I'm also not sure what you mean by "main pod", do you mean the scheduler, webserver, or both? I wasn't able to replicate the UI being flaky while a task is running with the official helm chart. Might be worth checking the `selector` on your service and the labels being set on your workers too? Anything in the webserver log? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
