potiuk commented on issue #23798: URL: https://github.com/apache/airflow/issues/23798#issuecomment-1133870269
> @uranusjr I'm not sure what all the info you need, but I'm providing as much as I can. Just to set expectations: Basically, any information that might help people here to help you. People here help in their free time, and more often than not the problems are connected to people misconfiguring Airlfow, or simply not troubleshooting their deployment as they should. While the community here delivers airflow as software - you are responsible for configuring it properly (and learning how to do it). So if we help here - we do it in our free time, mostly when users had shown that they've done investigations on their side and provided enough info to help others diagnose it. There shoudl be no expectations that you will for sure get help here. If you provide enough info, you might get it. I think - if you want to help us diagnose your deployment issue - is to provide even more information. So it's really you who should care about giving as much information as you can, so that we can help you (again - this is free help on free software, if you NEED your problem to be solved, there are companies that provide paid support for troubleshooting airlfow installations). In this particular case I can advice you to provide more information on circumstances. A number of questions come to my mind immediately - but again - probably you can provide even more information - it's you, who want to have your problem solved, so it's your worry to provide enough information. * Does it happen always? * or for specific tasks only? * or maybe intermittently (sometimes works, sometimes not)? * what customisations you have (Especially for logging) * do you have any netwerking/firewall configuration? * did you check that networking works between the webserver and UI and that dns works properly to see your pods from the URL? * do you have special configuration for logs ? * does your pod have persistent storage for logs ? * is the file that you are trying to access when you see the error /opt/airflow/airflow/logs/mydagname/mytaskname/2022-05-19T04:53:37.167551+00:00/2.log - actually present in the workar that webserver tries to download it from? * is your callable (the one you configured) actually called and works? Please run it in the worker pod and see what it returns as hostname/Ip address. Maybe your networking is miconfigured and it provides empty value * do you have the right hostname in task_instance table for the tasks you run ? What is the value for an example failure. I think going through that list might help you to gather enough information to make it possible to help you. Converting it into discussion until more info is provided. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
