GitHub user potiuk added a comment to the discussion: Unable to see logs in the web UI when the job is running
Yeah, I think I knw what it is. it looks like your processes have too low ulimit set. The error usually happens when there are not enough sockets. This is an "os" level error and often caused by `ulimit` constraints on the kernel level. Simply it looks like whatever underlying kernel configuration you have, it opened too many sockets already. This might also happen when you have many, many many processes/pods sharing the same kernel on the machine you run it - each of them will open sockets for all kind of communication and at some point of time you simply run out of those. So you have to look at the configuration of your Kubernetes and Kernel to see how you can increase the numbers. Converting it into a discussion in case more is needeed. GitHub link: https://github.com/apache/airflow/discussions/45624#discussioncomment-11823676 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
