potiuk commented on issue #33445: URL: https://github.com/apache/airflow/issues/33445#issuecomment-1685059034
This sounds like EFS/EKS problem, not airflow. I think you should look for similar issues (I saw there are plenty of airflow-unrelated issues raised with EFS/EKS and other apps having similar issues. From a quick look it's likely a configuration of networking or EFS resources that need to be able to handle that many mounts, but I think it's best if you look for similar issues or raise the issue to AWS support. Converting to discussion, in case more discussion is needed as it seems a deployment-specific troubleshooting, not airflow issue. BTW. Comment for the future It would be great to explain the difference you have in your configuration vs. standard or maybe add your specific code in the [collapsible section of markdown])https://gist.github.com/pierrejoubert73/902cc94d79424356a8d20be2b382e1ab) - the more easy you make for someone who tries to help you to understand your issue, the better (remember people here try to help when they can in their free time) - so by making it easier to see what the problem is, you increase your chances that someon will help you to solve your problem, In this case it took me quite some time time scroll many pages of the configuration (which maybe was useful but impossible to analyse in full by human) in order to find what the problem is. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
