GitHub user bh7274 edited a comment on the discussion: API-Server occurs memory alarm in K8S Env.
When running the airflow api-server with args, there is no way to set a separate memory limit. When a large number of tasks occur at once, memory req is 6GB, limit is 9GB. Even if memory req is set to 4GB, limit is set to 9GB, memory alarms are still detected through Prometheus, Grafana, and OCP Alter Manager. (Alarms are triggered when memory usage exceeds 80%.) (Test environment: wrcp 24.02, OCP 3.x, 4.x, HW: Dell R740, public: 10GB, Internal: 40GB, SSD, Rock Ceph) For example, in the case of a Java application, I can limit the maximum usage of heap memory to a percentage to prevent an alarm from occurring, but currently, there is no separate option for the airflow api-server, so it cannot be set. GitHub link: https://github.com/apache/airflow/discussions/56671#discussioncomment-14689597 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
