The GitHub Actions job "Tests (AMD)" on airflow.git/feat-24171-support_yarn_application_status has failed. Run started by GitHub user nailo2c (triggered by nailo2c).
Head commit for run: 0628bee2f4ab66f6508afb33fc9632ec4035cfce / nailo2c <[email protected]> Spark: track YARN cluster apps via RM REST API to free JVM In YARN cluster mode, Airflow keeps a local spark-submit JVM alive for each running Spark task to monitor completion. At scale, these long-lived JVMs consume significant Airflow worker memory. Adds an opt-in `yarn_track_via_rm_api` flag that releases the local spark-submit JVM after YARN submission and tracks completion via the YARN ResourceManager REST API. closes: #24171 Report URL: https://github.com/apache/airflow/actions/runs/26556497765 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
