dimberman opened a new issue #8000: Show whether spark job is "running" or "waiting" URL: https://github.com/apache/airflow/issues/8000 Ticket was created 07/Feb/17 21:52 **Description** As of now, Airflow shows that a task is "running" in Airflow when it could be listed as "WAITING" in the Spark UI (and can be listed as "WAITING" for hours when the Airflow UI might indicate it is running if I forget to check the Spark UI). Would be awesome once ticket 802 for spark integration is complete to add this enhancement of more granular detail about the task. Note (Daniel 3/29/20): We should add an "external" field to task state to store task-specific data like spark cluster state **Use case / motivation** **Related Issues** Moved here from https://issues.apache.org/jira/browse/AIRFLOW-849
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
