Hari Sekhon created AIRFLOW-1553:
------------------------------------

             Summary: Feature Request: Rest API for Monitoring workflow and 
task status
                 Key: AIRFLOW-1553
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1553
             Project: Apache Airflow
          Issue Type: New Feature
          Components: api
            Reporter: Hari Sekhon


Feature Request to complete full API for monitoring integration of Airflow 
workflows and tasks.

The experimental API currently doesn't expose enough information as there is 
only a GET on a specific dag and task id, and a POST to create a dag run.

I've dug around in the source code with a colleague and we've found in 
endpoints.py

/api/experimental/latest_runs

but the url refs are back to the UI which would require scraping.

What we ideally need are JSON Rest API endpoints to be able to list all dags 
and all tasks for a given dag and endpoints to show the status and related 
details of the last run of a given dag. I'm sure there is more that could be 
added but this would be a good start, so that unified enterprise monitoring 
systems like nagios etc could integrate the Airflow workflow statuses in to 
their single ops dashboards.

I've also found an airflow plugin which exposes a rest api which seems 
promising:

https://github.com/teamclairvoyant/airflow-rest-api-plugin

Perhaps you could integrate this or do something similar?

Btw thanks very much for the great work on this project so far :)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to