[jira] [Created] (AIRFLOW-2664) Support filtering on /dags//dag_runs

2018-06-22 Thread Ryan Roden-Corrent (JIRA)
Ryan Roden-Corrent created AIRFLOW-2664:
---

 Summary: Support filtering on /dags//dag_runs
 Key: AIRFLOW-2664
 URL: https://issues.apache.org/jira/browse/AIRFLOW-2664
 Project: Apache Airflow
  Issue Type: New Feature
  Components: api
Reporter: Ryan Roden-Corrent


the `GET /dags//dag_runs` endpoint was recently added as described in 
AIRFLOW-2550. I'd like a ?run_id_prefix parameter to filter runs by the run_id.

 

For example, `GET /dags/my_dag/dag_runs?run_id_prefix=create_namespace_foo 
would return the list of dag runs with a run_id starting with 
"create_namespace_foo".

 

An additional filter would be a `?latest=` query param to limit the count to 
the latest  runs (I believe the list returned by GET is already ordered 
chronologically). For example, `GET 
/dags/my_dag/dag_runs?run_id_prefix=create_namespace_foo=1` would return 
the last run with run_id starting with create_namespace_foo.

 

Do these features sound generally useful, or are they too specific?

 

In our use case, we have a DAG that provisions namespaced resources. If I'm 
provisioning resources for namespace foo, I would `POST 
/dags/provision/dag_runs \{"run_id": "create_namespace_foo"}`. To check on the 
status, we could run `GET 
/dags/provision/dag_runs?run_id_prefix=create_namespace_foo=1`.

 

While there is already an endpoint to get status based on an exact dag_run ID, 
this requires storing the id after the POST, which would make our service 
stateful. Filtering by a prefix allows for stateless querying of status.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AIRFLOW-2550) API endpoint to list dagruns

2018-06-14 Thread Ryan Roden-Corrent (JIRA)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512899#comment-16512899
 ] 

Ryan Roden-Corrent commented on AIRFLOW-2550:
-

FYI, I have a WIP implementation, I'm just waiting for my company to go through 
the legal process of approving contributions.


> API endpoint to list dagruns
> 
>
> Key: AIRFLOW-2550
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2550
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: api
>Reporter: Ryan Roden-Corrent
>Assignee: Verdan Mahmood
>Priority: Major
>
> There should be an endpoint, say 'GET /dags//dag_runs` that 
> lists all runs for a given DAG. 
>  
> Related: https://issues.apache.org/jira/browse/AIRFLOW-1919 is requesting a 
> similar CLI option, though in our case we need all runs, not just actively 
> running runs. Possibly a ?state=running query option could be added.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (AIRFLOW-2550) API endpoint to list dagruns

2018-06-01 Thread Ryan Roden-Corrent (JIRA)
Ryan Roden-Corrent created AIRFLOW-2550:
---

 Summary: API endpoint to list dagruns
 Key: AIRFLOW-2550
 URL: https://issues.apache.org/jira/browse/AIRFLOW-2550
 Project: Apache Airflow
  Issue Type: New Feature
  Components: api
Reporter: Ryan Roden-Corrent


There should be an endpoint, say 'GET /dags//dag_runs` that 
lists all runs for a given DAG. 

 

Related: https://issues.apache.org/jira/browse/AIRFLOW-1919 is requesting a 
similar CLI option, though in our case we need all runs, not just actively 
running runs. Possibly a ?state=running query option could be added.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)