[
https://issues.apache.org/jira/browse/AIRFLOW-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181435#comment-17181435
]
ASF GitHub Bot commented on AIRFLOW-1488:
-----------------------------------------
xaoo edited a comment on pull request #4291:
URL: https://github.com/apache/airflow/pull/4291#issuecomment-677866367
Just finished adding your implementation. I had to edit it... I did not
understood in what format the xcom value should exist:
I saved it like this, I used: `TriggerDagRunOperator` and extended it to
push to xcom it's `run_id`
```
Key | Value
test_bp_org_policies | trig__2020-08-20T19:15:43.018172+00:00
```
Or you expect some specific operator to save it in some specific format?
failed here:
```
ids = dagrun_ids[:2]
ids = ids + ['...'] if len(dagrun_ids) > 2 else ids
self.log.info('Poking for %s', ','.join(ids))
```
because of course i save my run_id as a string.
btw, thank you, really helpful
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Add a sensor operator to wait on DagRuns
> ----------------------------------------
>
> Key: AIRFLOW-1488
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1488
> Project: Apache Airflow
> Issue Type: New Feature
> Components: contrib, operators
> Reporter: Yati
> Assignee: Yati
> Priority: Major
>
> The
> [ExternalTaskSensor|https://airflow.incubator.apache.org/code.html#airflow.operators.ExternalTaskSensor]
> operator already allows for encoding dependencies on tasks in external DAGs.
> However, when you have teams, each owning multiple small-to-medium sized
> DAGs, it is desirable to be able to wait on an external DagRun as a whole.
> This allows the owners of an upstream DAG to refactor their code freely by
> splitting/squashing task responsibilities, without worrying about dependent
> DAGs breaking.
> I'll now enumerate the easiest ways of achieving this that come to mind:
> * Make all DAGs always have a join DummyOperator in the end, with a task id
> that follows some convention, e.g., "{{ dag_id }}.__end__".
> * Make ExternalTaskSensor poke for a DagRun instead of TaskInstances when the
> external_task_id argument is None.
> * Implement a separate DagRunSensor operator.
> After considerations, we decided to implement a separate operator, which
> we've been using in the team for our workflows, and I think it would make a
> good addition to contrib.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
