dinowernli opened a new issue #21379: URL: https://github.com/apache/airflow/issues/21379
### Description A sensor which allows waiting for completion of a Databricks job or task. ### Use case/motivation We would like to make it easy to wait for a Databricks job, similar to how [ExternalTaskSensor](https://airflow.apache.org/docs/apache-airflow/2.0.2/_api/airflow/sensors/external_task/index.html) allows waiting for other Airflow tasks. Specifically, we’d like to support waiting for: * A specific job run to complete * A specific task of a job run to complete The state of job runs can be queried via the [JobRunsGet](https://docs.databricks.com/dev-tools/api/latest/jobs.html#operation/JobsRunsGet.) API. ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
