The GitHub Actions job "Tests" on airflow.git has failed.
Run started by GitHub user pankajkoti (triggered by pankajkoti).

Head commit for run:
68bd42a7ffc3d2828b1ac4102e65944429d34012 / Pankaj Koti <[email protected]>
Add DatabricksTaskOperator (#40013)

This pull request introduces the 
[DatabricksTaskOperator](https://github.com/astronomer/astro-provider-databricks/blob/main/src/astro_databricks/operators/common.py#L26)
 
to the Airflow Databricks provider from the 
[astro-provider-databricks](https://github.com/astronomer/astro-provider-databricks/tree/main)
repository. Unlike the `DatabricksNotebookOperator` which only
allows to run Notebook tasks, the `DatabricksTaskOperator` allows
running all kinds of tasks across a wide range of types including 
notebooks, JAR files, Python scripts, Databricks SQL queries 
and dashboards, Delta Live Tables pipelines, dbt tasks and more
that are supported by the [Jobs API in its tasks 
attribute](https://docs.databricks.com/api/workspace/jobs/create#tasks).

It marks another pull request aimed at contributing  operators 
and features from that repository into the Airflow  Databricks 
provider. This PR also abstracts the common implementation
between the `DatabricksNotebookOperator` and 
`DatabricksTaskOperator` into a base abstract class 
`DatabricksTaskBaseOperator` so that we do not introduce 
duplicate code for the common set of implementation methods.

Report URL: https://github.com/apache/airflow/actions/runs/9365400536

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to