hussein-awala commented on code in PR #32903:
URL: https://github.com/apache/airflow/pull/32903#discussion_r1315161086
##########
airflow/providers/databricks/hooks/databricks.py:
##########
@@ -215,6 +216,67 @@ def find_job_id_by_name(self, job_name: str) -> int | None:
else:
return matching_jobs[0]["job_id"]
+ def list_pipelines(
+ self, max_results: int = 25, pipeline_name: str | None = None,
notebook_path: str | None = None
+ ) -> list[dict[str, Any]]:
+ """
+ Lists the pipelines in Databricks Delta Live Tables.
+
+ :param max_results: The limit/batch size used to retrieve pipelines.
Review Comment:
Yes it is consistent with the API, but the API uses it to determine the
total number of pipelines it should return by query, but in our case we collect
all the pipelines, so IMHO `max_results_by_page` or `batch_size` are more
suitable.
It's a nit, if you don't agree you can merge.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
