alexott opened a new pull request, #27446: URL: https://github.com/apache/airflow/pull/27446
Existing implementation uses list API to find all possible jobs and filtering out them by name. This leads to huge load on the API backend for workspaces with big number of jobs (> 1k). Databricks Workflows team extended list API with search functionality. This PR uses new API, but leaving old functionality in-place as not all clouds (for example, Azure GovCloud) could be updated already. If your cloud wasn't updated yet, set `use_old_list_impl` to `True` when creating an instance of `DatabricksRunNowOperator`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
