lennartkats-db commented on PR #29790: URL: https://github.com/apache/airflow/pull/29790#issuecomment-1568527563
@potiuk @kyle-winkelman This seems like a useful addition from the Databricks perspective. Thanks for contributing, Kyle! 🙏 I do think it would be good to look at the XCOM issue that Alex called out. Wouldn't it be better to just use the API to find an existing job for the cases that Alex called out where the current approach doesn't work? To avoid creating duplicate jobs or having the operator fail? The `DatabricksRunNowOperator` already applies [logic like this](https://github.com/apache/airflow/blob/91568b26a448bf15c91dcb4497690d54842678fc/airflow/providers/databricks/hooks/databricks.py#L211), as it allows users to run a given job based on the name of that job (rather than the job id). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
