onlyarnav opened a new pull request, #70130: URL: https://github.com/apache/airflow/pull/70130
### Description This PR introduces an option to opt out of forwarding Dag-level parameters in the `DatabricksRunNowOperator`. In PR #66613 (for issue #39002), parameter forwarding was introduced such that the operator's `params` dict is automatically forwarded as `job_parameters` when no `job_parameters` are specified. However, this changes the payload for Databricks jobs and breaks execution for jobs whose entry points do not expect or accept additional parameters. To resolve this compatibility issue, this PR: 1. Adds a new boolean parameter `forward_dag_params` (default: `True`) to `DatabricksRunNowOperator`. 2. Checks `self.forward_dag_params` when constructing the payload inside `_build_run_now_payload` before merging `self.params`. 3. Adds unit tests to verify that Dag-level parameters are not forwarded when `forward_dag_params=False`. 4. Fixes minor Windows-specific issues (e.g. file encoding, `os.register_at_fork`, and a mock `fcntl`) to enable executing the local test suite on Windows development hosts. closes: #70121 --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes (Google Antigravity) Generated-by: Google Antigravity following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
