potiuk opened a new pull request, #74209: URL: https://github.com/apache/airflow/pull/74209
`SFTPHook.retrieve_directory_concurrently()` and `store_directory_concurrently()` rebuilt each worker hook from `ssh_conn_id` alone. Anything the caller passed to the hook's constructor — `remote_host`, port, username, password / key file, proxy command, host key settings — was dropped, so the workers connected with the connection's defaults. A directory listed through an explicit `remote_host` could then be transferred from the connection's original host. The workers are now copies of the parent hook with only the connection state reset (`conn`, `client`, the managed-connection counters and the cached `host_proxy`), so each worker still opens its own connection and proxy but uses the parent's effective settings. Tests: a regression test checks that a worker hook keeps the parent's constructor overrides and connection-derived host key setting while starting with no open connection, and a parametrized test checks that both concurrent transfer paths build their workers through it. closes: #74208 --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Claude Code (Opus 5) Generated-by: Claude Code (Opus 5) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
