jroachgolf84 opened a new pull request, #54916: URL: https://github.com/apache/airflow/pull/54916
To match the behavior in the `SFTPOperator`, the `create_intermediate_dirs` parameter was added to the `GCSToSFTPOperator`. If this is `False`, then the file will be copied/moved with running the `SFTPHook.create_directory()` method. An SFTP user may have permissions to copy/move a file, but not create a new directory. This resulted in `PermissionError`'s. Per the original issue: > The goal is to upload files from GCS to SFTP reliably even when the target folder exists and directory creation permissions are restricted. This prevents `PermissionError` failures and makes `GCSToSFTPOperator` more consistent with other SFTP operators. closes: #54906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
