Guaqamole commented on code in PR #44320:
URL: https://github.com/apache/airflow/pull/44320#discussion_r1856698284
##########
providers/src/airflow/providers/amazon/aws/transfers/sftp_to_s3.py:
##########
@@ -85,6 +89,15 @@ def execute(self, context: Context) -> None:
sftp_client = ssh_hook.get_conn().open_sftp()
+ try:
+ sftp_client.stat(self.sftp_path)
+ except FileNotFoundError:
+ if self.fail_on_file_not_exist:
+ raise
+ else:
+ self.log.info("File %s not found on SFTP server. Skipping
transfer.", self.sftp_path)
+ return
Review Comment:
As mentioned in https://github.com/apache/airflow/issues/40576, the
fail_on_file_not_exist option is intended to provide users greater control over
the operator's behaviour, particularly in environments where continued
processing is preferred.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
