kalyani-subbiah commented on issue #23514: URL: https://github.com/apache/airflow/issues/23514#issuecomment-1120046815
I see. In my project since I'm downloading a lot of files, the filenames are important to keep track of what the contents are. When it gets downloaded as a temp file with a different name, this content is lost. I will have to delete all the contents of the temp directory for each iteration which is time-consuming. One thing that would be nice is if we could specify the file name for the download. Any reason why we're using .download_fileobj over .download_file from boto3? The .download_file function would be much better since a local filename can be specified: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Client.download_file -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
