maggesssss opened a new pull request, #28964: URL: https://github.com/apache/airflow/pull/28964
closes: #23666 This PR includes a new Transfer Operator that reads a CSV File from S3 Storage and loads it into an existing Table of a generic SQL Database I used csv.reader to read the file and `insert_rows` method of the existing DbApiHook. Due to the fact that csv.reader is not reading the complete file into the memory, also large files can be loaded somehow efficiently. I am happy for any feedback. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
