patricker opened a new pull request, #24382: URL: https://github.com/apache/airflow/pull/24382
closes: #22065 --- This change captures the row count in total, and per file, for a DB to GCS operation. This metadata is then included in the XCom output. This metadata can also optionally be included as GCS Blob metadata. During test development, I noticed that the CSV file write test was outputting a 4th empty file. This wasn't immediately obvious with the old tests, since they had no metadata, but with the updated tests we know in advance that the max row count available is 3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
