GitHub user potiuk added a comment to the discussion: Read table by chunks in `SqlToS3Operator` if `max_rows_per_file` specified
MIght be worth trying -> PR with proposal is better to discuss such things, and by preparing a PR proposal you might find out more limitations/issues or that it is actually easy. GitHub link: https://github.com/apache/airflow/discussions/47665#discussioncomment-12514582 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
