JavierLopezT commented on pull request #9246: URL: https://github.com/apache/airflow/pull/9246#issuecomment-649429192
While I agree that the rest of functionalities can be done in separates operators (for instance, you may want to delete several s3 files at the end of your dag, or you don't want to check duplicates, or you may execute previous queries in a single operator at the beginning of the dag), I think the "truncate" is more "fittable" to be in this operator, because it is way simpler than the others (just one line) and it is just kind of preparation for the copy, not an extra step. Also, I believe the log/errors that can be thrown because of the truncate are simple enough to be monitored in the same task of the COPY. Anyway, if you think I should also remove that from the PR, I'll do it. Thanks! ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
