[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-552745857 Hi @potiuk my changes are done. Ready for review / merge when you are. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-552394032 Somehow my branch got messed up with all the changes, busy fixing it This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-552374465 Hi @potiuk , I saw AIP 21 was updated and activity on #6502 , are those changes now merged so I can rebase? Thanks for the help! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-552090845 I made some initial changes per review feedback, and dependent on #6502 being merged (my build is failing because it is missing a proper documentation migration). Once those two are done I'll rebase and update and should be good to go. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-551882095 Sounds good, I wouldn't mind an example of the new conventions :) I'll wait for #6502 to be merged and then rebase. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-551719082 No problem at all, I'll change it accordingly. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-551119608 I split up the monolithic DataSync operator into different operators for Create, Get, Update, Delete and execute. This provides more fine-grained control for dealing with AWS DataSync and will work better for users in read-only scenarios or scenarios where new Tasks _must_ be created every time. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services