shlomiken commented on issue #16299: URL: https://github.com/apache/airflow/issues/16299#issuecomment-988012736
@olivermeyer - you described precisely the way we work and the problem we are now facing trying to migrate to airflow 2.0 not sure how this didn't resonate more - probably not many use airflow with sagemaker. regarding the single responsibility of the operator - i could not agree more , and in fact we are working like this for 3 years now, creating our own semi-random job names, and its fine - this definitely should not be implemented within the operator. (specially not by checking existing jobs...) we are facing the same for other operators as well - like processing jobs and transform jobs. i'd like to contribute here as well - do you have some kind of a one pager how to start ? regards Shlomi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
