Taragolis commented on issue #29423: URL: https://github.com/apache/airflow/issues/29423#issuecomment-1423066278
I've never like design of GlueJobOperator (previously AwsGlueJobOperator) because a lot of different things combine in one single operator: Upload Artifact to S3, Create/Update Job, Run Job. Seems like it should be decompose on different Operators, when I used Glue as service (hopefully not use it anymore) I've create and update it outside of Airflow as part of the CI process, so for me only Run Job was useful part but someone required also create/update it in Airflow in this case could use multiple chained operators. But for now would be nice if someone create a fix for current operator. Just let know who want to make a PR soon for avoid situation that multiple people work on the same issue 😉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
