Taragolis commented on PR #24308: URL: https://github.com/apache/airflow/pull/24308#issuecomment-1149613534
Not related to this PR just my 50 cents about design Glue operator / Hook IMHO, better to do refactor them in near future rather than try to add new features / bug fixes At that moment `GlueJobOperator` do up to three different things and could be split to different operators 1. (optional) Upload local file to S3 (same as `LocalFilesystemToS3Operator`) 1. (optional) Create Job and don't update on changes `¯\_(ツ)_/¯` 1. Run Glue Job And GlueJobHook only design to use only for this single operator -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
