[
https://issues.apache.org/jira/browse/AIRFLOW-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101913#comment-17101913
]
ASF GitHub Bot commented on AIRFLOW-2310:
-----------------------------------------
paulsyl commented on pull request #6007:
URL: https://github.com/apache/airflow/pull/6007#issuecomment-625403415
> @paulsyl could you possibly share your local Glue implementation (custom
operator, hook, etc) as a Gist or otherwise that we could run in the meantime?
If so I'd be happy to test it out and bring some of your improvements into this
PR as well.
Sure, here you go. I don't claim these to be perfectly aligned to airflow
principles, so please use them and please add to this PR once you've had chance
to correct my errors, I would be more than happy to replace my own with
contributions from the wider community.
Thanks to the excellent work by @abdulbasitds that enabled me to get this
far with Airflow.
[Glue Hook](https://gist.github.com/paulsyl/34ee457518689d120d64173f44f89b45)
[Glue
Operator](https://gist.github.com/paulsyl/bbed05dc0cc6146c36cc6b26ba9bd886)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Enable AWS Glue Job Integration
> -------------------------------
>
> Key: AIRFLOW-2310
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2310
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib
> Reporter: Olalekan Elesin
> Assignee: Olalekan Elesin
> Priority: Major
> Labels: AWS
>
> Would it be possible to integrate AWS Glue into Airflow, such that Glue jobs
> and ETL pipelines can be orchestrated with Airflow
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
