jaketf opened a new issue #10454:
URL: https://github.com/apache/airflow/issues/10454


   
   **Description**
   
   Create a terraform integration for apache airflow.
   
   **Use case / motivation**
   
   Use terraform to manage ephemeral infrastructure used in airflow DAGs taking 
advantage of it's "drift" detection features and wide array of existing 
integrations. For teams who use terraform this could replace tasks like create 
/ delete dataproc cluster operator. This could be really interesting for 
automating nightly large scale e2e integration tests of your terraform and data 
pipelines code bases (terraform apply >> run data pipelines >> terraform 
destory.
   
   
   **Related Issues**
   
   Inspired by [this 
discussion](https://github.com/apache/airflow/pull/9593#issuecomment-667906041) 
 in #9593
   
   cc: @brandonjbjelland @potiuk 
   
   Brandon and I will discuss a design for this next week.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to