hussein-awala opened a new pull request, #59:
URL: https://github.com/apache/airflow-ci-infra/pull/59
This PR:
- Creates a new EKS cluster in Airflow AWS account using Terraform to run
the Github Actions jobs:
- A new VPC
- 4 managed node groups: default for infra and ARC resources, small,
medium and large where the runners pods should be scheduled
- an IAM role with IRSA policy to use it by the Autoscaler
- Install and configure the K8S resources and ARC using helm:
- Create namespaces
- Install an helm release for Autoscaler
- Install an helm release for cert manager (user by ARC)
- Install an helm release for ARC
- Create multiple deployments for runners with horizontal autoscalers
each one with different config and labels.
- Adds the Dockerfile and scripts to install and use the Airflow Actions
Runner.
- Adds the documentation of the different resources and explain the steps to
deploy a new change (will be followed by a PR which adds a CI workflow to plan
and deploy the CI infrastructure)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
