elink21 commented on code in PR #23158: URL: https://github.com/apache/beam/pull/23158#discussion_r970095819
########## .github/gh-actions-self-hosted-runners/README.md: ########## @@ -0,0 +1,121 @@ +<!-- + Licensed to the Apache Software Foundation (ASF) under one + or more contributor license agreements. See the NOTICE file + distributed with this work for additional information + regarding copyright ownership. The ASF licenses this file + to you under the Apache License, Version 2.0 (the + "License"); you may not use this file except in compliance + with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +# GitHub Actions - Self-hosted Runners +The current GitHub Actions workflows are being tested on multiple operating systems, such as Ubuntu, Windows and MacOS. The way to migrate these runners from GitHub to GCP is by implementing self-hosted runners, so we implemented them in both Ubuntu and Windows environments, going with Google Kubernetes Engine and Google Cloud Compute VMs instances respectively. + +On the other hand, we will rely on GitHub-hosted runners for MacOS builds until a straightforward implementation approach comes out. + +## Ubuntu +Ubuntu Self-hosted runners are stored in Artifact Registry and implemented using Google Kubernetes Engine with the following specifications: + +#### Cluster +* Cluster: [gh-actions-linux-runners](https://console.cloud.google.com/kubernetes/clusters/details/us-central1-a/gh-actions-linux-runners/details?project=apache-beam-testing) +* Image: [linux-github-actions-runner](https://console.cloud.google.com/artifacts/docker/apache-beam-testing/us-central1/beam-github-actions/linux-github-actions-runner?project=apache-beam-testing) + +#### Pool +* Number of nodes: 5 +* Cluster Autoscaler: ON + * Minimum number of nodes: 5 + * Maximum number of nodes: 10 + +#### Node +* Machine Type: e2-custom-6-18432 +* Disk Size: 100 GB +* CPU: 6 vCPUs +* Memory : 18 GB + +#### Pod +##### Container 1: gh-actions-runner +* Image: $LOCAL_IMAGE_NAME LOCATION-docker.pkg.dev/PROJECT-ID/REPOSITORY/IMAGE:latest +* CPU: 2 +* Memory: 1028 Mi +* Volumes + * gcloud-key + * docker-certs-client +* Environment variables + * Container variables + * GOOGLE_APPLICATION_CREDENTIALS + * DOCKER_HOST + * DOCKER_TLS_VERIFY + * DOCKER_CERT_PATH + * Kubernetes secret env variables + * github-actions-secrets + * gcloud-key + +##### Container 2: dind +* Image: `docker:20.10.17-dind` +* Volumes + * dind-storage + * docker-certs-client + +###### Pod Diagram + + +#### AutoScaling +* Horizontal Pod Autoscaling + * 5-10 nodes (From Pool Cluster Autoscaler) + * HorizontalPodAutoscaler + * Min replicas: 10 + * Max replicas: 20 + * CPU utilization: 70% +* Vertical Pod Autoscaling + * updateMode: "Auto" + + +## Windows +Windows Virtual machines have the following specifications + +#### VM specifications +* Instance Template: _TODO: Add GCP link when final resources are in place._ Review Comment: We have resolved the image nomenclature, it's going to be added, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
