[
https://issues.apache.org/jira/browse/BEAM-12812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475842#comment-17475842
]
Daniela Martín commented on BEAM-12812:
---------------------------------------
Hi Apache Beam team,
We have been working on the migration of the GitHub Actions self-hosted runners
and we would like to let you know that the self-hosted runners for the Ubuntu
GitHub Actions workflows are ready for revision. The resources that we created
are:
* Docker image stored in Google Cloud Artifact Registry
({_}beam-github-actions{_})
* Linux hosts running in a GKE cluster ({_}github-actions-linux-runners{_})
* README, Docker and Kubernetes files to run the runners in both GKE and local
* Pull Request: [GitHub Pull Request
#16511|https://github.com/apache/beam/pull/16511]
Currently, the k8s deployment is down as we need to recreate it replacing the
_GITHUB_TOKEN_ and _GITHUB_REPO_ variables in the k8s secrets (Please refer to
the
[Kubernetes|https://github.com/apache/beam/blob/f7c04ee1bb7d955fdaf0d576fa5fe54266be0437/.github/dockerized-gh-actions-runners/self-hosted-linux/README.md]
section). In order to do so, we will need the help of an admin of the beam
repo who should be able to get an access token.
Regarding the Windows and Mac self-hosted runners we have found the following:
* Windows: We will use the _servercore:ltsc2019_ image from the official
Microsoft docker hub images. Enabling WSL (Windows Subsystem for Linux) on pods
is not currently allowed in k8s, so the workaround turned into updating the
bash scripts to powershell.
* Mac: We couldn’t find an official _macos_ docker image to use. We are
thinking of having virtual machines, load balancers and auto scaling services.
Pending to research more possible scenarios and the ideal workaround for this
use case.
As previously discussed with you [~kileys] , we will proceed with Windows
migration in another Pull Request.
Please let us know if you have any comments or questions.
Thank you.
Regards,
> Run Github Actions on GCP workers in the apache-beam-testing project
> --------------------------------------------------------------------
>
> Key: BEAM-12812
> URL: https://issues.apache.org/jira/browse/BEAM-12812
> Project: Beam
> Issue Type: Task
> Components: build-system
> Reporter: Kiley Sok
> Assignee: Daniela Martín
> Priority: P2
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> Objective: migrate the runners of the GitHub CI/CD pipeline (GitHub Actions
> or GAs) over to the Apache Beam GCP infrastructure; GKE in this case.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
