On 16-10-22, Christian Marangi wrote: > On Sun, Oct 16, 2022 at 02:07:05PM +0200, Baptiste Jonglez wrote: > > - either buildbot can run latent workers with a different Docker image > > depending on the build > > IMHO, this would be the safest and better solution to the problem. But > this means that we will have to support 2 thing instead of having one > centrilized container.
I'm not even sure Buildbot is able to do that :) But if it is, and the only change between worker images is the version of the base image (e.g. Debian), then that sounds manageable. > Would be ideal to have one centrilized dl/ dir where each runner can go > and take the file. We already support that in openwrt (to have a > different dl dir) and there isn't any problem with having different > release tar for the same package. I had tried to share dl/ across several worker containers on the same physical machine. But there are race conditions that make it not so easy to do. I fixed one issue [1] but there was another that I couldn't track down. We could use object storage, for instance from DigitalOcean [2]. It would allow all workers to read/write to the same shared storage for download files, and get (hopefully) good download performance. With that in place, we could also prune dl/ very aggressively to save disk space. Baptiste [1] https://git.openwrt.org/d4c957f24b2f76986378c6d9 [2] https://www.digitalocean.com/products/spaces
signature.asc
Description: PGP signature
_______________________________________________ openwrt-devel mailing list openwrt-devel@lists.openwrt.org https://lists.openwrt.org/mailman/listinfo/openwrt-devel
