Re: [yocto] CDN for sstate.yoctoproject.org

2023-11-01 Thread Michael Halstead
Some CDN stats are now published at https://www.jsdelivr.com/oss-cdn/yocto. Let me know if you notice anything that needs to be changed. On Wed, Oct 18, 2023 at 10:33 AM Richard Purdie < richard.pur...@linuxfoundation.org> wrote: > On Wed, 2023-10-18 at 14:02 +0200, Alexander Kanavin wrote: > > O

Re: [yocto] CDN for sstate.yoctoproject.org

2023-10-18 Thread Richard Purdie
On Wed, 2023-10-18 at 14:02 +0200, Alexander Kanavin wrote: > On Wed, 18 Oct 2023 at 08:45, Richard Purdie > wrote: > > I'm torn on the targets to test as sato-sdk is a large image and world > > is a lot of work. I'd be tempted to test sato, weston and full-cmdline? > > World is a good test I gues

Re: [yocto] CDN for sstate.yoctoproject.org

2023-10-18 Thread Alexander Kanavin
On Wed, 18 Oct 2023 at 08:45, Richard Purdie wrote: > I'm torn on the targets to test as sato-sdk is a large image and world > is a lot of work. I'd be tempted to test sato, weston and full-cmdline? > World is a good test I guess and if from sstate, shouldn't have that > much of an issue. It does

Re: [yocto] CDN for sstate.yoctoproject.org

2023-10-17 Thread Richard Purdie
On Tue, 2023-10-17 at 17:33 +0200, Alexander Kanavin wrote: > Thanks for working on this! I finally got to playing with CDN mirror a > bit, and it seems to basically work ok, so next I'm going to write AB > tests that check that it remains useful. Specifically: > > 1. What should the test be? > >

Re: [yocto] CDN for sstate.yoctoproject.org

2023-10-17 Thread Alexander Kanavin
Thanks for working on this! I finally got to playing with CDN mirror a bit, and it seems to basically work ok, so next I'm going to write AB tests that check that it remains useful. Specifically: 1. What should the test be? I tried 'bitbake -S printdiff core-image-sato' on a blank build directory

Re: [yocto] CDN for sstate.yoctoproject.org

2023-09-24 Thread Armin Kuster
Hello Micheal, Thanks for working on this. BR, Armin On 9/23/23 3:52 PM, Michael Halstead wrote: When adding https://cdn.jsdelivr.net/yocto/sstate/all  please remove any reference to sstate.yoctoproject.org from SSTA

Re: [yocto] CDN for sstate.yoctoproject.org

2023-09-23 Thread Khem Raj
For fun, I tried scratch build of core-image-sato-sdk from master-next + my changes with the new SSTATE_MIRROR Initialising tasks: 100% |###|

Re: [yocto] CDN for sstate.yoctoproject.org

2023-09-23 Thread Michael Halstead
When adding https://cdn.jsdelivr.net/yocto/sstate/all please remove any reference to sstate.yoctoproject.org from SSTATE_MIRRORS to ensure a proper test. Thank you On Sat, Sep 23, 2023 at 12:51 PM Michael Halstead < mhalst...@linuxfoundation.org> wrote: > After some workshopping this morning we

Re: [yocto] CDN for sstate.yoctoproject.org

2023-09-23 Thread Michael Halstead
After some workshopping this morning we have a solution for larger files. Almost every package is now available with CDN acceleration. For files over 64MB the fetcher will need to follow a series of redirects to work properly. Files under 64MB will be served fast from every region. Larger files wil

Re: [yocto] CDN for sstate.yoctoproject.org

2023-09-22 Thread Michael Halstead
Here are packages and size ranges that are not yet served via CDN. Hopefully testing on the smaller files is possible while we figure out a solution for these. assimp 75M 76M binutils 64M 100M boost 68M 148M ceres-solver 167M 182M cmake 157M 553M ffmpeg 68M 69M gcc 127M 681M gcc-cross-aarch64 64M

[yocto] CDN for sstate.yoctoproject.org

2023-09-22 Thread Michael Halstead
Right now we have https://cdn.jsdelivr.net/yocto/sstate set up as a CDN mirroring proxy endpoint. It's fast and completely free to the project. However, it will only work for files smaller than 64MB and will send a redirect to the main server at sstate.yoctoproject.org for files larger than 64MB.