On Mon, 2025-01-27 at 10:07 +0100, Stefan Herbrechtsmeier wrote: > Am 25.01.2025 um 14:17 schrieb Richard Purdie: > > The gomod fetcher is totally broken for mirroring unfortunately. It is > > used for the crucible recipe in meta-oe and it is one of the reasons > > the autobuilder mirroring test for meta-oe never passes. > > > > The issue is that it downloads files into subdirs of DL_DIR but when > > mirroring, that translation is lost. The files are there on the mirror, > > the code just doesn't have any way to access them. > > Does this mean the downloadfilename doesn't support sub directories or > is the rewrite of the URI a problem?
The rewrite is hard. The syntax doesn't support taking a path component and injecting it into a parameter. > Is the npm fetcher broken too? I don't know. > > I don't know what to do about this. The source mirroring for meta-oe > > has been broken for months. I've tried to fix a couple of the issues > > but this one is systemic and not easy to fix. > > > > I'd note that the sanity test in sanity.bbclass doesn't recognise the > > gomod and godmogit fetchers anyway. I did try a few different urls but > > due to the weird way gomod subclasses wget, the normal mirror url > > manipulation techniques don't work. > > > > What do I do? > > > > I could drop meta-oe from source mirroring. > > > > I could ask Khem to drop the recipe. > > > > Neither seem like nice things to do but I don't want to do "partial" > > mirrors. Explaining to people that it may or may not work looks really > > bad and I'm not doing it. > > > > Is there anyone willing to help fix this? Only stopping it running at > > all is really within my own control. > > I can look into it. Would it be okay to init the urldata before resolve > the mirror or should the mirror use the gomod scheme? Currently the mirror being passed the modified url which makes it a challenge as it appears as a normal http url. I posted my workaround that made it work but that has several issues. It needs a new parameter to the wget fetcher, which might be useful elsewhere, not sure. It also requires hardcoding the go proxy url into the PREMIRROR which won't work for any other go proxy servers. Cheers, Richard
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#2104): https://lists.openembedded.org/g/openembedded-architecture/message/2104 Mute This Topic: https://lists.openembedded.org/mt/110806536/21656 Group Owner: openembedded-architecture+ow...@lists.openembedded.org Unsubscribe: https://lists.openembedded.org/g/openembedded-architecture/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
