On Sat, Dec 19, 2009, Frans Pop wrote: > On Thursday 17 December 2009, Loïc Minier wrote: > > I just tried mirroring the dists at > > http://build.chromium.org/buildbot/packages/dists/chromeos/ (I think > > these are created with reprepro), but failed due to missing Release.gpg > > files. > > Thanks a lot for identifying the issues, but I've decided on a different > patch that also restructures and cleans up the code a bit. > The end result should be the same and the error reporting cleaner. > > Could you give it a try on that repository?
Sure, before the patch, with debmirror 1:2.3.1 in verbose + debug mode: + debmirror --progress --verbose --debug --host=build.chromium.org --root=buildbot/packages --method=http --dist=chromeos,chromeos_dev --section=main,restricted,universe,multiverse --arch=armel,i386 --nosource --ignore-release-gpg '--rsync-options=-aIL --partial' /somepath/chromium Mirroring to /somepath/chromium from http://build.chromium.org/buildbot/packages/ Arches: armel,i386 Dists: chromeos,chromeos_dev Sections: main,restricted,universe,multiverse Pdiff mode: use Will clean up AFTER mirroring. Attempting to get lock, this might take 2 minutes before it fails. Get Release files. http://build.chromium.org/buildbot/packages/dists/chromeos/Release => [0%] Getting: dists/chromeos/Release... 200 OK ok http://build.chromium.org/buildbot/packages/dists/chromeos/Release.gpg => [0%] Getting: dists/chromeos/Release.gpg... 404 Not Found dists/chromeos/Release.gpg failed 404 Not Found dists/chromeos/Release.gpg failed md5sum check, removing http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release => [0%] Getting: dists/chromeos_dev/Release... 200 OK ok http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release.gpg => [0%] Getting: dists/chromeos_dev/Release.gpg... 404 Not Found dists/chromeos_dev/Release.gpg failed 404 Not Found dists/chromeos_dev/Release.gpg failed md5sum check, removing Errors: Download of dists/chromeos/Release.gpg failed: 404 Not Found Download of dists/chromeos_dev/Release.gpg failed: 404 Not Found Failed to download some Release or Release.gpg files! WARNING: releasing 1 pending lock... With the patch: debmirror --progress --verbose --debug --host=build.chromium.org --root=buildbot/packages --method=http --dist=chromeos,chromeos_dev --section=main,restricted,universe,multiverse --arch=armel,i386 --nosource --ignore-release-gpg '--rsync-options=-aIL --partial' /somepath/chromium Mirroring to /somepath/chromium from http://build.chromium.org/buildbot/packages/ Arches: armel,i386 Dists: chromeos,chromeos_dev Sections: main,restricted,universe,multiverse Pdiff mode: use Will clean up AFTER mirroring. Attempting to get lock, this might take 2 minutes before it fails. Get Release files. http://build.chromium.org/buildbot/packages/dists/chromeos/Release => [0%] Getting: dists/chromeos/Release... 200 OK ok http://build.chromium.org/buildbot/packages/dists/chromeos/Release.gpg => [0%] Getting: dists/chromeos/Release.gpg... 404 Not Found dists/chromeos/Release.gpg failed 404 Not Found dists/chromeos/Release.gpg failed md5sum check, removing Release signature does not verify, file missing. http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release => [0%] Getting: dists/chromeos_dev/Release... 200 OK ok http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release.gpg => [0%] Getting: dists/chromeos_dev/Release.gpg... 404 Not Found dists/chromeos_dev/Release.gpg failed 404 Not Found dists/chromeos_dev/Release.gpg failed md5sum check, removing Release signature does not verify, file missing. Errors: Download of dists/chromeos/Release.gpg failed: 404 Not Found Download of dists/chromeos_dev/Release.gpg failed: 404 Not Found Failed to download some Release or Release.gpg files! WARNING: releasing 1 pending lock... Problem is that: remote_get("dists/$dist/Release.gpg", "$tempdir/.tmp"); increments $num_errors at some level. I changed: remote_get("dists/$dist/Release.gpg", "$tempdir/.tmp"); into: my $t = $num_errors; remote_get("dists/$dist/Release.gpg", "$tempdir/.tmp"); $num_errors = $t if $ignore_release_gpg; and that allowed debmirror to perform its operation, but it would still least the errors at the end of the run: debmirror --progress --verbose --debug --host=build.chromium.org --root=buildbot/packages --method=http --dist=chromeos,chromeos_dev --section=main,restricted,universe,multiverse --arch=armel,i386 --nosource --ignore-release-gpg '--rsync-options=-aIL --partial' /somepath/chromium Mirroring to /somepath/chromium from http://build.chromium.org/buildbot/packages/ Arches: armel,i386 Dists: chromeos,chromeos_dev Sections: main,restricted,universe,multiverse Pdiff mode: use Will clean up AFTER mirroring. Attempting to get lock, this might take 2 minutes before it fails. Get Release files. http://build.chromium.org/buildbot/packages/dists/chromeos/Release => [0%] Getting: dists/chromeos/Release... 200 OK ok http://build.chromium.org/buildbot/packages/dists/chromeos/Release.gpg => [0%] Getting: dists/chromeos/Release.gpg... 404 Not Found dists/chromeos/Release.gpg failed 404 Not Found dists/chromeos/Release.gpg failed md5sum check, removing Release signature does not verify, file missing. http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release => [0%] Getting: dists/chromeos_dev/Release... 200 OK ok http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release.gpg => [0%] Getting: dists/chromeos_dev/Release.gpg... 404 Not Found dists/chromeos_dev/Release.gpg failed 404 Not Found dists/chromeos_dev/Release.gpg failed md5sum check, removing Release signature does not verify, file missing. Get Packages and Sources files and other miscellany. Parse Packages and Sources files and add to the file list everything therein. Download all files that we need to get (0 B). Get package files. Downloaded 12 kiB in 1s at 12.2 kiB/s. Everything OK. Moving meta files. Moving dists/chromeos_dev/multiverse/binary-i386/Packages.gz [...] Moving dists/chromeos/main/binary-armel/Packages.bz2 Cleanup mirror. All done. Errors: Download of dists/chromeos/Release.gpg failed: 404 Not Found Download of dists/chromeos_dev/Release.gpg failed: 404 Not Found Moving dists/chromeos_dev/restricted/binary-armel/Packages.bz2 Moving dists/chromeos_dev/main/binary-i386/Packages.gz Moving dists/chromeos_dev/main/binary-i386/Release Moving dists/chromeos_dev/main/binary-armel/Packages.gz So perhaps remote_get should take an ignore errors arg, or perhaps the errors array should be backed up / restored around that call as well; another way is to simply not try downloading Release.gpg at all, but I think some people might want to download them without verifying the signature (or perhaps a new flag is needed? --no-verify-release-gpg or something). Thanks for the patch! -- Loïc Minier -- To UNSUBSCRIBE, email to [email protected] with a subject of "unsubscribe". Trouble? Contact [email protected]
