On Sat, Dec 19, 2009, Frans Pop wrote:
> Never mind. I've just tested it myself and there was a bug in the patch.
> Fixed now and will upload new version soon.
Thanks; see my other mail to the bug (attached) too
--
Loïc Minier
--- Begin Message ---
On Sat, Dec 19, 2009, Frans Pop wrote:
> On Thursday 17 December 2009, Loïc Minier wrote:
> > I just tried mirroring the dists at
> > http://build.chromium.org/buildbot/packages/dists/chromeos/ (I think
> > these are created with reprepro), but failed due to missing Release.gpg
> > files.
>
> Thanks a lot for identifying the issues, but I've decided on a different
> patch that also restructures and cleans up the code a bit.
> The end result should be the same and the error reporting cleaner.
>
> Could you give it a try on that repository?
Sure, before the patch, with debmirror 1:2.3.1 in verbose + debug mode:
+ debmirror --progress --verbose --debug --host=build.chromium.org
--root=buildbot/packages --method=http --dist=chromeos,chromeos_dev
--section=main,restricted,universe,multiverse --arch=armel,i386 --nosource
--ignore-release-gpg '--rsync-options=-aIL --partial' /somepath/chromium
Mirroring to /somepath/chromium from
http://build.chromium.org/buildbot/packages/
Arches: armel,i386
Dists: chromeos,chromeos_dev
Sections: main,restricted,universe,multiverse
Pdiff mode: use
Will clean up AFTER mirroring.
Attempting to get lock, this might take 2 minutes before it fails.
Get Release files.
http://build.chromium.org/buildbot/packages/dists/chromeos/Release => [0%]
Getting: dists/chromeos/Release... 200 OK
ok
http://build.chromium.org/buildbot/packages/dists/chromeos/Release.gpg => [0%]
Getting: dists/chromeos/Release.gpg... 404 Not Found
dists/chromeos/Release.gpg failed 404 Not Found
dists/chromeos/Release.gpg failed md5sum check, removing
http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release => [0%]
Getting: dists/chromeos_dev/Release... 200 OK
ok
http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release.gpg =>
[0%] Getting: dists/chromeos_dev/Release.gpg... 404 Not Found
dists/chromeos_dev/Release.gpg failed 404 Not Found
dists/chromeos_dev/Release.gpg failed md5sum check, removing
Errors:
Download of dists/chromeos/Release.gpg failed: 404 Not Found
Download of dists/chromeos_dev/Release.gpg failed: 404 Not Found
Failed to download some Release or Release.gpg files!
WARNING: releasing 1 pending lock...
With the patch:
debmirror --progress --verbose --debug --host=build.chromium.org
--root=buildbot/packages --method=http --dist=chromeos,chromeos_dev
--section=main,restricted,universe,multiverse --arch=armel,i386 --nosource
--ignore-release-gpg '--rsync-options=-aIL --partial' /somepath/chromium
Mirroring to /somepath/chromium from
http://build.chromium.org/buildbot/packages/
Arches: armel,i386
Dists: chromeos,chromeos_dev
Sections: main,restricted,universe,multiverse
Pdiff mode: use
Will clean up AFTER mirroring.
Attempting to get lock, this might take 2 minutes before it fails.
Get Release files.
http://build.chromium.org/buildbot/packages/dists/chromeos/Release => [0%]
Getting: dists/chromeos/Release... 200 OK
ok
http://build.chromium.org/buildbot/packages/dists/chromeos/Release.gpg => [0%]
Getting: dists/chromeos/Release.gpg... 404 Not Found
dists/chromeos/Release.gpg failed 404 Not Found
dists/chromeos/Release.gpg failed md5sum check, removing
Release signature does not verify, file missing.
http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release => [0%]
Getting: dists/chromeos_dev/Release... 200 OK
ok
http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release.gpg =>
[0%] Getting: dists/chromeos_dev/Release.gpg... 404 Not Found
dists/chromeos_dev/Release.gpg failed 404 Not Found
dists/chromeos_dev/Release.gpg failed md5sum check, removing
Release signature does not verify, file missing.
Errors:
Download of dists/chromeos/Release.gpg failed: 404 Not Found
Download of dists/chromeos_dev/Release.gpg failed: 404 Not Found
Failed to download some Release or Release.gpg files!
WARNING: releasing 1 pending lock...
Problem is that:
remote_get("dists/$dist/Release.gpg", "$tempdir/.tmp");
increments $num_errors at some level.
I changed:
remote_get("dists/$dist/Release.gpg", "$tempdir/.tmp");
into:
my $t = $num_errors;
remote_get("dists/$dist/Release.gpg", "$tempdir/.tmp");
$num_errors = $t if $ignore_release_gpg;
and that allowed debmirror to perform its operation, but it would still
least the errors at the end of the run:
debmirror --progress --verbose --debug --host=build.chromium.org
--root=buildbot/packages --method=http --dist=chromeos,chromeos_dev
--section=main,restricted,universe,multiverse --arch=armel,i386 --nosource
--ignore-release-gpg '--rsync-options=-aIL --partial' /somepath/chromium
Mirroring to /somepath/chromium from
http://build.chromium.org/buildbot/packages/
Arches: armel,i386
Dists: chromeos,chromeos_dev
Sections: main,restricted,universe,multiverse
Pdiff mode: use
Will clean up AFTER mirroring.
Attempting to get lock, this might take 2 minutes before it fails.
Get Release files.
http://build.chromium.org/buildbot/packages/dists/chromeos/Release => [0%]
Getting: dists/chromeos/Release... 200 OK
ok
http://build.chromium.org/buildbot/packages/dists/chromeos/Release.gpg => [0%]
Getting: dists/chromeos/Release.gpg... 404 Not Found
dists/chromeos/Release.gpg failed 404 Not Found
dists/chromeos/Release.gpg failed md5sum check, removing
Release signature does not verify, file missing.
http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release => [0%]
Getting: dists/chromeos_dev/Release... 200 OK
ok
http://build.chromium.org/buildbot/packages/dists/chromeos_dev/Release.gpg =>
[0%] Getting: dists/chromeos_dev/Release.gpg... 404 Not Found
dists/chromeos_dev/Release.gpg failed 404 Not Found
dists/chromeos_dev/Release.gpg failed md5sum check, removing
Release signature does not verify, file missing.
Get Packages and Sources files and other miscellany.
Parse Packages and Sources files and add to the file list everything therein.
Download all files that we need to get (0 B).
Get package files.
Downloaded 12 kiB in 1s at 12.2 kiB/s.
Everything OK. Moving meta files.
Moving dists/chromeos_dev/multiverse/binary-i386/Packages.gz
[...]
Moving dists/chromeos/main/binary-armel/Packages.bz2
Cleanup mirror.
All done.
Errors:
Download of dists/chromeos/Release.gpg failed: 404 Not Found
Download of dists/chromeos_dev/Release.gpg failed: 404 Not Found
Moving dists/chromeos_dev/restricted/binary-armel/Packages.bz2
Moving dists/chromeos_dev/main/binary-i386/Packages.gz
Moving dists/chromeos_dev/main/binary-i386/Release
Moving dists/chromeos_dev/main/binary-armel/Packages.gz
So perhaps remote_get should take an ignore errors arg, or perhaps the
errors array should be backed up / restored around that call as well;
another way is to simply not try downloading Release.gpg at all, but I
think some people might want to download them without verifying the
signature (or perhaps a new flag is needed? --no-verify-release-gpg or
something).
Thanks for the patch!
--
Loïc Minier
--- End Message ---
