Also having some Friday fun here. Two issues, one trying to sync CentOS
6.0 and another with CentOS 4.9 (don't ask).
Attaching exception errors from /var/log/pulp/pulp.log
When doing the sync in the foreground, the CentOS 6.0 sync errors out
with "error: Exception: Cannot read from directory
/var/lib/pulp/distributions/ks-CentOS-None-6.0-x86_64"
The CentOS 4.9 sync errors out with "documents must have only string
keys, key was None"
The two commands I used to create the repos are:
pulp-admin repo create --id centos-6.0-x86_64 --name "CentOS 6.0 Base
x86_64" --gpgkeys /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-6 --arch x86_64
--feed http://mirror.cogentco.com/pub/linux/centos/6/os/x86_64/
--relativepath /centos/6/os/x86_64
and
pulp-admin repo create --id centos-4.9-x86_64 --name "CentOS 4.9 Base
x86_64" --arch x86_64 --feed
http://mirror.cogentco.com/pub/linux/centos/4/os/x86_64/ --relativepath
/centos/4/os/x86_64
I have tried using --preserve_metadata, but it didn't seem to make a
difference.
--
_____________________
Phil Gardner
PGP Key ID 0xFECC890C
OTR Fingerprint 6707E9B8 BD6062D3 5010FE8B 36D614E3 D2F80538
2011-11-18 21:17:34,380 13898:1133910336: pulp.server.util:INFO: util:450
started repo metadata update: ['createrepo', '--database', '--checksum',
'sha256', '--update', '/var/lib/pulp//repos/centos/4/os/x86_64']
2011-11-18 21:17:35,227 13898:1133910336: pulp.server.util:INFO: util:500
createrepo on /var/lib/pulp//repos/centos/4/os/x86_64 finished
2011-11-18 21:17:35,227 13898:1133910336: pulp.server.util:INFO: util:502
Nothing further to check; we got our fresh metadata
2011-11-18 21:17:38,726 13898:1207339328:
pulp.server.webservices.controllers.repositories:INFO: repositories:801 sync
timeout passed : None
2011-11-18 21:17:38,783 13898:1270278464: pulp.server.api.repo_sync:INFO:
repo_sync:242 Sync invoked for repo <centos-4.9-x86_64>
2011-11-18 21:17:38,784 13898:1270278464: pulp.server.api.repo_sync:INFO:
repo_sync:256 Sync of centos-4.9-x86_64 starting, skip_dict = {}
2011-11-18 21:17:38,786 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:569 cacert = <None>, cert = <None>
2011-11-18 21:17:38,786 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:617 Fetching repo to </var/lib/pulp//repos/centos/4/os/x86_64>
with verify_options <{'checksum': True, 'size': True}>
2011-11-18 21:18:29,597 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:624 YumSynchronizer reported 1844 successes, 0 downloads, 0 errors
2011-11-18 21:20:48,105 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:303 No image files to import to repo..
2011-11-18 21:20:48,108 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:283 No metadata for 'File Sync' present; no files to import to
repo..
2011-11-18 21:20:48,126 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:669 Running createrepo, this may take a few minutes to complete.
2011-11-18 21:20:48,127 13898:1270278464: pulp.server.util:INFO: util:467
metadata found; taking backup.
2011-11-18 21:20:48,738 13898:1270278464: pulp.server.util:INFO: util:450
started repo metadata update: ['createrepo', '--database', '--checksum',
'sha256', '-g',
'/var/lib/pulp//repos/centos/4/os/x86_64/repodata/yumgroups.xml', '--update',
'/var/lib/pulp//repos/centos/4/os/x86_64']
2011-11-18 21:22:42,237 13898:1270278464: pulp.server.util:INFO: util:500
createrepo on /var/lib/pulp//repos/centos/4/os/x86_64 finished
2011-11-18 21:22:42,278 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:673 Createrepo finished in 114.15101409 seconds
2011-11-18 21:22:42,284 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:254 Loading comps group info from:
/var/lib/pulp//repos/centos/4/os/x86_64/repodata/yumgroups.xml
2011-11-18 21:22:42,345 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:275 Skipping errata imports from sync process
2011-11-18 21:22:42,532 13898:1270278464: pulp.server.tasking.task:ERROR:
task:455 Task failed: Task be3adbc0-122a-11e1-b828-000c292e576c:
_sync(centos-4.9-x86_64,
synchronizer=<pulp.server.api.synchronizers.YumSynchronizer object at
0x2b69d030e210>, skip_dict={}, max_speed=None, threads=None,
progress_callback=<bound method RepoSyncTask.progress_callback of
<pulp.server.api.repo_sync_task.RepoSyncTask object at 0x2b69d030e990>>)
Traceback (most recent call last):
File "/usr/lib/python2.4/site-packages/pulp/server/tasking/task.py", line
404, in run
result = self.callable(*self.args, **self.kwargs)
File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line
260, in _sync
progress_callback, synchronizer, max_speed, threads)
File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line
351, in fetch_content
added_errataids = synchronizer.import_metadata(repo_dir, repo_id, skip_dict)
File "/usr/lib/python2.4/site-packages/pulp/server/api/synchronizers.py",
line 276, in import_metadata
self.repo_api.collection.save(repo, safe=True)
File "/usr/lib/python2.4/site-packages/pulp/server/db/connection.py", line
80, in retry
return method(*args, **kwargs)
File "/usr/lib64/python2.4/site-packages/pymongo/collection.py", line 211, in
save
manipulate, safe, **kwargs)
File "/usr/lib/python2.4/site-packages/pulp/server/db/connection.py", line
80, in retry
return method(*args, **kwargs)
File "/usr/lib64/python2.4/site-packages/pymongo/collection.py", line 363, in
update
spec, document, safe, kwargs), safe)
File "/usr/lib64/python2.4/site-packages/pymongo/message.py", line 94, in
update
data += bson.BSON.encode(doc)
File "/usr/lib64/python2.4/site-packages/bson/__init__.py", line 462, in
encode
return cls(_dict_to_bson(document, check_keys))
InvalidDocument: documents must have only string keys, key was None
2011-11-18 21:26:06,220 13898:1207339328: pulp.server.api.keystore:INFO:
keystore:200 mkdir: /var/lib/pulp//repos/centos/6/os/x86_64
2011-11-18 21:26:06,223 13898:1207339328: pulp.server.api.keystore:INFO:
keystore:200 mkdir: /var/lib/pulp/published/gpg/centos/6/os/x86_64
2011-11-18 21:26:06,224 13898:1207339328: pulp.server.api.keystore:INFO:
keystore:52 writing @:
/var/lib/pulp//repos/centos/6/os/x86_64/RPM-GPG-KEY-CentOS-6
2011-11-18 21:26:06,227 13898:1207339328: pulp.server.api.keystore:INFO:
keystore:175 linking:
/var/lib/pulp/published/gpg/centos/6/os/x86_64/RPM-GPG-KEY-CentOS-6 -->
/var/lib/pulp//repos/centos/6/os/x86_64/RPM-GPG-KEY-CentOS-6
2011-11-18 21:26:06,250 13898:1207339328: pulp.server.util:INFO: util:450
started repo metadata update: ['createrepo', '--database', '--checksum',
'sha256', '--update', '/var/lib/pulp//repos/centos/6/os/x86_64']
2011-11-18 21:26:07,044 13898:1207339328: pulp.server.util:INFO: util:500
createrepo on /var/lib/pulp//repos/centos/6/os/x86_64 finished
2011-11-18 21:26:07,044 13898:1207339328: pulp.server.util:INFO: util:502
Nothing further to check; we got our fresh metadata
2011-11-18 21:26:33,108 13898:1133910336:
pulp.server.webservices.controllers.repositories:INFO: repositories:801 sync
timeout passed : None
2011-11-18 21:26:33,159 13898:1270278464: pulp.server.api.repo_sync:INFO:
repo_sync:242 Sync invoked for repo <centos-6.0-x86_64>
2011-11-18 21:26:33,160 13898:1270278464: pulp.server.api.repo_sync:INFO:
repo_sync:256 Sync of centos-6.0-x86_64 starting, skip_dict = {}
2011-11-18 21:26:33,162 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:569 cacert = <None>, cert = <None>
2011-11-18 21:26:33,163 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:617 Fetching repo to </var/lib/pulp//repos/centos/6/os/x86_64>
with verify_options <{'checksum': True, 'size': True}>
2011-11-18 21:29:17,321 13898:1270278464: pulp.server.api.synchronizers:INFO:
synchronizers:624 YumSynchronizer reported 6022 successes, 0 downloads, 1 errors
2011-11-18 21:36:21,868 13898:1270278464: pulp.server.tasking.task:ERROR:
task:455 Task failed: Task fcbefea1-122b-11e1-9f95-000c292e576c:
_sync(centos-6.0-x86_64,
synchronizer=<pulp.server.api.synchronizers.YumSynchronizer object at
0x2b69cee32dd0>, skip_dict={}, max_speed=None, threads=None,
progress_callback=<bound method RepoSyncTask.progress_callback of
<pulp.server.api.repo_sync_task.RepoSyncTask object at 0x2b69cee328d0>>)
Traceback (most recent call last):
File "/usr/lib/python2.4/site-packages/pulp/server/tasking/task.py", line
404, in run
result = self.callable(*self.args, **self.kwargs)
File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line
260, in _sync
progress_callback, synchronizer, max_speed, threads)
File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line
345, in fetch_content
synchronizer.add_distribution_from_dir(repo_dir, repo_id, skip_dict)
File "/usr/lib/python2.4/site-packages/pulp/server/api/synchronizers.py",
line 229, in add_distribution_from_dir
self._process_repo_images(dir, repo)
File "/usr/lib/python2.4/site-packages/pulp/server/api/synchronizers.py",
line 322, in _process_repo_images
files = pulp.server.util.listdir(distro_path) or []
File "/usr/lib/python2.4/site-packages/pulp/server/util.py", line 345, in
listdir
raise Exception("Cannot read from directory %s" % directory)
Exception: Cannot read from directory
/var/lib/pulp/distributions/ks-CentOS-None-6.0-x86_64
_______________________________________________
Pulp-list mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/pulp-list
