[Pulp-list] --repoview not working

2016-07-15 Thread Webb, Reece 
Loving that pulp integrates this now. However, when I set this to true on a 
repository, the publish always fails. Maybe a missing Python module?

>From the publish command:
Task Failed

'ascii' codec can't decode byte 0xa0 in position 51051: ordinal not in
range(128)

# journalctl SYSLOG_IDENTIFIER=pulp -f
…
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) Exception caught from 
plugin during publish for repo [base-7Workstation]
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) Traceback (most recent 
call last):
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 
1090, in _do_publish
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) publish_report = 
publish_repo(transfer_repo, conduit, call_config)
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 658, in 
wrap_f
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) return f(*args, 
**kwargs)
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py",
 line 174, in publish_repo
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) return 
self._publisher.process_lifecycle()
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 562, 
in process_lifecycle
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) super(PluginStep, 
self).process_lifecycle()
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 159, 
in process_lifecycle
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) step.process()
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 261, 
in process
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) 
self._record_failure(e, tb)
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 392, 
in _record_failure
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) 
error_details['error'] = str(e)
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120)   File 
"/usr/lib/python2.7/site-packages/pulp/server/exceptions.py", line 96, in 
__str__
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) return 
msg.encode('utf-8')
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.controllers.repository:ERROR: (2273-37120) UnicodeDecodeError: 
'ascii' codec can't decode byte 0xa0 in position 51051: ordinal not in 
range(128)
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[2273]: 
pulp.server.async.tasks:INFO: Task failed : 
[59368826-ec89-4580-8a43-2b94bb1491f3]
Jul 15 13:01:37 yummy.radiology.ucsf.edu pulp[1652]: celery.worker.job:ERROR: 
(1652-37120) Task 
pulp.server.managers.repo.publish.publish[59368826-ec89-4580-8a43-2b94bb1491f3] 
raised unexpected: UnicodeDecodeError('ascii', 'Error occurred during 
\'repoview\' execution: Examining repository...done\nOpening primary 
database...done\nOpening changelogs database...done\nParsing 
comps.xml...done\nCopying layout...done\nExamining state db...done\nCollecting 
letters...done\nWriting package compat-db47.html\nWriting package 
compat-glibc.html\nWriting package compat-libcap1.html\nWriting package 
compat-libf2c-34.html\nWriting package compat-libgfortran-41.html\nWriting 
package compat-libtiff3.html\nWriting package compat-openldap.html\nWriting 
package libpng12.html\nWriting package openssl098e.html\nWriting group 
compat-libraries.group.html\nWriting package elinks.html\nWriting package 
fetchmail.html\nWriting package ftp.html\nWriting package irssi.html\nWriting 
package lftp.html\nWriting package mutt.html\nWriting package 
whois.html\nWriting group

Re: [Pulp-list] Pulp 2.7.0 beta is available

2015-09-17 Thread Webb, Reece 
After recreating all of my repositories, I ran into the offset and metadata 
errors again today. I can confirm the metadata error isn't generated due to 
problems with upstream; the repository I last saw it on was local and during 
publish.

I don't know if this helps, or if it's just coincidence, but the metadata 
errors have only (today) been on repositories where the feed has a cert. My 
other repos (local, CentOS, EPEL) had the offset error. I'm usually able to 
successfully sync after recreating the repository, but not always.

The new "pulp-admin tasks list" functionality was the main reason I upgraded, 
but I think I'm going to have to go back to 2.6.3 until things stabilize.

Reece



On 9/16/15, 2:56 PM, "Webb, Reece" <reece.w...@ucsf.edu> wrote:

>Thanks Randy, the CDN/metadata errors aren't showing up right now, so maybe it 
>was just a temporary fluke. I successfully synced right before the upgrade to 
>2.7, so I assumed the worse. :) In any case, I'll keep an eye on it for the 
>next couple of days to make sure the error doesn't return. And if there's any 
>other info I can provide to help get the email issue resolved, please let me 
>know.
>
>Reece
>
>
>
>
>On 9/16/15, 2:39 PM, "Randy Barlow" <rbar...@redhat.com> wrote:
>
>>Webb, Reece wrote:
>>> Thanks, I upgraded from 2.6.3. As I said in my last follow-up email, 
>>> recreating a repository allow it to successfully sync/publish. But now I'm 
>>> running into two other issues... email notification events don't work at 
>>> all. I've also run into an error retrieving metadata on seemingly random 
>>> repositories that I've tried recreating to workaround the offset error. I 
>>> can recreate the repository, but I receive the same error. I found one bug 
>>> report with this error that turned out to be a selinux issue, but I have 
>>> selinux disabled... not good. Logs below.
>>
>>Hi Reece,
>>
>>Apologies, I misread your earlier e-mail and I thought it said you had
>>upgraded to 2.6.3, not from 2.6.3. I updated the bug report to reflect
>>that now.
>>
>>As for the e-mail error - would you mind filing a bug about that?
>>
>>The CDN error is more surprising. Perhaps it is possible that the CDN
>>really was missing that file for a bit? Can you confirm whether that
>>error is repeatable?
>>

___
Pulp-list mailing list
Pulp-list@redhat.com
https://www.redhat.com/mailman/listinfo/pulp-list

Re: [Pulp-list] Pulp 2.7.0 beta is available

2015-09-16 Thread Webb, Reece 
If I delete and recreate the repository, sync/publish works. So I guess 
something isn't getting updated correctly?

Reece




On 9/16/15, 8:28 AM, "Webb, Reece" <reece.w...@ucsf.edu> wrote:

>I just upgraded from 2.6.3 on RHEL 7.1, using the upgrade instructions 
>provided in the release notes. I'm now unable to sync or publish. I tried 
>running the sync with the "-v", but it says the option doesn't exist...
>
># pulp-admin rpm repo sync run --repo-id rad-epel-7
>+--+
> Synchronizing Repository [rad-epel-7]
>+--+
>
>This command may be exited via ctrl+c without affecting the request.
>
>
>Downloading metadata...
>[-]
>... completed
>
>Downloading repository content...
>[==] 100%
>RPMs:   14/14 items
>Delta RPMs: 0/0 items
>
>... completed
>
>Downloading distribution files...
>[==] 100%
>Distributions: 0/0 items
>... completed
>
>Importing errata...
>[/]
>... completed
>
>Importing package groups/categories...
>[\]
>... completed
>
>
>Task Succeeded
>
>
>
>
>Task Failed
>
>can't compare offset-naive and offset-aware datetimes
>
>
>--
>
>Sep 16 08:26:13 yummy pulp: kombu.transport.qpid:INFO: Connected to qpid with 
>SASL mechanism ANONYMOUS
>Sep 16 08:26:13 yummy pulp: celery.worker.strategy:INFO: Received task: 
>pulp.server.async.tasks._queue_reserved_task[03bc3b55-ab22-4141-a378-f072dc5e265e]
>Sep 16 08:26:13 yummy pulp: celery.worker.strategy:INFO: Received task: 
>pulp.server.managers.repo.sync.sync[09544adc-5035-49f5-a24f-3b32d721bb32]
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) Exception from notifier of type [email]
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) Traceback (most recent call last):
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File 
>"/usr/lib/python2.7/site-packages/pulp/server/managers/event/fire.py", line 
>76, in _do_fire
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) f(l['notifier_config'], event)
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File 
>"/usr/lib/python2.7/site-packages/pulp/server/event/mail.py", line 35, in 
>handle_event
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) body = json.dumps(event.data(), indent=2, 
>default=json_util.default)
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File "/usr/lib64/python2.7/json/__init__.py", line 250, in dumps
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) sort_keys=sort_keys, **kw).encode(obj)
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File "/usr/lib64/python2.7/json/encoder.py", line 209, in encode
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) chunks = list(chunks)
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File "/usr/lib64/python2.7/json/encoder.py", line 434, in 
>_iterencode
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) for chunk in _iterencode_dict(o, _current_indent_level):
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File "/usr/lib64/python2.7/json/encoder.py", line 408, in 
>_iterencode_dict
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) for chunk in chunks:
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File "/usr/lib64/python2.7/json/encoder.py", line 442, in 
>_iterencode
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) o = _default(o)
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784)   File "/usr/lib64/python2.7/site-packages/bson/json_util.py", 
>line 256, in default
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) raise TypeError("%%r is not JSON serializable" %% obj)
>Sep 16 08:26:14 yummy pulp: pulp.server.managers.event.fire:ERROR: 
>(2092-58784) TypeError:  is not JSON 
>serializable
>Sep 16 08:26:14 yummy pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
>Downloading metadata from http://dl.fedoraproject.org/pub/epel/7/x86_64/.
>Sep 16 08:26:14

Re: [Pulp-list] Pulp 2.7.0 beta is available

2015-09-16 Thread Webb, Reece 
line 76, in _do_fire
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
f(l['notifier_config'], event)
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib/python2.7/site-packages/pulp/server/event/mail.py", line 35, 
in handle_event
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
body = json.dumps(event.data(), indent=2, default=json_util.default)
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib64/python2.7/json/__init__.py", line 250, in dumps
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
sort_keys=sort_keys, **kw).encode(obj)
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib64/python2.7/json/encoder.py", line 209, in encode
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
chunks = list(chunks)
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib64/python2.7/json/encoder.py", line 434, in _iterencode
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
for chunk in _iterencode_dict(o, _current_indent_level):
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib64/python2.7/json/encoder.py", line 408, in _iterencode_dict
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
for chunk in chunks:
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib64/python2.7/json/encoder.py", line 442, in _iterencode
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
o = _default(o)
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
  File "/usr/lib64/python2.7/site-packages/bson/json_util.py", line 256, in 
default
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
raise TypeError("%%r is not JSON serializable" %% obj)
Sep 16 18:24:54 yummy pulp: pulp.server.managers.event.fire:ERROR: (2016-40256) 
TypeError:  is not JSON serializable
Sep 16 18:24:54 yummy pulp: pulp.server.async.tasks:INFO: resetting consecutive 
failure count for schedule None
Sep 16 18:24:54 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.managers.repo.publish.publish[fe941e70-b0c7-4971-84fd-1d2215bb37ea] 
succeeded in 1.803173554s: {'exception': None, 'repo_id': 
u'rad-7Server-optional', 'traceback': None, 'started': '2015-09-16T18:24:52Z', 
'_ns':...
Sep 16 18:24:54 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._release_resource[c634b5dd-4df3-4198-86e7-ddff4567c4c0] 
succeeded in 0.0632455370001s: None




--- metadata error - recreating repository doesn't fix this one. sync worked 
fine prior to upgrade to 2.7.

# pulp-admin rpm repo sync run --repo-id rad-7Server
+--+
 Synchronizing Repository [rad-7Server]
+--+

This command may be exited via ctrl+c without affecting the request.

Task Failed

Error retrieving metadata: Not found



- messages
Sep 16 18:17:46 yummy pulp: celery.worker.strategy:INFO: Received task: 
pulp.server.async.tasks._queue_reserved_task[347ab5c3-1f47-4edb-88a0-d3be5e248c62]
Sep 16 18:17:46 yummy pulp: celery.worker.strategy:INFO: Received task: 
pulp.server.managers.repo.sync.sync[af75f802-8ea8-4285-8c47-ce5671ea0316]
Sep 16 18:17:46 yummy pulp: celery.worker.strategy:INFO: Received task: 
pulp.server.async.tasks._release_resource[f0585d85-5ffb-4617-ae60-34b4091e2e33]
Sep 16 18:17:46 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._queue_reserved_task[347ab5c3-1f47-4edb-88a0-d3be5e248c62]
 succeeded in 0.256292566s: None
Sep 16 18:17:46 yummy pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Downloading metadata from 
https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os/.
Sep 16 18:17:46 yummy pulp: requests.packages.urllib3.connectionpool:INFO: 
Starting new HTTPS connection (1): cdn.redhat.com
Sep 16 18:17:47 yummy pulp: requests.packages.urllib3.connectionpool:INFO: 
Starting new HTTPS connection (1): cdn.redhat.com
Sep 16 18:17:47 yummy pulp: pulp.server.async.tasks:INFO: Task failed : 
[af75f802-8ea8-4285-8c47-ce5671ea0316] : Error retrieving metadata: Not found
Sep 16 18:17:48 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.managers.repo.sync.sync[af75f802-8ea8-4285-8c47-ce5671ea0316] 
raised expected: PulpCodedException()
Sep 16 18:17:48 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._release_resource[f0585d85-5ffb-4617-ae60-34b4091e2e33] 
succeeded in 0.0707463489998s: None








On 9/16/15, 10:29 AM, "pulp-list-boun...@redhat.com o

Re: [Pulp-list] Pulp 2.7.0 beta is available

2015-09-16 Thread Webb, Reece 
Thanks Randy, the CDN/metadata errors aren't showing up right now, so maybe it 
was just a temporary fluke. I successfully synced right before the upgrade to 
2.7, so I assumed the worse. :) In any case, I'll keep an eye on it for the 
next couple of days to make sure the error doesn't return. And if there's any 
other info I can provide to help get the email issue resolved, please let me 
know.

Reece




On 9/16/15, 2:39 PM, "Randy Barlow" <rbar...@redhat.com> wrote:

>Webb, Reece wrote:
>> Thanks, I upgraded from 2.6.3. As I said in my last follow-up email, 
>> recreating a repository allow it to successfully sync/publish. But now I'm 
>> running into two other issues... email notification events don't work at 
>> all. I've also run into an error retrieving metadata on seemingly random 
>> repositories that I've tried recreating to workaround the offset error. I 
>> can recreate the repository, but I receive the same error. I found one bug 
>> report with this error that turned out to be a selinux issue, but I have 
>> selinux disabled... not good. Logs below.
>
>Hi Reece,
>
>Apologies, I misread your earlier e-mail and I thought it said you had
>upgraded to 2.6.3, not from 2.6.3. I updated the bug report to reflect
>that now.
>
>As for the e-mail error - would you mind filing a bug about that?
>
>The CDN error is more surprising. Perhaps it is possible that the CDN
>really was missing that file for a bit? Can you confirm whether that
>error is repeatable?
>

___
Pulp-list mailing list
Pulp-list@redhat.com
https://www.redhat.com/mailman/listinfo/pulp-list

[Pulp-list] syncing RHEL5 repositories

2015-05-04 Thread Webb, Reece 
I’m able to sync RHEL5 repositories to Pulp 2.6.1, but I get a checksum error 
when I try a ‘yum update’ on a RHEL5 host:

[Errno -3] Error performing checksum

I found a few threads from a couple of years ago stating that this was 
apparently an issue with the repository being published with sha256. I’ve tried 
re-creating my repositories with —checksum-type=sha1, but no luck. I checked 
repomd.xml, I still see sha256 listed. Any advice?

Here’s my repo create:

# pulp-admin rpm repo create --repo-id=rad-5Client --relative-url=rad-5Client 
--generate-sqlite=true --serve-http=true --retain-old-count=2 
--remove-missing=true --checksum-type=sha1 --description=Red Hat Enterprise 
Linux 5 Client - Updates 
--feed=https://cdn.redhat.com/content/dist/rhel/workstation/5/5Client/x86_64/os/
 --feed-ca-cert=/etc/rhsm/ca/redhat-uep.pem 
--feed-cert=/etc/pki/pulp/content/Workstation-Entitlement.pem 
--feed-key=/etc/pki/pulp/content/Workstation-Entitlement.pem

Thanks,
Reece
___
Pulp-list mailing list
Pulp-list@redhat.com
https://www.redhat.com/mailman/listinfo/pulp-list

Re: [Pulp-list] Pulp sync failure - not well-formed (invalid token): line 44436, column 0

2015-03-23 Thread Webb, Reece 
I’ve been having failures syncing with certain RH repositories as well. For me, 
it’s the 7Workstation and 5Client repo’s (7Server doesn’t have any problems). I 
get a “Forbidden”, which would seem to indicate a problem with the cert… but 
this sync problem is intermittent. If I manually kick off a sync, sometimes it 
works, often it doesn’t.

Mar 23 10:24:07 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._queue_reserved_task[f8759f66-7416-4fd1-9ee4-6005ca06df8a]
 succeeded in 0.0339540460263s: None
Mar 23 10:24:07 yummy pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Downloading metadata from 
https://cdn.redhat.com/content/dist/rhel/workstation/7/7Workstation/x86_64/kickstart/.
Mar 23 10:24:07 yummy pulp: requests.packages.urllib3.connectionpool:INFO: 
Starting new HTTPS connection (1): cdn.redhat.com
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) sync failed
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) Traceback (most recent call last):
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632)   File 
/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py, line 
104, in run
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) metadata_files = self.get_metadata()
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632)   File 
/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py, line 
198, in get_metadata
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) raise FailedException(str(e))
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) FailedException: Forbidden
Mar 23 10:24:08 yummy pulp: celery.worker.job:ERROR: (1595-41632) Task 
pulp.server.managers.repo.sync.sync[80a6866e-0ed6-456a-8b7a-8d0cadbd84aa] 
raised unexpected: PulpExecutionException('Importer indicated a failed 
response',)



Here’s two back-to-back sync’s, first failed (messages above), second was fine.

# pulp-admin rpm repo sync run --repo-id=base-7Workstation
+--+
  Synchronizing Repository [base-7Workstation]
+--+

This command may be exited via ctrl+c without affecting the request.


Downloading metadata...
[-]
... failed

Forbidden


Task Failed

Importer indicated a failed response


# pulp-admin rpm repo sync run --repo-id=base-7Workstation
+--+
  Synchronizing Repository [base-7Workstation]
+--+

This command may be exited via ctrl+c without affecting the request.


Downloading metadata...
[/]
... completed

Downloading repository content...
[==] 100%
RPMs:   0/0 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... completed

Importing package groups/categories...
[-]
... completed

Task Succeeded

Copying files
[\]
... completed

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[-]
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[-]
... completed

Publishing Comps file
[==] 100%
86 of 86 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
[|]
... completed

Publishing files to web
[|]
... completed

Writing Listings File
[-]
... completed

Writing Listings File
[\]
... completed


Task Succeeded


—-

The other issue I have is that I’m syncing the kickstart trees…. When I first 
setup Pulp, it was syncing 7.1 server and workstation. Early last week, my 
workstation repo looks to have fallen back to 7.0. Looking at the local 
workstation treeinfo file, it lists version=7.0, whereas my server treeinfo 
lists 7.1.

I used curl to see what’s on the RH repo, treeinfo for both workstation and 
server list 7.0. (I disabled my server sync so that it remains at 7.1)

These are the two feeds I’m syncing against:

https://cdn.redhat.com/content/dist/rhel/workstation/7/7Workstation/x86_64/kickstart/
https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/kickstart/



It’s weird, if I look at the redhat-release package, it’s 7.1:

# ls -al 
/var/lib/pulp/published/yum/http/repos/base-7Workstation/redhat-release-workstation-7.1-1.el7.x86_64.rpm


But the images/pxeboot files are all from 7.0

# ls -al /var/lib/pulp/content/distribution/ks-Red\ Hat\ Enterprise\ 
Linux-Workstation-7.0-x86_64/images/pxeboot/
total 72456
drwxr-xr-x. 2 apache apache

Re: [Pulp-list] Pulp sync failure - not well-formed (invalid token): line 44436, column 0

2015-03-23 Thread Webb, Reece 
Forgot to include version info.. I had to upgrade to 2.6 to get things working..

# rpm -qa | grep pulp
python-isodate-0.5.0-4.pulp.el7.noarch
pulp-puppet-admin-extensions-2.6.0-0.8.rc.el7.noarch
pulp-admin-client-2.6.0-0.10.rc.el7.noarch
python-pulp-rpm-common-2.6.0-0.8.rc.el7.noarch
pulp-puppet-plugins-2.6.0-0.8.rc.el7.noarch
python-kombu-3.0.24-5.pulp.el7.noarch
pulp-rpm-admin-extensions-2.6.0-0.8.rc.el7.noarch
python-pulp-common-2.6.0-0.10.rc.el7.noarch
python-pulp-client-lib-2.6.0-0.10.rc.el7.noarch
pulp-server-2.6.0-0.10.rc.el7.noarch
python-pulp-puppet-common-2.6.0-0.8.rc.el7.noarch
pulp-rpm-plugins-2.6.0-0.8.rc.el7.noarch
python-pulp-bindings-2.6.0-0.10.rc.el7.noarch
pulp-selinux-2.6.0-0.10.rc.el7.noarch





On 3/23/15, 10:50 AM, Webb, Reece reece.w...@ucsf.edu wrote:

I’ve been having failures syncing with certain RH repositories as well. For 
me, it’s the 7Workstation and 5Client repo’s (7Server doesn’t have any 
problems). I get a “Forbidden”, which would seem to indicate a problem with 
the cert… but this sync problem is intermittent. If I manually kick off a 
sync, sometimes it works, often it doesn’t.

Mar 23 10:24:07 yummy pulp: celery.worker.job:INFO: Task 
pulp.server.async.tasks._queue_reserved_task[f8759f66-7416-4fd1-9ee4-6005ca06df8a]
 succeeded in 0.0339540460263s: None
Mar 23 10:24:07 yummy pulp: pulp_rpm.plugins.importers.yum.sync:INFO: 
Downloading metadata from 
https://cdn.redhat.com/content/dist/rhel/workstation/7/7Workstation/x86_64/kickstart/.
Mar 23 10:24:07 yummy pulp: requests.packages.urllib3.connectionpool:INFO: 
Starting new HTTPS connection (1): cdn.redhat.com
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) sync failed
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) Traceback (most recent call last):
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632)   File 
/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py, 
line 104, in run
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) metadata_files = self.get_metadata()
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632)   File 
/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py, 
line 198, in get_metadata
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) raise FailedException(str(e))
Mar 23 10:24:08 yummy pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: 
(1986-41632) FailedException: Forbidden
Mar 23 10:24:08 yummy pulp: celery.worker.job:ERROR: (1595-41632) Task 
pulp.server.managers.repo.sync.sync[80a6866e-0ed6-456a-8b7a-8d0cadbd84aa] 
raised unexpected: PulpExecutionException('Importer indicated a failed 
response',)



Here’s two back-to-back sync’s, first failed (messages above), second was fine.

# pulp-admin rpm repo sync run --repo-id=base-7Workstation
+--+
  Synchronizing Repository [base-7Workstation]
+--+

This command may be exited via ctrl+c without affecting the request.


Downloading metadata...
[-]
... failed

Forbidden


Task Failed

Importer indicated a failed response


# pulp-admin rpm repo sync run --repo-id=base-7Workstation
+--+
  Synchronizing Repository [base-7Workstation]
+--+

This command may be exited via ctrl+c without affecting the request.


Downloading metadata...
[/]
... completed

Downloading repository content...
[==] 100%
RPMs:   0/0 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... completed

Importing package groups/categories...
[-]
... completed

Task Succeeded

Copying files
[\]
... completed

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[-]
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[-]
... completed

Publishing Comps file
[==] 100%
86 of 86 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
[|]
... completed

Publishing files to web
[|]
... completed

Writing Listings File
[-]
... completed

Writing Listings File
[\]
... completed


Task Succeeded


—-

The other issue I have is that I’m syncing the kickstart trees…. When I first 
setup Pulp, it was syncing 7.1 server and workstation. Early last week, my 
workstation repo looks to have fallen back to 7.0. Looking at the local 
workstation treeinfo file, it lists version=7.0