Kodiak: Thanks for the pointer to the bug report. I did, indeed, pile on there. I've also manually applied the patch in that bug report to my copy of /usr/bin/repoview and that seems to have fixed my issue. A bit hack-y, but it works.
Cheers!
-Joe Rhodes
> On Oct 12, 2017, at 9:23 AM, Kodiak Firesmith <[email protected]> wrote:
>
> https://pulp.plan.io/issues/2346 - probably pile onto this one.
> Ha! Turns out at some point in the past I was also affected by this bug and
> piled on.
>
> On Thu, Oct 12, 2017 at 9:21 AM, Kodiak Firesmith <[email protected]>
> wrote:
> This smells like an ascii/unicode issue with the repoview creation portion of
> your sync. I would turn off repoview and file an issue if one isn't already
> in place for this problem.
> - Kodiak
>
> On Thu, Oct 12, 2017 at 8:32 AM, Joe Rhodes <[email protected]> wrote:
> I'm running into an issue when trying to sync the CentOS 6 and CentOS 7 base
> repos to a newly build pulp server. Repo view dies with:
>
> Generating HTML files
> [/]
>
> Task Failed
>
> 'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in
> range(128)
>
>
> Sometimes I can delete the repo and re-create it, in which case it will work.
> But I haven't figured out why it's happening.
>
> >From /var/log/messages:
>
> Writing package cdparanoia-devel.html\nWriting package
> cdparanoia-libs.html\n\n::\nTraceback (most recent call last):\n File
> "/usr/bin/repoview", line 940, in <module>\n main()\n File
> "/usr/bin/repoview", line 937, in main\n Repoview(opts)\n File
> "/usr/bin/repoview", line 191, in __init__\n packages =
> self.do_packages(repo_data, group_data, pkgnames)\n File
> "/usr/bin/repoview", line 544, in do_packages\n pkg_data =
> self.get_package_data(pkgname)\n File "/usr/bin/repoview", line 442, in
> get_package_data\n rows = pcursor.fetchall()\nsqlite3.OperationalError:
> Could not decode to UTF-8 column \'location_href\' with text \'\xc0\xb9\'\n',
> 79012, 79013, 'ordinal not in range(128)')
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> Traceback (most recent call last):
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in
> trace_task
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> R = retval = fun(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line
> 529, in __call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> return super(Task, self).__call__(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line
> 107, in __call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> return super(PulpTask, self).__call__(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 438, in
> __protected_call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> return self.run(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File
> "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 1106, in publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo,
> conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File
> "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 1200, in check_publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo,
> conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File
> "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 1252, in _do_publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> publish_report = publish_repo(transfer_repo, conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line
> 732, in wrap_f
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> return f(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File
> "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py",
> line 174, in publish_repo
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> return self._publisher.process_lifecycle()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 572, in process_lifecycle
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> super(PluginStep, self).process_lifecycle()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 163, in process_lifecycle
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> step.process()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 271, in process
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> self._record_failure(e, tb)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 402, in _record_failure
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> error_details['error'] = str(e)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> File "/usr/lib/python2.7/site-packages/pulp/server/exceptions.py", line 96,
> in __str__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> return msg.encode('utf-8')
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xc0 in position 79012:
> ordinal not in range(128)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:INFO: Task
> pulp.server.async.tasks._release_resource[b2532289-bc58-4b05-b3d9-feb68f4e2c1b]
> succeeded in 0.005379242s: None
>
>
> The feed URLs I'm using:
>
> CentOS 7: http://mirror.centos.org/centos/7/os/x86_64/
> CentOS 6: http://mirror.centos.org/centos/6/os/x86_64/
>
> I'm using CentOS 7.4 (with all updates applied). The VM has 16 GB of RAM and
> 4 CPUs. Pulp packages I've got installed:
>
> python-pulp-client-lib-2.14.1-1.el7.noarch
> python-pulp-repoauth-2.14.1-1.el7.noarch
> pulp-rpm-plugins-2.14.1-1.el7.noarch
> python-isodate-0.5.0-4.pulp.el7.noarch
> python-kombu-3.0.33-8.pulp.el7.noarch
> pulp-selinux-2.14.1-1.el7.noarch
> python-pulp-bindings-2.14.1-1.el7.noarch
> python-pulp-oid_validation-2.14.1-1.el7.noarch
> pulp-server-2.14.1-1.el7.noarch
> python-pulp-common-2.14.1-1.el7.noarch
> pulp-admin-client-2.14.1-1.el7.noarch
> pulp-rpm-admin-extensions-2.14.1-1.el7.noarch
> python-pulp-rpm-common-2.14.1-1.el7.noarch
>
>
> Python is reporting 2.7.5.
>
>
> About the closest I've found to this would be:
> https://bugs.centos.org/view.php?id=13272 But the fix (noted in the "Notes"
> section) doesn't seem to help.
>
> Any suggestions?
>
> Thanks in advance!
> -Joe Rhodes
>
>
>
> --
> *Confidentiality Notice: The information contained in this e-mail and any
> attachments may be confidential. If you are not an intended recipient, you
> are hereby notified that any dissemination, distribution or copying of this
> e-mail is strictly prohibited. If you have received this e-mail in error,
> please notify the sender and permanently delete the e-mail and any
> attachments immediately. You should not retain, copy or use this e-mail or
> any attachment for any purpose, nor disclose all or any part of the
> contents to any other person. Thank you.*
>
> _______________________________________________
> Pulp-list mailing list
> [email protected]
> https://www.redhat.com/mailman/listinfo/pulp-list
>
>
--
*Confidentiality Notice: The information contained in this e-mail and any
attachments may be confidential. If you are not an intended recipient, you
are hereby notified that any dissemination, distribution or copying of this
e-mail is strictly prohibited. If you have received this e-mail in error,
please notify the sender and permanently delete the e-mail and any
attachments immediately. You should not retain, copy or use this e-mail or
any attachment for any purpose, nor disclose all or any part of the
contents to any other person. Thank you.*
smime.p7s
Description: S/MIME cryptographic signature
_______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list
