Hello, This was fixed in pulp_rpm 3.12.0 released about a month ago [0]. Up until recently CentOS had been using Gzip compression for their modules.yaml metadata, but recently they switched to LZMA (.xz) compression which we were not supporting properly. It should work fine if your pulp_rpm plugin is version >=3.12.0
[0] https://github.com/pulp/pulp_rpm/blob/master/CHANGES.rst#bugfixes-1 On Tue, Jun 22, 2021 at 2:13 AM J, Priyanka <[email protected]> wrote: > Hi All, > > > > We are trying to sync http://mirror.centos.org/centos/8/BaseOS/x86_64/os/ > remote to our local pulp repository, it was successful till past few weeks > but it is failing now with below error, > > > > pulp_version: "3.2.1" > > django_version: "2.2.11" > > pulp-rpm: > > prereq_role: "pulp.pulp_rpm_prerequisites" > > version: "3.2.0" > > pulp-file: > > version: "0.2.0" > > > > *ERROR:* > > { > > "allow": "GET, PATCH, DELETE, HEAD, OPTIONS", > > "attempts": 2, > > "changed": false, > > "connection": "close", > > "content": > "{\"pulp_href\":\"/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/\",\"pulp_created\":\"2021-06-18T05:38:05.355153Z\",\"state\":\"failed\",\"name\":\"pulp_rpm.app.tasks.synchronizing.synchronize\",\"started_at\":\"2021-06-18T05:38:05.461725Z\",\"finished_at\":\"2021-06-18T05:38:06.550936Z\",\"error\":{\"traceback\":\" > File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\\\", > line 884, in perform_job\\n rv = job.perform()\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\", line > 664, in perform\\n self._result = self._execute()\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\\\", line > 670, in _execute\\n return self.func(*self.args, **self.kwargs)\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\", > line 146, in synchronize\\n dv.create()\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\\\", > line 149, in create\\n loop.run_until_complete(pipeline)\\n File > \\\"/usr/lib64/python3.6/asyncio/base_events.py\\\", line 484, in > run_until_complete\\n return future.result()\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\", > line 228, in create_pipeline\\n await asyncio.gather(*futures)\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\\\", > line 43, in __call__\\n await self.run()\\n File > \\\"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\\\", > line 401, in run\\n content = moduleyaml.read()\\n File > \\\"/usr/lib64/python3.6/codecs.py\\\", line 321, in decode\\n (result, > consumed) = self._buffer_decode(data, self.errors, > final)\\n\",\"description\":\"'utf-8' codec can't decode byte 0xfd in > position 0: invalid start > byte\"},\"worker\":\"/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/\",\"progress_reports\":[{\"message\":\"Downloading > Metadata > Files\",\"code\":\"downloading.metadata\",\"state\":\"failed\",\"total\":null,\"done\":1,\"suffix\":null},{\"message\":\"Downloading > Artifacts\",\"code\":\"downloading.artifacts\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null},{\"message\":\"Associating > Content\",\"code\":\"associating.content\",\"state\":\"canceled\",\"total\":null,\"done\":0,\"suffix\":null}],\"created_resources\":[],\"reserved_resources_record\":[\"/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/\",\"/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/\"]}", > > "content_length": "2442", > > "content_type": "application/json", > > "cookies": {}, > > "cookies_string": "", > > "date": "Fri, 18 Jun 2021 05:38:36 GMT", > > "elapsed": 0, > > "failed_when_result": true, > > "json": { > > "created_resources": [], > > "error": { > > "description": "'utf-8' codec can't decode byte 0xfd in position 0: > invalid start byte", > > "traceback": " File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line > 884, in perform_job\n rv = job.perform()\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664, > in perform\n self._result = self._execute()\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670, > in _execute\n return self.func(*self.args, **self.kwargs)\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", > line 146, in synchronize\n dv.create()\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py\", > line 149, in create\n loop.run_until_complete(pipeline)\n File > \"/usr/lib64/python3.6/asyncio/base_events.py\", line 484, in > run_until_complete\n return future.result()\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", > line 228, in create_pipeline\n await asyncio.gather(*futures)\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/plugin/stages/api.py\", > line 43, in __call__\n await self.run()\n File > \"/usr/local/lib/pulp/lib64/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py\", > line 401, in run\n content = moduleyaml.read()\n File > \"/usr/lib64/python3.6/codecs.py\", line 321, in decode\n (result, > consumed) = self._buffer_decode(data, self.errors, final)\n" > > }, > > "finished_at": "2021-06-18T05:38:06.550936Z", > > "name": "pulp_rpm.app.tasks.synchronizing.synchronize", > > "progress_reports": [ > > { > > "code": "downloading.metadata", > > "done": 1, > > "message": "Downloading Metadata Files", > > "state": "failed", > > "suffix": null, > > "total": null > > }, > > { > > "code": "downloading.artifacts", > > "done": 0, > > "message": "Downloading Artifacts", > > "state": "canceled", > > "suffix": null, > > "total": null > > }, > > { > > "code": "associating.content", > > "done": 0, > > "message": "Associating Content", > > "state": "canceled", > > "suffix": null, > > "total": null > > } > > ], > > "pulp_created": "2021-06-18T05:38:05.355153Z", > > "pulp_href": > "/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/", > > "reserved_resources_record": [ > > > "/pulp/api/v3/repositories/rpm/rpm/a60af567-62b5-422c-b1dd-1cb8519ec79c/", > > "/pulp/api/v3/remotes/rpm/rpm/2729d528-e80c-4158-a119-7ab3cab6776e/" > > ], > > "started_at": "2021-06-18T05:38:05.461725Z", > > "state": "failed", > > "worker": "/pulp/api/v3/workers/33b6e705-157e-443c-a159-b32819cf0498/" > > }, > > "msg": "OK (2442 bytes)", > > "redirected": false, > > "server": "gunicorn/20.0.4", > > "status": 200, > > "url": "http:// > <<host>>:24817/pulp/api/v3/tasks/39fcb4cd-b443-467a-a11f-62afb8bae98f/", > > "vary": "Accept, Cookie", > > "x_frame_options": "SAMEORIGIN" > > } > > > > Please let me know if any one of you came across the same issue and > solution for this. > > > > Thanks, > > Priyanka > > > _______________________________________________ > Pulp-list mailing list > [email protected] > https://listman.redhat.com/mailman/listinfo/pulp-list
_______________________________________________ Pulp-list mailing list [email protected] https://listman.redhat.com/mailman/listinfo/pulp-list
