Does the sync task itself fail? If so, what do you see on the errors tab of the task? Is Pulp throwing an error?
Thanks Eric On Feb 16, 2017 10:07 PM, "Edson Manners" <[email protected]> wrote: Hate to bump the thread but I have the same issue. Katello 3.1. The sync worked in this repo: http://vault.centos.org/7.1.1503/os/x86_64/ and did 8652 packages 3 months ago. A few yum updates later and now it wont do it again or this repo: http://vault.centos.org/7.2.1511/os/x86_64/ On Tuesday, October 25, 2016 at 4:42:55 PM UTC-4, steved0ca wrote: > > It seems the pulp-streaming service stopped running. After restarting it I > was able to kill the sync tasks and restart them, but they still don't > actually download any packages for Centos-base or -updates repos. > > On Mon, Oct 24, 2016 at 1:35 PM, steved0ca <[email protected]> wrote: > >> I tried all three options without any luck. >> >> After restarting the host, I tried to sync again with the 'background' >> option and a manual sync and now I have an endless 'Result: Pending' >> spinning circle for both the centos-base repo, and another repo that was >> previously working. >> >> Here is the foreman production.log but I don't see anything helpful. >> https://drive.google.com/file/d/0B7s4TFC-GYcAdVM1MH >> NaOWZfR3c/view?usp=sharing >> >> On Monday, 24 October 2016 01:12:12 UTC-7, Klaas Demter wrote: >>> >>> Hi, >>> try to change the download policy to "Immediate", I have had problems >>> with "On demand" for some repositories. >>> >>> Greetings >>> Klaas >>> >>> >>> >>> ----- Ursprüngliche Mail ----- >>> Von: "steved0ca" <[email protected]> >>> An: "Foreman users" <[email protected]> >>> Gesendet: Sonntag, 23. Oktober 2016 21:03:59 >>> Betreff: [foreman-users] katello centos-base repo not syncing >>> >>> I have successfully synced other repos ie 'epel' without any difficulty. >>> >>> I've created a product 'centos-base' with a repo called 'centos-base' >>> and >>> attempted to sync the repo but no packages will sync. Same problem with >>> centos-updates. Not sure where to start troubleshooting this, the >>> foreman >>> production.log doesn't have any obvious errors. >>> >>> The content host does display the repo including package count: >>> # yum repolist >>> ... >>> repo id >>> >>> repo name status >>> *!Default_Organization_CentOS-Base_CentOS-Base >>> >>> CentOS-Base 9,007* >>> !Default_Organization_CentOS-Gluster-3_7_CentOS-Gluster-3_7 >>> >>> CentOS-Gluster-3.7 14 >>> !Default_Organization_CentOS-Updates_CentOS-Updates >>> >>> CentOS-Updates 2,548 >>> !Default_Organization_epel_epel >>> >>> epel 11,215 >>> !Default_Organization_filebeat_filebeat >>> >>> filebeat 44 >>> !Default_Organization_glusterfs-nagios-epel_glusterfs-nagios-epel >>> >>> glusterfs-nagios-epel 10 >>> !Default_Organization_katello-agent_katello-agent >>> >>> katello-agent 15 >>> !Default_Organization_pcic_internal_pcic_internal >>> >>> pcic_internal 13 >>> base/7/x86_64 >>> >>> CentOS-7 - Base *9,007* >>> epel/x86_64 >>> >>> Extra Packages for Enterprise Linux 7 - x86_64 10,751 >>> extras/7/x86_64 >>> >>> CentOS-7 - Extras 393 >>> updates/7/x86_64 >>> >>> CentOS-7 - Updates 2,548 >>> repolist: 45,565 >>> >>> >>> Katello version 3.1 >>> Foreman 1.12.3 >>> Foreman OS CentOS 7.2 >>> >>> pulp journal: >>> Oct 23 11:45:03 foreman.my.domain.name pulp[12865]: >>> kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism >>> ANONYMOUS >>> Oct 23 11:45:04 foreman.my.domain.name pulp[299]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.async.tasks._queue_reserved_task[060c2ae6-44a4-483f-ad90-be54e872ffec] >>> >>> Oct 23 11:45:04 foreman.my.domain.name pulp[322]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.managers.repo.sync.sync[a3070bfa-6723-40c4-971e-2781746212c5] >>> >>> Oct 23 11:45:04 foreman.my.domain.name pulp[322]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.async.tasks._release_resource[1f2bfee7-af00-4b0c-adb5-6dae94460415] >>> >>> Oct 23 11:45:04 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from >>> http://mirror.it.ubc.ca/centos/7.2.1511/os/x86_64/. >>> Oct 23 11:45:04 foreman.my.domain.name pulp[299]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.async.tasks._queue_reserved_task[060c2ae6-44a4-483f-ad90-be54e872ffec] >>> >>> succeeded in 0.0428758189082s: None >>> Oct 23 11:45:04 foreman.my.domain.name pulp[648]: >>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTP >>> connection >>> (1): mirror.it.ubc.ca >>> Oct 23 11:45:05 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata. >>> Oct 23 11:45:05 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from >>> http://mirror.it.ubc.ca/centos/7.2.1511/os/x86_64/. >>> Oct 23 11:45:05 foreman.my.domain.name pulp[648]: >>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTP >>> connection >>> (1): mirror.it.ubc.ca >>> Oct 23 11:45:06 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata. >>> Oct 23 11:45:06 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from >>> http://mirror.it.ubc.ca/centos/7.2.1511/os/x86_64/. >>> Oct 23 11:45:06 foreman.my.domain.name pulp[648]: >>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTP >>> connection >>> (1): mirror.it.ubc.ca >>> Oct 23 11:45:07 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata. >>> Oct 23 11:45:07 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: upstream repo metadata has >>> not >>> changed. Skipping steps. >>> Oct 23 11:45:07 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Downloading additional units. >>> Oct 23 11:45:07 foreman.my.domain.name pulp[648]: >>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTP >>> connection >>> (1): mirror.it.ubc.ca >>> Oct 23 11:45:09 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.parse.treeinfo:INFO: upstream >>> distribution >>> unchanged; skipping >>> Oct 23 11:45:09 foreman.my.domain.name pulp[648]: >>> pulp_rpm.plugins.importers.yum.sync:INFO: Sync complete. >>> Oct 23 11:45:09 foreman.my.domain.name pulp[648]: >>> pulp.server.event.http:INFO: (648-55392) {"call_report": {"exception": >>> null, "task_type": "pulp.server.managers.repo.sync.sync", "_href": >>> "/pulp/api/v2/tasks/a3070bfa-6723-40c4-971e-2781746212c5/", "task_id": >>> "a3070bfa-6723-40c4-971e-2781746212c5", "tags": >>> ["pulp:repository:Default_Organization-CentOS-Base-CentOS-Base", >>> "pulp:action:sync"], "finish_time": null, "_ns": "task_status", >>> "start_time": "2016-10-23T18:45:04Z", "traceback": null, >>> "spawned_tasks": >>> [], "progress_report": {"yum_importer": {"content": {"items_total": 0, >>> "state": "FINISHED", "error_details": [], "details": {"rpm_total": 0, >>> "rpm_done": 0, "drpm_total": 0, "drpm_done": 0}, "size_total": 0, >>> "size_left": 0, "items_left": 0}, "comps": {"state": "FINISHED"}, >>> "purge_duplicates": {"state": "FINISHED"}, "distribution": >>> {"items_total": >>> 0, "state": "FINISHED", "error_details": [], "items_left": 0}, "errata": >>> {"state": "FINISHED"}, "metadata": {"state": "FINISHED"}}}, "state": >>> "running", "worker_name": >>> "[email protected]", "result": null, >>> "error": null, "_id": {"$oid": "580d0530490eac48a8250b80"}, "id": >>> "580d0530490eac48a8250b80"}, "event_type": "repo.sync.finish", >>> "payload": >>> {"importer_id": "yum_importer", "exception": null, "repo_id": >>> "Default_Organization-CentOS-Base-CentOS-Base", "traceback": null, >>> "started": "2016-10-23T18:45:04Z", "_ns": "repo_sync_results", >>> "completed": >>> "2016-10-23T18:45:09Z", "importer_type_id": "yum_importer", >>> "error_message": null, "summary": {"content": {"state": "FINISHED"}, >>> "comps": {"state": "FINISHED"}, "purge_duplicates": {"state": >>> "FINISHED"}, >>> "distribution": {"state": "FINISHED"}, "errata": {"state": "FINISHED"}, >>> "metadata": {"state": "FINISHED"}}, "added_count": 0, "result": >>> "success", >>> "updated_count": 0, "details": {"content": {"size_total": 0, >>> "items_left": >>> 0, "items_total": 0, "state": "FINISHED", "size_left": 0, "details": >>> {"rpm_total": 0, "rpm_done": 0, "drpm_total": 0, "drpm_done": 0}, >>> "error_details": []}, "comps": {"state": "FINISHED"}, >>> "purge_duplicates": >>> {"state": "F >>> Oct 23 11:45:09 foreman.my.domain.name pulp[648]: >>> pulp.server.event.http:INFO: (648-55392) INISHED"}, "distribution": >>> {"items_total": 0, "state": "FINISHED", "error_details": [], >>> "items_left": >>> 0}, "errata": {"state": "FINISHED"}, "metadata": {"state": "FINISHED"}}, >>> "id": "580d0535d7717202883a8a8b", "removed_count": 0}} >>> Oct 23 11:45:09 foreman.my.domain.name pulp[648]: >>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS >>> connection (1): foreman.my.domain.name >>> Oct 23 11:45:09 foreman.my.domain.name pulp[299]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.async.tasks._queue_reserved_task[d1e2c6c0-909d-4f06-bcc0-f652472f6681] >>> >>> Oct 23 11:45:09 foreman.my.domain.name pulp[322]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.managers.repo.sync.sync[a3070bfa-6723-40c4-971e-2781746212c5] >>> >>> succeeded in 4.60131726041s: <pulp.server.async.tasks.TaskResult object >>> at >>> 0x4dd1ed0> >>> Oct 23 11:45:09 foreman.my.domain.name pulp[322]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.async.tasks._release_resource[1f2bfee7-af00-4b0c-adb5-6dae94460415] >>> >>> succeeded in 0.00455158576369s: None >>> Oct 23 11:45:09 foreman.my.domain.name pulp[322]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.managers.repo.publish.publish[22792d9c-9a96-4191-b310-b633965ce3a1] >>> >>> Oct 23 11:45:09 foreman.my.domain.name pulp[322]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.async.tasks._release_resource[b13b4b6b-881e-4684-86ce-d180fdc4ca43] >>> >>> Oct 23 11:45:09 foreman.my.domain.name pulp[299]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.async.tasks._queue_reserved_task[d1e2c6c0-909d-4f06-bcc0-f652472f6681] >>> >>> succeeded in 0.0457601174712s: None >>> Oct 23 11:45:34 foreman.my.domain.name pulp[322]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.managers.repo.publish.publish[22792d9c-9a96-4191-b310-b633965ce3a1] >>> >>> succeeded in 24.9757040888s: {'exception': None, 'repo_id': >>> u'Default_Organization-CentOS-Base-CentOS-Base', 'traceback': None, >>> 'started':... >>> Oct 23 11:45:34 foreman.my.domain.name pulp[322]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.async.tasks._release_resource[b13b4b6b-881e-4684-86ce-d180fdc4ca43] >>> >>> succeeded in 0.00444951653481s: None >>> Oct 23 11:46:58 foreman.my.domain.name pulp[296]: celery.beat:INFO: >>> Scheduler: Sending due task download_deferred_content >>> (pulp.server.controllers.repository.queue_download_deferred) >>> Oct 23 11:46:58 foreman.my.domain.name pulp[312]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.controllers.repository.queue_download_deferred[ >>> 6c0f1cc5-e8be-461e-b8f4-85adf8ea79cb] >>> Oct 23 11:46:58 foreman.my.domain.name pulp[322]: >>> celery.worker.strategy:INFO: Received task: >>> pulp.server.controllers.repository.download_deferred[ba46e810-b094-494b-858f-3372d945b5e3] >>> >>> Oct 23 11:46:58 foreman.my.domain.name pulp[312]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.controllers.repository.queue_download_deferred[ >>> 6c0f1cc5-e8be-461e-b8f4-85adf8ea79cb] >>> succeeded in 0.0418180599809s: None >>> Oct 23 11:46:58 foreman.my.domain.name pulp[322]: >>> celery.worker.job:INFO: >>> Task >>> pulp.server.controllers.repository.download_deferred[ba46e810-b094-494b-858f-3372d945b5e3] >>> >>> succeeded in 0.0417454093695s: None >>> Oct 23 11:52:00 foreman.my.domain.name pulp[12863]: >>> kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism >>> ANONYMOUS >>> >>> >>> >>> >>> Product CentOS-Base >>> Remove Product Close >>> >>> - Details >>> - Repositories >>> - Tasks >>> >>> BackTask Details >>> Action Type Synchronize >>> User sdainard >>> Started At 10/23/16 11:37 AM >>> Finished At 10/23/16 11:38 AM >>> Parameters repository 'CentOS-Base' ; product 'CentOS-Base' >>> ;organization >>> 'Default Organization' >>> State stopped >>> Result success >>> Details >>> >>> No new packages. >>> >>> >>> Product CentOS-Base >>> Remove Product Close >>> >>> - Details <https://foreman.pcic.uvic.ca/products/6/info> >>> - Repositories >>> - Tasks <https://foreman.pcic.uvic.ca/products/6/tasks> >>> >>> Back to Repository List >>> Manage Packages Sync Now >>> Basic Information >>> Name >>> CentOS-Base >>> Label CentOS-Base >>> Type yum >>> URL >>> http://mirror.it.ubc.ca/centos/7.2.1511/os/x86_64/ >>> Yum Metadata Checksum >>> sha256 >>> Mirror on Sync >>> Yes >>> Publish via HTTPS Yes >>> Publish via HTTP >>> Yes >>> Published At >>> http://foreman..../pulp/repos/Default_Organization/Library/custom/CentOS-Base/CentOS-Base/ >>> >>> GPG Key >>> RPM-GPG-KEY-CentOS-7 >>> Download Policy >>> On Demand >>> Sync Status >>> Sync Interval Daily at 2016-10-19 02:00:00 -0700 (Server Time) >>> Last Sync 4 minutes Ago (2016-10-23 11:38:18 -0700 Local Time) >>> Next Sync Synced manually, no interval set. >>> Sync State success >>> Content Counts >>> Content Type >>> Packages 0 >>> Errata 0 >>> Package Groups 0 >>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Foreman users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To post to this group, send email to [email protected]. >>> Visit this group at https://groups.google.com/group/foreman-users. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "Foreman users" group. >> To unsubscribe from this topic, visit https://groups.google.com/d/to >> pic/foreman-users/wPbBPSSwZZo/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> [email protected]. >> To post to this group, send email to [email protected]. >> Visit this group at https://groups.google.com/group/foreman-users. >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "Foreman users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/foreman-users. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Foreman users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/foreman-users. For more options, visit https://groups.google.com/d/optout.
