Search turned up this potential solution: https://access.redhat.com/discussions/2065363
I tried restarting Katello service as noted, without success. I ended up here https://access.redhat.com/solutions/1381053 There's an error thrown on the last step: [root@vmpr-res-utils ~]# foreman-rake katello:reindex --trace rake aborted! Don't know how to build task 'katello:reindex' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/task_manager.rb:62:in `[]' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:149:in `invoke_task' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' /opt/rh/rh-ruby22/root/usr/bin/rake:33:in `<main>' That will teach me for trying to solve my own problems. The problem seems to have persisted - where do I look next? cheers L. ------ The most dangerous phrase in the language is, "We've always done it this way." - Grace Hopper On 27 February 2017 at 09:39, Lachlan Musicman <[email protected]> wrote: > CentOS 7.3, Katello 3.2, Foreman 1.13.4 > > And it's cascading - there are four other sync's that haven't finished > because one seems to be in a permanent pending state. > > I don't see any obvious cancel/resume function? The cancel link on the > sync status page bounces when clicked but...nothing. > > The logs/Dynaflow show no errors, it's just stopped at 71%. > > How to solve? > > (raw details below) > > cheers > L. > > {"repository"=>{"id"=>5, "name"=>"epel", "label"=>"epel"}, > "product"=> > {"id"=>2, > "name"=>"Extra Packages for Enterprise Linux 7", > "label"=>"Extra_Packages_for_Enterprise_Linux_7_-_x86_64", > "cp_id"=>"1464869283627"}, > "provider"=>{"id"=>1, "name"=>"Anonymous"}, > "organization"=> > {"id"=>1, > "name"=>"Peter MacCallum Cancer Centre", > "label"=>"Peter_MacCallum_Cancer_Centre"}, > "services_checked"=>["pulp", "pulp_auth"], > "id"=>5, > "sync_result"=> > {"contents_changed"=>true, > "pulp_tasks"=> > [{"exception"=>nil, > "task_type"=>"pulp.server.managers.repo.sync.sync", > "_href"=>"/pulp/api/v2/tasks/5460a086-d7e8-4510-9549-c75766ec8fc2/", > "task_id"=>"5460a086-d7e8-4510-9549-c75766ec8fc2", > "tags"=> > > ["pulp:repository:Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel", > "pulp:action:sync"], > "finish_time"=>"2017-02-24T16:07:18Z", > "_ns"=>"task_status", > "start_time"=>"2017-02-24T16:01:23Z", > "traceback"=>nil, > "spawned_tasks"=> > [{"_href"=>"/pulp/api/v2/tasks/a9843fac-51de-4fb0-a06d-31c0db9b108e/", > "task_id"=>"a9843fac-51de-4fb0-a06d-31c0db9b108e"}], > "progress_report"=> > {"yum_importer"=> > {"content"=> > {"items_total"=>22, > "state"=>"FINISHED", > "error_details"=>[], > "details"=> > {"rpm_total"=>22, > "rpm_done"=>22, > "drpm_total"=>0, > "drpm_done"=>0}, > "size_total"=>16914540, > "size_left"=>0, > "items_left"=>0}, > "comps"=>{"state"=>"FINISHED"}, > "purge_duplicates"=>{"state"=>"FINISHED"}, > "distribution"=> > {"items_total"=>0, > "state"=>"FINISHED", > "error_details"=>[], > "items_left"=>0}, > "errata"=>{"state"=>"FINISHED"}, > "metadata"=>{"state"=>"FINISHED"}}}, > "queue"=> > "reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au.dq", > "state"=>"finished", > "worker_name"=> > "[email protected]", > "result"=> > {"result"=>"success", > "importer_id"=>"yum_importer", > "exception"=>nil, > "repo_id"=> > > "Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel", > "traceback"=>nil, > "started"=>"2017-02-24T16:01:23Z", > "_ns"=>"repo_sync_results", > "completed"=>"2017-02-24T16:07:18Z", > "importer_type_id"=>"yum_importer", > "error_message"=>nil, > "summary"=> > {"content"=>{"state"=>"FINISHED"}, > "comps"=>{"state"=>"FINISHED"}, > "purge_duplicates"=>{"state"=>"FINISHED"}, > "distribution"=>{"state"=>"FINISHED"}, > "errata"=>{"state"=>"FINISHED"}, > "metadata"=>{"state"=>"FINISHED"}}, > "added_count"=>29, > "removed_count"=>-25, > "updated_count"=>14872, > "id"=>"58b05a36bdb1d60a7024bf11", > "details"=> > {"content"=> > {"size_total"=>16914540, > "items_left"=>0, > "items_total"=>22, > "state"=>"FINISHED", > "size_left"=>0, > "details"=> > {"rpm_total"=>22, > "rpm_done"=>22, > "drpm_total"=>0, > "drpm_done"=>0}, > "error_details"=>[]}, > "comps"=>{"state"=>"FINISHED"}, > "purge_duplicates"=>{"state"=>"FINISHED"}, > "distribution"=> > {"items_total"=>0, > "state"=>"FINISHED", > "error_details"=>[], > "items_left"=>0}, > "errata"=>{"state"=>"FINISHED"}, > "metadata"=>{"state"=>"FINISHED"}}}, > "error"=>nil, > "_id"=>{"$oid"=>"58b058a1c47a37aeec805a43"}, > "id"=>"58b058a1c47a37aeec805a43"}, > {"exception"=>nil, > "task_type"=>"pulp.server.managers.repo.publish.publish", > "_href"=>"/pulp/api/v2/tasks/a9843fac-51de-4fb0-a06d-31c0db9b108e/", > "task_id"=>"a9843fac-51de-4fb0-a06d-31c0db9b108e", > "tags"=> > > ["pulp:repository:Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel", > "pulp:action:publish"], > "finish_time"=>"2017-02-24T16:09:45Z", > "_ns"=>"task_status", > "start_time"=>"2017-02-24T16:07:21Z", > "traceback"=>nil, > "spawned_tasks"=>[], > "progress_report"=> > > {"Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel"=> > [{"num_success"=>1, > "description"=>"Initializing repo metadata", > "step_type"=>"initialize_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"5a446a30-7f4f-4fdc-beed-6a8fd2889a80", > "num_processed"=>1}, > {"num_success"=>0, > "description"=>"Publishing Distribution files", > "step_type"=>"distribution", > "items_total"=>0, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"ed6fbc4a-5bce-40f5-95a0-8138a58ca633", > "num_processed"=>0}, > {"num_success"=>11239, > "description"=>"Publishing RPMs", > "step_type"=>"rpms", > "items_total"=>11239, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"5634cc70-459d-4f08-9ca0-6f9783af239c", > "num_processed"=>11239}, > {"num_success"=>0, > "description"=>"Publishing Delta RPMs", > "step_type"=>"drpms", > "items_total"=>1, > "state"=>"SKIPPED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"9c172b59-01dd-4913-8d0d-40c367d970ca", > "num_processed"=>0}, > {"num_success"=>3448, > "description"=>"Publishing Errata", > "step_type"=>"errata", > "items_total"=>3448, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"76c9b431-7cf9-4edb-a1d0-555cecec03b7", > "num_processed"=>3448}, > {"num_success"=>214, > "description"=>"Publishing Comps file", > "step_type"=>"comps", > "items_total"=>214, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"7c3df37c-419c-44c2-adc7-2c74bd537263", > "num_processed"=>214}, > {"num_success"=>0, > "description"=>"Publishing Metadata.", > "step_type"=>"metadata", > "items_total"=>0, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"a5f913dd-d33c-4777-aa13-b25e086b4dfb", > "num_processed"=>0}, > {"num_success"=>1, > "description"=>"Closing repo metadata", > "step_type"=>"close_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"0f71d80f-5e6d-4759-8e69-4b0c3bb559f2", > "num_processed"=>1}, > {"num_success"=>0, > "description"=>"Generating sqlite files", > "step_type"=>"generate sqlite", > "items_total"=>1, > "state"=>"SKIPPED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"12c2b669-a180-44a5-9b75-e0fffaf3dd49", > "num_processed"=>0}, > {"num_success"=>0, > "description"=>"Generating HTML files", > "step_type"=>"repoview", > "items_total"=>1, > "state"=>"SKIPPED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"c3d3f16a-727a-4b7c-839c-45a95a9888a7", > "num_processed"=>0}, > {"num_success"=>1, > "description"=>"Publishing files to web", > "step_type"=>"publish_directory", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"cb0246f9-c2ef-49b3-9bd2-da53e71d692a", > "num_processed"=>1}, > {"num_success"=>1, > "description"=>"Writing Listings File", > "step_type"=>"initialize_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"0f12a784-557d-4f4f-8d5b-f34db4dd59ec", > "num_processed"=>1}, > {"num_success"=>1, > "description"=>"Writing Listings File", > "step_type"=>"initialize_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"3dcbf71e-6950-45a1-b834-42ccfc2e8e0f", > "num_processed"=>1}]}, > "queue"=> > "reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au.dq", > "state"=>"finished", > "worker_name"=> > "[email protected]", > "result"=> > {"result"=>"success", > "exception"=>nil, > "repo_id"=> > > "Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel", > "started"=>"2017-02-24T16:07:21Z", > "_ns"=>"repo_publish_results", > "completed"=>"2017-02-24T16:09:45Z", > "traceback"=>nil, > "distributor_type_id"=>"yum_distributor", > "summary"=> > {"generate sqlite"=>"SKIPPED", > "initialize_repo_metadata"=>"FINISHED", > "rpms"=>"FINISHED", > "close_repo_metadata"=>"FINISHED", > "drpms"=>"SKIPPED", > "comps"=>"FINISHED", > "distribution"=>"FINISHED", > "repoview"=>"SKIPPED", > "publish_directory"=>"FINISHED", > "errata"=>"FINISHED", > "metadata"=>"FINISHED"}, > "error_message"=>nil, > "distributor_id"=> > > "Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel", > "id"=>"58b05ac9bdb1d60a7024c08c", > "details"=> > [{"num_success"=>1, > "description"=>"Initializing repo metadata", > "step_type"=>"initialize_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"5a446a30-7f4f-4fdc-beed-6a8fd2889a80", > "num_processed"=>1}, > {"num_success"=>0, > "description"=>"Publishing Distribution files", > "step_type"=>"distribution", > "items_total"=>0, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"ed6fbc4a-5bce-40f5-95a0-8138a58ca633", > "num_processed"=>0}, > {"num_success"=>11239, > "description"=>"Publishing RPMs", > "step_type"=>"rpms", > "items_total"=>11239, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"5634cc70-459d-4f08-9ca0-6f9783af239c", > "num_processed"=>11239}, > {"num_success"=>0, > "description"=>"Publishing Delta RPMs", > "step_type"=>"drpms", > "items_total"=>1, > "state"=>"SKIPPED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"9c172b59-01dd-4913-8d0d-40c367d970ca", > "num_processed"=>0}, > {"num_success"=>3448, > "description"=>"Publishing Errata", > "step_type"=>"errata", > "items_total"=>3448, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"76c9b431-7cf9-4edb-a1d0-555cecec03b7", > "num_processed"=>3448}, > {"num_success"=>214, > "description"=>"Publishing Comps file", > "step_type"=>"comps", > "items_total"=>214, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"7c3df37c-419c-44c2-adc7-2c74bd537263", > "num_processed"=>214}, > {"num_success"=>0, > "description"=>"Publishing Metadata.", > "step_type"=>"metadata", > "items_total"=>0, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"a5f913dd-d33c-4777-aa13-b25e086b4dfb", > "num_processed"=>0}, > {"num_success"=>1, > "description"=>"Closing repo metadata", > "step_type"=>"close_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"0f71d80f-5e6d-4759-8e69-4b0c3bb559f2", > "num_processed"=>1}, > {"num_success"=>0, > "description"=>"Generating sqlite files", > "step_type"=>"generate sqlite", > "items_total"=>1, > "state"=>"SKIPPED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"12c2b669-a180-44a5-9b75-e0fffaf3dd49", > "num_processed"=>0}, > {"num_success"=>0, > "description"=>"Generating HTML files", > "step_type"=>"repoview", > "items_total"=>1, > "state"=>"SKIPPED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"c3d3f16a-727a-4b7c-839c-45a95a9888a7", > "num_processed"=>0}, > {"num_success"=>1, > "description"=>"Publishing files to web", > "step_type"=>"publish_directory", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"cb0246f9-c2ef-49b3-9bd2-da53e71d692a", > "num_processed"=>1}, > {"num_success"=>1, > "description"=>"Writing Listings File", > "step_type"=>"initialize_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"0f12a784-557d-4f4f-8d5b-f34db4dd59ec", > "num_processed"=>1}, > {"num_success"=>1, > "description"=>"Writing Listings File", > "step_type"=>"initialize_repo_metadata", > "items_total"=>1, > "state"=>"FINISHED", > "error_details"=>[], > "details"=>"", > "num_failures"=>0, > "step_id"=>"3dcbf71e-6950-45a1-b834-42ccfc2e8e0f", > "num_processed"=>1}]}, > "error"=>nil, > "_id"=>{"$oid"=>"58b05a36c47a37aeec805b06"}, > "id"=>"58b05a36c47a37aeec805b06"}], > "poll_attempts"=>{"total"=>29, "failed"=>0}}, > "user_id"=>1, > "contents_changed"=>true, > "current_user_id"=>1} > > > > ------ > The most dangerous phrase in the language is, "We've always done it this > way." > > - Grace Hopper > -- You received this message because you are subscribed to the Google Groups "Foreman users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/foreman-users. For more options, visit https://groups.google.com/d/optout.
