Re: [foreman-users] Re: Sync is stuck in pending

2017-02-26 Thread Sean O'Keeffe
Try foreman-rake katello:reimport

foreman-rake katello:reindex Has been renamed recently.

On Mon, 27 Feb 2017 at 00:49, Lachlan Musicman  wrote:

> Search turned up this potential solution:
>
> https://access.redhat.com/discussions/2065363
>
> I tried restarting Katello service as noted, without success. I ended up
> here
>
> https://access.redhat.com/solutions/1381053
>
> There's an error thrown on the last step:
>
> [root@vmpr-res-utils ~]# foreman-rake katello:reindex --trace
> rake aborted!
> Don't know how to build task 'katello:reindex'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/task_manager.rb:62:in
> `[]'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:149:in
> `invoke_task'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in
> `block (2 levels) in top_level'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in
> `each'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in
> `block in top_level'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:115:in
> `run_with_threads'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:100:in
> `top_level'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:78:in
> `block in run'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:176:in
> `standard_exception_handling'
> /opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:75:in
> `run'
> /opt/rh/rh-ruby22/root/usr/bin/rake:33:in `'
>
> That will teach me for trying to solve my own problems.
>
> The problem seems to have persisted - where do I look next?
>
> cheers
> L.
>
>
>
> --
> The most dangerous phrase in the language is, "We've always done it this
> way."
>
> - Grace Hopper
>
> On 27 February 2017 at 09:39, Lachlan Musicman  wrote:
>
> CentOS 7.3, Katello 3.2, Foreman 1.13.4
>
> And it's cascading - there are four other sync's that haven't finished
> because one seems to be in a permanent pending state.
>
> I don't see any obvious cancel/resume function? The cancel link on the
> sync status page bounces when clicked but...nothing.
>
> The logs/Dynaflow show no errors, it's just stopped at 71%.
>
> How to solve?
>
> (raw details below)
>
> cheers
> L.
>
> {"repository"=>{"id"=>5, "name"=>"epel", "label"=>"epel"},
>  "product"=>
>   {"id"=>2,
>"name"=>"Extra Packages for Enterprise Linux 7",
>"label"=>"Extra_Packages_for_Enterprise_Linux_7_-_x86_64",
>"cp_id"=>"1464869283627"},
>  "provider"=>{"id"=>1, "name"=>"Anonymous"},
>  "organization"=>
>   {"id"=>1,
>"name"=>"Peter MacCallum Cancer Centre",
>"label"=>"Peter_MacCallum_Cancer_Centre"},
>  "services_checked"=>["pulp", "pulp_auth"],
>  "id"=>5,
>  "sync_result"=>
>   {"contents_changed"=>true,
>"pulp_tasks"=>
> [{"exception"=>nil,
>   "task_type"=>"pulp.server.managers.repo.sync.sync",
>   "_href"=>"/pulp/api/v2/tasks/5460a086-d7e8-4510-9549-c75766ec8fc2/",
>   "task_id"=>"5460a086-d7e8-4510-9549-c75766ec8fc2",
>   "tags"=>
>
> ["pulp:repository:Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
> "pulp:action:sync"],
>   "finish_time"=>"2017-02-24T16:07:18Z",
>   "_ns"=>"task_status",
>   "start_time"=>"2017-02-24T16:01:23Z",
>   "traceback"=>nil,
>   "spawned_tasks"=>
>[{"_href"=>"/pulp/api/v2/tasks/a9843fac-51de-4fb0-a06d-31c0db9b108e/",
>  "task_id"=>"a9843fac-51de-4fb0-a06d-31c0db9b108e"}],
>   "progress_report"=>
>{"yum_importer"=>
>  {"content"=>
>{"items_total"=>22,
> "state"=>"FINISHED",
> "error_details"=>[],
> "details"=>
>  {"rpm_total"=>22,
>   "rpm_done"=>22,
>   "drpm_total"=>0,
>   "drpm_done"=>0},
> "size_total"=>16914540,
> "size_left"=>0,
> "items_left"=>0},
>   "comps"=>{"state"=>"FINISHED"},
>   "purge_duplicates"=>{"state"=>"FINISHED"},
>   "distribution"=>
>{"items_total"=>0,
> "state"=>"FINISHED",
> "error_details"=>[],
> "items_left"=>0},
>   "errata"=>{"state"=>"FINISHED"},
>   "metadata"=>{"state"=>"FINISHED"}}},
>   "queue"=>
>"reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au.dq",
>   "state"=>"finished",
>   "worker_name"=>
>"reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au",
>   "result"=>
>{"result"=>"success",
> "importer_id"=>"yum_importer",
> "exception"=>nil,
> "repo_id"=>
>  
> "Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
> "traceback"=>nil,
> 

[foreman-users] Re: Sync is stuck in pending

2017-02-26 Thread Lachlan Musicman
Search turned up this potential solution:

https://access.redhat.com/discussions/2065363

I tried restarting Katello service as noted, without success. I ended up
here

https://access.redhat.com/solutions/1381053

There's an error thrown on the last step:

[root@vmpr-res-utils ~]# foreman-rake katello:reindex --trace
rake aborted!
Don't know how to build task 'katello:reindex'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/task_manager.rb:62:in
`[]'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:149:in
`invoke_task'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in
`block (2 levels) in top_level'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in
`each'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:106:in
`block in top_level'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:115:in
`run_with_threads'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:100:in
`top_level'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:78:in
`block in run'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:176:in
`standard_exception_handling'
/opt/rh/rh-ruby22/root/usr/share/gems/gems/rake-10.4.2/lib/rake/application.rb:75:in
`run'
/opt/rh/rh-ruby22/root/usr/bin/rake:33:in `'

That will teach me for trying to solve my own problems.

The problem seems to have persisted - where do I look next?

cheers
L.



--
The most dangerous phrase in the language is, "We've always done it this
way."

- Grace Hopper

On 27 February 2017 at 09:39, Lachlan Musicman  wrote:

> CentOS 7.3, Katello 3.2, Foreman 1.13.4
>
> And it's cascading - there are four other sync's that haven't finished
> because one seems to be in a permanent pending state.
>
> I don't see any obvious cancel/resume function? The cancel link on the
> sync status page bounces when clicked but...nothing.
>
> The logs/Dynaflow show no errors, it's just stopped at 71%.
>
> How to solve?
>
> (raw details below)
>
> cheers
> L.
>
> {"repository"=>{"id"=>5, "name"=>"epel", "label"=>"epel"},
>  "product"=>
>   {"id"=>2,
>"name"=>"Extra Packages for Enterprise Linux 7",
>"label"=>"Extra_Packages_for_Enterprise_Linux_7_-_x86_64",
>"cp_id"=>"1464869283627"},
>  "provider"=>{"id"=>1, "name"=>"Anonymous"},
>  "organization"=>
>   {"id"=>1,
>"name"=>"Peter MacCallum Cancer Centre",
>"label"=>"Peter_MacCallum_Cancer_Centre"},
>  "services_checked"=>["pulp", "pulp_auth"],
>  "id"=>5,
>  "sync_result"=>
>   {"contents_changed"=>true,
>"pulp_tasks"=>
> [{"exception"=>nil,
>   "task_type"=>"pulp.server.managers.repo.sync.sync",
>   "_href"=>"/pulp/api/v2/tasks/5460a086-d7e8-4510-9549-c75766ec8fc2/",
>   "task_id"=>"5460a086-d7e8-4510-9549-c75766ec8fc2",
>   "tags"=>
>
> ["pulp:repository:Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
> "pulp:action:sync"],
>   "finish_time"=>"2017-02-24T16:07:18Z",
>   "_ns"=>"task_status",
>   "start_time"=>"2017-02-24T16:01:23Z",
>   "traceback"=>nil,
>   "spawned_tasks"=>
>[{"_href"=>"/pulp/api/v2/tasks/a9843fac-51de-4fb0-a06d-31c0db9b108e/",
>  "task_id"=>"a9843fac-51de-4fb0-a06d-31c0db9b108e"}],
>   "progress_report"=>
>{"yum_importer"=>
>  {"content"=>
>{"items_total"=>22,
> "state"=>"FINISHED",
> "error_details"=>[],
> "details"=>
>  {"rpm_total"=>22,
>   "rpm_done"=>22,
>   "drpm_total"=>0,
>   "drpm_done"=>0},
> "size_total"=>16914540,
> "size_left"=>0,
> "items_left"=>0},
>   "comps"=>{"state"=>"FINISHED"},
>   "purge_duplicates"=>{"state"=>"FINISHED"},
>   "distribution"=>
>{"items_total"=>0,
> "state"=>"FINISHED",
> "error_details"=>[],
> "items_left"=>0},
>   "errata"=>{"state"=>"FINISHED"},
>   "metadata"=>{"state"=>"FINISHED"}}},
>   "queue"=>
>"reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au.dq",
>   "state"=>"finished",
>   "worker_name"=>
>"reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au",
>   "result"=>
>{"result"=>"success",
> "importer_id"=>"yum_importer",
> "exception"=>nil,
> "repo_id"=>
>  
> "Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
> "traceback"=>nil,
> "started"=>"2017-02-24T16:01:23Z",
> "_ns"=>"repo_sync_results",
> "completed"=>"2017-02-24T16:07:18Z",
> "importer_type_id"=>"yum_importer",
> "error_message"=>nil,
> "summary"=>
>  {"content"=>{"state"=>"FINISHED"},
>

[foreman-users] Sync is stuck in pending

2017-02-26 Thread Lachlan Musicman
CentOS 7.3, Katello 3.2, Foreman 1.13.4

And it's cascading - there are four other sync's that haven't finished
because one seems to be in a permanent pending state.

I don't see any obvious cancel/resume function? The cancel link on the sync
status page bounces when clicked but...nothing.

The logs/Dynaflow show no errors, it's just stopped at 71%.

How to solve?

(raw details below)

cheers
L.

{"repository"=>{"id"=>5, "name"=>"epel", "label"=>"epel"},
 "product"=>
  {"id"=>2,
   "name"=>"Extra Packages for Enterprise Linux 7",
   "label"=>"Extra_Packages_for_Enterprise_Linux_7_-_x86_64",
   "cp_id"=>"1464869283627"},
 "provider"=>{"id"=>1, "name"=>"Anonymous"},
 "organization"=>
  {"id"=>1,
   "name"=>"Peter MacCallum Cancer Centre",
   "label"=>"Peter_MacCallum_Cancer_Centre"},
 "services_checked"=>["pulp", "pulp_auth"],
 "id"=>5,
 "sync_result"=>
  {"contents_changed"=>true,
   "pulp_tasks"=>
[{"exception"=>nil,
  "task_type"=>"pulp.server.managers.repo.sync.sync",
  "_href"=>"/pulp/api/v2/tasks/5460a086-d7e8-4510-9549-c75766ec8fc2/",
  "task_id"=>"5460a086-d7e8-4510-9549-c75766ec8fc2",
  "tags"=>
   
["pulp:repository:Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
"pulp:action:sync"],
  "finish_time"=>"2017-02-24T16:07:18Z",
  "_ns"=>"task_status",
  "start_time"=>"2017-02-24T16:01:23Z",
  "traceback"=>nil,
  "spawned_tasks"=>
   [{"_href"=>"/pulp/api/v2/tasks/a9843fac-51de-4fb0-a06d-31c0db9b108e/",
 "task_id"=>"a9843fac-51de-4fb0-a06d-31c0db9b108e"}],
  "progress_report"=>
   {"yum_importer"=>
 {"content"=>
   {"items_total"=>22,
"state"=>"FINISHED",
"error_details"=>[],
"details"=>
 {"rpm_total"=>22,
  "rpm_done"=>22,
  "drpm_total"=>0,
  "drpm_done"=>0},
"size_total"=>16914540,
"size_left"=>0,
"items_left"=>0},
  "comps"=>{"state"=>"FINISHED"},
  "purge_duplicates"=>{"state"=>"FINISHED"},
  "distribution"=>
   {"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"items_left"=>0},
  "errata"=>{"state"=>"FINISHED"},
  "metadata"=>{"state"=>"FINISHED"}}},
  "queue"=>
   "reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au.dq",
  "state"=>"finished",
  "worker_name"=>
   "reserved_resource_worke...@vmpr-res-utils.unix.petermac.org.au",
  "result"=>
   {"result"=>"success",
"importer_id"=>"yum_importer",
"exception"=>nil,
"repo_id"=>
 
"Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
"traceback"=>nil,
"started"=>"2017-02-24T16:01:23Z",
"_ns"=>"repo_sync_results",
"completed"=>"2017-02-24T16:07:18Z",
"importer_type_id"=>"yum_importer",
"error_message"=>nil,
"summary"=>
 {"content"=>{"state"=>"FINISHED"},
  "comps"=>{"state"=>"FINISHED"},
  "purge_duplicates"=>{"state"=>"FINISHED"},
  "distribution"=>{"state"=>"FINISHED"},
  "errata"=>{"state"=>"FINISHED"},
  "metadata"=>{"state"=>"FINISHED"}},
"added_count"=>29,
"removed_count"=>-25,
"updated_count"=>14872,
"id"=>"58b05a36bdb1d60a7024bf11",
"details"=>
 {"content"=>
   {"size_total"=>16914540,
"items_left"=>0,
"items_total"=>22,
"state"=>"FINISHED",
"size_left"=>0,
"details"=>
 {"rpm_total"=>22,
  "rpm_done"=>22,
  "drpm_total"=>0,
  "drpm_done"=>0},
"error_details"=>[]},
  "comps"=>{"state"=>"FINISHED"},
  "purge_duplicates"=>{"state"=>"FINISHED"},
  "distribution"=>
   {"items_total"=>0,
"state"=>"FINISHED",
"error_details"=>[],
"items_left"=>0},
  "errata"=>{"state"=>"FINISHED"},
  "metadata"=>{"state"=>"FINISHED"}}},
  "error"=>nil,
  "_id"=>{"$oid"=>"58b058a1c47a37aeec805a43"},
  "id"=>"58b058a1c47a37aeec805a43"},
 {"exception"=>nil,
  "task_type"=>"pulp.server.managers.repo.publish.publish",
  "_href"=>"/pulp/api/v2/tasks/a9843fac-51de-4fb0-a06d-31c0db9b108e/",
  "task_id"=>"a9843fac-51de-4fb0-a06d-31c0db9b108e",
  "tags"=>
   
["pulp:repository:Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel",
"pulp:action:publish"],
  "finish_time"=>"2017-02-24T16:09:45Z",
  "_ns"=>"task_status",
  "start_time"=>"2017-02-24T16:07:21Z",
  "traceback"=>nil,
  "spawned_tasks"=>[],
  "progress_report"=>
   
{"Peter_MacCallum_Cancer_Centre-Extra_Packages_for_Enterprise_Linux_7_-_x86_64-epel"=>
 [{"num_success"=>1,
   "description"=>"Initializing repo