I did that, didn't seem to help. I've now done a few things:
1. Removed all lifecycle environments from the capsule (via the katello GUI)
2. Used foreman-console to delete the 2 running tasks that had been stuck
at 62% for days
ForemanTasks::Task.find("7808217a-4057-4b43-a741-0c20a6c41307").destroy
ForemanTasks::Task.find("ff0e613c-9160-49d6-bbc0-b8fcbb0f583a").destroy
This then put the capsule in a "synchronised" state - i.e. no running tasks
according to katello
3. Added a single lifecycle environment to the capsule
4. Hit Synchronise
5. It ran up to 48% super quickly, and now seems stuck
If I browse to the running task > running steps, there are a whole bunch of
waiting actions "Actions::Pulp::Repository::Destroy" - state is State: waiting
for Pulp to start the task
Is this a communication problem? I have the following ports open on the
katello server
443/tcp 80/tcp 8140/tcp 9090/tcp 5647/tcp 5646/tcp 5672/tcp 8080/tcp 67/udp
9000/tcp 68/udp 53/tcp 69/udp 4505-4506/tcp 53/udp 5671/tcp
and on the capsule:
443/tcp 80/tcp 8140/tcp 9090/tcp 5647/tcp 9000/tcp 8443/tcp 8000/tcp 69/udp
4505-4506/tcp
There is a physical firewall between the two servers, these ports are open
on that for the two servers to communicate
HTTP (80/tcp)
HTTPS (443/tcp)
9090/tcp
4505-4506/tcp
5646/tcp
5647/tcp
On Thursday, August 4, 2016 at 7:46:53 AM UTC+12, John Mitsch wrote:
>
> Dylan,
>
> I wonder if things are a little stopped up in pulp/celery on the capsule.
> Run this on the capsule:
>
> systemctl stop pulp_celerybeat.service pulp_workers.service
> pulp_resource_manager.service
> systemctl start pulp_celerybeat.service pulp_workers.service
> pulp_resource_manager.service
> systemctl restart httpd
>
> Sometimes this can help clear stuck pulp jobs. Not sure if that is your
> issue, but worth a try :)
>
> Thanks,
>
> John Mitsch
> Red Hat Engineering
> (860)-967-7285
> irc: jomitsch
>
> On Wed, Aug 3, 2016 at 3:41 PM, Dylan Baars <[email protected]
> <javascript:>> wrote:
>
>> Hi again,
>>
>> I've noticed in the dynflow console that katello seems to be waiting for
>> pulp to start the task -
>>
>> 12: Actions::Pulp::Consumer::SyncCapsule (waiting for Pulp to start the
>> task) [ 201571.83s / 2023.95s ] Cancel
>> <https://192.168.59.247/foreman_tasks/dynflow/48f70f23-1f1f-4e9f-8ca2-05db9e0da521/cancel/12>
>>
>> *Started at:* 2016-08-01 00:06:17 UTC
>>
>> *Ended at:* 2016-08-03 08:05:48 UTC
>>
>> *Real time:* 201571.83s
>>
>> *Execution time (excluding suspended state):* 2023.95s
>>
>> *Input:*
>>
>> ---
>> capsule_id: 2
>> repo_pulp_id: NIWA-Oracle_Virtualbox-Virtualbox_rhel7_x86_64
>> remote_user: admin
>> remote_cp_user: admin
>> locale: en
>>
>> *Output:*
>>
>> ---
>> pulp_tasks:- exception:
>> task_type: pulp.server.managers.repo.sync.sync
>> _href: "/pulp/api/v2/tasks/20254460-c490-4669-bf02-bbcf0161172d/"
>> task_id: 20254460-c490-4669-bf02-bbcf0161172d
>> tags:
>> - pulp:repository:NIWA-Oracle_Virtualbox-Virtualbox_rhel7_x86_64
>> - pulp:action:sync
>> finish_time:
>> _ns: task_status
>> start_time:
>> traceback:
>> spawned_tasks: []
>> progress_report: {}
>> queue: None.dq
>> state: waiting
>> worker_name:
>> result:
>> error:
>> _id:
>> "$oid": 579e9279b9867873daf31b4f
>> id: 579e9279b9867873daf31b4f
>> poll_attempts:
>> total: 12369
>> failed: 0
>>
>> Does this help anyone try and figure out whats going on?
>>
>> Thanks :-)
>> Dylan
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Foreman users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected] <javascript:>.
>> To post to this group, send email to [email protected]
>> <javascript:>.
>> Visit this group at https://groups.google.com/group/foreman-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
--
You received this message because you are subscribed to the Google Groups
"Foreman users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/foreman-users.
For more options, visit https://groups.google.com/d/optout.
