On Fri, Dec 2, 2011 at 7:28 PM, Nigel Kersten <[email protected]> wrote:
> awesome, thanks for the ticket #s Jo, I'll do some follow up there and
> hopefully we can report a happy summary back to the list.
>
>
> On Fri, Dec 2, 2011 at 3:32 PM, Jo Rhett <[email protected]> wrote:
>>
>> I am also now pretty certain that this issue (ticket #11140) is tied
>> directly to 3 systems (in ticket #11143) which can't get catalogs. I believe
>> their attempts to get a catalog produce a hung server. 3 servers every 30
>> minutes means that in just over 3 hours I have 20 hung puppetmasters, and
>> the queue goes out of control.
>>
>> I would deeply appreciate some information on how to diagnose the catalog
>> failures and related puppetmaster hangs.
>>
>> On Dec 2, 2011, at 3:09 PM, Jo Rhett wrote:
>>
>> Hm, you know I don't think that it's a sudden lock of all 20 passenger
>> clients. I think it's a slow lockup of various puppet sessions until all 20
>> are locked. Here's an example: every one of the "active" sessions below
>> with an uptime longer than 30 minutes has had the same "processed" number
>> for more than 30 minutes at this time. So in theory, they've been
>> processing the same session for more than 30 minutes. Somehow, I don't
>> think so. I think those sessions are locked up. And what is happening is
>> that eventually all 20 processes are hung and we are dead in the water.
Not sure if this was mentioned, but in the config.ru file you can
enable more debugging.
# if you want debugging:
# ARGV << "--debug"
On the master you can try to compile for these hanging clients via:
puppet master --compile ${hostname} --debug
Hopefully these methods give you more useful outputs. Last do you
happen to use an ENC or custom function that query data?
Thanks,
Nan
--
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en.
