Issue #2901 has been updated by konrad rzentarzewski.
yes, auth problems are gone, however "not mounted" errors are ocurring
frequently (at least on 50% of runs). it happens on all clients (i have mixed
0.24.8 and 0.25.1 clients), randomly on all of modules in manifests (i think).
i think it never happens on 1st connection to passenger after restarting it.
example - from client's POV:
<pre>
[r...@test ~]# puppetd --version
0.24.8
[r...@test ~]# puppetd --test
info: Loading fact mounts
notice: Ignoring --listen on onetime run
info: Retrieving plugins
notice: /File[/var/lib/puppet/lib]/mode: mode changed '755' to '775'
notice: /File[/var/lib/puppet/lib/facter]/mode: mode changed '755' to '775'
info: Loading fact mounts
info: Caching catalog at /var/lib/puppet/localconfig.yaml
notice: Starting catalog run
notice: //puppet::puppet/File[/var/lib/puppet/lib]/mode: mode changed '775' to
'755'
notice: //puppet::puppet/File[/var/lib/puppet/lib/facter]/mode: mode changed
'775' to '755'
err: //ha::haproxy/File[/etc/haproxy/err503-x1.http]: Failed to retrieve
current state of resource: Fileserver module 'ha' not mounted Could not
describe /ha/fwlb/err503-x1.http: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:133
err: //ha::haproxy/File[/etc/haproxy/err503-x2.http]: Failed to retrieve
current state of resource: Fileserver module 'ha' not mounted Could not
describe /ha/fwlb/err503-x2.http: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:213
err: //ha::haproxy/File[/etc/haproxy/err503-x3.http]: Failed to retrieve
current state of resource: Fileserver module 'ha' not mounted Could not
describe /ha/fwlb/err503-x3.http: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:196
err: //ha::haproxy/File[/etc/haproxy/err503-x4.http]: Failed to retrieve
current state of resource: Fileserver module 'ha' not mounted Could not
describe /ha/fwlb/err503-x4.http: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:187
err: //ha::haproxy/File[/etc/haproxy/err503-x5.http]: Failed to retrieve
current state of resource: Fileserver module 'ha' not mounted Could not
describe /ha/fwlb/err503-x5.http: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:124
err: //ha::haproxy/File[/etc/haproxy/err503-x6.http]: Failed to retrieve
current state of resource: Fileserver module 'ha' not mounted Could not
describe /ha/fwlb/err503-x6.http: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:204
notice: //ha::haproxy/Service[haproxy]: Dependency
file[/etc/haproxy/err503-x1.http] has 1 failures
notice: //ha::haproxy/Service[haproxy]: Dependency
file[/etc/haproxy/err503-x2.http] has 1 failures
notice: //ha::haproxy/Service[haproxy]: Dependency
file[/etc/haproxy/err503-x3.http] has 1 failures
notice: //ha::haproxy/Service[haproxy]: Dependency
file[/etc/haproxy/err503-x4.http] has 1 failures
notice: //ha::haproxy/Service[haproxy]: Dependency
file[/etc/haproxy/err503-x5.http] has 1 failures
notice: //ha::haproxy/Service[haproxy]: Dependency
file[/etc/haproxy/err503-x6.http] has 1 failures
warning: //ha::haproxy/Service[haproxy]: Skipping because of failed dependencies
err: //puppet::puppet/File[/etc/sysconfig/puppet]: Failed to retrieve current
state of resource: Fileserver module 'puppet' not mounted Could not describe
/puppet/sysconfig: Fileserver module 'puppet' not mounted at
/etc/puppet/site/modules/puppet/manifests/init.pp:57
err: //nagios::check::pacemaker/File[check_xml]: Failed to retrieve current
state of resource: Fileserver module 'nagios' not mounted Could not describe
/nagios/check.xsl: Fileserver module 'nagios' not mounted at
/etc/puppet/site/modules/nagios/manifests/init.pp:750
err: //nagios::check::pacemaker/File[config_xml]: Failed to retrieve current
state of resource: Fileserver module 'nagios' not mounted Could not describe
/nagios/test/config.xml: Fileserver module 'nagios' not mounted at
/etc/puppet/site/modules/nagios/manifests/init.pp:760
notice: //nagios::check::pacemaker/File[check_pacemaker]: Dependency
file[/usr/local/lib/config.xml] has 1 failures
notice: //nagios::check::pacemaker/File[check_pacemaker]: Dependency
file[/usr/local/lib/check.xsl] has 1 failures
warning: //nagios::check::pacemaker/File[check_pacemaker]: Skipping because of
failed dependencies
err: //ha::varnish/File[/etc/varnish/default.vcl]: Failed to retrieve current
state of resource: Fileserver module 'ha' not mounted Could not describe
/ha/test/default.vcl: Fileserver module 'ha' not mounted at
/etc/puppet/site/modules/ha/manifests/init.pp:290
notice: //ha::varnish/Service[varnish]: Dependency
file[/etc/varnish/default.vcl] has 1 failures
warning: //ha::varnish/Service[varnish]: Skipping because of failed dependencies
err: //bacula::fd/File[/etc/bacula/pki/test-fd.pem]: Failed to retrieve current
state of resource: Fileserver module 'bacula' not mounted Could not describe
/bacula/test/fd.pem: Fileserver module 'bacula' not mounted at
/etc/puppet/site/modules/bacula/manifests/init.pp:123
notice: //bacula::fd/Service[bacula-fd]: Dependency
file[/etc/bacula/pki/test-fd.pem] has 1 failures
warning: //bacula::fd/Service[bacula-fd]: Skipping because of failed
dependencies
notice: //bacula::fd/File[/etc/bacula/pki/test.non.3dart.com-fd.pem]:
Dependency file[/etc/bacula/pki/test-fd.pem] has 1 failures
warning: //bacula::fd/File[/etc/bacula/pki/test.non.3dart.com-fd.pem]: Skipping
because of failed dependencies
err: //bacula::fd/File[/etc/bacula/pki/master.cert]: Failed to retrieve current
state of resource: Fileserver module 'bacula' not mounted Could not describe
/bacula/master.pem: Fileserver module 'bacula' not mounted at
/etc/puppet/site/modules/bacula/manifests/init.pp:116
err: //nagios::check::puppet/File[monitor_puppet]: Failed to retrieve current
state of resource: Fileserver module 'puppet' not mounted Could not describe
/puppet/monitor.py: Fileserver module 'puppet' not mounted at
/etc/puppet/site/modules/nagios/manifests/init.pp:692
notice: //puppet::puppet/Service[puppet]: Dependency
file[/etc/sysconfig/puppet] has 1 failures
warning: //puppet::puppet/Service[puppet]: Skipping because of failed
dependencies
info: Sent transaction report in 0.26 seconds
notice: Finished catalog run in 11.38 seconds
</pre>
from puppetmaster POV:
<pre>
Dec 14 16:28:31 punch puppetmasterd[3361]: Starting Puppet server version 0.25.1
Dec 14 16:28:31 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:31 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:31 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:31 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'puppet' not
mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'nagios' not
mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'nagios' not
mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'ha' not mounted
Dec 14 16:28:32 punch puppetmasterd[3361]: Fileserver module 'bacula' not
mounted
Dec 14 16:28:33 punch puppetmasterd[3361]: Fileserver module 'bacula' not
mounted
Dec 14 16:28:33 punch puppetmasterd[3361]: Fileserver module 'puppet' not
mounted
Dec 14 16:28:33 punch puppetmasterd[3361]: No report named 'log #'
Dec 14 16:28:33 punch puppetmasterd[3361]: RRD library is missing; cannot store
metrics
Dec 14 16:28:33 punch puppetmasterd[3361]: RRD library is missing; cannot graph
metrics
Dec 14 16:28:33 punch puppetmasterd[3361]: RRD library is missing; cannot store
metrics
Dec 14 16:28:33 punch puppetmasterd[3361]: RRD library is missing; cannot graph
metrics
Dec 14 16:28:33 punch puppetmasterd[3361]: RRD library is missing; cannot store
metrics
Dec 14 16:28:33 punch puppetmasterd[3361]: RRD library is missing; cannot graph
metrics
Dec 14 16:28:33 punch puppetmasterd[3361]: Report rrdgraph failed: Could not
find graphs for daily
</pre>
yes, there is "puppet" environment defined in my puppet.conf, and at this time
it's the same as main/production.
<pre>
[puppet]
manifest = /etc/puppet/site/manifests/site.pp
modulepath = /etc/puppet/site/modules
</pre>
----------------------------------------
Bug #2901: numerous issues with puppetmaster 0.25.1 and passenger (2.2.2, 2.2.7)
http://projects.reductivelabs.com/issues/2901
Author: konrad rzentarzewski
Status: Investigating
Priority: Normal
Assigned to:
Category: passenger
Target version:
Affected version: 0.25.1
Keywords:
Branch:
attached my current configuration (mod_passenger, puppet.conf).
below are problems encountered. none of them exists with webrick configuration,
however support for webrick should be removed as it doesn't handle multiple
server connections.
(1) problem with stored configs and postgres. applying fix from #2880 did no
change here.
<pre>
Dec 8 14:34:05 punch puppetmasterd[741]: Cached facts for
puppet.looney.acme.com failed: PGError: no connection to the server
Dec 8 14:34:05 punch puppetmasterd[741]: Could not retrieve facts for
puppet.looney.acme.com: PGError: no connection to the server
Dec 8 14:34:06 punch puppetmasterd[741]: Cached facts for
puppet.looney.acme.com failed: PGError: no connection to the server
Dec 8 14:34:06 punch puppetmasterd[741]: Could not retrieve facts for
puppet.looney.acme.com: PGError: no connection to the server
Dec 8 14:34:06 punch puppetmasterd[741]: Cached facts for
puppet.looney.acme.com failed: PGError: no connection to the server
Dec 8 14:34:06 punch puppetmasterd[741]: Could not retrieve facts for
puppet.looney.acme.com: PGError: no connection to the server
Dec 8 14:34:06 punch puppetmasterd[741]: Cached facts for
puppet.looney.acme.com failed: PGError: no connection to the server
Dec 8 14:34:06 punch puppetmasterd[741]: Could not retrieve facts for
puppet.looney.acme.com: PGError: no connection to the server
</pre>
(2) similiar issue with sqlite3:
<pre>
Dec 8 16:40:46 punch puppetmasterd[13613]: SQLite3::BusyException: database is
locked: INSERT INTO "hosts" ("name", "last_report", "created_at", "updated_at",
"ip", "last_freshcheck", "environment", "sou
ce_file_id", "last_compile") VALUES('roadrunner.looney.acme.com', NULL,
'2009-12-08 16:40:46', '2009-12-08 16:40:46', NULL, NULL, NULL, NULL, NULL)
</pre>
have not tried mysql.
(3) "unathenticated" messages:
<pre>
Dec 8 16:43:39 punch puppetmasterd[13530]: Denying access: Forbidden request:
puppet.looney.acme.com(10.0.4.2) access to /catalog/roadrunner.looney.acme.com
[find] authenticated at line 0
</pre>
(4) numerous random "cannot find resource" (defined and included from modules)
- not repeating on successive run:
<pre>
Dec 8 16:55:22 punch puppetmasterd[19953]: Could not find resource type
mysql::db::create at /etc/puppet/site/manifests/nodes.pp:2022 on node
donald.looney.acme.com
Dec 8 16:55:22 punch puppetmasterd[19953]: Could not find resource type
mysql::db::create at /etc/puppet/site/manifests/nodes.pp:2022 on node
donald.looney.acme.com
Dec 8 16:55:25 punch puppetmasterd[19878]: Could not find resource type
mysql::db::slowcheck at /etc/puppet/site/manifests/nodes.pp:1953 on node
mickey.looney.acme.com
Dec 8 16:55:25 punch puppetmasterd[19878]: Could not find resource type
mysql::db::slowcheck at /etc/puppet/site/manifests/nodes.pp:1953 on node
mickey.looney.acme.com
Dec 8 16:58:37 punch puppetmasterd[25891]: Could not find class apache::server
at /etc/puppet/site/manifests/nodes.pp:1793 on node jerry.looney.acme.com
Dec 8 16:58:37 punch puppetmasterd[25891]: Could not find class apache::server
at /etc/puppet/site/manifests/nodes.pp:1793 on node jerry.looney.acme.com
Dec 8 17:56:04 punch puppetmasterd[14169]: Could not find class java::jdk in
namespaces baseclass_jetty at /etc/puppet/site/manifests/nodes.pp:2232 on node
bunny.looney.acme.com
Dec 8 17:56:04 punch puppetmasterd[14169]: Could not find class java::jdk in
namespaces baseclass_jetty at /etc/puppet/site/manifests/nodes.pp:2232 on node
bunny.looney.acme.com
</pre>
(5) spontanous "fileserver module not mounted":
<pre>
Dec 8 16:55:29 punch puppetmasterd[20284]: Fileserver module 'sudo' not mounted
Dec 8 16:55:29 punch puppetmasterd[20284]: Fileserver module 'denyhosts' not
mounted
Dec 8 16:55:29 punch puppetmasterd[20284]: Fileserver module 'ntp' not mounted
Dec 8 16:55:29 punch puppetmasterd[20469]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:29 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:29 punch puppetmasterd[20284]: Fileserver module 'yum' not mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'bacula' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20028]: Fileserver module 'bacula' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20028]: Fileserver module 'denyhosts' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20028]: Fileserver module 'nagios' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'nagios' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'mysql' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'puppet' not
mounted
Dec 8 16:55:30 punch puppetmasterd[20284]: Fileserver module 'yum' not mounted
Dec 8 16:55:31 punch puppetmasterd[20284]: Fileserver module 'sudo' not mounted
</pre>
(6) there is apparently no way to make puppetd use keepalive. for that reason
each fileserver request is made in separate http connection, thus causing more
passenger thread load. plus it applies incomplete manifests if one of threads
responds with one of the error listed above and another succeeds.
(7) virtually no problems manifests itself on 1st run after i start passenger.
they all seem to be caused by connection pooling (reusing existing spawned
applications).
--
You have received this notification because you have either subscribed to it,
or are involved in it.
To change your notification preferences, please click here:
http://reductivelabs.com/redmine/my/account
--
You received this message because you are subscribed to the Google Groups
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/puppet-bugs?hl=en.
