Andrew Bogott has submitted this change and it was merged.

Change subject: Increase the filehandle limit for rabbitmq in labs.
......................................................................


Increase the filehandle limit for rabbitmq in labs.

This is an impulsive change motivated by:

- I just saw a talk by some OpenStack admins full of horror stories
   of cryptic failure cases when the file handle limit is hit
- Rabbitmq just now seized up and I had to restart it
- https://bugs.launchpad.net/fuel/+bug/1279594

Change-Id: Ie7ce51964accc19e9389c20ef156287af65ab410
---
A modules/openstack/files/rabbitmq/labs-rabbitmq.default
M modules/openstack/manifests/queue_server.pp
2 files changed, 27 insertions(+), 0 deletions(-)

Approvals:
  Andrew Bogott: Looks good to me, approved
  jenkins-bot: Verified



diff --git a/modules/openstack/files/rabbitmq/labs-rabbitmq.default 
b/modules/openstack/files/rabbitmq/labs-rabbitmq.default
new file mode 100644
index 0000000..0592815
--- /dev/null
+++ b/modules/openstack/files/rabbitmq/labs-rabbitmq.default
@@ -0,0 +1,18 @@
+#####################################################################
+### THIS FILE IS MANAGED BY PUPPET
+### puppet:///modules/openstack/rabbitmq/labs-rabbitmq.default
+#####################################################################
+
+
+# This file is sourced by /etc/init.d/rabbitmq-server. Its primary
+# reason for existing is to allow adjustment of system limits for the
+# rabbitmq-server process.
+#
+# Default file handles limit is 1024.  We need a handle
+#  for every worker thread of every service on every node
+#  which shouldn't add up to 1024 but Rabbit has been dying
+#  and this is an inexpensive thing to try.
+#
+# Many big production OS installs have this set to 16k or even 64k.
+#
+ulimit -n 8192
diff --git a/modules/openstack/manifests/queue_server.pp 
b/modules/openstack/manifests/queue_server.pp
index 3a3bf50..b9503ce 100644
--- a/modules/openstack/manifests/queue_server.pp
+++ b/modules/openstack/manifests/queue_server.pp
@@ -8,6 +8,15 @@
         require => Class['openstack::repo'];
     }
 
+    # Turn up the number of allowed file handles for rabbitmq
+    file { '/etc/default/rabbitmq-server':
+        ensure => present,
+        owner  => 'root',
+        group  => 'root',
+        mode   => '0444',
+        source => 'puppet:///modules/openstack/rabbitmq/labs-rabbitmq.default',
+    }
+
     if $::fqdn == hiera('labs_nova_controller') {
         service { 'rabbitmq-server':
             ensure    => running,

-- 
To view, visit https://gerrit.wikimedia.org/r/285888
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: Ie7ce51964accc19e9389c20ef156287af65ab410
Gerrit-PatchSet: 5
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Andrew Bogott <[email protected]>
Gerrit-Reviewer: Andrew Bogott <[email protected]>
Gerrit-Reviewer: Rush <[email protected]>
Gerrit-Reviewer: jenkins-bot <>

_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

Reply via email to