Ori.livneh has uploaded a new change for review.
https://gerrit.wikimedia.org/r/125026
Change subject: Increase count of carbon cache instances to eight
......................................................................
Increase count of carbon cache instances to eight
tungsten has 16 CPUs with four cores each. Apart from the six carbon-cache
instances, the jobs that generate significant load are mwprof (one process,
single-threaded), txStatsD (one process, single-threaded), graphite-web
(four uWSGI worker processes), and carbon-relay (one process, single-threaded).
Profiling the system shows that we are not exploiting parallelism as much as we
could -- whenever I looked there are always multiple processors that are just
idling. If the incoming Graphite metric load was enough to overwhelm four
instances, let's not stop six.
Change-Id: I978efd095392c0e262a22ad7deca6cff9d1bb736
---
M manifests/role/graphite.pp
1 file changed, 13 insertions(+), 1 deletion(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/26/125026/1
diff --git a/manifests/role/graphite.pp b/manifests/role/graphite.pp
index ea67c66..5969837 100644
--- a/manifests/role/graphite.pp
+++ b/manifests/role/graphite.pp
@@ -46,7 +46,7 @@
},
# All metric data goes through a single carbon-relay instance, which
- # forwards each data point to one of six carbon-cache instances, using
+ # forwards each data point to one of eight carbon-cache instances,
using
# a consistent hash ring to distribute the load.
#
# Why is this necessary? Because carbon-cache is CPU-bound, and the
Python
@@ -96,6 +96,16 @@
pickle_receiver_port => 2604,
cache_query_port => 7602,
},
+ 'cache:g' => {
+ line_receiver_port => 2703,
+ pickle_receiver_port => 2704,
+ cache_query_port => 7702,
+ },
+ 'cache:h' => {
+ line_receiver_port => 2803,
+ pickle_receiver_port => 2804,
+ cache_query_port => 7802,
+ },
## Carbon relay ##
@@ -112,6 +122,8 @@
'127.0.0.1:2404:d',
'127.0.0.1:2504:e',
'127.0.0.1:2604:f',
+ '127.0.0.1:2604:g',
+ '127.0.0.1:2604:h',
],
},
},
--
To view, visit https://gerrit.wikimedia.org/r/125026
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I978efd095392c0e262a22ad7deca6cff9d1bb736
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ori.livneh <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
