Ottomata has submitted this change and it was merged.
Change subject: Add EventLogging Kafka writer plug-in
......................................................................
Add EventLogging Kafka writer plug-in
Adds an EventLogging consumer that writes events to Kafka.
The topic name is 'eventlogging-00'.
Change-Id: Ia58c4503b91bdeba6016432602159df2f735db7b
---
M manifests/role/eventlogging.pp
1 file changed, 21 insertions(+), 0 deletions(-)
Approvals:
Ottomata: Verified; Looks good to me, approved
diff --git a/manifests/role/eventlogging.pp b/manifests/role/eventlogging.pp
index 8d67843..50a4362 100644
--- a/manifests/role/eventlogging.pp
+++ b/manifests/role/eventlogging.pp
@@ -157,6 +157,27 @@
}
+ ## Kafka / Hadoop
+
+ include role::analytics::kafka::client
+
+ $kafka_brokers = inline_template('<%=
scope.lookupvar("role::analytics::kafka::client::brokers_array").join(",") %>')
+ $kafka_cluster = $::role::analytics::kafka::client::kafka_cluster_name
+
+ $kafka_topic_base_name = 'eventlogging'
+ $kafka_topic_version = 0
+ $kafka_topic = sprintf('%s-%02d', $kafka_topic_base_name,
$kafka_topic_version)
+
+ package { 'python-kafka':
+ ensure => present,
+ }
+
+ eventlogging::service::consumer { 'kafka':
+ input => "tcp://${processor}:8600",
+ output =>
"kafka://${kafka_cluster}?brokers=${kafka_brokers}&topic=${kafka_topic}",
+ }
+
+
## Monitoring
eventlogging::service::reporter { 'statsd':
--
To view, visit https://gerrit.wikimedia.org/r/85337
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Ia58c4503b91bdeba6016432602159df2f735db7b
Gerrit-PatchSet: 5
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ori.livneh <[email protected]>
Gerrit-Reviewer: Faidon Liambotis <[email protected]>
Gerrit-Reviewer: Ori.livneh <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
