Ottomata has submitted this change and it was merged.
Change subject: Increase number of map tasks for camus webrequest to 72
......................................................................
Increase number of map tasks for camus webrequest to 72
Bug: T127351
Change-Id: I53ca51cea69c6c32c4d6b7cc2aef57abc42fa60a
---
M modules/camus/templates/webrequest.erb
1 file changed, 3 insertions(+), 3 deletions(-)
Approvals:
Ottomata: Verified; Looks good to me, approved
Joal: Looks good to me, but someone else must approve
diff --git a/modules/camus/templates/webrequest.erb
b/modules/camus/templates/webrequest.erb
index 5258823..5c87a03 100644
--- a/modules/camus/templates/webrequest.erb
+++ b/modules/camus/templates/webrequest.erb
@@ -44,9 +44,9 @@
etl.record.writer.provider.class=com.linkedin.camus.etl.kafka.common.SequenceFileRecordWriterProvider
# Max hadoop tasks to use, each task can pull multiple topic partitions.
-# Currently 5 topics, each with 12 partitions. Setting
-# map.tasks to 5*12.
-mapred.map.tasks=60
+# Currently 4 topics, 2 with 24 partitions, 2 with 12.
+# 2 * 24 + 2 * 12 == 72
+mapred.map.tasks=72
# Connection parameters.
kafka.brokers=<%= Array(@kafka_brokers).join(',') %>
--
To view, visit https://gerrit.wikimedia.org/r/278288
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I53ca51cea69c6c32c4d6b7cc2aef57abc42fa60a
Gerrit-PatchSet: 2
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ottomata <[email protected]>
Gerrit-Reviewer: Joal <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
