Ottomata has submitted this change and it was merged. Change subject: Use same values of kafka.max.pull.hrs and kafka.max.historical.days ......................................................................
Use same values of kafka.max.pull.hrs and kafka.max.historical.days This was causing camus to throw out lagging data for mediawiki_CirrusSearchRequestSet Change-Id: I8fddc2abab4c298fc51bdcbc19f0254986125fee --- M modules/camus/templates/mediawiki.erb 1 file changed, 2 insertions(+), 2 deletions(-) Approvals: Ottomata: Verified; Looks good to me, approved diff --git a/modules/camus/templates/mediawiki.erb b/modules/camus/templates/mediawiki.erb index cbeb3c5..2bc8fa5 100644 --- a/modules/camus/templates/mediawiki.erb +++ b/modules/camus/templates/mediawiki.erb @@ -55,9 +55,9 @@ # This will take some more sleuthing to figure out why, but in our case # here its ok, as we hope to never be this far behind in Kafka messages to # consume. -kafka.max.pull.hrs=24 +kafka.max.pull.hrs=168 # events with a timestamp older than this will be discarded. -kafka.max.historical.days=1 +kafka.max.historical.days=7 # Max minutes for each mapper to pull messages (-1 means no limit) # Let each mapper run for no more than 55 minutes. # Camus creates hourly directories, and we don't want a single -- To view, visit https://gerrit.wikimedia.org/r/269604 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I8fddc2abab4c298fc51bdcbc19f0254986125fee Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Ottomata <[email protected]> Gerrit-Reviewer: Ottomata <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
