jenkins-bot has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/364183 )
Change subject: [cirrus] Enable the token_count_router only for chinese
......................................................................
[cirrus] Enable the token_count_router only for chinese
We have some doubts that the token_count_router might be an indirect
cause of the recurring load spikes we encouter since few weeks on the
eqiad cluster. Previously phrase rescoring was activated by detecting
spaces. Token count router will run a tokenizer to detect multiword
queries thus enabling the costly phrase rescorer on more queries and
possibly causing load spkikes.
Enable only this feature on chinese wikis and monitor the load spikes
to confirm our assumptions.
Bug: T169498
Change-Id: I9c88280dde0f3026e5844c961139b69179c1e10b
---
M wmf-config/CirrusSearch-common.php
1 file changed, 7 insertions(+), 1 deletion(-)
Approvals:
Zfilipin: Looks good to me, approved
jenkins-bot: Verified
diff --git a/wmf-config/CirrusSearch-common.php
b/wmf-config/CirrusSearch-common.php
index 1871057..a99774e 100644
--- a/wmf-config/CirrusSearch-common.php
+++ b/wmf-config/CirrusSearch-common.php
@@ -86,9 +86,15 @@
'super_detect_noop' => true,
'id_hash_mod_filter' => true,
'documentVersion' => true,
- 'token_count_router' => true,
];
+# Investigate T169498, only activate token_count_router for spaceless
languages with sane
+# analysis chain and the perfield_builder ft builder.
+if ( $wgLanguageCode === 'zh' ) {
+ $wgCirrusSearchWikimediaExtraPlugin['token_count_router'] = true;
+}
+
+
# Enable the "experimental" highlighter on all wikis
$wgCirrusSearchUseExperimentalHighlighter = true;
$wgCirrusSearchOptimizeIndexForExperimentalHighlighter = true;
--
To view, visit https://gerrit.wikimedia.org/r/364183
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I9c88280dde0f3026e5844c961139b69179c1e10b
Gerrit-PatchSet: 2
Gerrit-Project: operations/mediawiki-config
Gerrit-Branch: master
Gerrit-Owner: DCausse <[email protected]>
Gerrit-Reviewer: Zfilipin <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
