jenkins-bot has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/366194 )
Change subject: Team Draft interleaved AB testing ...................................................................... Team Draft interleaved AB testing Adjusts primary full text search handing to support team draft interleaving via wgCirrusSearchUserTesting triggers. This method of AB testing search changes is significantly more robust to noise, as all users are in both the control and test buckets. See linked ticket/papers for more information. Implementation is perhaps not perfect, but for AB testing should be sufficient. Specifically a way to decorate a ResultSet, rather than copying all the data over into an extended class would be useful. SearchContext now tracks its 'dirty' state, meaning additional configuration that effects search results beyond the SearchConfig object. This is primarily to detect custom rescore profiles set in the request, so interleaving with the ltr rescore profile will be against what we expect and not something custom provided by users. Bug: T150032 Change-Id: I936d2432cc94a67d373f77779ca6550a0f127bf1 --- M CirrusSearch.php M autoload.php M docs/settings.txt M includes/Api/ConfigDump.php M includes/CirrusSearch.php A includes/Search/InterleavedResultSet.php M includes/Search/ResultSet.php M includes/Search/SearchContext.php A includes/Search/SearchMetricsProvider.php A includes/Search/TeamDraftInterleaver.php M includes/Searcher.php A tests/unit/Search/TeamDraftInterleaverTest.php A tests/unit/fixtures/searchText/interleave_001.default.expected A tests/unit/fixtures/searchText/interleave_001.fullyfeatured-interwiki.expected A tests/unit/fixtures/searchText/interleave_001.fullyfeatured.expected A tests/unit/fixtures/searchText/interleave_001.query A tests/unit/fixtures/searchText/interleave_002.default.expected A tests/unit/fixtures/searchText/interleave_002.fullyfeatured-interwiki.expected A tests/unit/fixtures/searchText/interleave_002.fullyfeatured.expected A tests/unit/fixtures/searchText/interleave_002.query A tests/unit/fixtures/searchText/interleave_003.default.expected A tests/unit/fixtures/searchText/interleave_003.fullyfeatured-interwiki.expected A tests/unit/fixtures/searchText/interleave_003.fullyfeatured.expected A tests/unit/fixtures/searchText/interleave_003.query 24 files changed, 9,136 insertions(+), 11 deletions(-) Approvals: Tjones: Looks good to me, but someone else must approve Cindy-the-browser-test-bot: Looks good to me, but someone else must approve jenkins-bot: Verified DCausse: Looks good to me, approved -- To view, visit https://gerrit.wikimedia.org/r/366194 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I936d2432cc94a67d373f77779ca6550a0f127bf1 Gerrit-PatchSet: 7 Gerrit-Project: mediawiki/extensions/CirrusSearch Gerrit-Branch: master Gerrit-Owner: EBernhardson <[email protected]> Gerrit-Reviewer: Cindy-the-browser-test-bot <[email protected]> Gerrit-Reviewer: DCausse <[email protected]> Gerrit-Reviewer: Gehel <[email protected]> Gerrit-Reviewer: Smalyshev <[email protected]> Gerrit-Reviewer: Tjones <[email protected]> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
