Chelsyx has submitted this change and it was merged. ( 
https://gerrit.wikimedia.org/r/370857 )

Change subject: Annotate sample rate change
......................................................................


Annotate sample rate change

On April 25th, we changed the sample rates for several projects, which results 
in changes in our search metrics.

Bug: T172428
Change-Id: I709222fa4fad807762c23858e6c00c43d0747d9a
---
M modules/desktop/events.R
M modules/desktop/load_times.R
M modules/desktop/paulscore.R
M modules/page_visit_times.R
M tab_documentation/desktop_events.md
M tab_documentation/desktop_load.md
M tab_documentation/paulscore_approx.html
M tab_documentation/survival.md
8 files changed, 12 insertions(+), 6 deletions(-)

Approvals:
  Chelsyx: Verified; Looks good to me, approved



diff --git a/modules/desktop/events.R b/modules/desktop/events.R
index bcfd686..4f94e44 100644
--- a/modules/desktop/events.R
+++ b/modules/desktop/events.R
@@ -32,5 +32,6 @@
     polloi::make_dygraph(xlab = "Date", ylab = "Events", title = "Desktop 
search events, by day") %>%
     dyRangeSelector %>%
     dyEvent(as.Date("2016-07-12"), "A (schema switch)", labelLoc = "bottom") 
%>%
-    dyEvent(as.Date("2017-01-01"), "R (reportupdater)", labelLoc = "bottom")
+    dyEvent(as.Date("2017-01-01"), "R (reportupdater)", labelLoc = "bottom") 
%>%
+    dyEvent(as.Date("2017-04-25"), "S (rates)", labelLoc = "bottom")
 })
diff --git a/modules/desktop/load_times.R b/modules/desktop/load_times.R
index 50fb49a..a797c80 100644
--- a/modules/desktop/load_times.R
+++ b/modules/desktop/load_times.R
@@ -5,5 +5,6 @@
     dyRangeSelector %>%
     dyEvent(as.Date("2016-07-12"), "A (schema switch)", labelLoc = "bottom") 
%>%
     dyEvent(as.Date("2017-01-01"), "R (reportupdater)", labelLoc = "bottom") 
%>%
-    dyEvent(as.Date("2017-06-15"), "B (sister search)", labelLoc = "bottom")
+    dyEvent(as.Date("2017-06-15"), "B (sister search)", labelLoc = "bottom") 
%>%
+    dyEvent(as.Date("2017-04-25"), "S (rates)", labelLoc = "bottom")
 })
diff --git a/modules/desktop/paulscore.R b/modules/desktop/paulscore.R
index 144569b..b0ffb14 100644
--- a/modules/desktop/paulscore.R
+++ b/modules/desktop/paulscore.R
@@ -10,7 +10,7 @@
     polloi::make_dygraph(xlab = "Date", ylab = "PaulScore", title = "PaulScore 
for fulltext searches, by day", use_si = FALSE, group = "paulscore_approx") %>%
     dyRangeSelector %>%
     dyLegend(labelsDiv = "paulscore_approx_legend", show = "always") %>%
-    dyEvent(as.Date("2017-04-19"), "A (rates)", labelLoc = "bottom")
+    dyEvent(as.Date("2017-04-25"), "S (rates)", labelLoc = "bottom")
   if (input$paulscore_relative) {
     dyOut <- dyAxis(dyOut, "y", axisLabelFormatter = "function(x) { return 
Math.round(100 * x, 3) + '%'; }", valueFormatter = "function(x) { return 
Math.round(100 * x, 3) + '%'; }")
   }
@@ -29,7 +29,7 @@
     polloi::make_dygraph(xlab = "Date", ylab = "PaulScore", title = "PaulScore 
for autocomplete searches, by day", use_si = FALSE, group = "paulscore_approx") 
%>%
     dyRangeSelector %>%
     dyLegend(labelsDiv = "paulscore_approx_legend", show = "always") %>%
-    dyEvent(as.Date("2017-04-19"), "A (rates)", labelLoc = "bottom")
+    dyEvent(as.Date("2017-04-25"), "S (rates)", labelLoc = "bottom")
   if (input$paulscore_relative) {
     dyOut <- dyAxis(dyOut, "y", axisLabelFormatter = "function(x) { return 
Math.round(100 * x, 3) + '%'; }", valueFormatter = "function(x) { return 
Math.round(100 * x, 3) + '%'; }")
   }
diff --git a/modules/page_visit_times.R b/modules/page_visit_times.R
index 4a51a78..115cbb4 100644
--- a/modules/page_visit_times.R
+++ b/modules/page_visit_times.R
@@ -6,5 +6,6 @@
            axisLabelWidth = 100, pixelsPerLabel = 80) %>%
     dyLegend(labelsDiv = "lethal_dose_plot_legend") %>%
     dyRangeSelector(fillColor = "", strokeColor = "") %>%
-    dyEvent(as.Date("2017-01-01"), "R (reportupdater)", labelLoc = "bottom")
+    dyEvent(as.Date("2017-01-01"), "R (reportupdater)", labelLoc = "bottom") 
%>%
+    dyEvent(as.Date("2017-04-25"), "S (rates)", labelLoc = "bottom")
 })
diff --git a/tab_documentation/desktop_events.md 
b/tab_documentation/desktop_events.md
index 94c5f95..be4d9d8 100644
--- a/tab_documentation/desktop_events.md
+++ b/tab_documentation/desktop_events.md
@@ -21,6 +21,7 @@
 * Data in late September/early October 2015 is unavailable due to another bug 
in EventLogging as a whole, which impacted data collection.
 * '__A__': we switched to using data from 
[Schema:TestSearchSatisfaction2](https://meta.wikimedia.org/wiki/Schema:TestSearchSatisfaction2)
 instead of [Schema:Search](https://meta.wikimedia.org/wiki/Schema:Search) for 
Desktop event counts and load times on 12 July 2016.
 * '__R__': on 2017-01-01 we started calculating all of Discovery's metrics 
using a new version of [our data retrieval and processing 
codebase](https://phabricator.wikimedia.org/diffusion/WDGO/) that we migrated 
to [Wikimedia Analytics](https://www.mediawiki.org/wiki/Analytics)' 
[Reportupdater 
infrastructure](https://wikitech.wikimedia.org/wiki/Analytics/Reportupdater). 
See [T150915](https://phabricator.wikimedia.org/T150915) for more details.
+* '__S__': on 2017-04-25 we changed the rates at which users are put into 
event logging (see [T163273](https://phabricator.wikimedia.org/T163273)). 
Specifically, we decreased the rate on English Wikipedia ("EnWiki") and 
increased it everywhere else.
 
 Questions, bug reports, and feature suggestions
 ------
diff --git a/tab_documentation/desktop_load.md 
b/tab_documentation/desktop_load.md
index dcd55c0..8220bca 100644
--- a/tab_documentation/desktop_load.md
+++ b/tab_documentation/desktop_load.md
@@ -19,6 +19,7 @@
 * Data in late September/early October 2015 is unavailable due to another bug 
in EventLogging as a whole, which impacted data collection.
 * '__A__': we switched to using data from 
[Schema:TestSearchSatisfaction2](https://meta.wikimedia.org/wiki/Schema:TestSearchSatisfaction2)
 instead of [Schema:Search](https://meta.wikimedia.org/wiki/Schema:Search) for 
Desktop event counts and load times on 12 July 2016.
 * '__R__': on 2017-01-01 we started calculating all of Discovery's metrics 
using a new version of [our data retrieval and processing 
codebase](https://phabricator.wikimedia.org/diffusion/WDGO/) that we migrated 
to [Wikimedia Analytics](https://www.mediawiki.org/wiki/Analytics)' 
[Reportupdater 
infrastructure](https://wikitech.wikimedia.org/wiki/Analytics/Reportupdater). 
See [T150915](https://phabricator.wikimedia.org/T150915) for more details.
+* '__S__': on 2017-04-25 we changed the rates at which users are put into 
event logging (see [T163273](https://phabricator.wikimedia.org/T163273)). 
Specifically, we decreased the rate on English Wikipedia ("EnWiki") and 
increased it everywhere else.
 * '__B__': [on 
2017-06-15](https://lists.wikimedia.org/pipermail/discovery/2017-June/001536.html)
 we deployed the sister search feature to all Wikipedia in all languages. This 
_technically_ has a slight impact on load time since we are performing 
additional searches, but we have not seen any noticeable or alarming increases 
since the feature's deployment.
 
 Questions, bug reports, and feature suggestions
diff --git a/tab_documentation/paulscore_approx.html 
b/tab_documentation/paulscore_approx.html
index b73d61b..71ebfbc 100644
--- a/tab_documentation/paulscore_approx.html
+++ b/tab_documentation/paulscore_approx.html
@@ -25,7 +25,7 @@
 
 <ul>
   <li>'<strong>R</strong>': on 2017-01-01 we started calculating all of 
Discovery's metrics using a new version of <a 
href="https://phabricator.wikimedia.org/diffusion/WDGO/";>our data retrieval and 
processing codebase</a> that we migrated to <a 
href="https://www.mediawiki.org/wiki/Analytics";>Wikimedia Analytics</a>' <a 
href="https://wikitech.wikimedia.org/wiki/Analytics/Reportupdater";>Reportupdater
 infrastructure</a>. See <a 
href="https://phabricator.wikimedia.org/T150915";>T150915</a> for more 
details.</li>
-  <li>'<strong>A</strong>': on 2017-04-19 we changed the rates at which users 
are put into event logging (see <a 
href="https://phabricator.wikimedia.org/T163273"; title="Phabricator ticket: 
Adjust search satisfaction sampling rate">T163273</a>. Specifically, we 
decreased the rate on English Wikipedia ("EnWiki") and increased it everywhere 
else, and since EnWiki generally has higher PaulScore than other projects, we 
effectively lowered the overall PaulScore by lessening EnWiki's contribution. 
See <a href="https://phabricator.wikimedia.org/T168466"; title="Phabricator 
ticket: Investigate PaulScores for late April and May for full-text 
searches">T168466</a> for more details.</li>
+  <li>'<strong>S</strong>': on 2017-04-25 we changed the rates at which users 
are put into event logging (see <a 
href="https://phabricator.wikimedia.org/T163273"; title="Phabricator ticket: 
Adjust search satisfaction sampling rate">T163273</a>). Specifically, we 
decreased the rate on English Wikipedia ("EnWiki") and increased it everywhere 
else, and since EnWiki generally has higher PaulScore than other projects, we 
effectively lowered the overall PaulScore by lessening EnWiki's contribution. 
See <a href="https://phabricator.wikimedia.org/T168466"; title="Phabricator 
ticket: Investigate PaulScores for late April and May for full-text 
searches">T168466</a> for more details.</li>
 </ul>
 
 <h2>Questions, bug reports, and feature suggestions</h2>
diff --git a/tab_documentation/survival.md b/tab_documentation/survival.md
index e40f648..711fffa 100644
--- a/tab_documentation/survival.md
+++ b/tab_documentation/survival.md
@@ -10,6 +10,7 @@
 Outages and inaccuracies
 ------
 * '__R__': on 2017-01-01 we started calculating all of Discovery's metrics 
using a new version of [our data retrieval and processing 
codebase](https://phabricator.wikimedia.org/diffusion/WDGO/) that we migrated 
to [Wikimedia Analytics](https://www.mediawiki.org/wiki/Analytics)' 
[Reportupdater 
infrastructure](https://wikitech.wikimedia.org/wiki/Analytics/Reportupdater). 
See [T150915](https://phabricator.wikimedia.org/T150915) for more details.
+* '__S__': on 2017-04-25 we changed the rates at which users are put into 
event logging (see [T163273](https://phabricator.wikimedia.org/T163273)). 
Specifically, we decreased the rate on English Wikipedia ("EnWiki") and 
increased it everywhere else.
 
 Questions, bug reports, and feature suggestions
 ------

-- 
To view, visit https://gerrit.wikimedia.org/r/370857
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I709222fa4fad807762c23858e6c00c43d0747d9a
Gerrit-PatchSet: 1
Gerrit-Project: wikimedia/discovery/rainbow
Gerrit-Branch: develop
Gerrit-Owner: Chelsyx <c...@wikimedia.org>
Gerrit-Reviewer: Bearloga <mpo...@wikimedia.org>
Gerrit-Reviewer: Chelsyx <c...@wikimedia.org>

_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

Reply via email to