jenkins-bot has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/325779 )
Change subject: Remove and cleanup URLs to make it easy to run tests every hour ...................................................................... Remove and cleanup URLs to make it easy to run tests every hour Removing and cleaning URLs to make it easy to run more often and then in the next step add alerts in Grafana to make it easier for us to spot regressions in SpeedIndex and firstVisualChange. With the changes we will run 30 URLs. We also use the same connectivity time for all mobile pages (3GFast) and remove the connectivity from the metrics key. We also change the Barack Obama page to Trump to make sure we test a page that is changed often and get a lot of traffic and focus on three articles per browser (two large and one small). We remove a whole list of URLs/tests: DESKTOP chrome * https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup * https://en.wikipedia.org/wiki/Special:BlankPage * https://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music * https://test2.wikipedia.org/wiki/Washington,_D.C. * /scripts/wptscripts/login-desktop-test2wiki-washington.txt Firefox * https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup * https://en.wikipedia.org/wiki/Special:BlankPage * https://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music * https://test2.wikipedia.org/wiki/Washington,_D.C. IE 11 * https://en.wikipedia.org/wiki/Special:BlankPage * https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup * https://en.wikipedia.org/wiki/Special:BlankPage * https://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music * https://test2.wikipedia.org/wiki/Washington,_D.C. MOBILE 2gslow * http://en.m.wikipedia.beta.wmflabs.org/wiki/Barack_Obama * http://en.m.wikipedia.beta.wmflabs.org/wiki/Barack_Obama?mobileaction=beta * https://ja.m.wikipedia.org/wiki/%E6%97%A5%E6%9C%AC * https://ja.m.wikipedia.org/wiki/%E6%97%A5%E6%9C%AC?mobileaction=beta * https://ja.m.wikipedia.org/wiki/%E3%83%90%E3%83%A9%E3%82%AF%E3%83%BB%E3%82%AA%E3%83%90%E3%83%9E * https://ja.m.wikipedia.org/wiki/%E3%83%90%E3%83%A9%E3%82%AF%E3%83%BB%E3%82%AA%E3%83%90%E3%83%9E?mobileaction=beta * https://pt.m.wikipedia.org/wiki/Brasil * https://pt.m.wikipedia.org/wiki/Brasil?mobileaction=beta * scripts/wptscripts/beta-mobile-obama.txt 3GFast * https://test2.m.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup * https://en.m.wikipedia.org/wiki/Special:BlankPage * http://en.m.wikipedia.beta.wmflabs.org/wiki/Chamber_music * https://test2.m.wikipedia.org/wiki/Washington,_D.C. * ./scripts/wptscripts/login-mobile-test2wiki-washington.txt 2gslowest * https://en.m.wikipedia.org/wiki/Barack_Obama?mobileaction=beta * https://en.m.wikipedia.org/wiki/Barack_Obama?mobileaction=beta * https://en.m.wikipedia.org/wiki/Barack_Obama Bug: T151197 Change-Id: I5f3cc2ad30d855f742ed86760c19718e987190a7 --- M scripts/batch/desktop.txt M scripts/batch/login-desktop.txt M scripts/batch/login-mobile.txt M scripts/batch/mobile.txt M scripts/batch/second-view-desktop.txt M scripts/batch/second-view-mobile.txt D scripts/wptscripts/beta-mobile-obama.txt D scripts/wptscripts/login-desktop-test2wiki-washington.txt D scripts/wptscripts/login-mobile-test2wiki-washington.txt 9 files changed, 32 insertions(+), 113 deletions(-) Approvals: Krinkle: Looks good to me, approved jenkins-bot: Verified diff --git a/scripts/batch/desktop.txt b/scripts/batch/desktop.txt index 79fbd47..8565219 100644 --- a/scripts/batch/desktop.txt +++ b/scripts/batch/desktop.txt @@ -9,20 +9,41 @@ # Example (make sure to change WMF_WPT_KEY) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch scripts/batch/desktop.txt -# Collect metrics using Chrome +# Test Facebook page --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv --timeline true --bodies true https://en.wikipedia.org/wiki/Facebook ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.anonymous.signup --reporter statsv --first true https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv --first true https://en.wikipedia.org/wiki/Facebook ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-base --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --reporter statsv --first true https://en.wikipedia.org/wiki/Special:BlankPage +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv --first true https://en.wikipedia.org/wiki/Facebook +# Test Donald Trump +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Donald_Trump --reporter statsv --timeline true --bodies true https://en.wikipedia.org/wiki/Donald_Trump + +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Donald_Trump --reporter statsv --first true https://en.wikipedia.org/wiki/Donald_Trump + +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Donald_Trump --reporter statsv --first true https://en.wikipedia.org/wiki/Donald_Trump + +# Test Ingrid Vang Nyman aka short article +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Ingrid_Vang_Nyman --reporter statsv --timeline true --bodies true https://en.wikipedia.org/wiki/Ingrid_Vang_Nyman + +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Ingrid_Vang_Nyman --reporter statsv --first true https://en.wikipedia.org/wiki/Ingrid_Vang_Nyman + +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Ingrid_Vang_Nyman --reporter statsv --first true https://en.wikipedia.org/wiki/Ingrid_Vang_Nyman + +# Test the portal page --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.org/ + +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.org/ + +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.org/ --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.beta.wmflabs.org/ ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.enwiki-beta.anonymous.Chamber_music --first true https://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.beta.wmflabs.org/ ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.test2wiki.anonymous.Washington_DC --first true https://test2.wikipedia.org/wiki/Washington,_D.C. +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.beta.wmflabs.org/ + +####### WIKIDATA --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.wikidatawiki.anonymous.Main_Page --reporter statsv --first true https://www.wikidata.org/wiki/Wikidata:Main_Page @@ -30,44 +51,11 @@ --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.wikidatawiki-beta.anonymous.Italy --first true https://wikidata.beta.wmflabs.org/wiki/Q15905 -# Collect metrics using Firefox ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv --first true https://en.wikipedia.org/wiki/Facebook - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.anonymous.signup --reporter statsv --first true https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-base --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --reporter statsv --first true https://en.wikipedia.org/wiki/Special:BlankPage - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.org/ - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.beta.wmflabs.org/ - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.enwiki-beta.anonymous.Chamber_music --first true https://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --reporter statsv --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.anonymous.Washington_DC --first true https://test2.wikipedia.org/wiki/Washington,_D.C. - --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.wikidatawiki.anonymous.Main_Page --reporter statsv --first true https://www.wikidata.org/wiki/Wikidata:Main_Page --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --reporter statsv --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.wikidatawiki.anonymous.Berlin --first true https://www.wikidata.org/wiki/Q64 --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff-beta --reporter statsv --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.wikidatawiki-beta.anonymous.Italy --first true https://wikidata.beta.wmflabs.org/wiki/Q15905 - -# Collect metrics using IE 11 (running windows 7 = no SPDY) - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-base --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --reporter statsv --first true https://en.wikipedia.org/wiki/Special:BlankPage - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv --first true https://en.wikipedia.org/wiki/Facebook - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.anonymous.signup --reporter statsv --first true https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-base --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --reporter statsv --first true https://en.wikipedia.org/wiki/Special:BlankPage - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.org/ - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true https://www.wikipedia.beta.wmflabs.org/ - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.enwiki-beta.anonymous.Chamber_music --first true https://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.test2wiki.anonymous.Washington_DC --first true https://test2.wikipedia.org/wiki/Washington,_D.C. --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.wikidatawiki.anonymous.Main_Page --reporter statsv --first true https://www.wikidata.org/wiki/Wikidata:Main_Page diff --git a/scripts/batch/login-desktop.txt b/scripts/batch/login-desktop.txt index 17f5d95..a401b06 100644 --- a/scripts/batch/login-desktop.txt +++ b/scripts/batch/login-desktop.txt @@ -13,6 +13,4 @@ # Example (make sure to change WMF_WPT_KEY, and WPT_USER_PASSWORD) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 WPT_USER=wptuser WPT_USER_PASSWORD=SECRET_PASSWORD WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/batch/login-desktop.txt ---webPageTestKey <%WMF_WPT_KEY> --median SpeedIndex --webPageTestHost wpt.wmftest.org --location <%WMF_WPT_LOCATION>:Chrome --label chrome-authenticated --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.authenticated.Facebook --reporter statsv ./scripts/wptscripts/login-desktop-enwiki-facebook.txt - ---webPageTestKey <%WMF_WPT_KEY> --median SpeedIndex --webPageTestHost wpt.wmftest.org --location <%WMF_WPT_LOCATION>:Chrome --label chrome-authenticated --reporter statsv --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.authenticated.Washington_DC ./scripts/wptscripts/login-desktop-test2wiki-washington.txt +--webPageTestKey <%WMF_WPT_KEY> --median SpeedIndex --webPageTestHost wpt.wmftest.org --location <%WMF_WPT_LOCATION>:Chrome --label chrome-authenticated --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.authenticated.Facebook --timeline true --bodies true --reporter statsv ./scripts/wptscripts/login-desktop-enwiki-facebook.txt diff --git a/scripts/batch/login-mobile.txt b/scripts/batch/login-mobile.txt index 8fee212..e86f8d0 100644 --- a/scripts/batch/login-mobile.txt +++ b/scripts/batch/login-mobile.txt @@ -13,6 +13,4 @@ # Example (make sure to change WMF_WPT_KEY, and WPT_USER_PASSWORD) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 WPT_USER=wptuser WPT_USER_PASSWORD=SECRET_PASSWORD WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/batch/login-mobile.txt ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-authenticated --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --connectivity 3GFast --namespace webpagetest.enwiki-mobile.authenticated.Facebook --reporter statsv ./scripts/wptscripts/login-mobile-enwiki-facebook.txt - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-authenticated --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --reporter statsv --connectivity 3GFast --namespace webpagetest.test2wiki-mobile.authenticated.Washington_DC ./scripts/wptscripts/login-mobile-test2wiki-washington.txt +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-authenticated --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --namespace webpagetest.enwiki-mobile.authenticated.Facebook --reporter statsv --timeline true --bodies true ./scripts/wptscripts/login-mobile-enwiki-facebook.txt diff --git a/scripts/batch/mobile.txt b/scripts/batch/mobile.txt index 7d88ceb..27ffe05 100644 --- a/scripts/batch/mobile.txt +++ b/scripts/batch/mobile.txt @@ -13,37 +13,6 @@ --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.Facebook --emulateMobile true --connectivity 3GFast --reporter statsv --timeline true --bodies true https://en.m.wikipedia.org/wiki/Facebook ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-2gslow.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true https://en.m.wikipedia.org/wiki/Barack_Obama +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.Donald_Trump --emulateMobile true --connectivity 3GFast --reporter statsv --first true --timeline true --bodies true https://en.m.wikipedia.org/wiki/Donald_Trump ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label beta-chrome-emulated-m-2g- --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-bc-mobile-2gslow.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true http://en.m.wikipedia.beta.wmflabs.org/wiki/Barack_Obama - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-2gslowest.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 28000 --bandwidthUp 25600 --latency 1300 --connectivity custom --reporter statsv --first true https://en.m.wikipedia.org/wiki/Barack_Obama - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label beta-chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-bc-mobile-beta-2gslow.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true http://en.m.wikipedia.beta.wmflabs.org/wiki/Barack_Obama?mobileaction=beta - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-beta-2gslow.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true https://en.m.wikipedia.org/wiki/Barack_Obama?mobileaction=beta - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label beta-chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-beta-cookie-2gslow.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true ./scripts/wptscripts/beta-mobile-obama.txt - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-beta-2gslowest.anonymous.Barack_Obama --emulateMobile true --bandwidthDown 28000 --bandwidthUp 25600 --latency 1300 --connectivity custom --reporter statsv --first true https://en.m.wikipedia.org/wiki/Barack_Obama?mobileaction=beta - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-2gslow.anonymous.ja-Japan --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true https://ja.m.wikipedia.org/wiki/%E6%97%A5%E6%9C%AC - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-beta-2gslow.anonymous.ja-Japan --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true https://ja.m.wikipedia.org/wiki/%E6%97%A5%E6%9C%AC?mobileaction=beta - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-2gslow.anonymous.ja-BarackObama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true https://ja.m.wikipedia.org/wiki/%E3%83%90%E3%83%A9%E3%82%AF%E3%83%BB%E3%82%AA%E3%83%90%E3%83%9E - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-beta-2gslow.anonymous.ja-BarackObama --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv --first true https://ja.m.wikipedia.org/wiki/%E3%83%90%E3%83%A9%E3%82%AF%E3%83%BB%E3%82%AA%E3%83%90%E3%83%9E?mobileaction=beta - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki-mobile.anonymous.signup --emulateMobile true --connectivity 3GFast --first true --reporter statsv https://test2.m.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.BlankPage --emulateMobile true --connectivity 3GFast --reporter statsv --first true https://en.m.wikipedia.org/wiki/Special:BlankPage - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-beta-mobile.anonymous.Chamber_music --reporter statsv --emulateMobile true --connectivity 3GFast --first true http://en.m.wikipedia.beta.wmflabs.org/wiki/Chamber_music - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --reporter statsv --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki-mobile.anonymous.Washington_DC --emulateMobile true --connectivity 3GFast --first true https://test2.m.wikipedia.org/wiki/Washington,_D.C. - ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-2gslow.anonymous.pt-Brasil --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv https://pt.m.wikipedia.org/wiki/Brasil - -# We test this on WebPageTest.org because on our own instance, the test runs fine but the JSON is always empty ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m-2g --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile-beta-2gslow.anonymous.pt-Brasil --emulateMobile true --bandwidthDown 35000 --bandwidthUp 32000 --latency 1300 --connectivity custom --reporter statsv https://pt.m.wikipedia.org/wiki/Brasil?mobileaction=beta +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.Ingrid_Vang_Nyman --emulateMobile true --connectivity 3GFast --reporter statsv --first true --timeline true --bodies true https://en.m.wikipedia.org/wiki/Ingrid_Vang_Nyman diff --git a/scripts/batch/second-view-desktop.txt b/scripts/batch/second-view-desktop.txt index 014b4a7..aca8743 100644 --- a/scripts/batch/second-view-desktop.txt +++ b/scripts/batch/second-view-desktop.txt @@ -11,7 +11,7 @@ # Example (make sure to change WMF_WPT_KEY) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/scripts/second-view-desktop.txt ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-second --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook-second --reporter statsv ./scripts/wptscripts/second-view-desktop-enwiki-facebook.txt +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-second --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook-second --timeline true --bodies true--reporter statsv ./scripts/wptscripts/second-view-desktop-enwiki-facebook.txt --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label firefox-second --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook-second --reporter statsv ./scripts/wptscripts/second-view-desktop-enwiki-facebook.txt diff --git a/scripts/batch/second-view-mobile.txt b/scripts/batch/second-view-mobile.txt index db487a9..85ee6d0 100644 --- a/scripts/batch/second-view-mobile.txt +++ b/scripts/batch/second-view-mobile.txt @@ -9,4 +9,4 @@ # Example (make sure to change WMF_WPT_KEY) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_MOBILE_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/batch/second-view-mobile.txt ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-second --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --connectivity 3GFast --namespace webpagetest.enwiki-mobile.anonymous.Facebook-second --reporter statsv ./scripts/wptscripts/second-view-mobile-enwiki-facebook.txt +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-second --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --connectivity 3GFast --timeline true --bodies true --namespace webpagetest.enwiki-mobile.anonymous.Facebook-second --reporter statsv ./scripts/wptscripts/second-view-mobile-enwiki-facebook.txt diff --git a/scripts/wptscripts/beta-mobile-obama.txt b/scripts/wptscripts/beta-mobile-obama.txt deleted file mode 100644 index 3a2520f..0000000 --- a/scripts/wptscripts/beta-mobile-obama.txt +++ /dev/null @@ -1,2 +0,0 @@ -setCookie https://en.m.wikipedia.org/ optin=beta -navigate https://en.m.wikipedia.org/wiki/Barack_Obama diff --git a/scripts/wptscripts/login-desktop-test2wiki-washington.txt b/scripts/wptscripts/login-desktop-test2wiki-washington.txt deleted file mode 100644 index 82c8b45..0000000 --- a/scripts/wptscripts/login-desktop-test2wiki-washington.txt +++ /dev/null @@ -1,16 +0,0 @@ -// The login page -logData 0 -navigate https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&returnto=Main+Page - -// Log in the user -setValue name=wpName <%WPT_USER> -setValue name=wpPassword <%WPT_USER_PASSWORD> -submitForm name=userlogin - -// Erase the current HTML to make the video easier to understand -exec document.body.innerHTML = ""; -sleep 2 - -// This is the URL that we want to measure as a logged in user -logData 1 -navigate https://test2.wikipedia.org/wiki/Washington,_D.C. diff --git a/scripts/wptscripts/login-mobile-test2wiki-washington.txt b/scripts/wptscripts/login-mobile-test2wiki-washington.txt deleted file mode 100644 index 68233f4..0000000 --- a/scripts/wptscripts/login-mobile-test2wiki-washington.txt +++ /dev/null @@ -1,16 +0,0 @@ -// The login page -logData 0 -navigate https://test2.m.wikipedia.org/w/index.php?title=Special:UserLogin&returnto=Main+Page - -// Log in the user -setValue name=wpName <%WPT_USER> -setValue name=wpPassword <%WPT_USER_PASSWORD> -submitForm name=userlogin - -// Erase the current HTML to make the video easier to understand -exec document.body.innerHTML = ""; -sleep 2 - -// This is the URL that we want to measure as a logged in user -logData 1 -navigate https://test2.wikipedia.org/wiki/Washington,_D.C. -- To view, visit https://gerrit.wikimedia.org/r/325779 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I5f3cc2ad30d855f742ed86760c19718e987190a7 Gerrit-PatchSet: 4 Gerrit-Project: performance/WebPageTest Gerrit-Branch: master Gerrit-Owner: Phedenskog <[email protected]> Gerrit-Reviewer: Krinkle <[email protected]> Gerrit-Reviewer: Phedenskog <[email protected]> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
