Phedenskog has uploaded a new change for review. https://gerrit.wikimedia.org/r/250679
Change subject: Removed tcpdump and devtools ...................................................................... Removed tcpdump and devtools When we got this running on Jenkins the SpeedIndex and Start Render increased for all URL:s testing using Chrome. It's a really small chance that it is an regression, everything points to that it is the collection of extra data that makes this happen so remove it. Later on we could try out WPT on a larger Amazon instance. Bug: T116981 Change-Id: Idf023783854444021c03ed1eedd18a0a64feda70 --- M lib/util.js M scripts/batch/desktop-wpt-org.txt M scripts/batch/desktop.txt M scripts/batch/mobile.txt M scripts/batch/second-view-desktop.txt M scripts/batch/second-view-mobile.txt 6 files changed, 18 insertions(+), 19 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/performance/WebPageTest refs/changes/79/250679/1 diff --git a/lib/util.js b/lib/util.js index fd09940..6101d2b 100644 --- a/lib/util.js +++ b/lib/util.js @@ -24,8 +24,7 @@ timeout: 1200, video: 'true', label: argv.label ? this.getTodaysDate() + '-' + argv.label : this.getTodaysDate(), - runs: 11, - tcpDump: true + runs: 11 }; Object.keys(argv).forEach(function(param) { diff --git a/scripts/batch/desktop-wpt-org.txt b/scripts/batch/desktop-wpt-org.txt index 0ce2578..bbc1c3d 100644 --- a/scripts/batch/desktop-wpt-org.txt +++ b/scripts/batch/desktop-wpt-org.txt @@ -11,4 +11,4 @@ # nodejs installed), just make sure to change the value of the WebPageTest key: # $ WPT_ORG_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_ORG_RUNS=1 bin/index.js --batch ./scripts/batch/desktop-wpt-org.txt ---webPageTestKey <%WPT_ORG_WPT_KEY> --webPageTestHost www.webpagetest.org --median SpeedIndex --location Dulles:Chrome --label chrome-dulles --runs <%WPT_ORG_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --timeout 2400 --reporter statsv --timeline true --chromeTrace true --netLog true https://en.wikipedia.org/wiki/Special:BlankPage +--webPageTestKey <%WPT_ORG_WPT_KEY> --webPageTestHost www.webpagetest.org --median SpeedIndex --location Dulles:Chrome --label chrome-dulles --runs <%WPT_ORG_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --timeout 2400 --reporter statsv https://en.wikipedia.org/wiki/Special:BlankPage diff --git a/scripts/batch/desktop.txt b/scripts/batch/desktop.txt index b33a5ca..ca70d43 100644 --- a/scripts/batch/desktop.txt +++ b/scripts/batch/desktop.txt @@ -10,21 +10,21 @@ # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch scripts/batch/desktop.txt # Collect metrics using Chrome ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Main_Page --reporter statsv --timeline true --chromeTrace true --netLog true https://en.wikipedia.org/wiki/Main_Page +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Main_Page --reporter statsv https://en.wikipedia.org/wiki/Main_Page ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv --timeline true --chromeTrace true --netLog true https://en.wikipedia.org/wiki/Facebook +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook --reporter statsv https://en.wikipedia.org/wiki/Facebook ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.anonymous.signup --reporter statsv --timeline true --chromeTrace true --netLog true https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki.anonymous.signup --reporter statsv https://test2.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-base --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --reporter statsv --timeline true --chromeTrace true --netLog true https://en.wikipedia.org/wiki/Special:BlankPage +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-base --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.BlankPage --reporter statsv https://en.wikipedia.org/wiki/Special:BlankPage ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv --timeline true --chromeTrace true --netLog true https://www.wikipedia.org/ +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-portals --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals.anonymous.wikipedia_org --reporter statsv https://www.wikipedia.org/ ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --timeline true --chromeTrace true --netLog true http://www.wikipedia.beta.wmflabs.org/ +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-portals-beta --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv http://www.wikipedia.beta.wmflabs.org/ ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.enwiki-beta.anonymous.Chamber_music --timeline true --chromeTrace true --netLog true http://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.enwiki-beta.anonymous.Chamber_music http://en.wikipedia.beta.wmflabs.org/wiki/Chamber_music ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --timeline true --chromeTrace true --netLog true --namespace webpagetest.test2wiki.anonymous.Washington_DC https://test2.wikipedia.org/wiki/Washington,_D.C. +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace webpagetest.test2wiki.anonymous.Washington_DC https://test2.wikipedia.org/wiki/Washington,_D.C. # Collect metrics using Firefox --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Firefox --label ff --runs <%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Main_Page --reporter statsv https://en.wikipedia.org/wiki/Main_Page diff --git a/scripts/batch/mobile.txt b/scripts/batch/mobile.txt index 9c97f57..9aa7f6a 100644 --- a/scripts/batch/mobile.txt +++ b/scripts/batch/mobile.txt @@ -11,14 +11,14 @@ # Example (make sure to change WMF_WPT_KEY) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_MOBILE_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/batch/mobile.txt ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.San_Francisco --emulateMobile true --connectivity 3GFast --reporter statsv --timeline true --chromeTrace true --netLog true https://en.m.wikipedia.org/wiki/San_Francisco +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.San_Francisco --emulateMobile true --connectivity 3GFast --reporter statsv https://en.m.wikipedia.org/wiki/San_Francisco ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.Facebook --emulateMobile true --connectivity 3GFast --reporter statsv --timeline true --chromeTrace true --netLog true https://en.m.wikipedia.org/wiki/Facebook +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.Facebook --emulateMobile true --connectivity 3GFast --reporter statsv https://en.m.wikipedia.org/wiki/Facebook ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki-mobile.anonymous.signup --emulateMobile true --connectivity 3GFast --reporter statsv --timeline true --chromeTrace true --netLog true https://test2.m.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki-mobile.anonymous.signup --emulateMobile true --connectivity 3GFast --reporter statsv https://test2.m.wikipedia.org/w/index.php?title=Special:UserLogin&type=signup ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.BlankPage --emulateMobile true --connectivity 3GFast --reporter statsv --timeline true --chromeTrace true --netLog true https://en.m.wikipedia.org/wiki/Special:BlankPage +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-mobile.anonymous.BlankPage --emulateMobile true --connectivity 3GFast --reporter statsv https://en.m.wikipedia.org/wiki/Special:BlankPage ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-beta-mobile.anonymous.Chamber_music --reporter statsv --emulateMobile true --connectivity 3GFast --timeline true --chromeTrace true --netLog true http://en.m.wikipedia.beta.wmflabs.org/wiki/Chamber_music +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki-beta-mobile.anonymous.Chamber_music --reporter statsv --emulateMobile true --connectivity 3GFast http://en.m.wikipedia.beta.wmflabs.org/wiki/Chamber_music ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --reporter statsv --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki-mobile.anonymous.Washington_DC --emulateMobile true --connectivity 3GFast --timeline true --chromeTrace true --netLog true https://test2.wikipedia.org/wiki/Washington,_D.C. +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-emulated-m --runs <%WPT_MOBILE_RUNS> --reporter statsv --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.test2wiki-mobile.anonymous.Washington_DC --emulateMobile true --connectivity 3GFast https://test2.wikipedia.org/wiki/Washington,_D.C. diff --git a/scripts/batch/second-view-desktop.txt b/scripts/batch/second-view-desktop.txt index 0b30983..10ece4f 100644 --- a/scripts/batch/second-view-desktop.txt +++ b/scripts/batch/second-view-desktop.txt @@ -11,4 +11,4 @@ # Example (make sure to change WMF_WPT_KEY) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/scripts/second-view-desktop.txt ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-second --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook-second --reporter statsv --timeline true --chromeTrace true --netLog true ./scripts/wptscripts/second-view-desktop-enwiki-facebook.txt +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-second --runs <%WPT_RUNS> --first true --endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook-second --reporter statsv ./scripts/wptscripts/second-view-desktop-enwiki-facebook.txt diff --git a/scripts/batch/second-view-mobile.txt b/scripts/batch/second-view-mobile.txt index 9833e44..db487a9 100644 --- a/scripts/batch/second-view-mobile.txt +++ b/scripts/batch/second-view-mobile.txt @@ -9,4 +9,4 @@ # Example (make sure to change WMF_WPT_KEY) # $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_MOBILE_RUNS=1 WMF_WPT_LOCATION=us-west-1 bin/index.js --batch ./scripts/batch/second-view-mobile.txt ---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-second --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --connectivity 3GFast --namespace webpagetest.enwiki-mobile.anonymous.Facebook-second --reporter statsv --timeline true --chromeTrace true --netLog true ./scripts/wptscripts/second-view-mobile-enwiki-facebook.txt +--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome-mobile-second --runs <%WPT_MOBILE_RUNS> --first true --emulateMobile true --endpoint <%STATSV_ENDPOINT> --connectivity 3GFast --namespace webpagetest.enwiki-mobile.anonymous.Facebook-second --reporter statsv ./scripts/wptscripts/second-view-mobile-enwiki-facebook.txt -- To view, visit https://gerrit.wikimedia.org/r/250679 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Idf023783854444021c03ed1eedd18a0a64feda70 Gerrit-PatchSet: 1 Gerrit-Project: performance/WebPageTest Gerrit-Branch: master Gerrit-Owner: Phedenskog <phedens...@wikimedia.org> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits