[MediaWiki-commits] [Gerrit] performance/WebPageTest[master]: Move Internet Explorer tests to own test files.

2018-01-24 Thread jenkins-bot (Code Review)
jenkins-bot has submitted this change and it was merged. ( 
https://gerrit.wikimedia.org/r/404918 )

Change subject: Move Internet Explorer tests to own test files.
..


Move Internet Explorer tests to own test files.

By moving all IE tests to separate files, we can setup
the new runs by only adding a extra job in Jenkins for
the Linux agent.

Bug: T175240
Change-Id: I786ea6153a26364c9880b314826695094a022d71
---
A scripts/batch/desktop-ie.txt
M scripts/batch/desktop.txt
A scripts/batch/second-view-desktop-ie.txt
M scripts/batch/second-view-desktop.txt
M test/rulethemall.sh
5 files changed, 46 insertions(+), 13 deletions(-)

Approvals:
  Krinkle: Looks good to me, approved
  jenkins-bot: Verified



diff --git a/scripts/batch/desktop-ie.txt b/scripts/batch/desktop-ie.txt
new file mode 100644
index 000..2449fed
--- /dev/null
+++ b/scripts/batch/desktop-ie.txt
@@ -0,0 +1,29 @@
+## This batch file contains runs testing Wikipedia desktop using WebPageTest
+## for Internet Explorer 11. The IE tests is in it own file to make it
+## easy to move to Linux test agents.
+
+# To run this you need to set the following environment variables:
+# WMF_WPT_KEY - The secret API key for our WebPageTest instance
+# STATSV_ENDPOINT - The endpoint of where we send the statsv data
+# WPT_RUNS - The number of runs per test
+# WMF_WPT_LOCATION - The AWS location to run the test example: us-west-1
+
+# Example (make sure to change WMF_WPT_KEY)
+# $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 
WMF_WPT_LOCATION=us-west-1 bin/index.js --batch scripts/batch/desktop.txt
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook 
--reporter statsv --first true https://en.wikipedia.org/wiki/Facebook
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.enwiki.anonymous.Barack_Obama --reporter statsv --first true 
https://en.wikipedia.org/wiki/Barack_Obama
+
+# Test the portal page
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true 
https://www.wikipedia.org/
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals-beta --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true 
https://www.wikipedia.beta.wmflabs.org/
+
+### WIKIDATA
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.wikidatawiki.anonymous.Main_Page --reporter statsv --first true 
https://www.wikidata.org/wiki/Wikidata:Main_Page
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace 
webpagetest.wikidatawiki.anonymous.Berlin --first true 
https://www.wikidata.org/wiki/Q64
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-beta --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace 
webpagetest.wikidatawiki-beta.anonymous.Italy --first true 
https://wikidata.beta.wmflabs.org/wiki/Q15905
diff --git a/scripts/batch/desktop.txt b/scripts/batch/desktop.txt
index 51fa048..2151e69 100644
--- a/scripts/batch/desktop.txt
+++ b/scripts/batch/desktop.txt
@@ -1,4 +1,5 @@
 ## This batch file contains runs testing Wikipedia desktop using WebPageTest
+## for Chrome and Firefox.
 
 # To run this you need to set the following environment variables:
 # WMF_WPT_KEY - The secret API key for our WebPageTest instance
@@ -12,14 +13,10 @@
 # Test Facebook page
 --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.enwiki.anonymous.Facebook --reporter statsv --timeline true 
--bodies true https://en.wikipedia.org/wiki/Facebook
 
---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook 
--reporter 

[MediaWiki-commits] [Gerrit] performance/WebPageTest[master]: Move Internet Explorer tests to own test files.

2018-01-17 Thread Phedenskog (Code Review)
Phedenskog has uploaded a new change for review. ( 
https://gerrit.wikimedia.org/r/404918 )

Change subject: Move Internet Explorer tests to own test files.
..

Move Internet Explorer tests to own test files.

By moving all IE tests to separate files, we can setup
the new runs by only adding a extra job in Jenkins for
the Linux agent.

Bug: T175240
Change-Id: I786ea6153a26364c9880b314826695094a022d71
---
A scripts/batch/desktop-ie.txt
M scripts/batch/desktop.txt
A scripts/batch/second-view-desktop-ie.txt
M scripts/batch/second-view-desktop.txt
M test/rulethemall.sh
5 files changed, 47 insertions(+), 13 deletions(-)


  git pull ssh://gerrit.wikimedia.org:29418/performance/WebPageTest 
refs/changes/18/404918/1

diff --git a/scripts/batch/desktop-ie.txt b/scripts/batch/desktop-ie.txt
new file mode 100644
index 000..71ee925
--- /dev/null
+++ b/scripts/batch/desktop-ie.txt
@@ -0,0 +1,29 @@
+## This batch file contains runs testing Wikipedia desktop using WebPageTest
+## for Internet Explorer 11. The IE tests is in it own file to make it 
+## easy to move to Linux test agents.
+
+# To run this you need to set the following environment variables:
+# WMF_WPT_KEY - The secret API key for our WebPageTest instance
+# STATSV_ENDPOINT - The endpoint of where we send the statsv data
+# WPT_RUNS - The number of runs per test
+# WMF_WPT_LOCATION - The AWS location to run the test example: us-west-1
+
+# Example (make sure to change WMF_WPT_KEY)
+# $ WMF_WPT_KEY=SECRET_KEY STATSV_ENDPOINT=http://localhost WPT_RUNS=1 
WMF_WPT_LOCATION=us-west-1 bin/index.js --batch scripts/batch/desktop.txt
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook 
--reporter statsv --first true https://en.wikipedia.org/wiki/Facebook
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.enwiki.anonymous.Barack_Obama --reporter statsv --first true 
https://en.wikipedia.org/wiki/Barack_Obama
+
+# Test the portal page
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.portals.anonymous.wikipedia_org --reporter statsv --first true 
https://www.wikipedia.org/
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-portals-beta --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.portals-beta.anonymous.wikipedia_org --reporter statsv --first true 
https://www.wikipedia.beta.wmflabs.org/
+
+### WIKIDATA
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.wikidatawiki.anonymous.Main_Page --reporter statsv --first true 
https://www.wikidata.org/wiki/Wikidata:Main_Page
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace 
webpagetest.wikidatawiki.anonymous.Berlin --first true 
https://www.wikidata.org/wiki/Q64
+
+--webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11-beta --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --reporter statsv --namespace 
webpagetest.wikidatawiki-beta.anonymous.Italy --first true 
https://wikidata.beta.wmflabs.org/wiki/Q15905
diff --git a/scripts/batch/desktop.txt b/scripts/batch/desktop.txt
index 51fa048..2151e69 100644
--- a/scripts/batch/desktop.txt
+++ b/scripts/batch/desktop.txt
@@ -1,4 +1,5 @@
 ## This batch file contains runs testing Wikipedia desktop using WebPageTest
+## for Chrome and Firefox.
 
 # To run this you need to set the following environment variables:
 # WMF_WPT_KEY - The secret API key for our WebPageTest instance
@@ -12,14 +13,10 @@
 # Test Facebook page
 --webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>:Chrome --label chrome --runs 
<%WPT_RUNS> --endpoint <%STATSV_ENDPOINT> --namespace 
webpagetest.enwiki.anonymous.Facebook --reporter statsv --timeline true 
--bodies true https://en.wikipedia.org/wiki/Facebook
 
---webPageTestKey <%WMF_WPT_KEY> --webPageTestHost wpt.wmftest.org --median 
SpeedIndex --location <%WMF_WPT_LOCATION>_IE11 --label ie11 --runs <%WPT_RUNS> 
--endpoint <%STATSV_ENDPOINT> --namespace webpagetest.enwiki.anonymous.Facebook