Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+---

Comment (by boklm):

 Replying to [comment:11 boklm]:
 > The slider_settings and dom-objects-enumeration are now converted to
 marionette.


 After converting the dom-objects-enumeration test to marionette, we see a
 `DOMConstructor` object that we didn't see when using mozmill. I have
 added it to the list of expected objects to avoid an error.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+---

Comment (by boklm):

 The slider_settings and dom-objects-enumeration are now converted to
 marionette.

 The following tests still need to be converted:
 * noscript (almost done)
 * screenshot
 * svg-disable
 * svg-enable

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+---

Comment (by boklm):

 The acid3 and searchengines tests are now converted to marionette.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+---

Comment (by boklm):

 I rebased the marionette_tests-v3 branch and merged it to master. The
 navigation-timing and resource-timing tests have also been converted to
 marionette.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+---

Comment (by boklm):

 Replying to [comment:5 boklm]:
 > - converting all our mozmill tests

 https-everywhere and play_videos tests have been converted to marionette.

 > - making it work on OSX

 Support for OSX has been added to the marionette_tests-v3 branch.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
 Reviewer: |Sponsor:
---+---

Comment (by boklm):

 Replying to [comment:5 boklm]:
 > - adding a mechanism to pass some parameters to the tests (such as the
 Tor Browser version we are testing) similar to what we currently do for
 mozmill tests

 This is now done in commit fabe206d932827663f17af099e4042623cd270d1 in the
 marionette_tests-v3 branch.

 > - converting all our mozmill tests

 The settings test is now converted in the marionette_tests-v3 branch.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
  Sponsor: |
---+---

Comment (by boklm):

 I have now pushed some commits to the marionette_tests-v3 branch with some
 fixes to make it work on Windows.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
  Sponsor: |
---+---

Comment (by boklm):

 I pushed a marionette_tests-v3 branch on my github repo:
 https://github.com/boklm/tbb-testsuite/commits/marionette_tests-v3

 This adds a few fixes and convert all selenium tests to marionette.

 The next steps will be:
 - adding a few Windows fixes, before merging the branch to master
 - adding a mechanism to pass some parameters to the tests (such as the Tor
 Browser version we are testing) similar to what we currently do for
 mozmill tests
 - converting all our mozmill tests
 - making it work on OSX

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  High   |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Severity:  Normal | Resolution:
 Keywords: |  Actual Points:
Parent ID: | Points:
  Sponsor: |
---+---
Changes (by gk):

 * priority:  Medium => High
 * severity:   => Normal


Comment:

 Bumping priority given #17567.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker & Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  normal |  Milestone:
Component:  Quality Assurance and Testing  |Version:
   Resolution: |   Keywords:
Actual Points: |  Parent ID:
   Points: |Sponsor:
---+---

Comment (by boklm):

 I started adding support for marionette tests in our test suite, in the
 marionette_tests branch on my github repo:
 https://github.com/boklm/tbb-testsuite/commits/marionette_tests

 The tests can use the Firefox Puppeteer library:
 https://firefox-puppeteer.readthedocs.org/en/latest/index.html

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  normal |  Milestone:
Component:  Quality Assurance and Testing  |Version:
   Resolution: |   Keywords:
Actual Points: |  Parent ID:
   Points: |
---+---

Comment (by gk):

 The announcement was on:
 https://groups.google.com/d/topic/mozilla.dev.platform/hq5-X0mlIgQ.

--
Ticket URL: https://trac.torproject.org/projects/tor/ticket/16009#comment:1
Tor Bug Tracker  Wiki https://trac.torproject.org/
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  normal |  Milestone:
Component:  Quality Assurance and Testing  |Version:
   Resolution: |   Keywords:
Actual Points: |  Parent ID:
   Points: |
---+---
Changes (by mcs):

 * cc: brade, mcs (added)


--
Ticket URL: https://trac.torproject.org/projects/tor/ticket/16009#comment:2
Tor Bug Tracker  Wiki https://trac.torproject.org/
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

[tor-bugs] #16009 [Quality Assurance and Testing]: Move away from Mozmill to Marionette for Tor Browser tests

[Tor Bug Tracker Wiki]

#16009: Move away from Mozmill to Marionette for Tor Browser tests
---+---
 Reporter:  gk |  Owner:  boklm
 Type:  task   | Status:  new
 Priority:  normal |  Milestone:
Component:  Quality Assurance and Testing  |Version:
 Keywords: |  Actual Points:
Parent ID: | Points:
---+---
 Mozilla is not maintaining Mozmill anymore, in fact deprecating it. They
 are instead using Marionette. We should port our tests to Marionette as
 well and migrate to that framework in order to avoid weird Mozmill bugs
 which are not getting fixed anymore.

 See: https://github.com/mozilla/firefox-ui-tests for the new test suite
 and

 https://firefox-puppeteer.readthedocs.org/en/latest/
 https://marionette-client.readthedocs.org/en/latest/

 for some documentation.

--
Ticket URL: https://trac.torproject.org/projects/tor/ticket/16009
Tor Bug Tracker  Wiki https://trac.torproject.org/
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs