One additional detail to add here - the definition of the smoketest suite should represent the following:
* Tests that cause major functionality loss and render the phone significantly unusable * If these tests fail, then we need a 24 hour turnaround time from development to resolve the smoketest blocker ----- Original Message ----- > From: "Jason Smith" <[email protected]> > To: "dev-b2g" <[email protected]>, "dev-gaia" > <[email protected]> > Sent: Wednesday, August 20, 2014 2:20:58 PM > Subject: Review of QA's Smoketests > > Hi Everyone, > > I'd like to get feedback on our current smoketest suite to see if there's > agreement or disagreement with the test cases currently included in the test > suite. Here is a link to the smoketest suite below: > > https://moztrap.mozilla.org/runtests/run/5060/env/347/?pagenumber=1&pagesize=100 > > Some questions I'd like feedback on include: > > 1. Which test cases do you think make sense to be included in a smoketest > suite? > 2. Which test cases do you think don't make sense to be included in a > smoketest suite? > 3. Are there test cases you don't see in the test suite that should be > included? > 4. Do you think the steps in certain test cases make sense or do you think > there's some refinement needed on those test cases? > > Sincerely, > Jason Smith _______________________________________________ dev-b2g mailing list [email protected] https://lists.mozilla.org/listinfo/dev-b2g
