Betreff: Review of QA's Smoketests
Von: Jason Smith <[email protected]>
Datum: 2014-08-20 23:20
Hi Everyone,
I'd like to get feedback on our current smoketest suite to see if
there's agreement or disagreement with the test cases currently included
in the test suite. Here is a link to the smoketest suite below:
https://moztrap.mozilla.org/runtests/run/5060/env/347/?pagenumber=1&pagesize=100
Some questions I'd like feedback on include:
1. Which test cases do you think make sense to be included in a smoketest suite?
2. Which test cases do you think don't make sense to be included in a smoketest
suite?
3. Are there test cases you don't see in the test suite that should be included?
Ability to join a hidden Wi-Fi (broken in First-run
https://bugzilla.mozilla.org/show_bug.cgi?id=935487 , was recently
broken in Settings https://bugzilla.mozilla.org/show_bug.cgi?id=1048373 )
Unlocking with SIM PIN enabled, e.g.
https://bugzilla.mozilla.org/show_bug.cgi?id=1035739
https://bugzilla.mozilla.org/show_bug.cgi?id=970022
Battery charge correctly recognized and drain and load reflected by
charge shown.
Screenshot can be taken and transfered to a computer connected with USB.
Music and Video can play the expected codecs and file formats. In the
same vein like https://moztrap.mozilla.org/manage/case/2478/
Importing contacts from a .vcf file works.
A graphics stressing test like big canvases or web pages (no crashes or
freeze if it happened before).
Enabling and disabling the screenreader should work.
4. Do you think the steps in certain test cases make sense or do you think
there's some refinement needed on those test cases?
OTA update over Wi-Fi: https://moztrap.mozilla.org/manage/case/2313/
There should be a given time limit for the installation to complete. (My
experience with Keon and Unagi is/was that this can take hours.
https://bugzilla.mozilla.org/show_bug.cgi?id=923753 )
Sincerely,
Jason Smith
Sebastian / Archaeopteryx
_______________________________________________
dev-b2g mailing list
[email protected]
https://lists.mozilla.org/listinfo/dev-b2g
