Awesome, Greg. You've got an amazing list here. I've made a few additions inline, mostly for things that have been regressions in the past, and in some cases have indicated what I think the test cases need to include (again, where I'm concerned about specific issues that have popped up, often as regressions, in the past that sometimes aren't obvious that a tester needs to look for.)
Judy On Apr 27, 2012, at 9:29 AM, Greg Logan wrote: > Hi folks, > > I'm putting together some formal testing procedures, and as part of that > I'm building up a list of test cases. I would like to ask that each of > our developers to go through this list and point out any test cases that > they can think of that aren't in that list. Tests marked with *s are > ones which I don't know how to test off the top of my head, so please > pay special attention to those. I would love to hear from the CA folks > about how to stress test it, and how to test the confidence monitoring > code especially. Note that when I write this up in the wiki there will > be screenshots and much more clarity when it comes to the definition of > 'working'. These are titles, not the full body of the test ;) > > The list: > ====Admin/Recordings==== > Does the admin UI work (sortable properly, things show up, max counts) Paging work properly? (And does number of recordings per page "stick") > Does the search in the admin UI work? > Does the bulk change tool in the admin UI work > Does the inspect UI work > Do the links to files in the mediapackage in the inspect UI work > Does the view info link work (For above: need to test View Info thru all phases, e.g. from Upcoming thru to Finished) > Does the edit link actually edit the event properly (For above: ensure that all options set in creating the recording, including holds, are shown correctly in the Edit UI) > Does the Play link go to the correct machine for processed lectures in a > clustered environment Does the Ignore action link work properly? > ====Scheduling==== > Does the scheduling (ie, time and date) information work as expected (Above needs to include whether time and date "stick" throughout the recording's lifecycle) > -Can you schedule things in the past > Does the capture input data work as expected > Does the other information passed in the scheduling tool make the round trip > Does assigning a series set the correct viewing perms Does Series autocomplete work correctly? Does Series get created if enter a new series name? > Does the hold-for-trim function work > Does the Processing Instructions dropdown work > Does the Review/Trim checkbox work > Do the distribution channels work as expected > Does multi-capture recurrence work correctly for weekly (start and end > dates, repeating) > > ====Upload==== > Does upload work with files <2GB > Does upload work with files >2GB > Does the scheduling (ie, time and date) information work as expected > Does the capture input data work as expected > Does the other information passed in the scheduling tool make the round trip (Assume you mean "upload" rather than "scheduling in above) > Does assigning a series set the correct viewing perms Does Series autocomplete work correctly? Does Series get created if enter a new series name? > Does ingesting from an inbox on the server work > Does ingesting multiple files from local disk work > Does ingesting multiple files from an inbox work > Does ingesting multiple files from a mix of both local and inbox work (For all of the above, need to check to make sure all 4 possible files, in a variety of combinations, make it to trim/review UI and then make it to Engage UI, as well as other distribution channels as expected.) > Does 'Contains discrete images/slides/scenes' work > Does the hold-for-trim function work > Does the Processing Instructions dropdown work > Does the Review/Trim checkbox work > Do the distribution channels work as expected > Does distributing to the M^3 work > Does distributing to Youtube work > Does distributing to iTunesU work > > ====Trim==== > Does the trim player load correctly (both streams) > Does editing the metadata work Are elements available to edit all the same metadata that was entered on scheduling or uploading the recording? > Does disabling track(s) work > Does trimming the beginning of the recording work > Does trimming the end of the recording work > Does trimming both the beginning and the end of the recording work > Does not trimming anything work > > > > ====Admin/Series==== > Does the series tab have the correct information (count, names, etc) > Can you create a new series and does it keep the data correctly > -Do the priveledges work as expected > Can you edit a series and have those permissions and changes pushed to > the relevant episodes Does View Info work correctly? > > > ====Engage==== > Does the player load a video > Can the video play back > Can the audio be adjusted > Can a multi-stream mediapackage be played > Can the stream sizes be adjusted > Do the streams play back in syn > Does seeking work > Does skipping forward and back work > Does the player load without segmentation data > Does the player display segmentation data correctly > Can the player seek to segments defined by the segmentation data > Does search work without segmentation data > Does search work with segmentation data, and return useful results > Do annotations work > Can you turn on annotations > Can you edit your annotations > Can you delete your annotations > Can you view others' annotations > Do view statistics work > Do the Download links work > Do the share links work > Do the keyboard shortcuts work Does Description show metadata correctly? Does entering current time seek correctly? (And does current time reflect the location of the playhead accurately?) > > ====Misc==== > Do the REST docs work (Need to confirm that all REST docs are available) _______________________________________________ Matterhorn mailing list [email protected] http://lists.opencastproject.org/mailman/listinfo/matterhorn To unsubscribe please email [email protected] _______________________________________________
