Hi folks, I'm putting together some formal testing procedures, and as part of that I'm building up a list of test cases. I would like to ask that each of our developers to go through this list and point out any test cases that they can think of that aren't in that list. Tests marked with *s are ones which I don't know how to test off the top of my head, so please pay special attention to those. I would love to hear from the CA folks about how to stress test it, and how to test the confidence monitoring code especially. Note that when I write this up in the wiki there will be screenshots and much more clarity when it comes to the definition of 'working'. These are titles, not the full body of the test ;)
The list: ====CA==== Does the CA install on Ubuntu Does the mock capture work Does real captures work Does the capture UI work (start and stop, settings) Does the content on the CA show up in the CA UI Does the agent handle repeated captures -Sets of 5 minutes, 30 minutes, 1 hour, back to back ====CI==== *Does confidence monitoring work ====Admin/Recordings==== Does the admin UI work (sortable properly, things show up, max counts) Does the search in the admin UI work? Does the bulk change tool in the admin UI work Does the inspect UI work Do the links to files in the mediapackage in the inspect UI work Does the view info link work Does the edit link actually edit the event properly Does the Play link go to the correct machine for processed lectures in a clustered environment ====Workflows==== Does the default workflow work Does the DVD workflow work Does the Export workflow work Does the multi-quality workflow work Does the retract workflow work Does the watermarking workflow work ====Scheduling==== Does the scheduling (ie, time and date) information work as expected -Can you schedule things in the past Does the capture input data work as expected Does the other information passed in the scheduling tool make the round trip Does assigning a series set the correct viewing perms Does the hold-for-trim function work Does the Processing Instructions dropdown work Does the Review/Trim checkbox work Do the distribution channels work as expected Does multi-capture recurrence work correctly for weekly (start and end dates, repeating) ====Upload==== Does upload work with files <2GB Does upload work with files >2GB Does the scheduling (ie, time and date) information work as expected Does the capture input data work as expected Does the other information passed in the scheduling tool make the round trip Does assigning a series set the correct viewing perms Does ingesting from an inbox on the server work Does ingesting multiple files from local disk work Does ingesting multiple files from an inbox work Does ingesting multiple files from a mix of both local and inbox work Does 'Contains discrete images/slides/scenes' work Does the hold-for-trim function work Does the Processing Instructions dropdown work Does the Review/Trim checkbox work Do the distribution channels work as expected Does distributing to the M^3 work Does distributing to Youtube work Does distributing to iTunesU work ====Trim==== Does the trim player load correctly (both streams) Does editing the metadata work Does disabling track(s) work Does trimming the beginning of the recording work Does trimming the end of the recording work Does trimming both the beginning and the end of the recording work Does not trimming anything work ====Export==== Does the export workflow hold for export Do the templates all work Does the output look like the template Can the output be downloaded Does the worker node do the processing when in a distrbuted cluster ====Inbox==== Does the default single-inbox work Does changing the default workflow for the default inbox work Do multiple inboxes work Do multiple inboxes with different workflows work ====Admin/Series==== Does the series tab have the correct information (count, names, etc) Can you create a new series and does it keep the data correctly -Do the priveledges work as expected Can you edit a series and have those permissions and changes pushed to the relevant episodes ====Admin/Capture Agents==== Do capture agents appear in the CA UI Does the capability information appear in the UI Do the agents update in the UI when the change states ====Admin/Statistics==== Does the statistics UI show the correct numbers Do the jobs distribute correctly Does the maintenance checkbox work as expected ====Search==== Do things render right when a video does not have segmentation data Does search work (ie, search in the search page) *Do the ATOM feeds work *Do the RSS feeds work Are permissions respected ====Engage==== Does the player load a video Can the video play back Can the audio be adjusted Can a multi-stream mediapackage be played Can the stream sizes be adjusted Do the streams play back in syn Does seeking work Does skipping forward and back work Does the player load without segmentation data Does the player display segmentation data correctly Can the player seek to segments defined by the segmentation data Does search work without segmentation data Does search work with segmentation data, and return useful results Do annotations work Can you turn on annotations Can you edit your annotations Can you delete your annotations Can you view others' annotations Do view statistics work Do the Download links work Do the share links work Do the keyboard shortcuts work ====Engage-Tech==== Does user tracking work * NB: Need specific script for people to follow ====Streaming==== *Does a streaming server work ====Clustering==== Do all of the Maven profiles build individually ====Docs==== Do the CA install docs work Do the core install docs work Do the cluster install docs work ====Scripts==== Do the CA install scripts work Do the core install scripts work Do the MySQL DDL scripts work Do the PostGres DDL script work ====AuthN/AuthZ==== *Does Sprint/CAS/whatever work *Does LDAP work Do the logout links work Is the admin UI restricted appropriately Is the player publicly accessible ====Misc==== Do the REST docs work *Does captioning work *Does LTI work *Does OAIPMH work
signature.asc
Description: OpenPGP digital signature
_______________________________________________ Matterhorn mailing list [email protected] http://lists.opencastproject.org/mailman/listinfo/matterhorn To unsubscribe please email [email protected] _______________________________________________
