Hi Peer, The way in which I see this working is that the browser communicates with AT both about the state of the video playback and the state of the cue text reading. Let me call the captions "cues", because they could be text descriptions or subtitles or any other piece of text that needs to be read out within a certain playback interval of the video. The cue has all three pieces of information: the text, the start time and the end time in relation to the video's playback position.
The way in which I can see this working is the following: 1) when the browser has a new cue available for a text track, then the browser fires a "cue changed" event at AT 2) AT picks up this cue, which causes the browser to set a "pauseOnExit" flag to true on this cue; from here on, the AT and the video play asynchronously 2.a) AT reads out cue and calls "next cue" when it is finished, which causes the browser to set the "pauseOnExit" flag to false and unpauses the video if it is paused 2.b) in parallel the browser plays video until the end of the cue; if the "pauseOnExit" flag is true, it pauses, otherwise it continues playing repeat from 1) Hope this helps. Cheers, Silvia. On Wed, Jun 8, 2011 at 7:28 AM, Peter Korn <[email protected]> wrote: > Hi Silvia, > > Do you have any thoughts on how specifically to implement this, and to > surface it to assistive technologies? Based on the IA2/MSAA architecture > (or for that matter, the ATK architecture), there would be some specific UI > element in the hierarchy that would implement some interface enabling an > assistive technology to get at this information. > > For example, a Play/Pause button which could be diagrammatically > manipulated, in order to activate the play() function. Likewise, some UI > component displaying the captions (whether actually visible on the screen or > not), which the AT could query to get the caption text - and receive events > from whenever that caption text changes. > > If the example above captures the use case(s), then perhaps we don't > actually need any new API so much as we need a design pattern document > explaining how this all should work and be used. > > > Regards, > > Peer > > > On 6/6/2011 11:30 PM, Silvia Pfeiffer wrote: > > Hi all, > > I am new to this list, so a quick intro: I am involved in the W3C > HTML5 accessibility task force and work on video specs. > > I added the need for an API for time-aligned text descriptions of > video to the bottom of that wiki page, since there is text there that > we need to expose. It's probably even broader than just text > descriptions - you'd probably want to expose all text cues (snippets) > of all types of text tracks, which includes captions and subtitles and > chapters. So, I'd like to bring this issue before this group and have > a think about how we may be able to satisfy this need. > > Best Regards, > Silvia. > > > On Tue, Jun 7, 2011 at 2:09 PM, Pete Brunet <[email protected]> > <[email protected]> wrote: > > Hi all, Please take a look at this and provide your feedback: > https://wiki.mozilla.org/Accessibility/IA2_1.3 > > Thanks, Pete > -- > Pete Brunet > > a11ysoft - Accessibility Architecture and Development(512) 238-6967 (work), > (512) 689-4155 (cell) > Skype: pete.brunet > IM: ptbrunet (AOL, Google), [email protected] > (MSN)http://www.a11ysoft.com/about/ > Ionosphere: WS4G > On 3/11/2011 11:10 PM, Alexander Surkov wrote: > > Hi, Jamie. I missed Mick suggestion on the list. It's sounds reasonable and > I agree we should try it before getting new API for this since the issue is > mostly about events. > > Thank you. > Alex. > > > On Sat, Mar 12, 2011 at 11:43 AM, James Teh <[email protected]> > <[email protected]> wrote: > > Hi. > > Nice work; good to get the discussion going. :) > > I still don't see a need for this registry API. Why not just use > IsWinEventHookInstalled(), as Mick suggested on the IA2 list? > > Thanks. > > Jamie > > On 12/03/2011 3:48 AM, Alexander Surkov wrote: > > Hi. > > I gathered ideas into one doc > -https://wiki.mozilla.org/Accessibility/IA2_1.3. Please give feedback > here and feel free to edit the wiki. > > Thank you. > Alex. > > -- > James Teh > Vice President, Developer > NV Access Inc, ABN 61773362390 > Email: [email protected] > Web site: http://www.nvaccess.org/ > > _______________________________________________ > Accessibility-ia2 mailing > [email protected]https://lists.linux-foundation.org/mailman/listinfo/accessibility-ia2 > > _______________________________________________ > Accessibility-ia2 mailing > [email protected]https://lists.linux-foundation.org/mailman/listinfo/accessibility-ia2 > > > -- > [image: Oracle] <http://www.oracle.com> > Peter Korn | Accessibility Principal > Phone: +1 650 506 9522 <+1%206505069522> > Oracle Corporate Architecture Group > 500 Oracle Parkway | Redwood City, CA 94065 > [image: Green Oracle] <http://www.oracle.com/commitment> Oracle is > committed to developing practices and products that help protect the > environment >
<<green-for-email-sig_0.gif>>
<<oracle_sig_logo.gif>>
_______________________________________________ Accessibility-ia2 mailing list [email protected] https://lists.linux-foundation.org/mailman/listinfo/accessibility-ia2
