We create a recognition context, then we create a grammar where the rules are just each word in the hint text (and we do permutations where you can skip up to a couple of words and still match as I recall). Then we point SAPI at the stream(.wav) and let it try and recognize the grammar using cpRecoContext->WaitForNotifyEvent( SR_WAVTIMEOUT ) and we look for CSpEvent(s) of type SPEI_HYPOTHESIS, SPEI_RECOGNITION, and SPEI_FALSE_RECOGNITION and grab the reported phonemes from that.
We also have another version of the extractor .dll which uses the IMS (formerly LipSinc) stuff. It's much more straightforward, but requires a separate license so we can't offer it to the SDK. We might be able to give out the code for the SAPI version in the SDK, I'll check around. Yahn -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jeffrey "botman" Broome Sent: Friday, June 08, 2007 8:30 AM To: [email protected] Subject: Re: [hlcoders] Phoneme extraction Nate Nichols wrote: > Hi, > > I was wondering if anyone knew how the automatic phoneme extraction in > FacePoser works. I always kind of assumed that it was an easy SAPI > call, but after poking around through the SAPI documentation, I'm > starting to think this is something Valve wrote themselves. > > Does anyone know what the phoneme extractor is actually doing? I > assume it's some kind of sliding window of recognition using the text > you give it, but if anyone has any more specific thoughts or ideas I > would love to hear them. > > Or, better yet, is Valve considering opening any of this code up? My guess is that they are doing an untrained dictation mode transcription. You can find several examples of SAPI code on the net, for example... http://www.ccir.ed.ac.uk/~jad/phonemes.html -- Jeffrey "botman" Broome _______________________________________________ To unsubscribe, edit your list preferences, or view the list archives, please visit: http://list.valvesoftware.com/mailman/listinfo/hlcoders _______________________________________________ To unsubscribe, edit your list preferences, or view the list archives, please visit: http://list.valvesoftware.com/mailman/listinfo/hlcoders
