Re: [Flashcoders] RE: Flash speech-to-text
You wouldn't actually do the speech recognition in Flash, but rather have Flash record to a file, have the server process it (using an already developed program of course, as as Steven explains speech to text is not just a simple matter). So essentially the flow would be: Flash Player would record the sound, tell server to save file to x location, open a socket connection to server, tell the server to process the sound file. Then, through the socket connection you would send data back to Flash as you process the file. This is a real simple overview, but essentially if you in fact can record sound through the microphone with Flash Player and you do have an already built speech to text program installed and working (with an API that you could plug into), then it is feasible and it's not as complicated as writing your own speech to text recognition software in ActionScript. I have implemented a similar solution for creating video files with Flash (i.e. you drag 5-10 second clips onto a timeline, send the data back to the server, the server reads the sequence, puts the clips together into a file and exports as a new video file), so this is a workable and good solution, as well as your best bet. - Taka On Wed, Aug 26, 2009 at 10:41 PM, Steven Sacks flash...@stevensacks.netwrote: This is how you record sound: http://www.getmicrophone.com/?p=69 If you're asking how to convert sound waves into speech, dude, what? Do you realize how challenging speech recognition is? Wait, why am I asking you this? If you did, you wouldn't be asking people on a Flash list how to do it, as if it's some piece of code somebody can copy and paste or a few links that will tell you the secret formula. Most speech to text programs are based on the Hidden Markov models. In speech recognition, the hidden Markov model would output a sequence of n-dimensional real-valued vectors (with n being a small integer, such as 10), outputting one of these every 10 milliseconds. The vectors would consist of cepstral coefficients, which are obtained by taking a Fourier transform of a short time window of speech and decorrelating the spectrum using a cosine transform, then taking the first (most significant) coefficients. The hidden Markov model will tend to have in each state a statistical distribution that is a mixture of diagonal covariance Gaussians which will give a likelihood for each observed vector. Each word, or (for more general speech recognition systems), each phoneme, will have a different output distribution; a hidden Markov model for a sequence of words or phonemes is made by concatenating the individual trained hidden Markov models for the separate words and phonemes. There you have it. That's a high level overview of speech to text. Do you understand anything in that paragraph? Probably not. Unless you're willing to study and put in the time to figure out how to do this, you're not going to figure it out. Nobody is going to point you in the right direction because this is a very niche knowledge area and none of these people are on Flashcoders. They're at universities working on their doctorates or working for the military or government, or some private company and they're not sharing this information. This is the stuff patents are made of. So either give up now (because what you want is some easy solution and there isn't one) or start doing real research, learn some serious Calculus, become an expert on on sound, speech, waveforms, and then figure out how to port all of this into Flash, which, in all likelihood, lacks the performance to actually achieve this. You'll probably have to do it on the server, passing the sound to the server as an mp3 file, and then pass the text back. That's the only thing I can think of that would possibly be able to do this. Prove me wrong. If you pull this off, you could probably build an entire company around your technology. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
Well, if you're got a working server solution, then all you have to do is send an mp3 file to the server, which that link I sent you should describe how to do. Rock on with your bad self. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
Steve, why didn't you say so in the first place?? ;P Thanks for the info - juju On Thu, Aug 27, 2009 at 1:41 PM, Steven Sacks flash...@stevensacks.netwrote: This is how you record sound: http://www.getmicrophone.com/?p=69 If you're asking how to convert sound waves into speech, dude, what? Do you realize how challenging speech recognition is? Wait, why am I asking you this? If you did, you wouldn't be asking people on a Flash list how to do it, as if it's some piece of code somebody can copy and paste or a few links that will tell you the secret formula. Most speech to text programs are based on the Hidden Markov models. In speech recognition, the hidden Markov model would output a sequence of n-dimensional real-valued vectors (with n being a small integer, such as 10), outputting one of these every 10 milliseconds. The vectors would consist of cepstral coefficients, which are obtained by taking a Fourier transform of a short time window of speech and decorrelating the spectrum using a cosine transform, then taking the first (most significant) coefficients. The hidden Markov model will tend to have in each state a statistical distribution that is a mixture of diagonal covariance Gaussians which will give a likelihood for each observed vector. Each word, or (for more general speech recognition systems), each phoneme, will have a different output distribution; a hidden Markov model for a sequence of words or phonemes is made by concatenating the individual trained hidden Markov models for the separate words and phonemes. There you have it. That's a high level overview of speech to text. Do you understand anything in that paragraph? Probably not. Unless you're willing to study and put in the time to figure out how to do this, you're not going to figure it out. Nobody is going to point you in the right direction because this is a very niche knowledge area and none of these people are on Flashcoders. They're at universities working on their doctorates or working for the military or government, or some private company and they're not sharing this information. This is the stuff patents are made of. So either give up now (because what you want is some easy solution and there isn't one) or start doing real research, learn some serious Calculus, become an expert on on sound, speech, waveforms, and then figure out how to port all of this into Flash, which, in all likelihood, lacks the performance to actually achieve this. You'll probably have to do it on the server, passing the sound to the server as an mp3 file, and then pass the text back. That's the only thing I can think of that would possibly be able to do this. Prove me wrong. If you pull this off, you could probably build an entire company around your technology. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
This sounds like what I'm trying to do, Thanks - juju On Thu, Aug 27, 2009 at 2:22 PM, Taka Kojima t...@gigafied.com wrote: You wouldn't actually do the speech recognition in Flash, but rather have Flash record to a file, have the server process it (using an already developed program of course, as as Steven explains speech to text is not just a simple matter). So essentially the flow would be: Flash Player would record the sound, tell server to save file to x location, open a socket connection to server, tell the server to process the sound file. Then, through the socket connection you would send data back to Flash as you process the file. This is a real simple overview, but essentially if you in fact can record sound through the microphone with Flash Player and you do have an already built speech to text program installed and working (with an API that you could plug into), then it is feasible and it's not as complicated as writing your own speech to text recognition software in ActionScript. I have implemented a similar solution for creating video files with Flash (i.e. you drag 5-10 second clips onto a timeline, send the data back to the server, the server reads the sequence, puts the clips together into a file and exports as a new video file), so this is a workable and good solution, as well as your best bet. - Taka On Wed, Aug 26, 2009 at 10:41 PM, Steven Sacks flash...@stevensacks.net wrote: This is how you record sound: http://www.getmicrophone.com/?p=69 If you're asking how to convert sound waves into speech, dude, what? Do you realize how challenging speech recognition is? Wait, why am I asking you this? If you did, you wouldn't be asking people on a Flash list how to do it, as if it's some piece of code somebody can copy and paste or a few links that will tell you the secret formula. Most speech to text programs are based on the Hidden Markov models. In speech recognition, the hidden Markov model would output a sequence of n-dimensional real-valued vectors (with n being a small integer, such as 10), outputting one of these every 10 milliseconds. The vectors would consist of cepstral coefficients, which are obtained by taking a Fourier transform of a short time window of speech and decorrelating the spectrum using a cosine transform, then taking the first (most significant) coefficients. The hidden Markov model will tend to have in each state a statistical distribution that is a mixture of diagonal covariance Gaussians which will give a likelihood for each observed vector. Each word, or (for more general speech recognition systems), each phoneme, will have a different output distribution; a hidden Markov model for a sequence of words or phonemes is made by concatenating the individual trained hidden Markov models for the separate words and phonemes. There you have it. That's a high level overview of speech to text. Do you understand anything in that paragraph? Probably not. Unless you're willing to study and put in the time to figure out how to do this, you're not going to figure it out. Nobody is going to point you in the right direction because this is a very niche knowledge area and none of these people are on Flashcoders. They're at universities working on their doctorates or working for the military or government, or some private company and they're not sharing this information. This is the stuff patents are made of. So either give up now (because what you want is some easy solution and there isn't one) or start doing real research, learn some serious Calculus, become an expert on on sound, speech, waveforms, and then figure out how to port all of this into Flash, which, in all likelihood, lacks the performance to actually achieve this. You'll probably have to do it on the server, passing the sound to the server as an mp3 file, and then pass the text back. That's the only thing I can think of that would possibly be able to do this. Prove me wrong. If you pull this off, you could probably build an entire company around your technology. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
I did, Chris, Thanks. On Thu, Aug 27, 2009 at 1:16 PM, Chris Foster cfos...@catalystinteractive.com.au wrote: Dunno for sure Juju, but while you wait for any other answers on this list... http://developer.ribbit.com/download Sign up, download the SDK, view the samples, and join the forums... I imagine it wouldn't take more than a couple of hours to find the right people to answer in detail. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 3:01 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text Thanks Chris, not even with Ribbit? That's what I really want to know: can Ribbit + Flash provide speech to text capability. Thanks, juju On Thu, Aug 27, 2009 at 12:32 PM, Chris Foster cfos...@catalystinteractive.com.au wrote: Hi Juju, You can't currently do speech-to-text in Actionscript. It's not that people are choosing not to answer you, there just aren't any useful solutions to your question. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 2:20 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text I wonder, if I offered $50 for an answer, how many replies with actual useful information would be posted to answer this question... :) Or $100? On Wed, Aug 26, 2009 at 12:02 PM, juju jlee...@gmail.com wrote: Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QB LH qs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
This is the best answer on Ribbit forums: I am wondering if there's any way to use the *speech* to text feature without making a phone call? Thanks for your help. You can send a Shout message and have that transcribed and sent to your email address. http://docs.ribbit.com/index.php?option=com_contentview=articleid=50:ribbit-shout-messagescatid=38:flex-articles%27,%27articles%27,888,666 rant Death to Capitalism! Knowledge wants to be Free! Go stick your patents where the sun don't shine /rant On Thu, Aug 27, 2009 at 4:30 PM, juju jlee...@gmail.com wrote: I did, Chris, Thanks. On Thu, Aug 27, 2009 at 1:16 PM, Chris Foster cfos...@catalystinteractive.com.au wrote: Dunno for sure Juju, but while you wait for any other answers on this list... http://developer.ribbit.com/download Sign up, download the SDK, view the samples, and join the forums... I imagine it wouldn't take more than a couple of hours to find the right people to answer in detail. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 3:01 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text Thanks Chris, not even with Ribbit? That's what I really want to know: can Ribbit + Flash provide speech to text capability. Thanks, juju On Thu, Aug 27, 2009 at 12:32 PM, Chris Foster cfos...@catalystinteractive.com.au wrote: Hi Juju, You can't currently do speech-to-text in Actionscript. It's not that people are choosing not to answer you, there just aren't any useful solutions to your question. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 2:20 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text I wonder, if I offered $50 for an answer, how many replies with actual useful information would be posted to answer this question... :) Or $100? On Wed, Aug 26, 2009 at 12:02 PM, juju jlee...@gmail.com wrote: Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QB LH qs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message
RE: [Flashcoders] RE: Flash speech-to-text
Hi Juju, You can't currently do speech-to-text in Actionscript. It's not that people are choosing not to answer you, there just aren't any useful solutions to your question. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 2:20 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text I wonder, if I offered $50 for an answer, how many replies with actual useful information would be posted to answer this question... :) Or $100? On Wed, Aug 26, 2009 at 12:02 PM, juju jlee...@gmail.com wrote: Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QBLH qs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
I wonder, if I offered $50 for an answer, how many replies with actual useful information would be posted to answer this question... :) Or $100? On Wed, Aug 26, 2009 at 12:02 PM, juju jlee...@gmail.com wrote: Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
Thanks Chris, not even with Ribbit? That's what I really want to know: can Ribbit + Flash provide speech to text capability. Thanks, juju On Thu, Aug 27, 2009 at 12:32 PM, Chris Foster cfos...@catalystinteractive.com.au wrote: Hi Juju, You can't currently do speech-to-text in Actionscript. It's not that people are choosing not to answer you, there just aren't any useful solutions to your question. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 2:20 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text I wonder, if I offered $50 for an answer, how many replies with actual useful information would be posted to answer this question... :) Or $100? On Wed, Aug 26, 2009 at 12:02 PM, juju jlee...@gmail.com wrote: Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QBLH qs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
RE: [Flashcoders] RE: Flash speech-to-text
Dunno for sure Juju, but while you wait for any other answers on this list... http://developer.ribbit.com/download Sign up, download the SDK, view the samples, and join the forums... I imagine it wouldn't take more than a couple of hours to find the right people to answer in detail. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 3:01 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text Thanks Chris, not even with Ribbit? That's what I really want to know: can Ribbit + Flash provide speech to text capability. Thanks, juju On Thu, Aug 27, 2009 at 12:32 PM, Chris Foster cfos...@catalystinteractive.com.au wrote: Hi Juju, You can't currently do speech-to-text in Actionscript. It's not that people are choosing not to answer you, there just aren't any useful solutions to your question. C: -Original Message- From: flashcoders-boun...@chattyfig.figleaf.com [mailto:flashcoders-boun...@chattyfig.figleaf.com] On Behalf Of juju Sent: Thursday, 27 August 2009 2:20 PM To: Flash Coders List Subject: Re: [Flashcoders] RE: Flash speech-to-text I wonder, if I offered $50 for an answer, how many replies with actual useful information would be posted to answer this question... :) Or $100? On Wed, Aug 26, 2009 at 12:02 PM, juju jlee...@gmail.com wrote: Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QB LH qs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
This is how you record sound: http://www.getmicrophone.com/?p=69 If you're asking how to convert sound waves into speech, dude, what? Do you realize how challenging speech recognition is? Wait, why am I asking you this? If you did, you wouldn't be asking people on a Flash list how to do it, as if it's some piece of code somebody can copy and paste or a few links that will tell you the secret formula. Most speech to text programs are based on the Hidden Markov models. In speech recognition, the hidden Markov model would output a sequence of n-dimensional real-valued vectors (with n being a small integer, such as 10), outputting one of these every 10 milliseconds. The vectors would consist of cepstral coefficients, which are obtained by taking a Fourier transform of a short time window of speech and decorrelating the spectrum using a cosine transform, then taking the first (most significant) coefficients. The hidden Markov model will tend to have in each state a statistical distribution that is a mixture of diagonal covariance Gaussians which will give a likelihood for each observed vector. Each word, or (for more general speech recognition systems), each phoneme, will have a different output distribution; a hidden Markov model for a sequence of words or phonemes is made by concatenating the individual trained hidden Markov models for the separate words and phonemes. There you have it. That's a high level overview of speech to text. Do you understand anything in that paragraph? Probably not. Unless you're willing to study and put in the time to figure out how to do this, you're not going to figure it out. Nobody is going to point you in the right direction because this is a very niche knowledge area and none of these people are on Flashcoders. They're at universities working on their doctorates or working for the military or government, or some private company and they're not sharing this information. This is the stuff patents are made of. So either give up now (because what you want is some easy solution and there isn't one) or start doing real research, learn some serious Calculus, become an expert on on sound, speech, waveforms, and then figure out how to port all of this into Flash, which, in all likelihood, lacks the performance to actually achieve this. You'll probably have to do it on the server, passing the sound to the server as an mp3 file, and then pass the text back. That's the only thing I can think of that would possibly be able to do this. Prove me wrong. If you pull this off, you could probably build an entire company around your technology. ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
Re: [Flashcoders] RE: Flash speech-to-text
Hi Jonathan, I'm trying to do speech to text. AFAIK Flash API cannot record the microphone input. It can listen for the sound level of the microphone input, and you could create interactivity with this (like shooting a bullet by clapping your hands). But how do you record a person's voice and convert this to text when you can't record the microphone input with Flash? Has anyone tried Ribbit to create voice interactive applications, like speech to text and voice-recognition? Would like to get some guidance before going into Ribbit development. I've tried SpeechXML but this needs SAPI 5 and TMK it only works on a local machine. I'm looking for speech-to-text solution and voice-recording/analysis that can be done via a Flash RIA. Am hoping that there's some actionscript library out there that gives this functionality. Or hopefully, the next version of Flash/Actionscript will have this functionality. Thanks, juju On Tue, Aug 25, 2009 at 8:48 PM, jonathan howe jonathangh...@gmail.comwrote: Are you trying to do text-to-speech or speech-to-text? The latter is better searched for under 'voice recognition'. Seems like there are a bunch of results for the former: http://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n -jonathanhttp://www.bing.com/search?q=flash+text-to-speechform=QBLHqs=n%0A-jonathan On Tue, Aug 25, 2009 at 5:30 AM, juju jlee...@gmail.com wrote: HI All, I searched Google and the forums but could not find an answer, hope you actionscript sages can help. There's plenty of text to speech solutions, but how do you do Speech-to-text with Flash? Can you do speech-to-text with ribbit http://www.ribbit.com/? Thanks, juju ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders -- -jonathan howe ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders ___ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
