Fred: Already in-progress. Also, I just made a new thread on oral commands with the plugin in the new update. I am interested to hear what you have to say about it, and would love someone to get a conversation going there so others see and give more feedback.
The new thread it at https://groups.google.com/g/tiddlywiki/c/3O0eT4K5mkI On Tuesday, August 10, 2021 at 9:57:31 PM UTC-4 [email protected] wrote: > Thanks for the speech-to-text plugin, quite impressive from my early > trials (chrome). As a couple people have suggested, I think an editor > toolbar button/keyboard shortcut to insert the transcript text in the > current tiddler's text field (where the cursor is?) would be neat and be > best for me. I'm happy to try mod'ing myself unless you've already got > plans. > > > On Tuesday, 10 August 2021 at 19:10:24 UTC-4 [email protected] wrote: > >> Something along those lines. My next goal, as I've shared with BTC, is to >> allow users to assign their own commands via tiddler inputs, and >> essentially, when they speak these commands out-loud via the plugin, the >> plugin then executes the command. I've started a minimal implementation of >> this with the new release (GH pages is acting up, so drag and drop may not >> be available for a while), which allows to users to speak "change the >> language to X" and the language will change if available, all that's needed >> is the custom-input ones :) >> >> On Tuesday, August 10, 2021 at 6:57:15 PM UTC-4 TW Tones wrote: >> >>> Flanc, >>> >>> I was not after language switching, but are you suggesting we change >>> from text dictation, to a tiddlywiki command, using the same mechaisium? >>> >>> Tones >>> >>> On Wednesday, 11 August 2021 at 08:53:42 UTC+10 [email protected] >>> wrote: >>> >>>> @Tones, way ahead of you :) Already added command functionality for >>>> language switching in new release. Updating Github Pages so drag and drop >>>> is on correct version right now! >>>> >>>> On Tuesday, August 10, 2021 at 6:49:32 PM UTC-4 TW Tones wrote: >>>> >>>>> Flanc >>>>> >>>>> I think a design configuration is how do we trigger a more involved >>>>> "command" on tiddlywiki. Perhaps we should leverage the existing keyboard >>>>> shortcuts, such that either one can speak eg alt-space then the user can >>>>> assign whatever they wish in response to that, ie trigger a set of >>>>> actions. >>>>> Of course in time "close tiddler" etc would be nice, but I think the key >>>>> is >>>>> the escape process, so lets say one can happily dictate any thing, except >>>>> "OK TiddlyWiki" in which case rather than dictate into the current text >>>>> field a dialogue opens in which the same dictation can search for any >>>>> tiddlywiki designed terms, eg ok tiddlywiki, new tiddler (which you see >>>>> on >>>>> screen). >>>>> >>>>> We have a way to detect what I call the focused tiddler eg; >>>>> {{$:/HistoryList!!current-tiddler}}, for which such "ok tiddlywiki" can >>>>> be >>>>> designed to use as currentTiddler. >>>>> >>>>> The TiddlyWiki command plugin and others may be a short cut for us, to >>>>> jump into, to move from dictation to commands. One could imagine where >>>>> the >>>>> user can assign what action or keyboard shortcut could be used as a >>>>> result >>>>> of "OK tiddlywiki". Only later we could see how to get the commands >>>>> recognised in the middle of dictation, but I expect we still need this >>>>> escape method. >>>>> >>>>> Regards >>>>> Tony >>>>> On Tuesday, 10 August 2021 at 22:57:36 UTC+10 [email protected] >>>>> wrote: >>>>> >>>>>> Thanks everyone for the great advice! >>>>>> >>>>>> My main takeaways for what I will start working on are commands: >>>>>> punctuation, language switch, etc. >>>>>> >>>>>> As this is on the side of the things I develop for the plug-in, I >>>>>> will set to work immediately reading documentation and example code. >>>>>> >>>>>> To get more technical, I believe I can just attach a function to >>>>>> check the last word of the transcription, and if it matches a set array >>>>>> of >>>>>> word/s it will the execute a command. >>>>>> >>>>>> BTC and I continue to talk on the Issues page of the repo, if any >>>>>> other devs would like to chime in with other ideas/implementation, feel >>>>>> free to chime in there. >>>>>> >>>>>> Thanks again! >>>>>> >>>>>> On Tue, Aug 10, 2021 at 6:32 AM R² <[email protected]> wrote: >>>>>> >>>>>>> Hi all and thanks Flank & BTC for this extremely promising plugin! >>>>>>> >>>>>>> Another few ideas and comments: >>>>>>> >>>>>>> (1) It would be nice to have a record button directly in the editor >>>>>>> and not only have to rely on creating new transcript tiddlers. >>>>>>> (2) Automatic punctuation should be easy to switch on and off as per >>>>>>> https://cloud.google.com/speech-to-text/docs/automatic-punctuation. >>>>>>> (3) There are quite a number of languages and accents available on >>>>>>> the Web Speech API demo. It would be nice to be able to set the >>>>>>> languageCode parameter manually (fully list at: >>>>>>> https://cloud.google.com/speech-to-text/docs/languages). When this >>>>>>> happens, could you make sure that custom record buttons can be added >>>>>>> using >>>>>>> only wikitext to allow multilingual users to have several record >>>>>>> buttons >>>>>>> based on their own needs? >>>>>>> (5) It could be worth mentioning in the readme that Google's Web >>>>>>> Speech API demo at >>>>>>> https://www.google.com/intl/en/chrome/demos/speech.html is a great >>>>>>> way of checking for browser compatibility. I haven't found anything >>>>>>> that >>>>>>> works on my Linux system by the way. Any ideas as Firefox is >>>>>>> unsupported >>>>>>> and even Chromium strangely doesn't seem to be able to run the API on >>>>>>> my >>>>>>> system (V. 91.0.4472.114 on Linux Mint)? On my phone, Quinoid V1.0 >>>>>>> doesn't >>>>>>> work either :( >>>>>>> (6) Bouncing on TT's idea of using speech-driven commands while >>>>>>> recording, this would make terrific sense not only for punctuation, but >>>>>>> also to enunciate proper nouns for instance, or to switch languages on >>>>>>> the >>>>>>> fly within a given recording or prior to a recording >>>>>>> ("switchtoItalian"…). >>>>>>> (7) I'm still running into problems regarding the short hearing span >>>>>>> on the plugin's TW demo despite the version being seemingly v. 1.0.3. >>>>>>> >>>>>>> Thanks :) >>>>>>> R² >>>>>>> >>>>>>> -- >>>>>>> >>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "TiddlyWiki" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> >>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/tiddlywiki/367d80b8-aa58-471a-8c89-155f20c2cfa2n%40googlegroups.com >>>>>>> >>>>>>> <https://groups.google.com/d/msgid/tiddlywiki/367d80b8-aa58-471a-8c89-155f20c2cfa2n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/6487337f-f79a-4b6a-b9f9-363ced67f4aen%40googlegroups.com.
