New idea, but I must first admit this does seem to stray a bit from our long-term goal of analog embodiment, but I think one of our "stepping stones" has been sitting right in front of us for a while, the Linux desktop. What if we created an API that allowed our system to interact with its host? We could easily fetch window title, window position, and through Wayland's new RDP protocol, potentially "slice" otherwise analog data in a way that a system can process. This could also be a very tangible practical value to our system. If it is able to know cursor position, window name and position, as well as miscellaneous meta data, it could very soon become a truly useful personal assistant for us that could be capable of most Linux operation and we would be able to use this as a stepping stone for more adventurous analog visual and spacial processing systems. With working with the Linux desktop, we have the very marked advantage of having all resources accounted for and in digital format already. Rather than define our targets, we would merely have to tie them in.
Projects that I think would be useful towards this end. -Wayland, specifically with the RDP module that is now being optionally baked right in. -RDP/X11, or another form of window manager with an API. We could also forgo the composition manager completely and tie right into a window manager that easily allows scripting such as i3. -x[tools] examples include xdotool, xclipboard, etc. These would allow our system to create its own input and accomplish its own tasks. -Synergy. While this is a software primarily intended for cross-platform software KVM, we may be able to borrow code for mouse tracking and keystroke logging that the AI can track and learn from. These are just off-the-wall ideas. I am still in the process of learning Python and intend to make myself useful in more practical ways as soon as possible, but if someone with skills wanted a side project, feel free to steal this. Regards good friends! Noah B. -- You received this message because you are subscribed to the Google Groups "opencog" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/opencog. To view this discussion on the web visit https://groups.google.com/d/msgid/opencog/c6351089-639d-46c1-a4c8-8d0e9401bedb%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
