Happy new year, community!
Hi, Marcos
Probably Yes.
I've been fascinated by EEG input to CLA since 2011 probably with the
mixture of other inputs, not only from body parts but also from keystrokes,
browser crawling activities, ...,etc.
I'm afraid that CLA can associate such blurry? multi-stream inputs with
motor outputs very well. CLA's features (online learning, real-time,
special pooling, temporary pooling) seem a best match to me. There are a
number of prediction & abnormally detection methods, but I believe not so
many are online AND real-time.
A hypothetical construction of CLA for that purpose could be:
- A CLA region receives EEG and other input streams and convert them to an
SDR at a specific time.
- Temporal changes of successive SDRs are stored in TP.
- Significant motor outputs (I could call "events") are associated with
related SDRs.
- TP predicts SDRs in the near future which indicates the corresponding
motor output with confidence probability.
I believe that the best publicly available EEG scanner is Emotiv EPOC,
which can produce 14 channel data streams with every 8 ms (plus additional
head gyro data so it can detect when you tilt your head).
If SP and TP with enough size of regions can handle this amount/speed of
data stream in every 5ms with commodity hardware, I'm wondering we can play
a lot with our EEG. In my opinion the prediction speed is the key
differentiator to enable this game.
Emotiv also provides several proprietary EEG-to-digital-data converters by
themselves; EmoKey to produce key input, Expressiv to get facial
expressions like blinking, Congnitiv to associate thoughts with commands,
and Affective to guess your feeling like sad or concentrated. The thing is
the user needs some training to use these software. i.e. the software rely
on the plasticity of your brain. I'm wondering if we can replace these
software with CLAs. Then, CLAs can learn the associations of inputs and
events for you, instead that your brain learns them for computers. ;-)
Also, the conversion has some time gap probably .1 sec or so with the
provided software. I'm suspecting that the delay implies the capturing
window for the software to extract the meaningful digital data from EEG
wave patterns. This can be fatal if one wants to play an action game with
EEG. We need sub-frame response time (<16.7ms) to feed input data. Then,
there is no such capturing window for CLA: truly real-time. IIUC.
BTW I have an EPOC scanner in my room and I like the product, so I'm not
saying the provided software is bad. I'm just talking about the possible
application of CLA. For clarity.
---
B.R.
​Hideaki Suzuki
PS.
I've been messed up with daytime job since the last October which is over
now (very happy)
I hope I can enjoy this OSS activity this year. I'm now reading the ML
archive...
_______________________________________________
nupic mailing list
[email protected]
http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org
