Hello NuPIC, TL;DR: Go to https://river-view.herokuapp.com/ for free live temporal streaming data.
At the last hackathon, one of our teams [1] found a data source for live NYC traffic speeds [2], but it had no historical values at all. I encouraged them to query the URL every ten minutes and collect data over time, but it was barely enough to get anything useful over the weekend. I have been working on an HTM Engine application that analyzes NYC traffic as well [3]. In order to get the live & historical traffic data I needed to build my HTM application, I needed a data service that collected the traffic info at regular intervals and provided a time-boxed window of the data, so I made a framework that provides this. It is called River View: https://river-view.herokuapp.com/. You can find the source code in nupic-community [4]. River View is a Public Temporal Streaming Data Service Framework (yes, that's a mouthful!). It provides a pluggable interface for users to expose temporal data streams in a time-boxed format that is easily query-able. (Here's an example of oceanographic data collected at Chicago beaches [5].) It was built to provide a longer-lasting historical window for public data sources that provide only real-time data snapshots, especially for sensor data from public government services like weather, traffic, and geological data. The type of streaming temporal data contained within River View is primed for processing with Hierarchical Temporal Memory (HTM) systems like NuPIC. And you can create your own rivers by following these instructions [6]. I hope some of you find this tool useful for running HTM models on real live data. It has certainly made my work with HTM Engine much easier. If you have any ideas about other public data sources that could be added to River View, please file a feature request [7] or write a river yourself [6]. [1] https://www.youtube.com/watch?v=ecSlW6zFS-g&index=17&list=PL3yXMgtrZmDpDhDZvixTUubv9R9cpZK4T [2] http://207.251.86.229/nyc-links-cams/LinkSpeedQuery.txt [3] https://github.com/rhyolight/htmengine-traffic-tutorial [4] https://github.com/nupic-community/river-view [5] https://river-view.herokuapp.com/chicago-water-temps/Rainbow%20Beach/data.html?limit=500 [6] https://github.com/nupic-community/river-view/wiki/Creating-a-River [7] https://github.com/nupic-community/river-view/issues/new Regards, --------- Matt Taylor OS Community Flag-Bearer Numenta
