You may already read it on twitter, I made a little BSP for this: https://github.com/thomasjungblut/thomasjungblut-common/blob/master/src/de/jungblut/bsp/DataStreamProcessing.java
Maybe we can integrate this as an example? I would replace the while(true) loop with a finite amount of tweets to process. And if a user does not give an account, use a global timeline. Anything we should add for real time processing? 2011/10/13 Thomas Jungblut <[email protected]> > Cool idea, should we provide some simple producer/comsumer queue example > which gets information from the outside world? > e.G. a twitter stream? > > > 2011/10/13 Tommaso Teofili <[email protected]> > >> +1 ! >> >> Tommaso >> >> 2011/10/13 Edward J. Yoon <[email protected]> >> >> > Hi, >> > >> > I just thought I'd share a little idea with you. >> > >> > Recently, I met some people who want to use Hama or already made >> > something. I expected only some large-scale/batch-oriented data >> > processing applications but heard very interesting use cases. One was >> > that a continuous processing using infinite loop in a bsp function of >> > each task. >> > >> > As you know, the real-time processing can be applied to various fields >> > e.g., trends, hot search keywords, traffic mornitoring .., etc. It'd >> > be nice if we can add some example to show how real-time applications >> > can be structured as a sequence of supersteps. >> > >> > -- >> > Best Regards, Edward J. Yoon >> > @eddieyoon >> > >> > > > > -- > Thomas Jungblut > Berlin <[email protected]> > -- Thomas Jungblut Berlin <[email protected]>
