Neal, Conviva is using apache spark streaming in production to monitor delivery of video on demand. They measure and react to CDN (content delivery network) performance per local geography. Davis Shepard gave a presentation on their use of apache spark at AmpCamp 3. I am providing links below to spark streaming documentation, hands on exercises, and video from Davis Sheperd's recent talk.
AmpCamp 3, Hands-on Exercises on AWS EC2 http://ampcamp.berkeley.edu/3/exercises/realtime-processing-with-spark-streaming.html Prerequisite, Setting up an apache spark cluster on AWS EC2 http://ampcamp.berkeley.edu/3/exercises/launching-a-bdas-cluster-on-ec2.html Latest Spark Streaming Programming Guide http://spark.incubator.apache.org/docs/latest/streaming-programming-guide.html User Case Study Talks - Conviva - Davis Sheperd - UC Berkeley AmpLab 2013 http://www.youtube.com/watch?feature=player_detailpage&v=YaayAatdRNs Presentation slides from Davis Sheperd's apache spark streaming talk. http://ampcamp.berkeley.edu/wp-content/uploads/2013/07/AmpCamp3-revision2.pptx
