am having trouble with streaming performance. My main problem is how to do a sliding window calculation where the ratio between the window size and the step size is relatively large (hundreds) without recalculating everything all the time.
I created a simple example of what I am aiming at with what I have so far which is detailed in http://stackoverflow.com/questions/41266956/apache-spark-streaming-performance I was hoping someone can point me to what I am doing wrong. Thanks, Assaf.
