On Mon, Jun 9, 2014 at 2:27 PM, P. Taylor Goetz <[email protected]> wrote:
> There is one study that I’m aware of that claims Spark streaming is > insanely faster than Storm. I like your way of describing the two tools as starting from differing extremes with a common territory around micro-batching. As such, it is hardly surprising that either system looks insanely faster on their home turf. I can imagine that if storm is compared on record at a time apps (with a few millisecond latency) then it looks insanely faster than what would happen if you distort Spark streaming to have micro-batches of, say, 100 ms. Not only would Spark grump about the tiny batch times, but it would look 100 x slower right out of the gate. The same game can undoubtedly be played at the other extreme to make Spark look really spiffy. Such comparisons are essentially vacuous and just a measure that one tool doesn't fit all applications.
