Thanks Fred - that is very helpful. > Delivering low latency, high throughput, and stability simultaneously: Right > now, our own tests indicate you can get at most two of these characteristics > out of Spark Streaming at the same time. I know of two parties that have > abandoned Spark Streaming because "pick any two" is not an acceptable answer > to the latency/throughput/stability question for them. > Could you expand a little bit more on stability ? Is it just bursty workloads in terms of peak vs. average throughput ? Also what level of latencies do you find users care about ? Is it on the order of 2-3 seconds vs. 1 second vs. 100s of milliseconds ? >
--------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org