Chris,
Think I will check back with you to see if you made progress on this issue.
Any good news so far? Thanks. Once again, I really appreciate you look into
this issue.
Thanks,
Wei
On Thu, Aug 28, 2014 at 4:44 PM, Chris Fregly ch...@fregly.com wrote:
great question, wei. this is very
great question, wei. this is very important to understand from a
performance perspective. and this extends is beyond kinesis - it's for any
streaming source that supports shards/partitions.
i need to do a little research into the internals to confirm my theory.
lemme get back to you!
-chris
We are exploring using Kinesis and spark streaming together. I took at a
look at the kinesis receiver code in 1.1.0. I have a question regarding
kinesis partition spark streaming partition. It seems to be pretty
difficult to align these partitions.
Kinesis partitions a stream of data into
