Hi Team, Could I please pull some attention towards the pull request on Spark-Kinesis operability. We have iterated over the patch for past few months, and it would be great to have some final review of the patch. I think its very close now. I would love to work on improvements if any.
This patch would enable much better crash recovery from amazon kinesis, avoiding many throttling errors and resuming from a given timestamp. https://github.com/apache/spark/pull/18029 https://issues.apache.org/jira/browse/SPARK-20168 Cheers, Yash