Oooh fascinating. I’m going on call this week so it will take me awhile but I do want to review this :)
On Mon, Aug 7, 2023 at 5:30 PM Pavan Kotikalapudi <pkotikalap...@twilio.com.invalid> wrote: > Hi Spark Dev, > > I have extended traditional DRA to work for structured streaming > use-case. > > Here is an initial Implementation draft PR > https://github.com/apache/spark/pull/42352 and design doc: > https://docs.google.com/document/d/1_YmfCsQQb9XhRdKh0ijbc-j8JKGtGBxYsk_30NVSTWo/edit?usp=sharing > > Please review and let me know what you think. > > Thank you, > > Pavan > -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
