Hi all,
I would like to start the discussion for a SPIP, Asynchronous Offset
Management in Structured Streaming. The high level summary of the SPIP is
that currently in Structured Streaming we perform a couple of offset
management operations for progress tracking purposes synchronously on the
Just FYI, I'm shepherding this SPIP project.
I think the major meta question would be, "why don't we spend effort on
continuous mode rather than initiating another feature aiming for the
same workload?". Jerry already updated the doc to answer the question, but
I can also share my thoughts about
Jungtaek,
Thanks for taking up the role to shepard this SPIP! Thank you for also
chiming in on your thoughts concerning the continuous mode!
Best,
Jerry
On Tue, Nov 22, 2022 at 5:57 PM Jungtaek Lim
wrote:
> Just FYI, I'm shepherding this SPIP project.
>
> I think the major meta question
