Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
+1 Dongjoon. On 2022/12/01 13:17:00 Wenchen Fan wrote: > +1 > > On Thu, Dec 1, 2022 at 12:31 PM Shixiong Zhu wrote: > > > +1 > > > > > > On Wed, Nov 30, 2022 at 8:04 PM Hyukjin Kwon wrote: > > > >> +1 > >> > >> On Thu, 1 Dec 2022 at 12:39, Mridul Muralidharan > >> wrote: > >> > >>> > >>> +1 > >>> > >>> Regards, > >>> Mridul > >>> > >>> On Wed, Nov 30, 2022 at 8:55 PM Xingbo Jiang > >>> wrote: > >>> > >>>> +1 > >>>> > >>>> On Wed, Nov 30, 2022 at 5:59 PM Jungtaek Lim < > >>>> kabhwan.opensou...@gmail.com> wrote: > >>>> > >>>>> Starting with +1 from me. > >>>>> > >>>>> On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim < > >>>>> kabhwan.opensou...@gmail.com> wrote: > >>>>> > >>>>>> Hi all, > >>>>>> > >>>>>> I'd like to start the vote for SPIP: Asynchronous Offset Management > >>>>>> in Structured Streaming. > >>>>>> > >>>>>> The high level summary of the SPIP is that we propose a couple of > >>>>>> improvements on offset management in microbatch execution to lower down > >>>>>> processing latency, which would help for certain types of workloads. > >>>>>> > >>>>>> References: > >>>>>> > >>>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> > >>>>>>- SPIP doc > >>>>>> > >>>>>> <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> > >>>>>>- Discussion thread > >>>>>><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> > >>>>>> > >>>>>> Please vote on the SPIP for the next 72 hours: > >>>>>> > >>>>>> [ ] +1: Accept the proposal as an official SPIP > >>>>>> [ ] +0 > >>>>>> [ ] -1: I don’t think this is a good idea because … > >>>>>> > >>>>>> Thanks! > >>>>>> Jungtaek Lim (HeartSaVioR) > >>>>>> > >>>>> > - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
+1 On Thu, Dec 1, 2022 at 12:31 PM Shixiong Zhu wrote: > +1 > > > On Wed, Nov 30, 2022 at 8:04 PM Hyukjin Kwon wrote: > >> +1 >> >> On Thu, 1 Dec 2022 at 12:39, Mridul Muralidharan >> wrote: >> >>> >>> +1 >>> >>> Regards, >>> Mridul >>> >>> On Wed, Nov 30, 2022 at 8:55 PM Xingbo Jiang >>> wrote: >>> >>>> +1 >>>> >>>> On Wed, Nov 30, 2022 at 5:59 PM Jungtaek Lim < >>>> kabhwan.opensou...@gmail.com> wrote: >>>> >>>>> Starting with +1 from me. >>>>> >>>>> On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim < >>>>> kabhwan.opensou...@gmail.com> wrote: >>>>> >>>>>> Hi all, >>>>>> >>>>>> I'd like to start the vote for SPIP: Asynchronous Offset Management >>>>>> in Structured Streaming. >>>>>> >>>>>> The high level summary of the SPIP is that we propose a couple of >>>>>> improvements on offset management in microbatch execution to lower down >>>>>> processing latency, which would help for certain types of workloads. >>>>>> >>>>>> References: >>>>>> >>>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> >>>>>>- SPIP doc >>>>>> >>>>>> <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> >>>>>>- Discussion thread >>>>>><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> >>>>>> >>>>>> Please vote on the SPIP for the next 72 hours: >>>>>> >>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>> [ ] +0 >>>>>> [ ] -1: I don’t think this is a good idea because … >>>>>> >>>>>> Thanks! >>>>>> Jungtaek Lim (HeartSaVioR) >>>>>> >>>>>
Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
+1 On Wed, Nov 30, 2022 at 8:04 PM Hyukjin Kwon wrote: > +1 > > On Thu, 1 Dec 2022 at 12:39, Mridul Muralidharan wrote: > >> >> +1 >> >> Regards, >> Mridul >> >> On Wed, Nov 30, 2022 at 8:55 PM Xingbo Jiang >> wrote: >> >>> +1 >>> >>> On Wed, Nov 30, 2022 at 5:59 PM Jungtaek Lim < >>> kabhwan.opensou...@gmail.com> wrote: >>> >>>> Starting with +1 from me. >>>> >>>> On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim < >>>> kabhwan.opensou...@gmail.com> wrote: >>>> >>>>> Hi all, >>>>> >>>>> I'd like to start the vote for SPIP: Asynchronous Offset Management in >>>>> Structured Streaming. >>>>> >>>>> The high level summary of the SPIP is that we propose a couple of >>>>> improvements on offset management in microbatch execution to lower down >>>>> processing latency, which would help for certain types of workloads. >>>>> >>>>> References: >>>>> >>>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> >>>>>- SPIP doc >>>>> >>>>> <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> >>>>>- Discussion thread >>>>><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> >>>>> >>>>> Please vote on the SPIP for the next 72 hours: >>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP >>>>> [ ] +0 >>>>> [ ] -1: I don’t think this is a good idea because … >>>>> >>>>> Thanks! >>>>> Jungtaek Lim (HeartSaVioR) >>>>> >>>>
Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
+1 On Thu, 1 Dec 2022 at 12:39, Mridul Muralidharan wrote: > > +1 > > Regards, > Mridul > > On Wed, Nov 30, 2022 at 8:55 PM Xingbo Jiang > wrote: > >> +1 >> >> On Wed, Nov 30, 2022 at 5:59 PM Jungtaek Lim < >> kabhwan.opensou...@gmail.com> wrote: >> >>> Starting with +1 from me. >>> >>> On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim < >>> kabhwan.opensou...@gmail.com> wrote: >>> >>>> Hi all, >>>> >>>> I'd like to start the vote for SPIP: Asynchronous Offset Management in >>>> Structured Streaming. >>>> >>>> The high level summary of the SPIP is that we propose a couple of >>>> improvements on offset management in microbatch execution to lower down >>>> processing latency, which would help for certain types of workloads. >>>> >>>> References: >>>> >>>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> >>>>- SPIP doc >>>> >>>> <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> >>>>- Discussion thread >>>><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> >>>> >>>> Please vote on the SPIP for the next 72 hours: >>>> >>>> [ ] +1: Accept the proposal as an official SPIP >>>> [ ] +0 >>>> [ ] -1: I don’t think this is a good idea because … >>>> >>>> Thanks! >>>> Jungtaek Lim (HeartSaVioR) >>>> >>>
Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
+1 Regards, Mridul On Wed, Nov 30, 2022 at 8:55 PM Xingbo Jiang wrote: > +1 > > On Wed, Nov 30, 2022 at 5:59 PM Jungtaek Lim > wrote: > >> Starting with +1 from me. >> >> On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim < >> kabhwan.opensou...@gmail.com> wrote: >> >>> Hi all, >>> >>> I'd like to start the vote for SPIP: Asynchronous Offset Management in >>> Structured Streaming. >>> >>> The high level summary of the SPIP is that we propose a couple of >>> improvements on offset management in microbatch execution to lower down >>> processing latency, which would help for certain types of workloads. >>> >>> References: >>> >>>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> >>>- SPIP doc >>> >>> <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> >>>- Discussion thread >>><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> >>> >>> Please vote on the SPIP for the next 72 hours: >>> >>> [ ] +1: Accept the proposal as an official SPIP >>> [ ] +0 >>> [ ] -1: I don’t think this is a good idea because … >>> >>> Thanks! >>> Jungtaek Lim (HeartSaVioR) >>> >>
Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
+1 On Wed, Nov 30, 2022 at 5:59 PM Jungtaek Lim wrote: > Starting with +1 from me. > > On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim > wrote: > >> Hi all, >> >> I'd like to start the vote for SPIP: Asynchronous Offset Management in >> Structured Streaming. >> >> The high level summary of the SPIP is that we propose a couple of >> improvements on offset management in microbatch execution to lower down >> processing latency, which would help for certain types of workloads. >> >> References: >> >>- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> >>- SPIP doc >> >> <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> >>- Discussion thread >><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> >> >> Please vote on the SPIP for the next 72 hours: >> >> [ ] +1: Accept the proposal as an official SPIP >> [ ] +0 >> [ ] -1: I don’t think this is a good idea because … >> >> Thanks! >> Jungtaek Lim (HeartSaVioR) >> >
Re: [VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
Starting with +1 from me. On Thu, Dec 1, 2022 at 10:54 AM Jungtaek Lim wrote: > Hi all, > > I'd like to start the vote for SPIP: Asynchronous Offset Management in > Structured Streaming. > > The high level summary of the SPIP is that we propose a couple of > improvements on offset management in microbatch execution to lower down > processing latency, which would help for certain types of workloads. > > References: > >- JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> >- SPIP doc > > <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> >- Discussion thread ><https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> > > Please vote on the SPIP for the next 72 hours: > > [ ] +1: Accept the proposal as an official SPIP > [ ] +0 > [ ] -1: I don’t think this is a good idea because … > > Thanks! > Jungtaek Lim (HeartSaVioR) >
[VOTE][SPIP] Asynchronous Offset Management in Structured Streaming
Hi all, I'd like to start the vote for SPIP: Asynchronous Offset Management in Structured Streaming. The high level summary of the SPIP is that we propose a couple of improvements on offset management in microbatch execution to lower down processing latency, which would help for certain types of workloads. References: - JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> - SPIP doc <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> - Discussion thread <https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> Please vote on the SPIP for the next 72 hours: [ ] +1: Accept the proposal as an official SPIP [ ] +0 [ ] -1: I don’t think this is a good idea because … Thanks! Jungtaek Lim (HeartSaVioR)