Re: Welcome to Our New Apache Spark Committer and PMCs

2023-10-09 Thread Kent Yao
Congrats! Kent 在 2023年10月7日星期六,John Zhuge 写道: > Congratulations! > > On Fri, Oct 6, 2023 at 6:41 PM Yi Wu wrote: > >> Congrats! >> >> On Sat, Oct 7, 2023 at 9:24 AM XiDuo You wrote: >> >>> Congratulations! >>> >>> Prashant Sharma 于2023年10月6日周五 00:26写道: >>> > >>> > Congratulations  >>> >

Re: Welcome to Our New Apache Spark Committer and PMCs

2023-10-09 Thread Xinrong Meng
Congratulations! On Mon, Oct 9, 2023 at 5:06 AM Kent Yao wrote: > Congrats! > > Kent > > > 在 2023年10月7日星期六,John Zhuge 写道: > >> Congratulations! >> >> On Fri, Oct 6, 2023 at 6:41 PM Yi Wu >> wrote: >> >>> Congrats! >>> >>> On Sat, Oct 7, 2023 at 9:24 AM XiDuo You wrote: >>>

Re: Watermark on late data only

2023-10-09 Thread Jungtaek Lim
Technically speaking, "late data" represents the data which cannot be processed due to the fact the engine threw out the state associated with the data already. That said, the only reason watermark does exist for streaming is to handle stateful operators. From the engine's point of view, there is