Amazing! Remote shuffle service is an important improvement for batch data processing experience on Flink. It is also a strong requirement in our internal batch business, we would try it soon and give you feedback.
Best, Jing Zhang Martijn Visser <mart...@ververica.com> 于2021年12月1日周三 上午3:25写道： > Hi Yingjie, > > This is great, thanks for sharing. Will you also add it to > https://flink-packages.org/ ? > > Best regards, > > Martijn > > On Tue, 30 Nov 2021 at 17:31, Till Rohrmann <trohrm...@apache.org> wrote: > > > Great news, Yingjie. Thanks a lot for sharing this information with the > > community and kudos to all the contributors of the external shuffle > service > > :-) > > > > Cheers, > > Till > > > > On Tue, Nov 30, 2021 at 2:32 PM Yingjie Cao <kevin.ying...@gmail.com> > > wrote: > > > > > Hi dev & users, > > > > > > We are happy to announce the open source of remote shuffle project [1] > > for > > > Flink. The project is originated in Alibaba and the main motivation is > to > > > improve batch data processing for both performance & stability and > > further > > > embrace cloud native. For more features about the project, please refer > > to > > > [1]. > > > > > > Before going open source, the project has been used widely in > production > > > and it behaves well on both stability and performance. We hope you > enjoy > > > it. Collaborations and feedbacks are highly appreciated. > > > > > > Best, > > > Yingjie on behalf of all contributors > > > > > > [1] https://github.com/flink-extended/flink-remote-shuffle > > > > > >
