Good work for flink's batch processing! Remote shuffle service can resolve the container lost problem and reduce the running time for batch jobs once failover. We have investigated the component a lot and welcome Flink's native solution. We will try it and help improve it.
Thanks, Liu Jiangang Yingjie Cao <kevin.ying...@gmail.com> 于2021年11月30日周二 下午9:33写道： > Hi dev & users, > > We are happy to announce the open source of remote shuffle project [1] for > Flink. The project is originated in Alibaba and the main motivation is to > improve batch data processing for both performance & stability and further > embrace cloud native. For more features about the project, please refer to > [1]. > > Before going open source, the project has been used widely in production > and it behaves well on both stability and performance. We hope you enjoy > it. Collaborations and feedbacks are highly appreciated. > > Best, > Yingjie on behalf of all contributors > > [1] https://github.com/flink-extended/flink-remote-shuffle >
