As one of the contributors of flink remote shuffle, I'm glad to hear all
the warm responses! Welcome more people to try the flink remote shuffle and
look forward to your feedback.
Best，
Lijie
Yingjie Cao 于2021年12月1日周三 17:50写道：
> Hi Jiangang,
>
> Great to hear that, welcome to work together to m
Hi Jiangang,
Great to hear that, welcome to work together to make the project better.
Best,
Yingjie
刘建刚 于2021年12月1日周三 下午3:27写道：
> Good work for flink's batch processing!
> Remote shuffle service can resolve the container lost problem and reduce
> the running time for batch jobs once failover.
Good work for flink's batch processing!
Remote shuffle service can resolve the container lost problem and reduce
the running time for batch jobs once failover. We have investigated the
component a lot and welcome Flink's native solution. We will try it and
help improve it.
Thanks,
Liu Jiangang
Yi
Subject:Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch
data processing
Hi Jing,
Great to hear that, collaborations and feedbacks are welcomed.
Best,
Yingjie
Jing Zhang 于2021年12月1日周三 上午10:34写道：
> Amazing!
> Remote shuffle service is an important improvement for batc
Amazing!
Thanks Yingjie and all contributors for your great work.
Best,
Jingsong
On Wed, Dec 1, 2021 at 10:52 AM Yun Tang wrote:
>
> Great news!
> Thanks for all the guys who contributed in this project.
>
> Best
> Yun Tang
>
> On 2021/11/30 16:30:52 Till Rohrmann wrote:
> > Great news, Yingjie
Great news!
Thanks for all the guys who contributed in this project.
Best
Yun Tang
On 2021/11/30 16:30:52 Till Rohrmann wrote:
> Great news, Yingjie. Thanks a lot for sharing this information with the
> community and kudos to all the contributors of the external shuffle service
> :-)
>
> Cheers,
Great news, Yingjie. Thanks a lot for sharing this information with the
community and kudos to all the contributors of the external shuffle service
:-)
Cheers,
Till
On Tue, Nov 30, 2021 at 2:32 PM Yingjie Cao wrote:
> Hi dev & users,
>
> We are happy to announce the open source of remote shuffl
Hi dev & users,
We are happy to announce the open source of remote shuffle project [1] for
Flink. The project is originated in Alibaba and the main motivation is to
improve batch data processing for both performance & stability and further
embrace cloud native. For more features about the project,
Are you using the DataSet or DataStream API?
Yes, most Flink transformations operate on single tuples, but you can
work around it:
- You could write a custom source function, which emits records that
contain X points
(https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/index.html#dat
I'm evaluating for some processing batches of data. As a simple example say I
have 2000 points which I would like to pass through an FIR filter using
functionality provided by the Python scipy libraryjk. The scipy filter is a
simple function which accepts a set of coefficients and the data to
10 matches
Mail list logo
