Re: [DISCUSS] FLIP-48: Pluggable Intermediate Result Storage

2019-09-18 Thread Becket Qin
Hi Stephan, Sorry for the belated reply. You are right that the functionality proposed in this FLIP can be implemented out of the Flink core as an ecosystem project. The main motivation of this FLIP is two folds: 1. Improve the performance of intermediate result sharing in the same session.

Re: [DISCUSS] FLIP-48: Pluggable Intermediate Result Storage

2019-08-15 Thread Stephan Ewen
Sorry for the late response. So many FLIPs these days. I am a bit unsure about the motivation here, and that this need to be a part of Flink. It sounds like this can be perfectly built around Flink as a minimal library on top of it, without any change in the core APIs or runtime. The proposal to