Re: [DISCUSS] Update Flink Roadmap

2023-09-01 Thread Jark Wu
Thank you all for helping with the roadmap documentation. I have merged the roadmap pull request. Cheers, Jark On Wed, 23 Aug 2023 at 15:26, Jing Ge wrote: > Thanks Jark, +1 for the OLAP :-) > > Best regards, > Jing > > On Sun, Aug 20, 2023 at 5:04 PM Jark Wu wrote: > > > Hi all, > > > > I

Re: [DISCUSS] Update Flink Roadmap

2023-08-23 Thread Jing Ge
Thanks Jark, +1 for the OLAP :-) Best regards, Jing On Sun, Aug 20, 2023 at 5:04 PM Jark Wu wrote: > Hi all, > > I have addressed another bunch of comments on the Google doc (mainly about > the OLAP roadmap). > And I have opened a pull request for the website: >

Re: [DISCUSS] Update Flink Roadmap

2023-08-20 Thread ConradJam
+1 Thanks for all suggest. It looks great that in feature Jark Wu 于2023年8月20日周日 23:03写道: > Hi all, > > I have addressed another bunch of comments on the Google doc (mainly about > the OLAP roadmap). > And I have opened a pull request for the website: >

Re: [DISCUSS] Update Flink Roadmap

2023-08-20 Thread Jark Wu
Hi all, I have addressed another bunch of comments on the Google doc (mainly about the OLAP roadmap). And I have opened a pull request for the website: https://github.com/apache/flink-web/pull/672 Please help to review it and continue the discussion on the pull request, thanks a lot! Best, Jark

Re: [DISCUSS] Update Flink Roadmap

2023-08-14 Thread Xintong Song
Thanks for driving this, Jark. The current draft looks good to me. I think it is good to open a PR with it. And if there are other comments, we can discuss them during the PR review. I also added a few minor comments in the draft regarding the feature radar. Those can also be discussed on the

Re: [DISCUSS] Update Flink Roadmap

2023-08-14 Thread Shammon FY
Hi Jark, Sounds good and I would love to, thanks! I will involve you and Xingtong on the document after updating. Best, Shammon FY On Mon, Aug 14, 2023 at 10:39 PM Jark Wu wrote: > Hi Shammon, > > Sure, could you help to draft a subsection about this in the google doc? > > Best, > Jark > >

Re: [DISCUSS] Update Flink Roadmap

2023-08-14 Thread Jark Wu
Hi Shammon, Sure, could you help to draft a subsection about this in the google doc? Best, Jark > 2023年8月14日 20:30,Shammon FY 写道: > > Thanks @Jark for driving the Flink Roadmap. > > As we discussed olap in the thread [1] and according to the suggestions from > @Xingtong Song, could we add

Re: [DISCUSS] Update Flink Roadmap

2023-08-14 Thread Shammon FY
Thanks @Jark for driving the Flink Roadmap. As we discussed olap in the thread [1] and according to the suggestions from @Xingtong Song, could we add a subsection in `Towards Streaming Warehouses` or `Performance` that the short-lived query in Flink Session Cluster is one of the future directions

Re: [DISCUSS] Update Flink Roadmap

2023-08-14 Thread Jark Wu
Thank you everyone for helping polish the roadmap [1]. I think I have addressed all the comments and we have included all ongoing parts of Flink. Please feel free to take a last look. I'm going to prepare the pull request if there are no more concerns. Best, Jark [1]:

Re: [DISCUSS] Update Flink Roadmap

2023-08-12 Thread Yuan Mei
Sorry for taking so long I've added a section about Flink Disaggregated State Management Evolution in the attached doc. I found some of the contents might be overlapped with the "large-scale streaming jobs". So that part might need some changes as well. Please let me know what you think. Best

Re: [DISCUSS] Update Flink Roadmap

2023-07-23 Thread Yuan Mei
Sorry have missed this email and respond a bit late. I will put a draft for the long-term vision for the state as well as large-scale state support into the roadmap. Best Yuan On Mon, Jul 17, 2023 at 10:34 AM Jark Wu wrote: > Hi Jiabao, > > Thank you for your suggestions. I have added them to

Re: [DISCUSS] Update Flink Roadmap

2023-07-16 Thread Jark Wu
Hi Jiabao, Thank you for your suggestions. I have added them to the "Going Beyond a SQL Stream/Batch Processing Engine" and "Large-Scale State Jobs" sections. Best, Jark On Thu, 13 Jul 2023 at 16:06, Jiabao Sun wrote: > Thanks Jark and Martijn for driving this. > > There are two suggestions

Re: [DISCUSS] Update Flink Roadmap

2023-07-13 Thread Jiabao Sun
Thanks Jark and Martijn for driving this. There are two suggestions about the Table API: - Add the JSON type to adapt to the no sql database type. - Remove changelog normalize operator for upsert stream. Best, Jiabao > 2023年7月13日 下午3:49,Jark Wu 写道: > > Hi all, > > Sorry for taking so long

Re: [DISCUSS] Update Flink Roadmap

2023-07-13 Thread Jark Wu
Hi all, Sorry for taking so long back here. Martijn and I have drafted the first version of the updated roadmap, including the updated feature radar reflecting the current state of different components. https://docs.google.com/document/d/12BDiVKEsY-f7HI3suO_IxwzCmR04QcVqLarXgyJAb7c/edit Feel

Re: [DISCUSS] Update Flink Roadmap

2023-06-01 Thread Jing Ge
Hi Jark, Fair enough. Let's do it like you suggested. Thanks! Best regards, Jing On Thu, Jun 1, 2023 at 6:00 PM Jark Wu wrote: > Hi Jing, > > This thread is for discussing the roadmap for versions 1.18, 2.0, and even > more. > One of the outcomes of this discussion will be an updated version

Re: [DISCUSS] Update Flink Roadmap

2023-06-01 Thread Jark Wu
Hi Jing, This thread is for discussing the roadmap for versions 1.18, 2.0, and even more. One of the outcomes of this discussion will be an updated version of the current roadmap. Let's work together on refining the roadmap in this thread. Best, Jark On Thu, 1 Jun 2023 at 23:25, Jing Ge wrote:

Re: [DISCUSS] Update Flink Roadmap

2023-06-01 Thread Jing Ge
Hi Jark, Thanks for driving it! For point 2, since we are developing 1.18 now, does it make sense to update the roadmap this time while we are releasing 1.18? This discussion thread will be focusing on the Flink 2.0 roadmap, as you mentioned previously. WDYT? Best regards, Jing On Thu, Jun 1,

[DISCUSS] Update Flink Roadmap

2023-06-01 Thread Jark Wu
Hi all, Martijn and I would like to initiate a discussion on the Flink roadmap, which should cover the project's long-term roadmap and the regular update mechanism. Xintong has already started a discussion about Flink 2.0 planning. One of the points raised in that discussion is that we should