Hi devs: I think data source management should be supported along with catalogs support. What do you think?
Best, jianjun.xu Cancai Cai <can...@apache.org> 于2024年3月28日周四 13:36写道： > Hi devs: > I think Yuepeng's proposal is very good, maybe we should prioritize it. > > Best, > Cancai Cai > > Yuepeng Pan <panyuep...@apache.org> 于2024年3月27日周三 21:59写道： > > > Hi, devs. > > > > Thank you for the discussion and I'm happy to hear about so much exciting > > comments. Perhaps we should support the availability of high > availability > > . > > > > BTW, Should we make a ordered list for the suggestions mentioned by > > corresponding priority before concluding this discussion ? > > > > Best, > > Yuepeng Pan > > > > On 2024/03/27 09:53:59 wulin wrote: > > > Hi devs： > > > On the roadmap mentioned above, with the maturity of flink/hive/spark > > catalog technology, catalog can greatly improve user experience. I think > we > > should add a function of catalog management to the roadmap. @Huajie > Wang，Do > > you agree？ > > > > > > > 2024年3月27日 17:01，Huajie Wang <benj...@apache.org> 写道： > > > > > > > > hi devs: > > > > > > > > Apache Paimon has graduated to become a top-level Apache project. we > > > > can plan to better support paimon > > > > > > > > > > > > 2024 roadmap: > > > > > > > > 1. Support for PyFlink > > > > 2. Support for Flink CDC 3.0 > > > > 3. Refactor Flink on k8s using k8s-operator > > > > > > > > 4. Integrate Flink sql-gateway > > > > > > > > 5. Support for Apache Spark(Development framework and platform) 6. > > Document > > > > improvements > > > > > > > > 7. Graduate Apache StreamPark (Incubating) as a TLP > > > > > > > > 8. Apache Flink Metrics monitoring solutions > > > > > > > > 9. Support Paimon > > > > > > > > > > > > Best, > > > > Huajie Wang > > > > > > > > > > > > > > > > Huajie Wang <benj...@apache.org> 于2024年3月25日周一 10:37写道： > > > > > > > >> hi: > > > >> > > > >> Welcome back here, The discussion is expected to end this week. Feel > > free > > > >> to join the discussion if you have any new ideas. > > > >> > > > >> > > > >> > > > >> Best, > > > >> Huajie Wang > > > >> > > > >> > > > >> > > > >> Huajie Wang <benj...@apache.org> 于2024年3月4日周一 11:19写道： > > > >> > > > >>> +1 > > > >>> > > > >>> Metrics Monitoring are very important foundational capabilities. > > Apache > > > >>> StreamPark(Incubating) needs to address this part of the capability > > better. > > > >>> I strongly agree with this proposal. > > > >>> > > > >>> 2024 roadmap: > > > >>> > > > >>> 1. Support for PyFlink > > > >>> 2. Support for Flink CDC 3.0 > > > >>> 3. Refactor Flink on k8s using k8s-operator > > > >>> > > > >>> 4. Integrate Flink sql-gateway > > > >>> > > > >>> 5. Support for Apache Spark(Development framework and platform) 6. > > > >>> Document improvements > > > >>> > > > >>> 7. Graduate Apache StreamPark (Incubating) as a TLP > > > >>> > > > >>> 8. Apache Flink Metrics monitoring solutions > > > >>> > > > >>> > > > >>> Best, > > > >>> Huajie Wang > > > >>> > > > >>> > > > >>> > > > >>> shun SUN <sunshu...@gmail.com> 于2024年3月4日周一 11:07写道： > > > >>> > > > >>>> Hi > > > >>>> > > > >>>> Thanks for the roadmap sharing, LGTM! > > > >>>> > > > >>>> Is it possible to add one point: provide monitoring solutions for > > Flink > > > >>>> jobs on yarn as well Kubernetes? > > > >>>> > > > >>>> I would like to take this part in coming months. > > > >>>> > > > >>>> Thanks and regards > > > >>>> Sun Shun > > > >>>> > > > >>>> On Mon, 4 Mar 2024 at 10:58 AM, Huajie Wang <benj...@apache.org> > > wrote: > > > >>>> > > > >>>>> I agree with your proposal: > > > >>>>> > > > >>>>> 1. Support for PyFlink > > > >>>>> 2. Support for Flink CDC 3.0 > > > >>>>> 3. Refactor Flink on k8s using k8s-operator > > > >>>>> > > > >>>>> 4. Integrate Flink sql-gateway > > > >>>>> > > > >>>>> 5. Support for Apache Spark(Development framework and platform) > 6. > > > >>>> Document > > > >>>>> improvements > > > >>>>> > > > >>>>> 7. Graduate Apache StreamPark (Incubating) as a TLP > > > >>>>> > > > >>>>> Welcome more discussions! > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>> Best, > > > >>>>> Huajie Wang > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>> Cancai Cai <can...@apache.org> 于2024年3月2日周六 19:34写道： > > > >>>>> > > > >>>>>> This looks good, +1. > > > >>>>>> A small suggestion, should document improvements also be put > into > > the > > > >>>>> 2024 > > > >>>>>> roadmap? > > > >>>>>> > > > >>>>>> Huajie Wang <benj...@apache.org> 于2024年3月2日周六 18:53写道： > > > >>>>>> > > > >>>>>>> Hello everyone: > > > >>>>>>> > > > >>>>>>> The support capability of Apache StreamPark for Apache Flink > has > > > >>>> been > > > >>>>>>> increasingly improved and stable., with more and more > enterprise > > > >>>> users > > > >>>>>>> using it. This is the effort of all developers, and we are > > > >>>> delighted > > > >>>>>>> to see this. Now I would like to initiate a discussion on the > > > >>>>>>> StreamPark 2024 roadmap, welcoming everyone to participate and > > > >>>> share > > > >>>>>>> their opinions. > > > >>>>>>> > > > >>>>>>> Here are some new features I have in mind for 2024: > > > >>>>>>> > > > >>>>>>> 1. Support for PyFlink > > > >>>>>>> 2. Support for Flink CDC 3.0 > > > >>>>>>> 3. Refactor Flink on k8s using k8s-operator > > > >>>>>>> > > > >>>>>>> 4. Integrate Flink sql-gateway > > > >>>>>>> > > > >>>>>>> 5. Support for Apache Spark(Development framework and platform) > > > >>>>>>> > > > >>>>>>> Looking forward to your opinion. Let's make Apache StramPark > even > > > >>>>> better > > > >>>>>> in > > > >>>>>>> 2024! 🚀 > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> Best, > > > >>>>>>> Huajie Wang > > > >>>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > > > > > > >
