Re: [DISCUSS] Drop Gelly

2022-10-12 Thread Martijn Visser
inal Mail -- > Sender:Martijn Visser > Send Date:Wed Jan 5 02:58:53 2022 > Recipients:Zhipeng Zhang > CC:David Anderson , Till Rohrmann > , dev , User > > Subject:Re: [DISCUSS] Drop Gelly > > Hi Zhipeng, > > I think that we're seeing

Re: Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Yun Gao
Rohrmann , dev , User Subject:Re: [DISCUSS] Drop Gelly Hi Zhipeng, I think that we're seeing more code being externalised, for example with the Flink Remote Shuffle service [1] and the ongoing discussion on the external connector repository [2], it makes sense to go for your second option. Maybe

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Martijn Visser
Hi Zhipeng, I think that we're seeing more code being externalised, for example with the Flink Remote Shuffle service [1] and the ongoing discussion on the external connector repository [2], it makes sense to go for your second option. Maybe it fits under Flink Extended [3]. The main question

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Jing Ge
Hi, thanks Martijn for bringing it up for discussion. I think we could make the discussion a little bit clearer by splitting it into two questions: 1. should Flink drop Gelly? 2. should Flink drop the graph computing? The answer of the first question could be yes, since there have been no

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Zhipeng Zhang
Hi Martijin, Thanks for the feedback. I am not proposing to bundle the new graph library with Alink. I am +1 for dropping the DataSet-based Gelly library, but we probably need a new graph library in Flink for the possible migration. We haven't decided what to do yet and probably need more

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Lukáš Drbal
Hi everyone, We (team in seznam.cz) are actually using the Gelly library for batch anomaly detection in our graphs. It will be very nice to somehow keep this functionality, maybe in a separate repository. Is there any replacement? Best, Lukas On Mon, Jan 3, 2022 at 2:20 PM Martijn Visser

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread Martijn Visser
Hi Zhipeng, Good that you've reached out, I wasn't aware that Gelly is being used in Alink. Are you proposing to write a new graph library as a successor of Gelly and bundle that with Alink? Best regards, Martijn On Tue, 4 Jan 2022 at 02:57, Zhipeng Zhang wrote: > Hi everyone, > > Thanks for

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread Zhipeng Zhang
Hi everyone, Thanks for starting the discussion :) We (Alink team [1]) are actually using part of the Gelly library to support graph algorithms (connected component, single source shortest path, etc.) for users in Alibaba Inc. As DataSet API is going to be dropped, shall we also provide a new

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread David Anderson
Most of the inquiries I've had about Gelly in recent memory have been from folks looking for a streaming solution, and it's only been a handful. +1 for dropping Gelly David On Mon, Jan 3, 2022 at 2:41 PM Till Rohrmann wrote: > I haven't seen any changes or requests to/for Gelly in ages.

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread Till Rohrmann
I haven't seen any changes or requests to/for Gelly in ages. Hence, I would assume that it is not really used and can be removed. +1 for dropping Gelly. Cheers, Till On Mon, Jan 3, 2022 at 2:20 PM Martijn Visser wrote: > Hi everyone, > > Flink is bundled with Gelly, a Graph API library [1].

[DISCUSS] Drop Gelly

2022-01-03 Thread Martijn Visser
Hi everyone, Flink is bundled with Gelly, a Graph API library [1]. This has been marked as approaching end-of-life for quite some time [2]. Gelly is built on top of Flink's DataSet API, which is deprecated and slowly being phased out [3]. It only works on batch jobs. Based on the activity in the