> would the repository ... be removed ... ?
Yes, I would remove it once it is merged into a version of flink that is
supported by GCP dataproc. It exists now (and I am creating releases and
maven artifacts for it) to unblock users in the interim period.
-Daniel
On Thu, Mar 16, 2023 at 3:32 PM
Hi Daniel,
> I don't know how to get to this point, it sounds like more of an
organizational constraint than a technical one though- who is responsible
for the same role for the standard Pub/Sub connector? I'm working with the
Pub/Sub team right now on prioritization of supporting the flink
Hi all,
Thank you for the feedback. Responses inline.
> we need feedback from a Committer who would review and help maintain it
going forward. Ideally, this Committer would guide one or more contributors
from Google to Committership so that Google could step up and maintain Flink
's PubSub and
Hi all,
I agree with Konstantin, mentoring is important especially on this new
connector framework. Long time maintenance is even more important.
I could not mentor you on this topic because I'm not a committer on the
Flink project and because I don't know Pub/Sub tech. That being said I
Hi Daniel,
I think, it would be great to have a PubSub Lite Connector in Flink. Before
you put this proposal up for a vote, though, we need feedback from a
Committer who would review and help maintain it going forward. Ideally,
this Committer would guide one or more contributors from Google to
Hi,
I agree with Ryan, even if clients might be totally different the
backend technologies are the same so hosting them in the same repo makes
sense. Similar thinking made us put all the Cassandra related connectors
in the same cassandra repo.
Etienne
Le 02/03/2023 à 14:43, Daniel Collins
Hello Ryan,
Unfortunately there's not much shared logic between the two- the clients
have to look fundamentally different since the Pub/Sub Lite client exposes
partitions to the split level for repeatable reads.
I have no objection to this living in the same repo as the Pub/Sub
connector, if
Hello Daniel! Quite a while ago, I started porting the Pub/Sub connector
(from an existing PR) to the new source API in the new
flink-connector-gcp-pubsub repository [PR2]. As Martijn mentioned, there
hasn't been a lot of attention on this connector; any community involvement
would be
Hello all,
I'd like to start an official discuss thread for adding a Pub/Sub Lite
Connector to Flink. We've had requests from our users to add flink support,
and are willing to maintain and support this connector long term from the
product team.
The proposal is
