Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-17 Thread Daniel Collins
, but > wanted to check with you. > > Best regards, > > Martijn > > On Tue, Mar 14, 2023 at 4:09 AM Daniel Collins > > wrote: > > > Hi all, > > > > Thank you for the feedback. Responses inline. > > > > > we need feedback from a Committer

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-13 Thread Daniel Collins
c...@apache.org>: > > > >> Hi, > >> > >> I agree with Ryan, even if clients might be totally different the > >> backend technologies are the same so hosting them in the same repo makes > >> sense. Similar thinking made us put all the Cassandra re

[VOTE] FLIP-299 Pub/Sub Lite Connector

2023-03-06 Thread Daniel Collins
Hello all, This is the vote thread for FLIP-299 https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240885055 to add a Pub/Sub Lite connector. I would like to add this to the same repo and maven artifacts as the flink pubsub connector, per a suggestion on the DISCUSS thread, but

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-02 Thread Daniel Collins
be with Lite, but I do recall > that they share many concepts and _some_ dependencies. > > All my best, Ryan > > > On Wed, Mar 1, 2023 at 11:21 PM Daniel Collins > > wrote: > > > Hello all, > > > > I'd like to start an official discuss thread for adding a Pub/Sub

[DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-01 Thread Daniel Collins
Hello all, I'd like to start an official discuss thread for adding a Pub/Sub Lite Connector to Flink. We've had requests from our users to add flink support, and are willing to maintain and support this connector long term from the product team. The proposal is

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-03-01 Thread Daniel Collins
Thanks Danny! I've written a FLIP doc and will send out a new email thread. On Wed, Mar 1, 2023 at 2:43 PM Danny Cranmer wrote: > Hey Daniel, I have granted you access. Please try again. > > Thanks, > Danny > > On Wed, Mar 1, 2023 at 6:48 PM Daniel Collins >

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-03-01 Thread Daniel Collins
Hello, It appears that I still do not have the ability to create Confluence pages? Could someone possibly grant me access? -Daniel On Tue, Feb 28, 2023 at 10:20 AM Daniel Collins wrote: > Thanks! My Jira username is `dpcollins-google`. > > -Daniel > > On Tue, Feb 28, 2023 at 1

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-02-28 Thread Daniel Collins
Thanks! My Jira username is `dpcollins-google`. -Daniel On Tue, Feb 28, 2023 at 10:19 AM Martijn Visser wrote: > Hi Daniel, > > If you can provide your Jira username, those permissions can be granted. > > Best regards, > > Martijn > > On Tue, Feb 28, 2023 at 3:13 P

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-02-28 Thread Daniel Collins
Hello, Absent any comments, I was attempting to create a connector FLIP as described above, however it appears that I do not have permissions to edit confluence to do so. Can someone please add access for me? -Daniel On Mon, Feb 27, 2023 at 10:28 AM Daniel Collins wrote: > Hello Mart

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-02-27 Thread Daniel Collins
> [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP+Connector+Template > [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws > > On Mon, Feb 27, 2023 at 9:44 AM Daniel Collins > > wrote: > > > Hello flink devs, > > > > My name is

Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-02-27 Thread Daniel Collins
Hello flink devs, My name is Daniel, I'm the tech lead for Google's Pub/Sub Lite streaming system, which is a lower cost streaming data system with semantics more similar to OSS streaming solutions. I've authored a source and sink connector for flink and load tested it at GiB/s scale- what would

[jira] [Created] (FLINK-31229) Implement a Pub/Sub Lite source and sink

2023-02-26 Thread Daniel Collins (Jira)
Daniel Collins created FLINK-31229: -- Summary: Implement a Pub/Sub Lite source and sink Key: FLINK-31229 URL: https://issues.apache.org/jira/browse/FLINK-31229 Project: Flink Issue Type: New