I've written pulsar-flink and pulsar-spark connectors before. Please feel free to ping me if you need some help.
Best, Yijie On Mon, Oct 28, 2019 at 1:21 AM Sijie Guo <s...@streamnative.io> wrote: > Add Yijie in the loop. He can help from Pulsar side. > > - Sijie > > On Sat, Oct 26, 2019 at 7:23 PM Taher Koitawala <taher...@gmail.com> > wrote: > >> Awesome. Thanks Max. Will definitely keep the community posted on this. >> >> On Sat, Oct 26, 2019, 4:21 PM Maximilian Michels <m...@apache.org> wrote: >> >>> Awesome. I've made you a contributor, so you can also create issues and >>> assign yourself now. >>> >>> Please let us know about the progress once you start writing the >>> connector. >>> >>> Thanks, >>> Max >>> >>> On 26.10.19 12:36, Taher Koitawala wrote: >>> > Thank you Alex and Max, >>> > My jira id is taherk77. Please add me. >>> > >>> > Regards, >>> > Taher Koitawala >>> > >>> > On Sat, Oct 26, 2019, 3:53 PM Maximilian Michels <m...@apache.org >>> > <mailto:m...@apache.org>> wrote: >>> > >>> > That sounds great. How about you start looking into this Taher? If >>> > necessary, Sijie could provide additional insight into Pulsar. >>> > >>> > Please create a JIRA account so we can assign you to >>> > https://issues.apache.org/jira/browse/BEAM-8218 >>> > >>> > Thanks, >>> > Max >>> > >>> > On 26.10.19 12:08, Alex Van Boxel wrote: >>> > > Hey Taher, do you have a Jira account? Then I will assign the >>> > ticket to >>> > > you. I made the ticket because we should have one, feel free to >>> > take the >>> > > lead on this one. >>> > > >>> > > _/ >>> > > _/ Alex Van Boxel >>> > > >>> > > >>> > > On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala >>> > <taher...@gmail.com <mailto:taher...@gmail.com> >>> > > <mailto:taher...@gmail.com <mailto:taher...@gmail.com>>> wrote: >>> > > >>> > > I would be interested in contributing to the Pulsar Beam >>> > connector. >>> > > That's one of the reasons i started the email thread. >>> > > >>> > > >>> > > Regards, >>> > > Taher Koitawala >>> > > >>> > > On Sat, Oct 26, 2019, 9:41 AM Sijie Guo <s...@streamnative.io >>> > <mailto:s...@streamnative.io> >>> > > <mailto:s...@streamnative.io <mailto:s...@streamnative.io>>> >>> wrote: >>> > > >>> > > This is Sijie Guo from StreamNative and Pulsar PMC. >>> > > >>> > > Maximilian - thank you for adding us in the email >>> thread! >>> > > >>> > > We do have one roadmap item for adding a Beam connector >>> for >>> > > Pulsar. It was planned for this quarter, but we haven’t >>> > started >>> > > the implementation yet. If the Beam community is >>> > interested in >>> > > it, we are happy to collaborate with Beam community. >>> > > >>> > > Thanks, >>> > > Sijie >>> > > >>> > > On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels >>> > > <m...@apache.org <mailto:m...@apache.org> >>> > <mailto:m...@apache.org <mailto:m...@apache.org>>> wrote: >>> > > >>> > > It would be great to have a Pulsar connector. We >>> > might want >>> > > to ask the >>> > > folks from StreamNative (in CC). Any plans? :) >>> > > >>> > > Cheers, >>> > > Max >>> > > >>> > > On 24.10.19 18:31, Pablo Estrada wrote: >>> > > > There's a JIRA issue to track this: >>> > > > https://issues.apache.org/jira/browse/BEAM-8218 >>> > > > >>> > > > Alex was kind enough to file it. +Alex Van Boxel >>> > > > <mailto:a...@vanboxel.be <mailto: >>> a...@vanboxel.be> >>> > <mailto:a...@vanboxel.be <mailto:a...@vanboxel.be>>> : ) >>> > > > Best >>> > > > -P >>> > > > >>> > > > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala >>> > > <taher...@gmail.com <mailto:taher...@gmail.com> >>> > <mailto:taher...@gmail.com <mailto:taher...@gmail.com>> >>> > > > <mailto:taher...@gmail.com >>> > <mailto:taher...@gmail.com> <mailto:taher...@gmail.com >>> > <mailto:taher...@gmail.com>>>> >>> > > wrote: >>> > > > >>> > > > Hi Reza, >>> > > > Thanks for your reply. However >>> i >>> > do not >>> > > see Pulsar >>> > > > listed in there. Should we file a jira? >>> > > > >>> > > > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni >>> > > <r...@google.com <mailto:r...@google.com> >>> > <mailto:r...@google.com <mailto:r...@google.com>> >>> > > > <mailto:r...@google.com <mailto: >>> r...@google.com> >>> > <mailto:r...@google.com <mailto:r...@google.com>>>> wrote: >>> > > > >>> > > > Hi Taher, >>> > > > >>> > > > You can see the list of current and >>> > wip IO's here: >>> > > > >>> > > > >>> https://beam.apache.org/documentation/io/built-in/ >>> > > > >>> > > > Cheers >>> > > > >>> > > > Reza >>> > > > >>> > > > On Thu, 24 Oct 2019 at 13:56, Taher >>> Koitawala >>> > > > <taher...@gmail.com >>> > <mailto:taher...@gmail.com> <mailto:taher...@gmail.com >>> > <mailto:taher...@gmail.com>> >>> > > <mailto:taher...@gmail.com >>> > <mailto:taher...@gmail.com> <mailto:taher...@gmail.com >>> > <mailto:taher...@gmail.com>>>> wrote: >>> > > > >>> > > > Hi All, >>> > > > Been wanting to know if we >>> > have a >>> > > Pulsar connector >>> > > > for Beam. Pulsar is another messaging >>> > queue >>> > > like Kafka and I >>> > > > would like to build a streaming >>> > pipeline with >>> > > Pulsar. Any >>> > > > help would be appreciated.. >>> > > > >>> > > > >>> > > > Regards, >>> > > > Taher Koitawala >>> > > > >>> > > > >>> > > > >>> > > > -- >>> > > > >>> > > > This email may be confidential and >>> > privileged. If >>> > > you received >>> > > > this communication by mistake, please >>> don't >>> > > forward it to anyone >>> > > > else, please erase all copies and >>> attachments, >>> > > and please let me >>> > > > know that it has gone to the wrong >>> person. >>> > > > >>> > > > The above terms reflect a potential >>> business >>> > > arrangement, are >>> > > > provided solely as a basis for further >>> > > discussion, and are not >>> > > > intended to be and do not constitute a >>> legally >>> > > binding >>> > > > obligation. No legally binding >>> obligations >>> > will >>> > > be created, >>> > > > implied, or inferred until an agreement >>> in >>> > final >>> > > form is >>> > > > executed in writing by all parties >>> involved. >>> > > > >>> > > >>> > >>> >>