Re: Apache Pulsar component for Hudi
No worries. done. Please claim the ticket. On Sun, Sep 22, 2019 at 8:58 AM Vinay Patil wrote: > HI Vinoth, > > My bad should have specified in the earlier mail :) > > Jira id : vinaypatil18 > > > Regards, > Vinay Patil > > > On Sun, Sep 22, 2019 at 7:34 PM Vinoth Chandar wrote: > > > sure. whats your jira id? > > > > On Sat, Sep 21, 2019 at 3:40 AM Vinay Patil > > wrote: > > > > > Hi, > > > > > > Interested to take this up, can you please provide me contributor > > > permissions and assign this task to me. > > > > > > Regards, > > > Vinay Patil > > > > > > > > > On Thu, Sep 12, 2019 at 2:25 PM vbal...@apache.org > > > > wrote: > > > > > > > > > > > +1 for adding new types of data pipes. On Thursday, September 12, > > > > 2019, 01:39:20 AM PDT, taher koitawala wrote: > > > > > > > > Hi All, > > > > A Jira has been opened to track the issue. > > > > https://issues.apache.org/jira/projects/HUDI/issues/HUDI-246 > > > > > > > > On Thu, Sep 12, 2019 at 10:48 AM Vinoth Chandar > > > wrote: > > > > > > > > > yes JIRA would be great to scope out the work. > > > > > > > > > > On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran > > > > > wrote: > > > > > > > > > > > +1 for integrating Apache Pulsar. > > > > > > > > > > > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala < > > taher...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > Should we file a jira? If everyone agrees? > > > > > > > > > > > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang > > > > > wrote: > > > > > > > > > > > > > > > +1 to welcome Pulsar connector > > > > > > > > > > > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > > > > > > > > > > > +1 Always welcome new sources. Any takers for a > PulsarSource > > in > > > > > > > > > DeltaStreamer? > > > > > > > > > > > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala < > > > > > taher...@gmail.com> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Hi Vinoth, > > > > > > > > > > Apache Pulsar is a pub/sub messaging system > > like > > > > > > Kafka, > > > > > > > > > > however, it has a few more functions which makes it > > different > > > > > like > > > > > > > > > > serverless per record etl at Pulsar level. Pulsar auto > > > service > > > > > > > > discovery > > > > > > > > > > etc. > > > > > > > > > >As Pulsar is picking up pace should we bring > > that > > > > as a > > > > > > > > > component > > > > > > > > > > in DeltaStreamer? > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > Taher Koitawala > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
HI Vinoth, My bad should have specified in the earlier mail :) Jira id : vinaypatil18 Regards, Vinay Patil On Sun, Sep 22, 2019 at 7:34 PM Vinoth Chandar wrote: > sure. whats your jira id? > > On Sat, Sep 21, 2019 at 3:40 AM Vinay Patil > wrote: > > > Hi, > > > > Interested to take this up, can you please provide me contributor > > permissions and assign this task to me. > > > > Regards, > > Vinay Patil > > > > > > On Thu, Sep 12, 2019 at 2:25 PM vbal...@apache.org > > wrote: > > > > > > > > +1 for adding new types of data pipes. On Thursday, September 12, > > > 2019, 01:39:20 AM PDT, taher koitawala wrote: > > > > > > Hi All, > > > A Jira has been opened to track the issue. > > > https://issues.apache.org/jira/projects/HUDI/issues/HUDI-246 > > > > > > On Thu, Sep 12, 2019 at 10:48 AM Vinoth Chandar > > wrote: > > > > > > > yes JIRA would be great to scope out the work. > > > > > > > > On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran > > > > wrote: > > > > > > > > > +1 for integrating Apache Pulsar. > > > > > > > > > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala < > taher...@gmail.com> > > > > > wrote: > > > > > > > > > > > Should we file a jira? If everyone agrees? > > > > > > > > > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang > > > wrote: > > > > > > > > > > > > > +1 to welcome Pulsar connector > > > > > > > > > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > > > > > > > > > +1 Always welcome new sources. Any takers for a PulsarSource > in > > > > > > > > DeltaStreamer? > > > > > > > > > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala < > > > > taher...@gmail.com> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Hi Vinoth, > > > > > > > > > Apache Pulsar is a pub/sub messaging system > like > > > > > Kafka, > > > > > > > > > however, it has a few more functions which makes it > different > > > > like > > > > > > > > > serverless per record etl at Pulsar level. Pulsar auto > > service > > > > > > > discovery > > > > > > > > > etc. > > > > > > > > >As Pulsar is picking up pace should we bring > that > > > as a > > > > > > > > component > > > > > > > > > in DeltaStreamer? > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > Taher Koitawala > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
sure. whats your jira id? On Sat, Sep 21, 2019 at 3:40 AM Vinay Patil wrote: > Hi, > > Interested to take this up, can you please provide me contributor > permissions and assign this task to me. > > Regards, > Vinay Patil > > > On Thu, Sep 12, 2019 at 2:25 PM vbal...@apache.org > wrote: > > > > > +1 for adding new types of data pipes. On Thursday, September 12, > > 2019, 01:39:20 AM PDT, taher koitawala wrote: > > > > Hi All, > > A Jira has been opened to track the issue. > > https://issues.apache.org/jira/projects/HUDI/issues/HUDI-246 > > > > On Thu, Sep 12, 2019 at 10:48 AM Vinoth Chandar > wrote: > > > > > yes JIRA would be great to scope out the work. > > > > > > On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran > > > wrote: > > > > > > > +1 for integrating Apache Pulsar. > > > > > > > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala > > > > wrote: > > > > > > > > > Should we file a jira? If everyone agrees? > > > > > > > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang > > wrote: > > > > > > > > > > > +1 to welcome Pulsar connector > > > > > > > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > > > > > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > > > > > > DeltaStreamer? > > > > > > > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala < > > > taher...@gmail.com> > > > > > > > wrote: > > > > > > > > > > > > > > > Hi Vinoth, > > > > > > > > Apache Pulsar is a pub/sub messaging system like > > > > Kafka, > > > > > > > > however, it has a few more functions which makes it different > > > like > > > > > > > > serverless per record etl at Pulsar level. Pulsar auto > service > > > > > > discovery > > > > > > > > etc. > > > > > > > >As Pulsar is picking up pace should we bring that > > as a > > > > > > > component > > > > > > > > in DeltaStreamer? > > > > > > > > > > > > > > > > Thanks, > > > > > > > > Taher Koitawala > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
Hi, Interested to take this up, can you please provide me contributor permissions and assign this task to me. Regards, Vinay Patil On Thu, Sep 12, 2019 at 2:25 PM vbal...@apache.org wrote: > > +1 for adding new types of data pipes. On Thursday, September 12, > 2019, 01:39:20 AM PDT, taher koitawala wrote: > > Hi All, > A Jira has been opened to track the issue. > https://issues.apache.org/jira/projects/HUDI/issues/HUDI-246 > > On Thu, Sep 12, 2019 at 10:48 AM Vinoth Chandar wrote: > > > yes JIRA would be great to scope out the work. > > > > On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran > > wrote: > > > > > +1 for integrating Apache Pulsar. > > > > > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala > > > wrote: > > > > > > > Should we file a jira? If everyone agrees? > > > > > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang > wrote: > > > > > > > > > +1 to welcome Pulsar connector > > > > > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > > > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > > > > > DeltaStreamer? > > > > > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala < > > taher...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > Hi Vinoth, > > > > > > > Apache Pulsar is a pub/sub messaging system like > > > Kafka, > > > > > > > however, it has a few more functions which makes it different > > like > > > > > > > serverless per record etl at Pulsar level. Pulsar auto service > > > > > discovery > > > > > > > etc. > > > > > > >As Pulsar is picking up pace should we bring that > as a > > > > > > component > > > > > > > in DeltaStreamer? > > > > > > > > > > > > > > Thanks, > > > > > > > Taher Koitawala > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
+1 for adding new types of data pipes. On Thursday, September 12, 2019, 01:39:20 AM PDT, taher koitawala wrote: Hi All, A Jira has been opened to track the issue. https://issues.apache.org/jira/projects/HUDI/issues/HUDI-246 On Thu, Sep 12, 2019 at 10:48 AM Vinoth Chandar wrote: > yes JIRA would be great to scope out the work. > > On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran > wrote: > > > +1 for integrating Apache Pulsar. > > > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala > > wrote: > > > > > Should we file a jira? If everyone agrees? > > > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang wrote: > > > > > > > +1 to welcome Pulsar connector > > > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > > > > DeltaStreamer? > > > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala < > taher...@gmail.com> > > > > > wrote: > > > > > > > > > > > Hi Vinoth, > > > > > > Apache Pulsar is a pub/sub messaging system like > > Kafka, > > > > > > however, it has a few more functions which makes it different > like > > > > > > serverless per record etl at Pulsar level. Pulsar auto service > > > > discovery > > > > > > etc. > > > > > > As Pulsar is picking up pace should we bring that as a > > > > > component > > > > > > in DeltaStreamer? > > > > > > > > > > > > Thanks, > > > > > > Taher Koitawala > > > > > > > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
Hi All, A Jira has been opened to track the issue. https://issues.apache.org/jira/projects/HUDI/issues/HUDI-246 On Thu, Sep 12, 2019 at 10:48 AM Vinoth Chandar wrote: > yes JIRA would be great to scope out the work. > > On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran > wrote: > > > +1 for integrating Apache Pulsar. > > > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala > > wrote: > > > > > Should we file a jira? If everyone agrees? > > > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang wrote: > > > > > > > +1 to welcome Pulsar connector > > > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > > > > DeltaStreamer? > > > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala < > taher...@gmail.com> > > > > > wrote: > > > > > > > > > > > Hi Vinoth, > > > > > > Apache Pulsar is a pub/sub messaging system like > > Kafka, > > > > > > however, it has a few more functions which makes it different > like > > > > > > serverless per record etl at Pulsar level. Pulsar auto service > > > > discovery > > > > > > etc. > > > > > >As Pulsar is picking up pace should we bring that as a > > > > > component > > > > > > in DeltaStreamer? > > > > > > > > > > > > Thanks, > > > > > > Taher Koitawala > > > > > > > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
yes JIRA would be great to scope out the work. On Wed, Sep 11, 2019 at 10:00 PM Bhavani Sudha Saktheeswaran wrote: > +1 for integrating Apache Pulsar. > > On Wed, Sep 11, 2019 at 8:58 PM taher koitawala > wrote: > > > Should we file a jira? If everyone agrees? > > > > On Thu, Sep 12, 2019, 6:30 AM vino yang wrote: > > > > > +1 to welcome Pulsar connector > > > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > > > DeltaStreamer? > > > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala > > > > wrote: > > > > > > > > > Hi Vinoth, > > > > > Apache Pulsar is a pub/sub messaging system like > Kafka, > > > > > however, it has a few more functions which makes it different like > > > > > serverless per record etl at Pulsar level. Pulsar auto service > > > discovery > > > > > etc. > > > > >As Pulsar is picking up pace should we bring that as a > > > > component > > > > > in DeltaStreamer? > > > > > > > > > > Thanks, > > > > > Taher Koitawala > > > > > > > > > > > > > > >
Re: Apache Pulsar component for Hudi
+1 for integrating Apache Pulsar. On Wed, Sep 11, 2019 at 8:58 PM taher koitawala wrote: > Should we file a jira? If everyone agrees? > > On Thu, Sep 12, 2019, 6:30 AM vino yang wrote: > > > +1 to welcome Pulsar connector > > > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > > DeltaStreamer? > > > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala > > > wrote: > > > > > > > Hi Vinoth, > > > > Apache Pulsar is a pub/sub messaging system like Kafka, > > > > however, it has a few more functions which makes it different like > > > > serverless per record etl at Pulsar level. Pulsar auto service > > discovery > > > > etc. > > > >As Pulsar is picking up pace should we bring that as a > > > component > > > > in DeltaStreamer? > > > > > > > > Thanks, > > > > Taher Koitawala > > > > > > > > > >
Re: Apache Pulsar component for Hudi
Should we file a jira? If everyone agrees? On Thu, Sep 12, 2019, 6:30 AM vino yang wrote: > +1 to welcome Pulsar connector > > Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > > > +1 Always welcome new sources. Any takers for a PulsarSource in > > DeltaStreamer? > > > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala > > wrote: > > > > > Hi Vinoth, > > > Apache Pulsar is a pub/sub messaging system like Kafka, > > > however, it has a few more functions which makes it different like > > > serverless per record etl at Pulsar level. Pulsar auto service > discovery > > > etc. > > >As Pulsar is picking up pace should we bring that as a > > component > > > in DeltaStreamer? > > > > > > Thanks, > > > Taher Koitawala > > > > > >
Re: Apache Pulsar component for Hudi
+1 to welcome Pulsar connector Vinoth Chandar 于2019年9月12日周四 上午6:57写道： > +1 Always welcome new sources. Any takers for a PulsarSource in > DeltaStreamer? > > On Tue, Sep 10, 2019 at 4:33 AM taher koitawala > wrote: > > > Hi Vinoth, > > Apache Pulsar is a pub/sub messaging system like Kafka, > > however, it has a few more functions which makes it different like > > serverless per record etl at Pulsar level. Pulsar auto service discovery > > etc. > >As Pulsar is picking up pace should we bring that as a > component > > in DeltaStreamer? > > > > Thanks, > > Taher Koitawala > > >
Re: Apache Pulsar component for Hudi
+1 Always welcome new sources. Any takers for a PulsarSource in DeltaStreamer? On Tue, Sep 10, 2019 at 4:33 AM taher koitawala wrote: > Hi Vinoth, > Apache Pulsar is a pub/sub messaging system like Kafka, > however, it has a few more functions which makes it different like > serverless per record etl at Pulsar level. Pulsar auto service discovery > etc. >As Pulsar is picking up pace should we bring that as a component > in DeltaStreamer? > > Thanks, > Taher Koitawala >
