Re: kafka 0.9 support

2019-04-03 Thread Raghu Angadi
On Wed, Apr 3, 2019 at 5:46 AM David Morávek wrote: > I'd say that APIs we use in KafkaIO are pretty much stable since 0.10 > release, all reflection based compatibility adapters seem to be aimed for > 0.9 release (which is 8 major releases behind current Kafka release). > > We may take an inspir

Re: Implementation an S3 file system for python SDK

2019-04-03 Thread Pablo Estrada
Hi Pasan! Thanks for the proposal. I'll try to take a look in the next few hours and give some feedback. Best --P. On Wed, Apr 3, 2019, 8:53 AM Ahmet Altay wrote: > +Pablo Estrada > > On Wed, Apr 3, 2019 at 8:46 AM Lukasz Cwik wrote: > >> +dev >> >> On Wed, Apr 3, 2019 at 2:03 AM Pasan Kambur

Re: Implementation an S3 file system for python SDK

2019-04-03 Thread Ahmet Altay
+Pablo Estrada On Wed, Apr 3, 2019 at 8:46 AM Lukasz Cwik wrote: > +dev > > On Wed, Apr 3, 2019 at 2:03 AM Pasan Kamburugamuwa < > pasankamburugamu...@gmail.com> wrote: > >> Hi , >> >> I have completed a proposal to implementation an S3 file system for >> python SDK for the google summer of Co

Re: Implementation an S3 file system for python SDK

2019-04-03 Thread Lukasz Cwik
+dev On Wed, Apr 3, 2019 at 2:03 AM Pasan Kamburugamuwa < pasankamburugamu...@gmail.com> wrote: > Hi , > > I have completed a proposal to implementation an S3 file system for python > SDK for the google summer of Code 2019. Please can you guys review this > proposal and if there is any issues wi

Re: kafka 0.9 support

2019-04-03 Thread Jean-Baptiste Onofré
Hi David, that's a discussion we had while ago. I was more in favor of having module per main backend version: - kafka 0.9 - kafka 1.x - kafka 2.x for instance. It's what we do in some Apache projects (like Camel for instance). As a best effort, we can try to maintain a unique module for a bac

Re: kafka 0.9 support

2019-04-03 Thread David Morávek
I'd say that APIs we use in KafkaIO are pretty much stable since 0.10 release, all reflection based compatibility adapters seem to be aimed for 0.9 release (which is 8 major releases behind current Kafka release). We may take an inspiration from Flink's kafka connector

Implementation an S3 file system for python SDK

2019-04-03 Thread Pasan Kamburugamuwa
Hi , I have completed a proposal to implementation an S3 file system for python SDK for the google summer of Code 2019. Please can you guys review this proposal and if there is any issues with this proposal, let me know. Here is the link to the project proposal - https://docs.google.com/document/d