Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-05-07 Thread sapiensy
Hi Randall, Sorry, I was away. Just started a vote a few minutes ago. On 2019/05/06 17:46:23, Randall Hauch wrote: > Have we started a vote on this? I don't see the separate "[VOTE]" thread. > > On Mon, Apr 29, 2019 at 6:19 PM Konstantine Karantasis < > konstant...@confluent.io> wrote: > > >

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-05-06 Thread Randall Hauch
Have we started a vote on this? I don't see the separate "[VOTE]" thread. On Mon, Apr 29, 2019 at 6:19 PM Konstantine Karantasis < konstant...@confluent.io> wrote: > Thanks Yaroslav, this KIP LGTM now too! > > To give some context regarding my previous comment: headers in Connect > would

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-29 Thread Konstantine Karantasis
Thanks Yaroslav, this KIP LGTM now too! To give some context regarding my previous comment: headers in Connect would probably have followed a similar approach if default methods in interfaces could be used at the time. But we could not have assumed java 8 or later yet in the AK version that

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-29 Thread Randall Hauch
Thanks for the update. Yes, IMO this KIP is ready for a vote. On Fri, Apr 26, 2019 at 12:15 AM sapie...@gmail.com wrote: > Hi Randall, Konstantine, > > I've updated the KIP to reflect the details we discussed here. Let me know > if it looks good and we can go to the voting phase. > > Thanks! >

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-25 Thread sapiensy
Hi Randall, Konstantine, I've updated the KIP to reflect the details we discussed here. Let me know if it looks good and we can go to the voting phase. Thanks! On 2019/04/22 21:07:31, Randall Hauch wrote: > I think it would be helpful to clarify this in the KIP, just so that > readers are

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-22 Thread Randall Hauch
I think it would be helpful to clarify this in the KIP, just so that readers are aware that the headers will be the raw header bytes that are the same as what is in the Kafka record. The alternative I was referring to is exposing the Connect `Headers` interface, which is different. On Mon, Apr

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-22 Thread sapiensy
Hi Konstantine, Randall, As you can see in the updated Converter interface, it always operates on `org.apache.kafka.common.header.Headers`. WorkerSinkTask simply uses Kafka message headers and passes them to the `toConnectData` method. WorkerSourceTask leverages header converter to extract

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-22 Thread Randall Hauch
Konstantine raises a good point. Which `Headers` is being referenced in the API? The Connect `org.apache.kafka.connect.header.Headers` would correspond to what was already deserialized by the `HeaderConverter` or what will yet be serialized by the `HeaderConverter`. Alternatively, the common `

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-22 Thread Konstantine Karantasis
Thanks for the KIP Yaroslav! Apologies for the late comment. However, after reading the KIP it's still not very clear to me what happens to the existing HeaderConverter interface and what's the expectation for existing code implementing this interface out there. Looking at the PR I see that the

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-22 Thread Randall Hauch
Thanks for updating the KIP. It looks good to me, and since there haven't been any other issue mentioned in this month-long thread, it's probably fine to start a vote. Best regards, Randall On Tue, Apr 2, 2019 at 3:12 PM Randall Hauch wrote: > Thanks for the submission, Yaroslav -- and for

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-07 Thread Yaroslav Tkachenko
Hello Randall, Thanks for your suggestion, I've just updated the KIP. Let me know what you think! On 2019/04/02 20:12:56, Randall Hauch wrote: > Thanks for the submission, Yaroslav -- and for building on the suggestion> > of Jeremy C in https://issues.apache.org/jira/browse/KAFKA-7273. This is

Re: [DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-04-02 Thread Randall Hauch
Thanks for the submission, Yaroslav -- and for building on the suggestion of Jeremy C in https://issues.apache.org/jira/browse/KAFKA-7273. This is a nice and simple approach that is backward compatible. The KIP looks good so far, but I do have two specific suggestions to make things just a bit

[DISCUSS] KIP-440: Extend Connect Converter to support headers

2019-03-11 Thread Yaroslav Tkachenko
Hello, I'd like to propose a KIP that extends Kafka Connect Converter interface: https://cwiki.apache.org/confluence/display/KAFKA/KIP-440%3A+Extend+Connect+Converter+to+support+headers Thanks for considering! -- Yaroslav Tkachenko sap1ens.com