Re: Kafka Contributor List Addition
Great! - Thanks Matthias! On Thu, Oct 8, 2020 at 12:03 PM Matthias J. Sax wrote: > KIP discussions happen on the mailing list. You should not leave > comments on the wiki and thus you don't need any special wiki > permissions to participate in the discussion. > > Each KIP contains a link to the mail archive of the DISCUSS thread, and > you should reply to the corresponding thread with your comments. > > -Matthias > > On 10/8/20 10:11 AM, Saher Ahwal wrote: > > Hi > > > > Do I need special permission to be able to comment on KIP discussion on > > confluence wikis? > > I have some KIPs I am interested in discussing / commenting on. > > > > Many thanks in advance, > > Saher > > > > On Tue, May 12, 2020 at 9:54 AM Saher Ahwal > wrote: > > > >> Thanks! > >> I look forward to contributing and being part of the community. > >> > >> Best > >> saher > >> > >> On Mon, May 11, 2020 at 4:53 PM Matthias J. Sax > wrote: > >> > >>> Saher, > >>> > >>> I added you to the list of contributors on Jira. You can now > self-assign > >>> tickets. > >>> > >>> A good way to get started is to checkout the web page: > >>> https://kafka.apache.org/contributing > >>> > >>> Welcome to the Kafka community! > >>> > >>> > >>> -Matthias > >>> > >>> On 5/11/20 3:40 PM, Saher Ahwal wrote: > >>>> Thanks Isreal for the information. I created JIRA account with > username > >>>> *saherahwal* > >>>> > >>>> On Mon, May 11, 2020 at 2:33 PM Israel Ekpo > >>> wrote: > >>>> > >>>>> Hi Saher, > >>>>> > >>>>> You can start by participating in discussions, testing release > >>> candidates, > >>>>> reviewing issues and submitting pull requests for documentation, code > >>>>> patches > >>>>> > >>>>> You can start by creating an account on the JIRA and you can be > granted > >>>>> access to assign issues to yourself. > >>>>> > >>>>> https://issues.apache.org/jira/projects/KAFKA/issues > >>>>> > >>>>> I hope this helps. > >>>>> > >>>>> On Mon, May 11, 2020 at 4:51 PM Saher Ahwal > >>> wrote: > >>>>> > >>>>>> Hi > >>>>>> > >>>>>> I kindly ask to be added to the Kafka contributor list. I was hoping > >>> to > >>>>>> start contributing to the community. > >>>>>> > >>>>>> My company is relying on Kafka heavily and I would like to deeply > >>>>>> understand the working of Kafka and contribute to the OS community > as > >>>>> much > >>>>>> as possible. > >>>>>> > >>>>>> My github handle is *saherahwal* > >>>>>> > >>>>>> Warm regards > >>>>>> Saher > >>>>>> > >>>>>> -- > >>>>>> *Saher Ahwal* > >>>>>> > >>>>>> *Massachusetts Institute of Technology '13, '14* > >>>>>> *Department of Electrical Engineering and Computer Science* > >>>>>> *sa...@alum.mit.edu | 617 680 4877* > >>>>>> > >>>>> > >>>> > >>>> > >>> > >>> > >> > >> -- > >> *Saher Ahwal* > >> > >> *Massachusetts Institute of Technology '13, '14* > >> *Department of Electrical Engineering and Computer Science* > >> *sa...@alum.mit.edu | 617 680 4877* > >> > >> > >> > > > -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
Re: Kafka Contributor List Addition
Hi Do I need special permission to be able to comment on KIP discussion on confluence wikis? I have some KIPs I am interested in discussing / commenting on. Many thanks in advance, Saher On Tue, May 12, 2020 at 9:54 AM Saher Ahwal wrote: > Thanks! > I look forward to contributing and being part of the community. > > Best > saher > > On Mon, May 11, 2020 at 4:53 PM Matthias J. Sax wrote: > >> Saher, >> >> I added you to the list of contributors on Jira. You can now self-assign >> tickets. >> >> A good way to get started is to checkout the web page: >> https://kafka.apache.org/contributing >> >> Welcome to the Kafka community! >> >> >> -Matthias >> >> On 5/11/20 3:40 PM, Saher Ahwal wrote: >> > Thanks Isreal for the information. I created JIRA account with username >> > *saherahwal* >> > >> > On Mon, May 11, 2020 at 2:33 PM Israel Ekpo >> wrote: >> > >> >> Hi Saher, >> >> >> >> You can start by participating in discussions, testing release >> candidates, >> >> reviewing issues and submitting pull requests for documentation, code >> >> patches >> >> >> >> You can start by creating an account on the JIRA and you can be granted >> >> access to assign issues to yourself. >> >> >> >> https://issues.apache.org/jira/projects/KAFKA/issues >> >> >> >> I hope this helps. >> >> >> >> On Mon, May 11, 2020 at 4:51 PM Saher Ahwal >> wrote: >> >> >> >>> Hi >> >>> >> >>> I kindly ask to be added to the Kafka contributor list. I was hoping >> to >> >>> start contributing to the community. >> >>> >> >>> My company is relying on Kafka heavily and I would like to deeply >> >>> understand the working of Kafka and contribute to the OS community as >> >> much >> >>> as possible. >> >>> >> >>> My github handle is *saherahwal* >> >>> >> >>> Warm regards >> >>> Saher >> >>> >> >>> -- >> >>> *Saher Ahwal* >> >>> >> >>> *Massachusetts Institute of Technology '13, '14* >> >>> *Department of Electrical Engineering and Computer Science* >> >>> *sa...@alum.mit.edu | 617 680 4877* >> >>> >> >> >> > >> > >> >> > > -- > *Saher Ahwal* > > *Massachusetts Institute of Technology '13, '14* > *Department of Electrical Engineering and Computer Science* > *sa...@alum.mit.edu | 617 680 4877* > > > -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
Re: Kafka Exactly-Once Semantics in .NET support
Hi Boyang Thank you so much for the reply. I opened an issue on confluent dotnet on github and it was answered here: https://github.com/confluentinc/confluent-kafka-dotnet/issues/1342 I will re-paste it here for the benefit of others who might be interested: Matt's reply from Confluent: " We don't have specific exceptions (yet) - rather you'll get a KafkaException with an Error field set. Error has properties that indicate whether the error is retriable etc. and an ErrorCode to tell you specifically what the error is. We do intend to add more specific exception types in the future (its better UX), but we don't have them presently. We will hopefully document this better when we implement KIP-447 (currently not implemented). https://cwiki.apache.org/confluence/display/KAFKA/KIP-447%3A+Producer+scalability+for+exactly+once+semantics this example might be helpful: https://github.com/confluentinc/confluent-kafka-dotnet/tree/master/examples/Transactions " Thanks Saher On Tue, Jun 30, 2020 at 11:43 PM Boyang Chen wrote: > Thanks for the interest Saher. TBH, I don't know how the .NET confluent > library works, but I would assume it is based on the > https://github.com/edenhill/librdkafka. Maybe propose an issue there as > well to attract some expertes. > > Boyang > > On Tue, Jun 30, 2020 at 3:22 PM Saher Ahwal wrote: > > > Hi > > > > I am working on exactly-once semantics with Kafka and I have streaming > > scenario of read-process-write. I noticed the new exactly-once > scalability > > design with correctness in case of partition reassignment here: > > > > > https://docs.google.com/document/d/1LhzHGeX7_Lay4xvrEXxfciuDWATjpUXQhrEIkph9qRE/edit# > > > > It all looks great and I understand we need to rely on > > PendingTransatcionException and ProducerFencedException. However, we are > > using confluent library and .NET and I don't see any of these exceptions. > > > > How do I ensure correctness of fencing of zombie producer transactions > when > > using .NET confluent library? What exceptions are retry-able and what are > > not? Can I call abortTransaction on any Kafka exception ? I don't find > good > > examples in the documentation. > > Any pointers or answers are kindly appreciated. > > > > Thanks in advance > > Saher > > > > > > > > -- > > *Saher Ahwal* > > > > *Massachusetts Institute of Technology '13, '14* > > *Department of Electrical Engineering and Computer Science* > > *sa...@alum.mit.edu | 617 680 4877* > > > -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
Kafka Exactly-Once Semantics in .NET support
Hi I am working on exactly-once semantics with Kafka and I have streaming scenario of read-process-write. I noticed the new exactly-once scalability design with correctness in case of partition reassignment here: https://docs.google.com/document/d/1LhzHGeX7_Lay4xvrEXxfciuDWATjpUXQhrEIkph9qRE/edit# It all looks great and I understand we need to rely on PendingTransatcionException and ProducerFencedException. However, we are using confluent library and .NET and I don't see any of these exceptions. How do I ensure correctness of fencing of zombie producer transactions when using .NET confluent library? What exceptions are retry-able and what are not? Can I call abortTransaction on any Kafka exception ? I don't find good examples in the documentation. Any pointers or answers are kindly appreciated. Thanks in advance Saher -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
Re: Kafka Contributor List Addition
Thanks! I look forward to contributing and being part of the community. Best saher On Mon, May 11, 2020 at 4:53 PM Matthias J. Sax wrote: > Saher, > > I added you to the list of contributors on Jira. You can now self-assign > tickets. > > A good way to get started is to checkout the web page: > https://kafka.apache.org/contributing > > Welcome to the Kafka community! > > > -Matthias > > On 5/11/20 3:40 PM, Saher Ahwal wrote: > > Thanks Isreal for the information. I created JIRA account with username > > *saherahwal* > > > > On Mon, May 11, 2020 at 2:33 PM Israel Ekpo > wrote: > > > >> Hi Saher, > >> > >> You can start by participating in discussions, testing release > candidates, > >> reviewing issues and submitting pull requests for documentation, code > >> patches > >> > >> You can start by creating an account on the JIRA and you can be granted > >> access to assign issues to yourself. > >> > >> https://issues.apache.org/jira/projects/KAFKA/issues > >> > >> I hope this helps. > >> > >> On Mon, May 11, 2020 at 4:51 PM Saher Ahwal > wrote: > >> > >>> Hi > >>> > >>> I kindly ask to be added to the Kafka contributor list. I was hoping to > >>> start contributing to the community. > >>> > >>> My company is relying on Kafka heavily and I would like to deeply > >>> understand the working of Kafka and contribute to the OS community as > >> much > >>> as possible. > >>> > >>> My github handle is *saherahwal* > >>> > >>> Warm regards > >>> Saher > >>> > >>> -- > >>> *Saher Ahwal* > >>> > >>> *Massachusetts Institute of Technology '13, '14* > >>> *Department of Electrical Engineering and Computer Science* > >>> *sa...@alum.mit.edu | 617 680 4877* > >>> > >> > > > > > > -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
Re: Kafka Contributor List Addition
Thanks Isreal for the information. I created JIRA account with username *saherahwal* On Mon, May 11, 2020 at 2:33 PM Israel Ekpo wrote: > Hi Saher, > > You can start by participating in discussions, testing release candidates, > reviewing issues and submitting pull requests for documentation, code > patches > > You can start by creating an account on the JIRA and you can be granted > access to assign issues to yourself. > > https://issues.apache.org/jira/projects/KAFKA/issues > > I hope this helps. > > On Mon, May 11, 2020 at 4:51 PM Saher Ahwal wrote: > > > Hi > > > > I kindly ask to be added to the Kafka contributor list. I was hoping to > > start contributing to the community. > > > > My company is relying on Kafka heavily and I would like to deeply > > understand the working of Kafka and contribute to the OS community as > much > > as possible. > > > > My github handle is *saherahwal* > > > > Warm regards > > Saher > > > > -- > > *Saher Ahwal* > > > > *Massachusetts Institute of Technology '13, '14* > > *Department of Electrical Engineering and Computer Science* > > *sa...@alum.mit.edu | 617 680 4877* > > > -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
Kafka Contributor List Addition
Hi I kindly ask to be added to the Kafka contributor list. I was hoping to start contributing to the community. My company is relying on Kafka heavily and I would like to deeply understand the working of Kafka and contribute to the OS community as much as possible. My github handle is *saherahwal* Warm regards Saher -- *Saher Ahwal* *Massachusetts Institute of Technology '13, '14* *Department of Electrical Engineering and Computer Science* *sa...@alum.mit.edu | 617 680 4877*
