[jira] [Resolved] (KAFKA-15659) Flaky test RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener

2023-10-27 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze resolved KAFKA-15659. --- Resolution: Fixed > Flaky t

Re: [DISCUSS] 3.5.2 Release

2023-10-12 Thread Levani Kokhreidze
t; For 3.5.2, I think there are sufficient pending (including some CVE fixes) >> to start a bug fix release. We just need a volunteer for the release >> manager. >> >> -- >> Divij Vaidya >> >> >> >> On Thu, Oct 12, 2023 at 9:57 AM Levani Kokhreidze &

[DISCUSS] 3.5.2 Release

2023-10-12 Thread Levani Kokhreidze
Hello, KAFKA-15571 [1] was merged and backported to the 3.5 and 3.6 branches. Bug fixes the feature that was added in 3.5. Considering the feature doesn't work as expected without a fix, I would like to know if it's reasonable to start the 3.5.2 release. Of course, releasing such a massive

Re: KAFKA-15571 Review

2023-10-10 Thread Levani Kokhreidze
you found a bug and you are looking at the right place! > > I commented on the PR. > > Best, > Bruno > > On 10/10/23 3:02 PM, Levani Kokhreidze wrote: >> Hello, >> We’ve been looking at a https://issues.apache.org/jira/browse/KAFKA-10575 >&g

KAFKA-15571 Review

2023-10-10 Thread Levani Kokhreidze
Hello, We’ve been looking at a https://issues.apache.org/jira/browse/KAFKA-10575 but seems implementation has a bug and user defined `StateRestoreListener#onRestoreSuspended` is not called because DelegatingStateRestoreListener was not updated. Here’s the PR that fixes it:

[jira] [Created] (KAFKA-15571) StateRestoreListener#onRestoreSuspended is never called because wrapper DelegatingStateRestoreListener doesn't implement onRestoreSuspended

2023-10-10 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-15571: - Summary: StateRestoreListener#onRestoreSuspended is never called because wrapper DelegatingStateRestoreListener doesn't implement onRestoreSuspended Key: KAFKA-15571

Re: [ANNOUNCE] New Kafka PMC Member: Bruno Cadonna

2022-11-02 Thread Levani Kokhreidze
Congrats Bruno, well deserved! On Wed, 2 Nov 2022, 11:11 Jorge Esteban Quilcate Otoya, < quilcate.jo...@gmail.com> wrote: > Congratulations, Bruno!! > > On Wed, 2 Nov 2022, 09:06 Mickael Maison, > wrote: > > > Congratulations Bruno! > > > > On Wed, Nov 2, 2022 at 8:33 AM Matthew Benedict de

Re: [DISCUSS] KIP-759: Unneeded repartition canceling

2022-05-23 Thread Levani Kokhreidze
o pick it up. > > > -Matthias > > On 4/26/22 3:58 AM, Levani Kokhreidze wrote: >> Hi, >> Sorry, maybe I am jumping the gun here, but if by any chance this KIP >> becomes dormant, I'd be interested in picking it up. >> Levani >>> On 2

Re: [DISCUSS] KIP-759: Unneeded repartition canceling

2022-04-26 Thread Levani Kokhreidze
Hi, Sorry, maybe I am jumping the gun here, but if by any chance this KIP becomes dormant, I'd be interested in picking it up. Levani > On 23. Apr 2022, at 02:43, Matthias J. Sax wrote: > > Ivan, > > are you still interested in this KIP? I think it would be a good addition. > > >

Re: [DISCUSS] Apache Kafka 3.2.0 release

2022-03-15 Thread Levani Kokhreidze
Hi Bruno, I assume we will be able to merge changes tomorrow as well? Thanks, Levani > On 15. Mar 2022, at 16:11, Bruno Cadonna wrote: > > Hi all, > > A quick reminder that feature freeze for Apache 3.2.0 is tomorrow. Please > make sure to get your features merged into trunk. > > I will

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

2021-07-01 Thread Levani Kokhreidze
Hi Konstantine, FYI, I don’t think we will be able to have KIP-708 ready on time. Feel free to remove it from the release plan. Best, Levani > On 1. Jul 2021, at 01:27, Konstantine Karantasis > wrote: > > Hi all, > > Today we have reached the Feature Freeze milestone for Apache Kafka 3.0. >

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-18 Thread Levani Kokhreidze
ns > here, and if users do hit limits on bytes, probably they'd consider giving > some shorter names anyways :) > > Guozhang > > On Wed, Mar 17, 2021 at 11:25 AM Levani Kokhreidze > wrote: > >> Hi Sophie, >> >> No worries! And thanks for taking a look. >>

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-17 Thread Levani Kokhreidze
rent KIP, I'm +1 (binding) -- > thanks for the proposal Levani! > > Cheers, > Sophie > > > On Wed, Mar 17, 2021 at 7:54 AM Levani Kokhreidze > wrote: > >> Hi Sophie and Bruno, >> >> Thanks for the questions and suggestions. >> Not sure if it's bes

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-17 Thread Levani Kokhreidze
Hi Sophie and Bruno, Thanks for the questions and suggestions. Not sure if it's best to discuss this in the DISCUSSION thread, but I will write it here first, and if it needs more discussion, we can move to the DISCUSSION thread. Actually, in the implementation, I have a version field in the

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-15 Thread Levani Kokhreidze
Hello all, Bumping this thread as we are one binding vote short accepting this KIP. Please let me know if you have any extra concerns and/or suggestions. Regards, Levani > On 12. Mar 2021, at 13:14, Levani Kokhreidze wrote: > > Hi Guozhang, > > Thanks for the feedback. I think

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-12 Thread Levani Kokhreidze
> > > > > On Thu, Mar 11, 2021 at 8:29 AM John Roesler wrote: > >> Thanks for the KIP! >> >> I'm +1 (binding) >> >> -John >> >> On Wed, 2021-03-10 at 13:13 +0200, Levani Kokhreidze wrote: >>> Hello all, >>> >>

[VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-10 Thread Levani Kokhreidze
Hello all, I’d like to start the voting on KIP-708 [1] Best, Levani [1] - https://cwiki.apache.org/confluence/display/KAFKA/KIP-708%3A+Rack+awareness+for+Kafka+Streams

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-03-09 Thread Levani Kokhreidze
licas. I think > there is no need to refer to actual code. > > After this changes, I am +1 on starting the vote thread. > > Best, > Bruno > > On 08.03.21 17:32, Levani Kokhreidze wrote: >> Hello all, >> Bumping this thread in case there’s any other feedback around KI

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-03-08 Thread Levani Kokhreidze
nce/display/KAFKA/KIP-708:+Rack+awarness+for+Kafka+Streams> > On 4. Mar 2021, at 10:36, Levani Kokhreidze wrote: > > Hi Bruno, > > Thanks a lot for the feedback. > I’ve updated KIP [1] based on suggestions. > > Regards, > Levani > > [1] - > https://cwiki.a

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-03-04 Thread Levani Kokhreidze
Hi Bruno, Thanks a lot for the feedback. I’ve updated KIP [1] based on suggestions. Regards, Levani [1] - https://cwiki.apache.org/confluence/display/KAFKA/KIP-708%3A+Rack+awarness+for+Kafka+Streams > On 1. Mar 2021, at 22:55, Bruno Cadonna wrote: > > clientTagPrefix

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-28 Thread Levani Kokhreidze
ach is different than appending > multiple tags together, e.g. how is cluster=foo, zone=bar different than > rack=foo-bar? > > Ryanne > > On Sat, Feb 27, 2021, 5:00 PM Levani Kokhreidze <mailto:levani.co...@gmail.com>> > wrote: > >> Hi Bruno, &

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-27 Thread Levani Kokhreidze
nfluence/display/KAFKA/KIP-441%3A+Smooth+Scaling+Out+for+Kafka+Streams#KIP441:SmoothScalingOutforKafkaStreams-AssignmentAlgorithm > > <https://cwiki.apache.org/confluence/display/KAFKA/KIP-441%3A+Smooth+Scaling+Out+for+Kafka+Streams#KIP441:SmoothScalingOutforKafkaStreams-AssignmentAlgorit

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-22 Thread Levani Kokhreidze
nor react on different numbers and different orderings > of the tags in standby.replicas.awareness across Streams clients? > > Best, > Bruno > > > On 22.02.21 11:46, Levani Kokhreidze wrote: >> Hi Bruno, >> Thanks for the feedback. Please check my answers below: &g

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-22 Thread Levani Kokhreidze
? > > 7. Could you also say some words about how this KIP affects the current > HighAvailabilityTaskAssignor? > > > Best, > Bruno > > On 09.02.21 15:54, Levani Kokhreidze wrote: >> Hello all, >> I’ve updated KIP-708 [1] to reflect the latest discussio

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-09 Thread Levani Kokhreidze
Hello all, I’ve updated KIP-708 [1] to reflect the latest discussion outcomes. I’m looking forward to your feedback. Regards, Levani [1] - https://cwiki.apache.org/confluence/display/KAFKA/KIP-708%3A+Rack+awarness+for+Kafka+Streams > On 2. Feb 2021, at 22:03, Levani Kokhreidze wr

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-02 Thread Levani Kokhreidze
instances > * one copy in each of zone a, b, and c > * two copies in one cluster and one in the other cluster > > For example, we might have 0_0 assigned to: > * Node 1 (cluster 1, zone a) > * Node 5 (cluster 2, zone b) > * Node 3 (cluster 1, zone c) > > Is that what you

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-02 Thread Levani Kokhreidze
rface (point 2) to a separate KIP. I do think a pluggable > assignor would be extremely valuable, but it might be nice to cut the scope > of KIP-708 if just a config will suffice. > > What do you think? > Thanks, > John > > > On Mon, Feb 1, 2021, at 06:07, Levani Kokhr

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-02-01 Thread Levani Kokhreidze
can learn the > relevant broker metadata, so this stretch might not be > currently feasible, but as long as we design the > TaskAssignor for extensibility, we can do something like > this in the future. > > Thanks again for this proposal, I hope the above is more > inspiring than

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-01-28 Thread Levani Kokhreidze
on to summarizing what rack awareness > looks like in other distributed systems, to help us put this design in > context. > > Thanks! > John > > > On Tue, Jan 26, 2021, at 16:46, Levani Kokhreidze wrote: >> Hello all, >> >> I’d like to start discuss

[DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-01-26 Thread Levani Kokhreidze
Hello all, I’d like to start discussion on KIP-708 [1] that aims to introduce rack aware standby task distribution in Kafka Streams. In addition to changes mentioned in the KIP, I’d like to get some ideas on additional change I have in mind. Assuming KIP moves forward, I was wondering if it

[jira] [Created] (KAFKA-10772) java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0)

2020-11-26 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-10772: - Summary: java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0) Key: KAFKA-10772

[jira] [Created] (KAFKA-10686) Pluggable standby tasks assignor for Kafka Streams

2020-11-05 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-10686: - Summary: Pluggable standby tasks assignor for Kafka Streams Key: KAFKA-10686 URL: https://issues.apache.org/jira/browse/KAFKA-10686 Project: Kafka

[jira] [Created] (KAFKA-10454) Kafka Streams Stuck in infinite REBALANCING loop when stream <> table join partitions don't match

2020-09-01 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-10454: - Summary: Kafka Streams Stuck in infinite REBALANCING loop when stream <> table join partitions don't match Key: KAFKA-10454 URL: https://issues.apache.org/jira/

[jira] [Created] (KAFKA-10375) Restore consumer fails with SSL handshake fail exception

2020-08-08 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-10375: - Summary: Restore consumer fails with SSL handshake fail exception Key: KAFKA-10375 URL: https://issues.apache.org/jira/browse/KAFKA-10375 Project: Kafka

Re: [VOTE] 2.6.0 RC0

2020-07-15 Thread Levani Kokhreidze
Hi Randall, Not sure if it’s intentional but, documentation for Kafka Streams 2.6.0 also contains “Streams API changes in 2.7.0” https://kafka.apache.org/26/documentation/streams/upgrade-guide Also, there seems to be some

Re: [VOTE] KIP-629: Use racially neutral terms in our codebase

2020-06-26 Thread Levani Kokhreidze
+1 (non-binding) Thank you for this initiative. Levani > On Jun 26, 2020, at 11:53 AM, Mickael Maison wrote: > > +1 (binding) > Thanks for the KIP! > > On Fri, Jun 26, 2020 at 9:51 AM Jorge Esteban Quilcate Otoya > wrote: >> >> +1 (non-binding) >> Thank you Xavier! >> >> On Fri, Jun 26,

[jira] [Resolved] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-05-20 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze resolved KAFKA-9859. -- Fix Version/s: 2.6.0 Resolution: Fixed fixed with PR [https://github.com/apache

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2020-05-15 Thread Levani Kokhreidze
> repartitioning before transform()) however this pattern should be >> subsumed by repartition(). >> >> Reducing the surface area of our API (instead of just enlarging it) >> might be good. >> >> Thoughts? >> >> >> -Matthias >> >&

[jira] [Created] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-10003: - Summary: Deprecate KStream#through in favor of KStream#repartition Key: KAFKA-10003 URL: https://issues.apache.org/jira/browse/KAFKA-10003 Project: Kafka

[jira] [Reopened] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-04-24 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze reopened KAFKA-9859: -- > kafka-streams-application-reset tool doesn't take into account topics > gen

[jira] [Created] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-04-13 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9859: Summary: kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation Key: KAFKA-9859 URL: https

[jira] [Created] (KAFKA-9850) Move KStream#repartition operator validation during Topology build process

2020-04-10 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9850: Summary: Move KStream#repartition operator validation during Topology build process Key: KAFKA-9850 URL: https://issues.apache.org/jira/browse/KAFKA-9850

[jira] [Created] (KAFKA-9828) Add partition to TestRecord in streams test-utils

2020-04-07 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9828: Summary: Add partition to TestRecord in streams test-utils Key: KAFKA-9828 URL: https://issues.apache.org/jira/browse/KAFKA-9828 Project: Kafka

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2020-04-04 Thread Levani Kokhreidze
hance+DSL+with+Connecting+Topic+Creation+and+Repartition+Hint>) Regards, Levani > On Aug 1, 2019, at 9:55 AM, Levani Kokhreidze wrote: > > Thank you all! > > The vote has been open for ~8 days. KIP has three binding votes (Bill, > Guozhang, Matthias) and one non-binding (Sophie)

Re: Subject: [VOTE] 2.4.1 RC0

2020-03-09 Thread Levani Kokhreidze
+1 non-binding. - Built from source - Ran unit tests. All passed. - Quickstart passed. Looking forward upgrading to 2.4.1 Regards, Levani On Mon, 9 Mar 2020, 17:11 Sean Glover, wrote: > +1 (non-binding). I built from source and ran the unit test suite > successfully. > > Thanks for running

[jira] [Created] (KAFKA-9638) Do not trigger REBALANCING when specific exceptions occur in Kafka Streams

2020-03-03 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9638: Summary: Do not trigger REBALANCING when specific exceptions occur in Kafka Streams Key: KAFKA-9638 URL: https://issues.apache.org/jira/browse/KAFKA-9638

Re: Issues with triggering the build

2020-01-14 Thread Levani Kokhreidze
work. > > Best, > Bruno > > On Tue, Jan 14, 2020 at 9:01 AM Levani Kokhreidze > wrote: >> >> Hello, >> >> Seems like there’re issues with triggering Jenkins builds. Latest commits >> for my PR doesn’t trigger any of the builds. >> Any ideas how to

Issues with triggering the build

2020-01-14 Thread Levani Kokhreidze
Hello, Seems like there’re issues with triggering Jenkins builds. Latest commits for my PR doesn’t trigger any of the builds. Any ideas how to fix the issue? Here’s the example PR: https://github.com/apache/kafka/pull/7170 - Levani

[jira] [Created] (KAFKA-9342) Consider making all Kafka Streams DSL configuration classes immutable

2019-12-29 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9342: Summary: Consider making all Kafka Streams DSL configuration classes immutable Key: KAFKA-9342 URL: https://issues.apache.org/jira/browse/KAFKA-9342 Project

[jira] [Created] (KAFKA-9240) Flaky test kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker

2019-11-27 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9240: Summary: Flaky test kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker Key: KAFKA-9240 URL: https://issues.apache.org/jira/browse/KAFKA-9240

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-11-16 Thread Levani Kokhreidze
ing with `repartition()` for now, and deferring >>>> `groupBy[Key](partitions)` to the future. >>>> >>>>> Users should not have to choose between allowing Streams to optimize the >>>> repartition placement, and allowing to specify a number of partitio

[jira] [Created] (KAFKA-9197) Consider introducing numberOfPartitions configuration field to Grouped configuration class

2019-11-16 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9197: Summary: Consider introducing numberOfPartitions configuration field to Grouped configuration class Key: KAFKA-9197 URL: https://issues.apache.org/jira/browse/KAFKA-9197

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-11-15 Thread Levani Kokhreidze
y "side effect". >>>>> >>>>> While I agree about "usability" in general, I would prefer a more >>>>> conservative appraoch to introduce this feature, see how it goes, and >>>>> maybe make it more advance later on. This also applies to what >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-11-12 Thread Levani Kokhreidze
)` seems to be "dangerous" >>>> because it might be too subtle and an "optional scaling out" as laid out >>>> above does not make sense IMHO. >>>> >>>> I am also not worried about "over repartitioning" because the result >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-11-07 Thread Levani Kokhreidze
artitions` to Grouped rather than > adding a new parameter to groupBy, that does seem more in line with the > current syntax so +1 from me > > On Tue, Nov 5, 2019 at 2:07 PM Levani Kokhreidze > wrote: > >> Hello all, >> >> While https://github.com/apach

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-11-05 Thread Levani Kokhreidze
are busy with the upcoming 2.4 release, and don't have much > spare time at the > moment. It's kind of a difficult time to get attention on things, but feel > free to pick up something else > to work on in the meantime until things have calmed down a bit! > > Cheers, > Sophi

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-10-16 Thread Levani Kokhreidze
ve any concerns. Regards, Levani > On Jul 26, 2019, at 11:25 AM, Levani Kokhreidze > wrote: > > Hi all, > > Here’s voting thread for this KIP: > https://www.mail-archive.com/dev@kafka.apache.org/msg99680.html > <https://www.mail-archive.com/dev@kafka.apach

[jira] [Created] (KAFKA-9031) Add possibility to reset Kafka streams application state to specific point in time

2019-10-11 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9031: Summary: Add possibility to reset Kafka streams application state to specific point in time Key: KAFKA-9031 URL: https://issues.apache.org/jira/browse/KAFKA-9031

[jira] [Created] (KAFKA-8871) Allow timestamp manipulation in ValueTransformerWithKey

2019-09-04 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-8871: Summary: Allow timestamp manipulation in ValueTransformerWithKey Key: KAFKA-8871 URL: https://issues.apache.org/jira/browse/KAFKA-8871 Project: Kafka

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-08-01 Thread Levani Kokhreidze
Sax wrote: > > +1 (binding) > > On 7/31/19 8:36 AM, Guozhang Wang wrote: >> Thanks for the update! +1 (binding). >> >> On Tue, Jul 30, 2019 at 11:42 PM Levani Kokhreidze >> wrote: >> >>> Hello Guozhang, >>> >>> Thanks for the f

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-31 Thread Levani Kokhreidze
> On Tue, Jul 30, 2019 at 1:27 PM Bill Bejeck wrote: > >> Thanks for the KIP Levani. >> >> +1 (binding) >> >> -Bill >> >> On Tue, Jul 30, 2019 at 3:37 PM Levani Kokhreidze >> wrote: >> >>> Hello, >>> >>&

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Levani Kokhreidze
Hello, Still waiting for feedback on this KIP. Please let me know if you have any concerns and/or questions. Regards, Levani > On Jul 24, 2019, at 8:20 PM, Sophie Blee-Goldman wrote: > > Looks good! Thanks Levani, > > +1 (non-binding) > > Sophie > > On Tue, Jul

[jira] [Resolved] (KAFKA-8727) Control over standby tasks host assignment

2019-07-29 Thread Levani Kokhreidze (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze resolved KAFKA-8727. -- Resolution: Duplicate  Duplicate of KAFKA-6718 > Control over standby tasks h

[jira] [Created] (KAFKA-8727) Control over standby tasks host assignment

2019-07-29 Thread Levani Kokhreidze (JIRA)
Levani Kokhreidze created KAFKA-8727: Summary: Control over standby tasks host assignment Key: KAFKA-8727 URL: https://issues.apache.org/jira/browse/KAFKA-8727 Project: Kafka Issue Type

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-26 Thread Levani Kokhreidze
Hi all, Here’s voting thread for this KIP: https://www.mail-archive.com/dev@kafka.apache.org/msg99680.html <https://www.mail-archive.com/dev@kafka.apache.org/msg99680.html> Regards, Levani > On Jul 24, 2019, at 11:15 PM, Levani Kokhreidze > wrote: > > Hi Mat

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-24 Thread Levani Kokhreidze
's valuable to keep the number of overload small if possible.) > > Otherwise LGTM. > > > -Matthias > > > On 7/23/19 2:18 PM, Levani Kokhreidze wrote: >> Hello, >> >> Thanks all for your feedback. >> I started voting procedure for this KIP. If the

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-23 Thread Levani Kokhreidze
Hello, Thanks all for your feedback. I started voting procedure for this KIP. If there’re any other concerns about this KIP, please let me know. Regards, Levani > On Jul 20, 2019, at 8:39 PM, Levani Kokhreidze wrote: > > Hi Matthias, > > Thanks for the suggestion, make

[VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-23 Thread Levani Kokhreidze
Hello, I’d like to initialize voting on KIP-221: https://cwiki.apache.org/confluence/display/KAFKA/KIP-221%3A+Enhance+KStream+with+Connecting+Topic+Creation+and+Repartition+Hint

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-20 Thread Levani Kokhreidze
o avoid abbreviations. Can > we rename: > > `withNumOfPartitions` -> `withNumberOfPartitions` > > Furthermore, it might be good to add some more `static` methods: > > - Repartitioned.with(Serde, Serde) > - Repartitioned.withNumberOfPartitions(int) > - Repartitioned.streamPa

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-19 Thread Levani Kokhreidze
't think we do this kind of composition elsewhere in Streams at > the moment > > On Fri, Jul 19, 2019 at 1:45 PM Levani Kokhreidze > wrote: > >> Hi Bill, >> >> Thanks a lot for the feedback. >> Yes, that makes sense. I’ve updated KIP with `Repartitioned#partitio

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-19 Thread Levani Kokhreidze
n of fields in the value in conjunction with the key > 2. Something other than the key > 3. We allow users to specify a partitioner on Produced hence in > KStream.to and KStream.through, so it makes sense for API consistency. > > Just my 2 cents. > > Thanks, > Bi

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-19 Thread Levani Kokhreidze
ion in Produced. > > Thanks, > -John > > On Wed, Jul 17, 2019 at 3:20 PM Levani Kokhreidze > wrote: >> >> Hey John, >> >> Oh that’s interesting use-case. >> Do I understand this correctly, in your example I would first issue >> repa

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-17 Thread Levani Kokhreidze
de > input topic uses a custom partitioning strategy, then the > repartitioned stream also needs to be partitioned with the same > strategy. > > Does that make sense, or did I maybe miss something important? > > Thanks, > -John > > On Wed, Jul 17, 2019 at 2:48 PM Lev

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-17 Thread Levani Kokhreidze
'm not sure how > widely this feature is really used, but seems it should be available for > repartition topics. > > On Wed, Jul 17, 2019 at 11:26 AM Levani Kokhreidze > wrote: > >> Hey Sophie, >> >> In both cases KStream#repartition and KStream#repartition(

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-17 Thread Levani Kokhreidze
es it seem like one version of the method will auto-create > topics while the other will not. > > Cheers, > Sophie > > On Wed, Jul 17, 2019 at 10:15 AM Levani Kokhreidze > wrote: > >> Hello, >> >> One more bump about KIP-221 ( >> https://cwiki.apache.or

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-17 Thread Levani Kokhreidze
int>) so it doesn’t get lost in mailing list :) Would love to hear communities opinions/concerns about this KIP. Regards, Levani > On Jul 12, 2019, at 5:27 PM, Levani Kokhreidze wrote: > > Hello, > > Kind reminder about this KIP: > https://cwiki.apache.org/confluence/

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-12 Thread Levani Kokhreidze
int> Regards, Levani > On Jul 9, 2019, at 11:38 AM, Levani Kokhreidze wrote: > > Hello, > > In order to move this KIP forward, I’ve updated confluence page with the new > proposal > https://cwiki.apache.org/confluence/display/KAFKA/KIP-221%3A+Enhance+KStream+wit

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-09 Thread Levani Kokhreidze
nce+KStream+with+Connecting+Topic+Creation+and+Repartition+Hint> I’ve also filled “Rejected Alternatives” section. Looking forward to discuss this KIP :) King regards, Levani > On Jul 3, 2019, at 1:08 PM, Levani Kokhreidze wrote: > > Hello Matthias, > > Thanks for the feedback

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-03 Thread Levani Kokhreidze
eplication > factor, retention-time etc, easily, without the need to change the "main > API". > > Just want to give some ideas. Not sure if I like them myself. :) > > > -Matthias > > > > On 7/1/19 1:04 AM, Levani Kokhreidze wrote: >> Actually, givi

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-01 Thread Levani Kokhreidze
discussed in the mailing list, but I kinda got with all the threads that were about this KIP :( Kind regards, Levani > On Jul 1, 2019, at 9:56 AM, Levani Kokhreidze wrote: > > Hello, > > I would like to resurrect discussion around KIP-221. Going through the > discussion thr

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2019-07-01 Thread Levani Kokhreidze
Hello, I would like to resurrect discussion around KIP-221. Going through the discussion thread, there’s seems to agreement around usefulness of this feature. Regarding the implementation, as far as I understood, the most optimal solution for me seems the following: 1) Add two method

[DISCUSS] KIP-485 Make topic optional when using through() operations in DSL

2019-06-28 Thread Levani Kokhreidze
Hello, I would like to start discussion about KIP-485 Make topic optional when using through() operations in DSL Regards, Levani

[jira] [Created] (KAFKA-8611) Make topic optional when using through() operations in DSL

2019-06-28 Thread Levani Kokhreidze (JIRA)
Levani Kokhreidze created KAFKA-8611: Summary: Make topic optional when using through() operations in DSL Key: KAFKA-8611 URL: https://issues.apache.org/jira/browse/KAFKA-8611 Project: Kafka

Permissions for creating KIP

2019-06-23 Thread Levani Kokhreidze
Hi, Please give me permission for creating KIP . You can find link to my profile on confluence here . Kind regards, Levani

[jira] [Created] (KAFKA-8413) Add possibility to do repartitioning on KStream

2019-05-23 Thread Levani Kokhreidze (JIRA)
Levani Kokhreidze created KAFKA-8413: Summary: Add possibility to do repartitioning on KStream Key: KAFKA-8413 URL: https://issues.apache.org/jira/browse/KAFKA-8413 Project: Kafka Issue