Re: [VOTE] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-15 Thread Dongjin Lee
cations, but > I'm > > > > fine to have a dedicated one for this tool (maybe we can link them). > > > > > > > > https://issues.apache.org/jira/browse/KAFKA-14705. > > > > > > > > On Sun, Jul 7, 2024

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-07-10 Thread Dongjin Lee
is not accurate (as you were the one bringing the KIP to > completion). > > Best, > > On Mon, Jul 8, 2024 at 5:38 PM Dongjin Lee wrote: > > > Hi Josep, > > > > Thanks for managing the 3.8 release. I have a request: could you please > > move the KIP-390 into the 3.9

Re: [DISCUSS] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-10 Thread Dongjin Lee
t; > > 1) "we usually have a deprecation period of at least 1 year" this > > was > > > > > what > > > > > > I believed before. > > > > > > 2) However, it seems another rule is "we don't introduce breaking > >

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-07-08 Thread Dongjin Lee
tps://www.linkedin.com/company/aiven/> < > https://twitter.com/aiven_io> > *Aiven Deutschland GmbH* > Alexanderufer 3-7, 10117 Berlin > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > Amtsgericht Charlottenburg, HRB 209739 B > -- *Dongjin Lee* *A hitchhike

[VOTE] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-07 Thread Dongjin Lee
Hi all, I'd like to call for a vote on KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9): https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=311627623 Thanks, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_9

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-07 Thread Dongjin Lee
2024 at 9:05 PM Dongjin Lee wrote: > Hi Tsai, > > Great. I will close the old KIP & PR and file new ones by this weekend. > > Thanks, > Dongjin > > On Thu, Jul 4, 2024 at 8:48 PM Chia-Ping Tsai wrote: > >> hi Dongjin >> >> I have assigned https://iss

[jira] [Resolved] (KAFKA-12899) Support --bootstrap-server in ReplicaVerificationTool

2024-07-07 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee resolved KAFKA-12899. - Resolution: Won't Fix Replaced by KAFKA-17073 > Support --bootstrap-s

[DISCUSS] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-07 Thread Dongjin Lee
pache.org/confluence/display/KAFKA/KIP-752%3A+Support+--bootstrap-server+in+ReplicaVerificationTool> . Thanks in advance for all discussions, feedbacks, etc. Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/d

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-06 Thread Dongjin Lee
) > > On 2024/07/04 05:38:42 Dongjin Lee wrote: > > Okay, Ismael's opinion seems reasonable, so I will follow it. > > > > Then, could you please assign me the deprecation issue & KIP? Since I > > opened this KIP in the past, I hope to wrap it up. If you are oka

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-03 Thread Dongjin Lee
gt; >> It will be removed in 4.0 if we are able to deprecate it in 3.9. > Hence, it > > >> seems to me enhancing it is a bit weird since the feature is active > only > > >> for one release … > > >> > > >>> > > >>>>

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-03 Thread Dongjin Lee
gt; it in years. > > > > Ismael > > > > On Wed, Jun 9, 2021 at 9:51 PM Dongjin Lee wrote: > > > > > Hi Ismael, > > > > > > Before I submit this KIP, I reviewed some history. When KIP-499 > > > < > > > > https://cwiki.

[jira] [Resolved] (KAFKA-13969) CVE-2022-24823 in netty 4.1.76.Final

2022-07-09 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee resolved KAFKA-13969. - Resolution: Duplicate > CVE-2022-24823 in netty 4.1.76.Fi

Re: Kafka Log4J vulnerabilities - Urgent

2022-06-30 Thread Dongjin Lee
ssemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail

Re: [VOTE] KIP-653: Upgrade log4j to log4j2

2022-03-23 Thread Dongjin Lee
omers don't use custom filters/layouts? > > Ismael > > On Wed, Mar 23, 2022 at 7:53 AM Dongjin Lee wrote: > > > Hi Mikael, Edoardo and Ismael, > > > > Sorry for being late. Frankly, I thought KIP-653 is not a breaking change > > since (as Edoardo stated) unl

Re: [VOTE] KIP-653: Upgrade log4j to log4j2

2022-03-23 Thread Dongjin Lee
HTH > > > > Edo > > > > -- > > > > Edoardo Comar > > > > Event Streams for IBM Cloud > > > > > > > > > > > > > > > > From:

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-11 Thread Dongjin Lee
+1 (non-binding) Thanks, Dongjin On Wed, Feb 9, 2022, 2:07 AM Mickael Maison wrote: > Bumping this vote. > > We have 1 binding and 4 non-binding votes so far. > Let me know if you have any feedback. > > Thanks, > Mickael > > On Wed, Feb 2, 2022 at 10:13 AM Julien Chanaud > wrote: > > > > Hi Mi

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-02-11 Thread Dongjin Lee
+1 (non-binding) Thanks for the KIP! Thanks, Dongjin On Fri, Feb 11, 2022, 10:16 PM Julien Chanaud wrote: > Bumping this vote. > > We have 2 binding votes so far. > > The associated PR is already implemented: > https://github.com/apache/kafka/pull/11575 > Let me know if you have any feedback.

Re: [ANNOUNCE] New committer: Luke Chen

2022-02-09 Thread Dongjin Lee
e community. > > > Thanks for all of your contributions Luke. Congratulations! > > -- Guozhang, on behalf of the Apache Kafka PMC > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongj

[jira] [Resolved] (KAFKA-13616) Log4j 1.X CVE-2022-23302/5/7 vulnerabilities

2022-02-09 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee resolved KAFKA-13616. - Resolution: Duplicate > Log4j 1.X CVE-2022-23302/5/7 vulnerabilit

Re: [DISCUSS] KIP-817: Fix inconsistency in dynamic application log levels

2022-02-07 Thread Dongjin Lee
't feel strong either way so let's see what others > have to say. > > Cheers, > David > > > > > On Fri, Jan 28, 2022 at 11:04 AM Dongjin Lee wrote: > > > > Hi Kafka dev, > > > > I would like to start the discussion of KIP-817: Fix inconsi

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2022-01-29 Thread Dongjin Lee
> So I don't think it's a problem but I think we probably want to > > mention it in the KIP or in the upgrade/release notes at least. > > > > Thanks, > > Mickael > > > > On Thu, Oct 22, 2020 at 4:27 AM Dongjin Lee wrote: > > > > > >

[DISCUSS] KIP-817: Fix inconsistency in dynamic application log levels

2022-01-28 Thread Dongjin Lee
KIP-653: Upgrade log4j to log4j2 (Accepted). https://cwiki.apache.org/confluence/display/KAFKA/KIP-653%3A+Upgrade+log4j+to+log4j2 All kinds of feedbacks are greatly appreciated! Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573

[jira] [Created] (KAFKA-13625) KIP-817: Fix inconsistency in dynamic application log levels

2022-01-28 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13625: --- Summary: KIP-817: Fix inconsistency in dynamic application log levels Key: KAFKA-13625 URL: https://issues.apache.org/jira/browse/KAFKA-13625 Project: Kafka

Re: [VOTE] KIP-719: Deprecate Log4J Appender

2022-01-24 Thread Dongjin Lee
> Luke > > On Mon, Jan 24, 2022 at 5:30 PM Tom Bentley wrote: > > > Thanks Dongjin, +1 (binding). > > > > Kind regards, > > > > Tom > > > > > > On Thu, 20 Jan 2022 at 17:20, Ismael Juma wrote: > > > > > Thanks for the

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-21 Thread Dongjin Lee
st > the use of 1.x configuration that's deprecated (which it is), but it's also > the use of the appender itself which is deprecated. > > Kind regards, > > Tom > > On Thu, 20 Jan 2022 at 05:01, Dongjin Lee wrote: > > > Hi all, > > > > I just fil

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-19 Thread Dongjin Lee
und in either logback or log4j2 > > or > > > any other logging framework, so I think the safest approach is to allow > > > users to choose their implementation, while in tests I think we're free > > to > > > use whatever we want as that shouldn't be constrained by > vulnerab

[jira] [Created] (KAFKA-13604) Add pluggable logging framework support

2022-01-19 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13604: --- Summary: Add pluggable logging framework support Key: KAFKA-13604 URL: https://issues.apache.org/jira/browse/KAFKA-13604 Project: Kafka Issue Type

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-17 Thread Dongjin Lee
logback or log4j2 > or > > any other logging framework, so I think the safest approach is to allow > > users to choose their implementation, while in tests I think we're free > to > > use whatever we want as that shouldn't be constrained by vulnerabilities. > >

Re: log4j-2.x

2022-01-17 Thread Dongjin Lee
On Sat, Jan 15, 2022 at 5:14 PM Berthold Reinwald > wrote: > > > Hi Everyone, > > > > > > > > kafka_2.13-3.0.0 is using log4j-1.2.17. Is there a plan to upgrade from > > log4j-1.x to log4j 2.x, and what would be the time line? > > > > Regards, >

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-12-22 Thread Dongjin Lee
tion was made from a PMC > * https://issues.apache.org/jira/browse/HADOOP-12956 > > > What do you think about adopting logback instead? > > > Thanks, > > 2021年12月21日(火) 18:02 Dongjin Lee : > > > Hi Mickael, > > > > > In the meantime, you may

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-12-21 Thread Dongjin Lee
may want to bump the VOTE thread too. > > Best, > Mickael > > > On Sat, Dec 18, 2021 at 10:00 AM Dongjin Lee wrote: > > > > Hi Mickael, > > > > Finally, I did it! As you can see at the PR > > <https://github.com/apache/kafka/pull/10244>, KIP-719 n

[VOTE] KIP-719: Deprecate Log4J Appender

2021-12-21 Thread Dongjin Lee
: - Before: Deprecate the log4j-appender and add log4j2-appender - After: Deprecate the log4j-appender and replace the current dependency with log4j 2.x's Kafka appender. This is why I reset the voting thread. Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *g

Re: [ANNOUNCE] New Kafka PMC member: David Jacot

2021-12-18 Thread Dongjin Lee
gt; been contributing to the community consistently this entire time - > > > > > especially notable the fact that he reviewed around 150 PRs in the > last > > > > > year. It is my pleasure to announce that David agreed to join the > > > Kafka PMC. > > > >

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-12-18 Thread Dongjin Lee
che.org/jira/browse/LOG4J2-3256>, but it seems like it will be resolved soon. Best, Dongjin On Wed, Dec 15, 2021 at 9:28 PM Dongjin Lee wrote: > Hi Mickael, > > > Can we do step 3 without breaking any compatibility? If so then that > sounds like a good idea. > > As far as

[jira] [Resolved] (KAFKA-13547) Kafka - 1.0.0 | Remove log4j.jar

2021-12-15 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee resolved KAFKA-13547. - Resolution: Duplicate It seems like you are trying VerifiableProducer in tools, right? Removing

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-12-15 Thread Dongjin Lee
ote: > Hi Dongjin, > > Sorry for the late reply. Can we do step 3 without breaking any > compatibility? If so then that sounds like a good idea. > > Thanks, > Mickael > > > > On Tue, Nov 23, 2021 at 2:08 PM Dongjin Lee wrote: > > > > Hi Mickael, > >

Re: [VOTE] KIP-780: Support fine-grained compression options

2021-11-23 Thread Dongjin Lee
Bumping up the voting thread. As of present: - binding: 0 - non-binding: 1 (Luke) Thanks, Dongjin On Wed, Oct 27, 2021 at 9:47 PM Luke Chen wrote: > Hi Dongjin, > Thanks for the KIP. > +1 (non-binding) > > Luke > > On Wed, Oct 27, 2021 at 8:44 PM Dongjin Lee wrote:

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-11-23 Thread Dongjin Lee
is not directly > affected by the log4j CVEs. At least this gives us a clear and simple > roadmap to follow. > > What do you think? > > On Tue, Nov 9, 2021 at 12:12 PM Dongjin Lee wrote: > > > > Hi Mickael, > > > > I greatly appreciate you for reading the

Re: [ANNOUNCE] New Kafka PMC Member: Tom Bentley

2021-11-19 Thread Dongjin Lee
; wrote: > >>>>>> > >>>>>>> Hi, Everyone, > >>>>>>> > >>>>>>> Tom Bentley has been a Kafka committer since Mar. 15, 2021. He > >> has > >>>>> been > >>>>>>>

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-11-09 Thread Dongjin Lee
ln/detail/CVE-2019-17571. The Apache log4j team > will not fix this vulnerability and is urging an upgrade to log4j2. See > https://logging.apache.org/log4j/1.2/ for further information. > > > > This is desperately needed in Apache 3.0 to keep the software secure. > > >

[jira] [Created] (KAFKA-13436) Omitted BrokerTopicMetrics metrics in the documentation

2021-11-06 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13436: --- Summary: Omitted BrokerTopicMetrics metrics in the documentation Key: KAFKA-13436 URL: https://issues.apache.org/jira/browse/KAFKA-13436 Project: Kafka Issue

[jira] [Created] (KAFKA-13430) Remove broker-wide quota properties from the documentation

2021-11-03 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13430: --- Summary: Remove broker-wide quota properties from the documentation Key: KAFKA-13430 URL: https://issues.apache.org/jira/browse/KAFKA-13430 Project: Kafka

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-10-29 Thread Dongjin Lee
; > > > > >> > > > >> > I just published a release plan here: > > >>>> > > > > > >> > > > >> > > > >>>> > > > > > >> > > > >>>> > > > > > > >>>> > https://cwiki.

[jira] [Resolved] (KAFKA-13294) Upgrade Netty to 4.1.68 for CVE fixes

2021-10-28 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee resolved KAFKA-13294. - Resolution: Fixed [~mimaison] Here it is. > Upgrade Netty to 4.1.68 for CVE fi

Re: [VOTE] KIP-780: Support fine-grained compression options

2021-10-27 Thread Dongjin Lee
Bumping up the voting thread. If you have any questions or opinions, don't hesitate to leave them in the discussion thread. Best, Dongjin On Thu, Oct 14, 2021 at 3:02 AM Dongjin Lee wrote: > Hi, Kafka dev, > > I'd like to open a vote for KIP-780: Support fine-grained co

[jira] [Created] (KAFKA-13397) Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics

2021-10-24 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13397: --- Summary: Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics Key: KAFKA-13397 URL: https://issues.apache.org/jira/browse/K

Re: [DISCUSS] KIP-780: Support fine-grained compression options

2021-10-18 Thread Dongjin Lee
Hi Ismael, do you have any opinion on this approach and benchmark results? Thanks, Dongjin On Wed, Oct 13, 2021 at 8:09 PM Dongjin Lee wrote: > Hi Chen, > > > It said, available value is [10, 22], but default is a value out of that > range, which should be wrong. > > Oh

[VOTE] KIP-780: Support fine-grained compression options

2021-10-13 Thread Dongjin Lee
epted, targeted to 3.1.0.). It was initially planned for a part of KIP-390 but spun off for performance concerns. https://cwiki.apache.org/confluence/display/KAFKA/KIP-390%3A+Support+Compression+Level Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github:

Re: [DISCUSS] KIP-780: Support fine-grained compression options

2021-10-13 Thread Dongjin Lee
, > default: 0 (disables long mode.)) > > It said, available value is [10, 22], but default is a value out of that > range, which should be wrong. > > Thank you. > Luke > > On Sun, Oct 10, 2021 at 9:50 PM Dongjin Lee wrote: > > > Hi Kafka dev, > > > > I w

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-10-12 Thread Dongjin Lee
which uses '--bootstrap-servers' yet. Thanks, Dongjin. On Mon, Jun 21, 2021 at 8:05 PM Dongjin Lee wrote: > Hi Guozhang, > > Thanks for the comment. I updated the KIP applying your comment. > > @All > > Any other thoughts? > > Regards, > Dongjin > &

Re: [VOTE] KIP-719: Add Log4J2 Appender

2021-10-12 Thread Dongjin Lee
grade provided by KIP-653. I found this problem while testing the preview build. I also updated the proposal document discussing the details of the problem and why the other approaches were all rejected. Thanks, Dongjin. On Mon, Jun 14, 2021 at 3:54 PM Dongjin Lee wrote: > > VerifiableLog4jAppen

[DISCUSS] KIP-781: Allow MirrorMaker 2 to override the client configurations

2021-10-11 Thread Dongjin Lee
deployments; in short, the configurations like `us-east.producer.acks = all` are not working now. It seems like to make it working like the documentation, a configuration overriding policy is needed. All kinds of feedbacks are greatly appreciated! Thanks, Dongjin -- *Dongjin Lee* *A hitchhiker in

[jira] [Created] (KAFKA-13365) Allow MirrorMaker 2 to override the client configurations

2021-10-11 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13365: --- Summary: Allow MirrorMaker 2 to override the client configurations Key: KAFKA-13365 URL: https://issues.apache.org/jira/browse/KAFKA-13365 Project: Kafka

[DISCUSS] KIP-780: Support fine-grained compression options

2021-10-10 Thread Dongjin Lee
tests in the Benchmark section. All kinds of feedbacks are greatly appreciated! Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjin

[jira] [Created] (KAFKA-13361) Support fine-grained compression options

2021-10-10 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13361: --- Summary: Support fine-grained compression options Key: KAFKA-13361 URL: https://issues.apache.org/jira/browse/KAFKA-13361 Project: Kafka Issue Type

Re: [ANNOUNCE] Apache Kafka 3.0.0

2021-09-22 Thread Dongjin Lee
korev, > > Victoria Xia, Viktor Somogyi-Vass, Viswanathan Ranganathan, Vito Jeng, > > Walker Carlson, Warren Zhu, Xavier Léauté, YiDing-Duke, Zara Lim, Zhao > > Haiyuan, bmaidics, cyc, dengziming, feyman2016, high.lee, iamgd67, > > iczellion, ketulgupta1995, lamberken, lob

[jira] [Resolved] (KAFKA-13048) Update vulnerable dependencies in 2.8.0

2021-07-08 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee resolved KAFKA-13048. - Resolution: Duplicate > Update vulnerable dependencies in 2.

[jira] [Created] (KAFKA-12985) CVE-2021-28169 - Upgrade jetty to 9.4.41

2021-06-22 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-12985: --- Summary: CVE-2021-28169 - Upgrade jetty to 9.4.41 Key: KAFKA-12985 URL: https://issues.apache.org/jira/browse/KAFKA-12985 Project: Kafka Issue Type: Task

Re: [ANNOUNCE] New Kafka PMC Member: Konstantine Karantasis

2021-06-22 Thread Dongjin Lee
>>>> wrote: > > >>>>>>>> > > >>>>>>>>> Congrats, Konstantine. Well deserved! > > >>>>>>>>> > > >>>>>>>>> Best, > > >>>>>>>>> David > > >>>

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-21 Thread Dongjin Lee
on, then we should remove it in the next > release; otherwise, I think this KIP still is worthy. In any ways, we > should not left a cmd tool not maintained but not removed either. > > Guozhang > > On Thu, Jun 10, 2021 at 10:05 PM Dongjin Lee wrote: > > > Hi Ismael, >

Re: [VOTE] KIP-719: Add Log4J2 Appender

2021-06-13 Thread Dongjin Lee
e don't need it to support log4j 2. > > Ismael > > On Sun, Jun 13, 2021 at 8:12 AM Dongjin Lee wrote: > > > Hi Ismael, > > > > > Can't we work with the log4j community to support the alternative > format? > > > > It seems not. > > > >

Re: [VOTE] KIP-719: Add Log4J2 Appender

2021-06-13 Thread Dongjin Lee
pport the alternative format? > > Ismael > > On Fri, Jun 11, 2021, 10:54 PM Dongjin Lee wrote: > > > Hi all, > > > > @Ismael > > > > As I stated in the KIP (see subsection 2 of 'Motivation'), the log4j > > community's implementation

Re: [VOTE] KIP-719: Add Log4J2 Appender

2021-06-11 Thread Dongjin Lee
t sure about this. We have not maintained the existing > > log4j-appender very actively, so are we sure that we can do a better job > > than the log4j community? > > > > Ismael > > > > On Tue, May 25, 2021, 6:46 AM Dongjin Lee wrote: > > > > > Hi

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

2021-06-11 Thread Dongjin Lee
21 at 3:03 AM Konstantine Karantasis wrote: > Makes sense. Looks like a good improvement. Thanks for including the > evaluation in the proposal Dongjin. > > +1 (binding) > > Konstantine > > On Wed, Jun 9, 2021 at 6:59 PM Dongjin Lee wrote: > > > Thanks Ismel, To

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-10 Thread Dongjin Lee
t; all have their own launcher script. On Thu, Jun 10, 2021 at 2:02 PM Ismael Juma wrote: > KAFKA-12600 was a general change, not related to this tool specifically. I > am not convinced this tool is actually useful, I haven't seen anyone using > it in years. > > Ismael >

[jira] [Created] (KAFKA-12928) Add a check whether the Task's statestore is actually a directory

2021-06-10 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-12928: --- Summary: Add a check whether the Task's statestore is actually a directory Key: KAFKA-12928 URL: https://issues.apache.org/jira/browse/KAFKA-12928 Project:

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-09 Thread Dongjin Lee
ma wrote: > Hi Dongjin, > > Does this tool still work? I recall that there were some doubts about it > and that's why it wasn't updated previously. > > Ismael > > On Sat, Jun 5, 2021 at 2:38 PM Dongjin Lee wrote: > > > Hi all, > >

Re: [VOTE] KIP-745: Connect API to restart connector and tasks

2021-06-09 Thread Dongjin Lee
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-745%3A+Connect+API+to+restart+connector+and+tasks > > > > > > > > +1 (binding) from myself. > > > > > > > > Thanks, and best regards! > > > > > > > > Randall > > &

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-09 Thread Dongjin Lee
Thanks, Gwen and Luke, As of present: - binding: +1 (Gwen) - non-binding: +1 (Luke) Anyone else? Regards, Dongjin On Thu, Jun 10, 2021 at 1:24 AM Gwen Shapira wrote: > +1 (binding) > > On Wed, Jun 9, 2021 at 8:28 AM Dongjin Lee wrote: > > > Bumping up the voting thread. &

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

2021-06-09 Thread Dongjin Lee
, but we could list that > as > > future work vs rejected alternatives. > > > > Ismael > > > > On Sat, Jun 5, 2021 at 2:37 PM Dongjin Lee wrote: > > > > > Hi all, > > > > > > I'd like to open a voting thread for KIP-390: Support

Re: [VOTE] KIP-724: Drop support for message formats v0 and v1

2021-06-09 Thread Dongjin Lee
+1 (non-binding). Best, Dongjin On Thu, Jun 10, 2021, 7:20 AM Jason Gustafson wrote: > +1 Thanks Ismael! > > On Wed, Jun 9, 2021 at 11:29 AM Ismael Juma wrote: > > > Hi all, > > > > Consensus was reached in the discussion thread and part of what is > proposed > > has to happen by 3.0, so start

Re: [VOTE] KIP-719: Add Log4J2 Appender

2021-06-09 Thread Dongjin Lee
Bumping up the voting thread. Please note that today is the KIP freeze day. Thanks, Dongjin On Mon, Jun 7, 2021 at 9:28 PM Dongjin Lee wrote: > Bumping up the voting thread. > > > As a reminder: Please note that without the Log4j2 appender, we can't > complete KIP-653: Upg

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-09 Thread Dongjin Lee
Bumping up the voting thread. Please note that today is the KIP freeze day. +1 non-binding until now. Thanks, Dongjin On Sun, Jun 6, 2021 at 4:10 PM Luke Chen wrote: > Hi Dongjin, > Thanks for the KIP. > +1 (non-binding) > > Thanks. > Luke > > On Sun, Jun 6, 2021 at 5:

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

2021-06-09 Thread Dongjin Lee
Bumping up the voting thread. Please note that today is the KIP freeze day. +1 non-binding until now. Thanks, Dongjin On Sun, Jun 6, 2021 at 11:47 PM Ryanne Dolan wrote: > +1 (non-binding), thanks! > > Ryanne > > On Sat, Jun 5, 2021, 4:37 PM Dongjin Lee wrote: > > >

Re: [DISCUSS] KIP-390: Support Compression Level (rebooted)

2021-06-09 Thread Dongjin Lee
> > I was thinking of a simple test: Snappy with 1 KB block size vs 32 KB > > block size. If the compression rate is similar for both, then it seems > very > > wasteful to use 32 KB. I suspect you will see a significant difference > > though. > > > > Ismael &

Re: [DISCUSS] KIP-390: Support Compression Level (rebooted)

2021-06-08 Thread Dongjin Lee
te to give me a suggestion. I am a newbie to run the linear write benchmark. Best, Dongjin On Sun, Jun 6, 2021 at 8:20 AM Dongjin Lee wrote: > Hi Ismael, > > Thanks for the reply. > > > So you're saying that reducing the buffer size didn't reduce the > compress

[jira] [Created] (KAFKA-12911) Configure automatic formatter for org.apache.kafka.streams.processor

2021-06-07 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-12911: --- Summary: Configure automatic formatter for org.apache.kafka.streams.processor Key: KAFKA-12911 URL: https://issues.apache.org/jira/browse/KAFKA-12911 Project: Kafka

[jira] [Created] (KAFKA-12910) Configure automatic formatter for org.apache.kafka.streams.state

2021-06-07 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-12910: --- Summary: Configure automatic formatter for org.apache.kafka.streams.state Key: KAFKA-12910 URL: https://issues.apache.org/jira/browse/KAFKA-12910 Project: Kafka

Re: [VOTE] KIP-750: Drop support for Java 8 in Kafka 4.0 (deprecate in 3.0)

2021-06-07 Thread Dongjin Lee
+1 (non-binding) As a note: I think the exact removal schedule may be changed. Best, Dongjin On Mon, Jun 7, 2021, 10:56 PM Josep Prat wrote: > Thanks Ismael, it's a +1 (non-binding) from my side, > > > Best, > > ——— > Josep Prat > > Aiven Deutschland GmbH > > Immanuelkirchstraße 26, 10405 Berl

Re: [VOTE] KIP-719: Add Log4J2 Appender

2021-06-07 Thread Dongjin Lee
4j artifact from the classpath for the tools dependency. Best, Dongjin On Tue, May 25, 2021 at 10:45 PM Dongjin Lee wrote: > Hi Kafka dev, > > I'd like to kick-off the voting for KIP-719: Add Log4J2 Appender. > > > https://cwiki.apache.org/confluence/display/KAFKA/

Re: [VOTE] KIP-618: Exactly-once support for source connectors

2021-06-06 Thread Dongjin Lee
t; > > > https://mail-archives.apache.org/mod_mbox/kafka-dev/202005.mbox/%3CCAMdOrUX-VK5OSB3OOdJNXW_YKEJH9FjQZ4eyzr2GXUhSeDnF3Q%40mail.gmail.com%3E > > > > Cheers, > > > > Chris > > > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *git

Re: [VOTE] KIP-726: Make the "cooperative-sticky, range" as the default assignor

2021-06-06 Thread Dongjin Lee
58c9068ea025b3ad38ca2cc340f5818ac07cd83452b7%40%3Cdev.kafka.apache.org%3E > > > > Thank you. > > Luke > > > > > -- > -- Guozhang > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr

Re: [DISCUSS] KIP-390: Support Compression Level (rebooted)

2021-06-05 Thread Dongjin Lee
On Sun, Jun 6, 2021 at 6:48 AM Ismael Juma wrote: > Thanks Dongjin. So you're saying that reducing the buffer size didn't > reduce the compression rate for codecs like lz4? If so, that would suggest > reducing the default value, but that seems odd. > > Ismael > > On Sat,

[VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-05 Thread Dongjin Lee
Hi all, I'd like to call for a vote on KIP-752: Support --bootstrap-server in ReplicaVerificationTool: https://cwiki.apache.org/confluence/display/KAFKA/KIP-752%3A+Support+--bootstrap-server+in+ReplicaVerificationTool Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical

[VOTE] KIP-390: Support Compression Level (rebooted)

2021-06-05 Thread Dongjin Lee
Hi all, I'd like to open a voting thread for KIP-390: Support Compression Level (rebooted): https://cwiki.apache.org/confluence/display/KAFKA/KIP-390%3A+Support+Compression+Level Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_9

[DISCUSS] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2021-06-05 Thread Dongjin Lee
or the command-line tool, but omitted in KIP-499 <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=123899170> . All feedback will be highly appreciated. Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>githu

[jira] [Created] (KAFKA-12899) Support --bootstrap-server in ReplicaVerificationTool

2021-06-05 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-12899: --- Summary: Support --bootstrap-server in ReplicaVerificationTool Key: KAFKA-12899 URL: https://issues.apache.org/jira/browse/KAFKA-12899 Project: Kafka Issue

[DISCUSS] KIP-390: Support Compression Level (rebooted)

2021-06-05 Thread Dongjin Lee
rate by more than 50%*, such a significant enhancement. 2. Dropped 'compression.buffer.size' option that was in the initial work. With the repeated benchmarks, I could not find any evidence this option results in meaningful differences. So I removed it. All feedback will be highly appreciated

Re: Kafka Serialzer for zOS Unix

2021-05-29 Thread Dongjin Lee
error. Even when the JKS files have been updated with the proper > certificates. > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjinle

Re: [DISCUSS] Apache Kafka 3.0.0 release

2021-05-26 Thread Dongjin Lee
tracking when adding adopted KIPs > tentatively into the release plan. > > Not including KIP-719 to the release plan just yet because it's still under > discussion. Happy to add it once we conclude voting on it. > > Regards, > Konstantine > > > On Tue, May 25, 2021 at

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-05-26 Thread Dongjin Lee
I hope you will check this proposal out. Best, Dongjin On Tue, May 25, 2021 at 10:43 PM Dongjin Lee wrote: > Bumping up the discussion thread. > > Recently, I updated the document of KIP-653: Upgrade log4j to log4j2 > <https://cwiki.apache.org/confluence/display/KAFKA/KIP-653%3A+

[VOTE] KIP-719: Add Log4J2 Appender

2021-05-25 Thread Dongjin Lee
Hi Kafka dev, I'd like to kick-off the voting for KIP-719: Add Log4J2 Appender. https://cwiki.apache.org/confluence/display/KAFKA/KIP-719%3A+Add+Log4J2+Appender Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-05-25 Thread Dongjin Lee
y will have a good grasp on why both KIPs are best if released altogether. I will open the voting thread now, and please leave a vote if you are interested in this issue. Best, Dongjin On Tue, Mar 2, 2021 at 5:00 PM Dongjin Lee wrote: > Hi Kafka dev, > > I would like to start the

Re: [DISCUSS] Apache Kafka 3.0.0 release

2021-05-25 Thread Dongjin Lee
t; > >> wrote: > >> > Hi all, > >> > > >> > Given that we seem to reach an agreement that the feature release > after > >> the > >> > upcoming 2.8.0 will be 3.0.0, I'd like to volunteer to be the release > >> >

Re: [VOTE] KIP-741: Change default serde to be null

2021-05-25 Thread Dongjin Lee
e date and time of the first message to this thread 72 > > hours havn't passed, yet. Theoretically, there could still be -1 votes > > coming in. > > > > Best, > > Bruno > > > > [1] > > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improve

Re: [VOTE] KIP-741: Change default serde to be null

2021-05-25 Thread Dongjin Lee
t; > > > < > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-741%3A+Change+default+serde+to+be+null > > > > > > > > > The > > > > discussion is linked on the KIP for context. > > > > > &

Re: [VOTE] KIP-731: Record Rate Limiting for Kafka Connect

2021-05-08 Thread Dongjin Lee
/confluence/display/KAFKA/KIP-731%3A+Record+Rate+Limiting+for+Kafka+Connect > > Thanks for your votes! > > Ryanne > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleek

Re: [VOTE] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-05-07 Thread Dongjin Lee
m myself. > > Thanks, and best regards! > > Randall > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjinleekr <https://ke

Re: [ANNOUNCE] New Committer: Bruno Cadonna

2021-04-12 Thread Dongjin Lee
uthored a paper on Kafka's stream processing > > semantics in this year's SIGMOD conference ( > > https://en.wikipedia.org/wiki/SIGMOD). Bruno has also been quite active > on > > SO channels and AK mailings. > > > > Please join me to congratulate Bruno fo

Re: [ANNOUNCE] New Kafka PMC Member: Bill Bejeck

2021-04-12 Thread Dongjin Lee
Matthias J. Sax > wrote: > >>> > >>>> Hi, > >>>> > >>>> It's my pleasure to announce that Bill Bejeck in now a member of the > >>>> Kafka PMC. > >>>> > >>>> Bill has been a Kafka committ

  1   2   3   4   >