Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Thank you everyone!! It has been my great pleasure to contribute to and be part of the Apache Kafka community! On Mon, Aug 20, 2018 at 3:50 PM, Mayuresh Gharat wrote: > Congrats Dong !!! > > Thanks, > > Mayuresh > > On Mon, Aug 20, 2018 at 1:36 PM Gwen Shapira wrote: > > > Congrats Dong Lin!

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! :) On Tue, Aug 21, 2018 at 10:09 AM James Cheng wrote: > Congrats Dong! > > -James > > > On Aug 20, 2018, at 3:54 AM, Ismael Juma wrote: > > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the community and

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! On 20.08.2018 16:35, Attila Sasvári wrote: Congratulations Dong! Well deserved. Regards, Attila Paolo Patierno ezt írta (időpont: 2018. aug. 20., H 15:09): Congratulations Dong! Paolo Patierno Principal Software Engineer (IoT) @ Red Hat Microsoft MVP on Azure & IoT

[jira] [Resolved] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6188. - Resolution: Fixed Likely fixed in https://issues.apache.org/jira/browse/KAFKA-7278. > Broker fails with

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! -James > On Aug 20, 2018, at 3:54 AM, Ismael Juma wrote: > > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerous KIP

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

How do I unsubscribe from this list? Best, Patrick Williams Enterprise New Business Manager +44 (0)7549 676279 patrick.willi...@storageos.com 20 Midtown 20 Proctor Street Holborn London WC1V 6NX Twitter: @patch37 LinkedIn: linkedin.com/in/patrickwilliams4

[jira] [Created] (KAFKA-7318) Should introduce a offset reset policy to consume only the messages after subscribing

joechen8...@gmail.com created KAFKA-7318: Summary: Should introduce a offset reset policy to consume only the messages after subscribing Key: KAFKA-7318 URL:

Build failed in Jenkins: kafka-1.1-jdk7 #185

See Changes: [lindong28] Cherry-pick KAFKA-7278; replaceSegments() should not call -- [...truncated 1.93 MB...] org.apache.kafka.streams.KafkaStreamsTest >

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! Eno On Tue, Aug 21, 2018 at 7:05 AM, Ted Yu wrote: > Congratulation Dong! > > On Tue, Aug 21, 2018 at 1:59 AM Viktor Somogyi-Vass < > viktorsomo...@gmail.com> > wrote: > > > Congrats Dong! :) > > > > On Tue, Aug 21, 2018 at 10:09 AM James Cheng > wrote: > > > > > Congrats Dong!

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

This sounds good to me! Thanks for the time you've spent on it, -John On Tue, Aug 21, 2018 at 12:13 AM Boyang Chen wrote: > Thanks Matthias for the input. Sorry I was busy recently and haven't got > time to update this thread. To summarize what we come up so far, here is a > draft updated

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats, Dong! > On Aug 21, 2018, at 11:03 PM, Eno Thereska wrote: > > Congrats Dong! > > Eno > > On Tue, Aug 21, 2018 at 7:05 AM, Ted Yu wrote: > >> Congratulation Dong! >> >> On Tue, Aug 21, 2018 at 1:59 AM Viktor Somogyi-Vass < >> viktorsomo...@gmail.com> >> wrote: >> >>> Congrats

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

Hi Eno, Thanks for the comments. This KIP is not really about improving the performance in general. It is about ensuring the cluster state can still be updated quickly even if the brokers are under heavy load. We have seen quite often that it took dozens of seconds for a broker to process the

Re: [DISCUSS] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

Thanks for the KIP Dhruvil! I agree with Jason's comment. An alternative might be to use "suppress" what would revert the logic of "allow". Not sure which one is more intuitive and I am fine with both (no personal preference). Just wanted to mention it as an alternative. Don't have any further

Re: [DISCUSS] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

Thanks for the KIP. A few questions/comments: 1. It seems hard to reason about if we just disregard the config for older brokers. Maybe we should throw an error if the brokers don't support it and let users explicitly change the config if they want to. 2. We probably want to switch the default

[DISCUSS] KIP-360: Improve handling of unknown producer

Hi All, I have a proposal to improve the transactional/idempotent producer's handling of the UNKNOWN_PRODUCER error, which is the result of losing producer state following segment removal. The current behavior is both complex and limited. Please take a look and let me know what you think. Thanks

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats! On Tue, Aug 21, 2018 at 10:03 AM, Ray Chiang wrote: > Congrats Dong! > > -Ray > > > On 8/21/18 9:33 AM, Becket Qin wrote: > >> Congrats, Dong! >> >> On Aug 21, 2018, at 11:03 PM, Eno Thereska >>> wrote: >>> >>> Congrats Dong! >>> >>> Eno >>> >>> On Tue, Aug 21, 2018 at 7:05 AM, Ted

[jira] [Created] (KAFKA-7320) Provide ability to disable auto topic creation in KafkaConsumer

Dhruvil Shah created KAFKA-7320: --- Summary: Provide ability to disable auto topic creation in KafkaConsumer Key: KAFKA-7320 URL: https://issues.apache.org/jira/browse/KAFKA-7320 Project: Kafka

[jira] [Resolved] (KAFKA-7301) KTable to KTable join invocation does not resolve in Scala DSL

[ https://issues.apache.org/jira/browse/KAFKA-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7301. -- Resolution: Fixed Fix Version/s: 2.1.0 > KTable to KTable join invocation does not

[jira] [Created] (KAFKA-7321) ensure timely processing of deletion requests in Kafka topic (Time-based log compaction)

xiongqi wu created KAFKA-7321: - Summary: ensure timely processing of deletion requests in Kafka topic (Time-based log compaction) Key: KAFKA-7321 URL: https://issues.apache.org/jira/browse/KAFKA-7321

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

Thanks Becket. Following the convention of KIP-103 makes sense. I've updated the KIP with your proposed changes. Please take another look. Lucas On Mon, Aug 20, 2018 at 7:29 AM Becket Qin wrote: > Hi Lucas, > > In KIP-103, we introduced a convention to define and look up the listeners. > So it

Re: [DISCUSS] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

Okay, after much delay let's try this again for AK 2.1. Has anyone found any concerns? Stephane suggested that we allow updating topic configurations (everything but partition count). I'm unconvinced that it's worth the additional complexity in the implementation and the documentation to explain

[DISCUSS] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

Hi, I would like to start discussion on KIP-361 that proposes we add a consumer configuration to disable auto topic creation. Link to the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-361%3A+Add+Consumer+Configuration+to+Disable+Auto+Topic+Creation Suggestions and feedback are

Jenkins build is back to normal : kafka-trunk-jdk10 #423

See

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

Hi Eno, I fully agree with Becket here. If the motivation section makes sense, and we know we can get burnt by this problem, then the exact numbers (which vary case by case according to the config settings and traffic pattern) are no longer as important. Thanks, Lucas On Tue, Aug 21, 2018 at

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congratulations, Dong! On Wed, Aug 22, 2018 at 6:20 AM Dhruvil Shah wrote: > Congratulations, Dong! > > On Tue, Aug 21, 2018 at 4:38 PM Jason Gustafson > wrote: > > > Congrats! > > > > On Tue, Aug 21, 2018 at 10:03 AM, Ray Chiang wrote: > > > > > Congrats Dong! > > > > > > -Ray > > > > > > >

Re: [DISCUSS] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

Hey Dhruvil, I would suggest using the verb "allow" rather than "enable. The consumer cannot enable auto topic creation because it is configured on the broker. All it can do is prevent it from happening if it is enabled. -Jason On Tue, Aug 21, 2018 at 3:56 PM, Dhruvil Shah wrote: > Hi, > > I

[jira] [Created] (KAFKA-7322) race between compaction thread and retention thread when changing topic cleanup policy

xiongqi wu created KAFKA-7322: - Summary: race between compaction thread and retention thread when changing topic cleanup policy Key: KAFKA-7322 URL: https://issues.apache.org/jira/browse/KAFKA-7322

[jira] [Reopened] (KAFKA-6753) Speed up event processing on the controller

[ https://issues.apache.org/jira/browse/KAFKA-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Wang reopened KAFKA-6753: --- > Speed up event processing on the controller > > >

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congratulations, Dong! On Tue, Aug 21, 2018 at 4:38 PM Jason Gustafson wrote: > Congrats! > > On Tue, Aug 21, 2018 at 10:03 AM, Ray Chiang wrote: > > > Congrats Dong! > > > > -Ray > > > > > > On 8/21/18 9:33 AM, Becket Qin wrote: > > > >> Congrats, Dong! > >> > >> On Aug 21, 2018, at 11:03 PM,

[jira] [Created] (KAFKA-7324) NPE due to lack of SASLExtensions in SASL/OAUTHBEARER

Ron Dagostino created KAFKA-7324: Summary: NPE due to lack of SASLExtensions in SASL/OAUTHBEARER Key: KAFKA-7324 URL: https://issues.apache.org/jira/browse/KAFKA-7324 Project: Kafka Issue

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

Jason, that's an interesting point regarding the Java client. Do we know what clients in other languages do in these cases? Ismael On Tue, 21 Aug 2018, 17:30 Jason Gustafson, wrote: > Hi Dongjin, > > One of the complications is that old versions of the API will not expect a > new error code.

Re: Request for contributor permissions

Thank you. 2018-08-22 12:00 GMT+08:00 Guozhang Wang : > Hello Jack, > > I've added you to the contributor list. Cheers. > > Guozhang > > 2018-08-21 19:07 GMT-07:00 楊宗訓 : > > > JIRA ID: jackyoh > > > > > > Thanks in advance! > > > > > > -- > >

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

Hi Dongjin, One of the complications is that old versions of the API will not expect a new error code. However, since we expect this to be a fatal error anyway for old clients, it may still be more useful to return the correct error code. For example, the Kafka clients use the following code to

[jira] [Created] (KAFKA-7323) add replication factor doesn't work

superheizai created KAFKA-7323: -- Summary: add replication factor doesn't work Key: KAFKA-7323 URL: https://issues.apache.org/jira/browse/KAFKA-7323 Project: Kafka Issue Type: Bug

Request for contributor permissions

JIRA ID: jackyoh Thanks in advance! -- * 研究發展部 - 資深軟體工程師 楊宗訓 jack e-mail:j...@is-land.com.tw 亦思科技股份有限公司 www.is-land.com.tw 300 新竹科學園區展業二路4號3樓 *

Re: Request for contributor permissions

Hello Jack, I've added you to the contributor list. Cheers. Guozhang 2018-08-21 19:07 GMT-07:00 楊宗訓 : > JIRA ID: jackyoh > > > Thanks in advance! > > > -- > * > 研究發展部 - 資深軟體工程師 > > 楊宗訓 jack > e-mail:j...@is-land.com.tw > >

Build failed in Jenkins: kafka-trunk-jdk8 #2915

See Changes: [wangguoz] MINOR: Small refactorings on KTable joins (#5540) [wangguoz] KAFKA-7301: Fix streams Scala join ambiguous overload (#5502) -- [...truncated 2.48

Build failed in Jenkins: kafka-trunk-jdk10 #422

See Changes: [junrao] KAFKA-6753: Updating the OfflinePartitions count only when necessary [jason] MINOR: Improved configuration formatting in documentation (#5532) --

Re: Contribution request

Hi, Flavien, Thanks for your interest. Just added you to the contributor list. Jun On Tue, Aug 21, 2018 at 10:19 AM, Flavien Raynaud wrote: > Hi there, > > Would it be possible to add me to the contributor list? > My JIRA username is: flavr > > Cheers, > Flavien >

Add to contributor list

Hi there, Could you please add me to the contributors list? My jira id is lmontrieux Cheers, Lionel -- Lionel Montrieux

[jira] [Resolved] (KAFKA-5407) Mirrormaker dont start after upgrade

[ https://issues.apache.org/jira/browse/KAFKA-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fernando Vega resolved KAFKA-5407. -- Resolution: Fixed > Mirrormaker dont start after upgrade >

Re: [VOTE] KIP-328: Ability to suppress updates for KTables

Hello again, all, I belatedly had a better idea for adding grace period to the Windows class hierarchy (TimeWindows, UnlimitedWindows, JoinWindows). Instead of providing the grace-setter in the abstract class and having to retract it in UnlimitedWindows, I've made the getter abstract method in

[jira] [Created] (KAFKA-7319) Add documentation for consumer group management

Manikumar created KAFKA-7319: Summary: Add documentation for consumer group management Key: KAFKA-7319 URL: https://issues.apache.org/jira/browse/KAFKA-7319 Project: Kafka Issue Type: Task

Build failed in Jenkins: kafka-1.0-jdk7 #235

See Changes: [mjsax] KAFKA-7284: streams should unwrap fenced exception (#5520) -- [...truncated 376.64 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

Build failed in Jenkins: kafka-trunk-jdk10 #421

See Changes: [jason] MINOR: Additional testing of logical type handling in Cast transform -- [...truncated 1.55 MB...] kafka.zk.KafkaZkClientTest >

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi John That is an excellent idea. The header usage I propose would be limited entirely to internal topics, and this could very well be the solution to potential conflicts. If we do not officially reserve a prefix "__" then I think this would be the safest idea, as it would entirely avoid any

Contribution request

Hi there, Would it be possible to add me to the contributor list? My JIRA username is: flavr Cheers, Flavien

Re: Add to contributor list

Done. On 8/21/18 11:14 AM, Lionel Montrieux wrote: > Hi there, > > Could you please add me to the contributors list? > My jira id is lmontrieux > > Cheers, > Lionel > signature.asc Description: OpenPGP digital signature

[jira] [Resolved] (KAFKA-6753) Speed up event processing on the controller

[ https://issues.apache.org/jira/browse/KAFKA-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-6753. Resolution: Fixed Fix Version/s: 2.1.0 Merged the PR to trunk. > Speed up event processing on the

Build failed in Jenkins: kafka-0.11.0-jdk7 #396

See Changes: [matthias] KAFKA-7284: streams should unwrap fenced exception (#5520) -- [...truncated 192.02 KB...] kafka.api.TransactionsTest >

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Just a quick thought regarding headers: > I think there is no absolute-safe ways to avoid conflicts, but we can still > consider using some name patterns to reduce the likelihood as much as > possible.. e.g. consider sth. like the internal topics naming: e.g. > "__internal_[name]"? I think there

Re: [VOTE] KIP-346 - Improve LogCleaner behavior on error

+1 Thanks for the KIP! I'd suggest mentioning the configurations that were previously proposed in the rejected alternatives section. We may reconsider them in the future. On Mon, Aug 13, 2018 at 9:48 AM, Dhruvil Shah wrote: > Thanks for the KIP, Stanislav! +1 (non-binding) > > - Dhruvil > > On

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

Ismael, Jason and all, I rewrote the backward compatibility strategy & its alternatives like following, based on Ismael & Jason's comments. Since it is not updated to the wiki yet, don't hesitate to give me a message if you have any opinion on it. ``` *Backward Compatibility* We need to

Re: [DISCUSS] KIP-358: Migrate Streams API to Duration instead of long ms times

I'll solicit more reviews. Let's get at least one committer to chime in before we start a vote (since we need their approval anyway). -John On Mon, Aug 20, 2018 at 12:39 PM Nikolay Izhikov wrote: > Hello, Ted. > > Thanks for the comment. > > I've edit KIP and change proposal to `windowSize`. >

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Still havent completly grabbed it. sorry will read more On 17.08.2018 21:23, Jan Filipiak wrote: Cool stuff. I made some random remarks. Did not touch the core of the algorithm yet. Will do Monday 100% I don't see Interactive Queries :) like that! On 17.08.2018 20:28, Adam Bellemare

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congratulation Dong! On Tue, Aug 21, 2018 at 1:59 AM Viktor Somogyi-Vass wrote: > Congrats Dong! :) > > On Tue, Aug 21, 2018 at 10:09 AM James Cheng wrote: > > > Congrats Dong! > > > > -James > > > > > On Aug 20, 2018, at 3:54 AM, Ismael Juma wrote: > > > > > > Hi everyone, > > > > > > Dong

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! -Ray On 8/21/18 9:33 AM, Becket Qin wrote: Congrats, Dong! On Aug 21, 2018, at 11:03 PM, Eno Thereska wrote: Congrats Dong! Eno On Tue, Aug 21, 2018 at 7:05 AM, Ted Yu wrote: Congratulation Dong! On Tue, Aug 21, 2018 at 1:59 AM Viktor Somogyi-Vass <