[GitHub] kafka pull request #3712: MINOR: Fix transient failure in SocketServerTest.t...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3712 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Replace Broker

2017-08-24 Thread Put C
Trying to add a new broker to the Kafka cluster and decommission the existing broker. Using the reassignment-partitions script, the partitions are migrated successfully to the new broker. But the consumer offsets are not migrating from existing broker to the new broker (Consumer offsets are stored

Jenkins build is back to normal : kafka-0.11.0-jdk7 #284

2017-08-24 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3733: [WIP] MINOR: KIP-160 docs

2017-08-24 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/3733 [WIP] MINOR: KIP-160 docs You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KMinor-kip160-docs Alternatively you can

Build failed in Jenkins: kafka-trunk-jdk8 #1940

2017-08-24 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5342; Clarify producer fatal/abortable errors and fix -- [...truncated 2.46 MB...]

[GitHub] kafka pull request #3732: MINOR: doc changes for KIP-138

2017-08-24 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/3732 MINOR: doc changes for KIP-138 1. Core concepts (added the stream time definition), upgrade guide and developer guide. 2. Related Java docs changes. You can merge this pull request into a

[GitHub] kafka pull request #3731: KAFKA-5720: Fix AdminClientIntegrationTest#testCal...

2017-08-24 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/3731 KAFKA-5720: Fix AdminClientIntegrationTest#testCallInFlightTimeouts * When a call is aborted, that should count as a "try" in the failure log message. * FailureInjectingTimeoutProcessorFactory

[jira] [Resolved] (KAFKA-5342) Distinguish abortable failures in transactional producer

2017-08-24 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5342. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3716

[GitHub] kafka pull request #3716: KAFKA-5342: Clarify fatal/abortable exceptions use...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3716 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-5784) Add a sensor for dropped records in window stores

2017-08-24 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-5784: Summary: Add a sensor for dropped records in window stores Key: KAFKA-5784 URL: https://issues.apache.org/jira/browse/KAFKA-5784 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-5783) Implement KafkaPrincipalBuilder interface with support for SASL (KIP-189)

2017-08-24 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-5783: -- Summary: Implement KafkaPrincipalBuilder interface with support for SASL (KIP-189) Key: KAFKA-5783 URL: https://issues.apache.org/jira/browse/KAFKA-5783 Project:

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Sriram Subramanian
+1 On Thu, Aug 24, 2017 at 10:20 AM, Guozhang Wang wrote: > +1. Thanks Damian! > > On Thu, Aug 24, 2017 at 9:47 AM, Bill Bejeck wrote: > > > Thanks for the KIP! > > > > +1 > > > > Thanks, > > Bill > > > > On Thu, Aug 24, 2017 at 12:25 PM, Damian Guy

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

2017-08-24 Thread Jason Gustafson
Hey Becket, Yeah, my point is that we should never retry a batch using a different PID/sequence. In the current implementation, the PID/sequence is assigned when the batch is dequeued and it is never changed after that. Even if we reset the PID due to an error on another partition, we will

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Matthias J. Sax
Thanks for clarification. I see your point. Java varargs are problematic in general IMHO as they force you to put them as last argument making parameter ordering unnatural for some cases (as we have it currently in the API). Nevertheless, I think that reading a single topic is the most common

Re: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Jun Rao
Congratulations, Jiangjie! Jun On Wed, Aug 23, 2017 at 10:20 PM, Joel Koshy wrote: > Hi everyone, > > Jiangjie (Becket) Qin has been a Kafka committer in October 2016 and has > contributed significantly to several major patches, reviews and discussions > since. I am glad

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

2017-08-24 Thread Becket Qin
Hi Jason, delivery.timeout.ms sounds good to me. I was referring to the case that we are resetting the PID/sequence after expire a batch. This is more about the sending the batches after the expired batch. The scenario being discussed is expiring one of the batches in a in-flight request and

[jira] [Created] (KAFKA-5782) Avoid unnecessary PID reset when expire batches.

2017-08-24 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-5782: --- Summary: Avoid unnecessary PID reset when expire batches. Key: KAFKA-5782 URL: https://issues.apache.org/jira/browse/KAFKA-5782 Project: Kafka Issue Type:

Re: [VOTE] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-24 Thread Vahid S Hashemian
+1 Thanks Rajini. --Vahid From: Edoardo Comar To: dev@kafka.apache.org Date: 08/24/2017 10:55 AM Subject:Re: [VOTE] KIP-152 - Improve diagnostics for SASL authentication failures Thanks Rajini! +1 (non-binding)

Re: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Becket Qin
Thanks everyone! On Thu, Aug 24, 2017 at 11:27 AM, Jason Gustafson wrote: > Congrats Becket! > > On Thu, Aug 24, 2017 at 11:15 AM, Ismael Juma wrote: > > > Congratulations Becket! > > > > On 24 Aug 2017 6:20 am, "Joel Koshy" wrote: >

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Guozhang Wang
Matthias, I think it's my bad that I did not post another comment on the mailing list while syncing with Damian. Here it is: Regarding 1) above, a second thought on varargs: though I have not heard from anyone using multiple topics, it is also true that people will just keep silent until their

Re: [DISCUSS] KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern

2017-08-24 Thread Jason Gustafson
Seems reasonable. I don't recall any specific reason for not providing this method initially. -Jason On Thu, Aug 24, 2017 at 5:50 AM, Attila Kreiner wrote: > Hi All, > > I created KIP-191: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Matthias J. Sax
We now have > public synchronized KStream stream(final Collection > topic, final Consumed options) This would prevent so write code like builder.stream("topic", Consumers.with(...)); I think, we need methods StreamsBuilder#stream(String topic); StreamsBuilder#stream(String

Re: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Jason Gustafson
Congrats Becket! On Thu, Aug 24, 2017 at 11:15 AM, Ismael Juma wrote: > Congratulations Becket! > > On 24 Aug 2017 6:20 am, "Joel Koshy" wrote: > > Hi everyone, > > Jiangjie (Becket) Qin has been a Kafka committer in October 2016 and has > contributed

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

2017-08-24 Thread Jason Gustafson
@Becket Good point about unnecessarily resetting the PID in cases where we know the request has failed. Might be worth opening a JIRA to try and improve this. So if we expire the batch prematurely and resend all > the other batches in the same request, chances are there will be > duplicates. If

Re: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Ismael Juma
Congratulations Becket! On 24 Aug 2017 6:20 am, "Joel Koshy" wrote: Hi everyone, Jiangjie (Becket) Qin has been a Kafka committer in October 2016 and has contributed significantly to several major patches, reviews and discussions since. I am glad to announce that Becket is

Re: [VOTE] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-24 Thread Edoardo Comar
Thanks Rajini! +1 (non-binding) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Rajini Sivaram To: dev Date: 24/08/2017 18:30 Subject:[VOTE] KIP-152 -

[VOTE] KIP-188 - Add new metrics to support health checks

2017-08-24 Thread Rajini Sivaram
Hi all, I would like to start the vote on KIP-188 that adds additional metrics to support health checks for Kafka Ops. Details are here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-188+-+Add+new+metrics+to+support+health+checks Thank you, Rajini

[VOTE] KIP-187 - Add cumulative count metric for all Kafka rate metrics

2017-08-24 Thread Rajini Sivaram
Hi all, I would like to start the vote on KIP-187 that adds a cumulative count metric associated with each Kafka rate metric to improve downstream processing of rate metrics. Details are here:

Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Mickael Maison
Congratulations Becket! On Thu, Aug 24, 2017 at 6:23 PM, Rajini Sivaram wrote: > Congratulations, Becket! > > Regards, > > Rajini > > On Thu, Aug 24, 2017 at 10:02 AM, Vahid S Hashemian < > vahidhashem...@us.ibm.com> wrote: > >> Congrats Becket! >> >> --Vahid >> >> >> >>

Re: [DISCUSS] KIP-131 : Add access to OffsetStorageReader from SourceConnector

2017-08-24 Thread Florian Hussonnois
Hi Randall, Thank you for your answer. I will update the KIP and the PR with your last approach which sounds better. Thanks. Le 16 août 2017 00:53, "Randall Hauch" a écrit : Sorry it's taken me so long to come back to this. Have you considered creating a

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Xavier Léauté
A few comments on the KIP: - I'm a bit confused about the BytesStoreSupplier interface. Nothing in its definition is really specific to Bytes, and when I see return types like BytesStoreSupplier>, it seems redundant to have "Bytes" in the supplier name. Why can't we

[VOTE] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-24 Thread Rajini Sivaram
Hi all, I would like to start vote on KIP-152 to improve diagnostics of authentication failures and to update clients to treat authentication failures as fatal exceptions rather than transient errors:

Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Rajini Sivaram
Congratulations, Becket! Regards, Rajini On Thu, Aug 24, 2017 at 10:02 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Congrats Becket! > > --Vahid > > > > From: Abhishek Mendhekar > To: dev@kafka.apache.org > Date: 08/24/2017 09:53 AM >

Re: [DISCUSS] KIP-189: Improve principal builder interface and add support for SASL

2017-08-24 Thread Mayuresh Gharat
Sure. Thanks, Mayuresh On Wed, Aug 23, 2017 at 5:07 PM, Jun Rao wrote: > Hi, Mayuresh, > > Since this KIP covers the requirement in KIP-111, could you review it too? > > Thanks, > > Jun > > > On Tue, Aug 22, 2017 at 3:04 PM, Jason Gustafson > wrote: >

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Guozhang Wang
+1. Thanks Damian! On Thu, Aug 24, 2017 at 9:47 AM, Bill Bejeck wrote: > Thanks for the KIP! > > +1 > > Thanks, > Bill > > On Thu, Aug 24, 2017 at 12:25 PM, Damian Guy wrote: > > > Hi, > > > > I'd like to kick off the voting thread for KIP-182: > >

[jira] [Resolved] (KAFKA-4350) Can't mirror from Kafka 0.9 to Kafka 0.10.1

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4350. -- Resolution: Won't Fix Closing as per comments. > Can't mirror from Kafka 0.9 to Kafka 0.10.1 >

Jenkins build is back to normal : kafka-trunk-jdk7 #2671

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-4109) kafka client send msg exception

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4109. -- Resolution: Cannot Reproduce Pl reopen if you think the issue still exists > kafka client send msg

Build failed in Jenkins: kafka-trunk-jdk8 #1939

2017-08-24 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: add upgrade section for 1.0.0 -- [...truncated 2.02 MB...] org.apache.kafka.common.security.scram.ScramMessagesTest >

[GitHub] kafka pull request #3730: MINOR: stateful docs for aggregates [WiP]

2017-08-24 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/3730 MINOR: stateful docs for aggregates [WiP] You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka minor-docs-aggregates

Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Vahid S Hashemian
Congrats Becket! --Vahid From: Abhishek Mendhekar To: dev@kafka.apache.org Date: 08/24/2017 09:53 AM Subject:Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin Congrats Becket! On Thu, Aug 24, 2017 at 9:48 AM, Damian Guy

[jira] [Resolved] (KAFKA-3885) Kafka new producer cannot failover

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3885. -- Resolution: Duplicate > Kafka new producer cannot failover > -- > >

Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Damian Guy
Congratulations. On Thu, 24 Aug 2017 at 17:44 Matthias J. Sax wrote: > Congrats! > > On 8/23/17 10:40 PM, Hu Xi wrote: > > Congrats Becket! > > > > > > > > 发件人: Guozhang Wang > > 发送时间: 2017年8月24日 13:32 > > 收件人:

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Bill Bejeck
Thanks for the KIP! +1 Thanks, Bill On Thu, Aug 24, 2017 at 12:25 PM, Damian Guy wrote: > Hi, > > I'd like to kick off the voting thread for KIP-182: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 182%3A+Reduce+Streams+DSL+overloads+and+allow+easier+ >

Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Matthias J. Sax
Congrats! On 8/23/17 10:40 PM, Hu Xi wrote: > Congrats Becket! > > > > 发件人: Guozhang Wang > 发送时间: 2017年8月24日 13:32 > 收件人: dev@kafka.apache.org > 主题: Re: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin > > Congrats Jiangjie! > > >

[GitHub] kafka pull request #3722: KAFKA-5603: Don't abort TX for zombie tasks

2017-08-24 Thread mjsax
Github user mjsax closed the pull request at: https://github.com/apache/kafka/pull/3722 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Damian Guy
Hi, I'd like to kick off the voting thread for KIP-182: https://cwiki.apache.org/confluence/display/KAFKA/KIP-182%3A+Reduce+Streams+DSL+overloads+and+allow+easier+use+of+custom+storage+engines Thanks, Damian

[GitHub] kafka pull request #3687: MINOR: add upgrade section for 1.0.0

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3687 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-2414) Running kafka-producer-perf-test.sh with " --messages 10000000 --message-size 1000 --new-producer" will get WARN Error in I/O.

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2414. -- Resolution: Cannot Reproduce This might have been fixed in latest versions. Pl reopen if you think the

[jira] [Created] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

2017-08-24 Thread Raoufeh Hashemian (JIRA)
Raoufeh Hashemian created KAFKA-5781: Summary: Frequent long produce latency periods that result in reduced produce rate. Key: KAFKA-5781 URL: https://issues.apache.org/jira/browse/KAFKA-5781

[jira] [Resolved] (KAFKA-2451) Exception logged but not managed

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2451. -- Resolution: Cannot Reproduce Pl reopen if you think the issue still exists > Exception logged but

[jira] [Resolved] (KAFKA-2577) one node of Kafka cluster cannot process produce request

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2577. -- Resolution: Cannot Reproduce This might have fixed in latest versions. Pl reopen if you think the issue

[jira] [Resolved] (KAFKA-2560) Fatal error during KafkaServer startup because of Map failed error.

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2560. -- Resolution: Fixed This is due to java.lang.OutOfMemoryError. Pl reopen if you think the issue still

[jira] [Resolved] (KAFKA-2565) Offset Commit is not working if multiple consumers try to commit the offset

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2565. -- Resolution: Cannot Reproduce may be related to deployment issue. Pl reopen if you think the issue still

[jira] [Resolved] (KAFKA-2829) Inconsistent naming in {Producer,Consumer} Callback interfaces

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2829. -- Resolution: Won't Fix These are public interfaces heavily used by users. It's not appropriate to

[jira] [Resolved] (KAFKA-2966) 0.9.0 docs missing upgrade notes regarding replica lag

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2966. -- Resolution: Fixed > 0.9.0 docs missing upgrade notes regarding replica lag >

[jira] [Resolved] (KAFKA-627) Make UnknownTopicOrPartitionException a WARN in broker

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-627. - Resolution: Fixed Not observed on latest versions > Make UnknownTopicOrPartitionException a WARN in

[jira] [Resolved] (KAFKA-3332) Consumer can't consume messages from zookeeper chroot

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3332. -- Resolution: Cannot Reproduce > Consumer can't consume messages from zookeeper chroot >

[GitHub] kafka pull request #3729: KAFKA-5749: Add MeteredSessionStore and Changelogg...

2017-08-24 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3729 KAFKA-5749: Add MeteredSessionStore and ChangeloggingSessionBytesStore. Make MeteredSessionStore the outermost store. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Resolved] (KAFKA-958) Please compile list of key metrics on the broker and client side and put it on a wiki

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-958. - Resolution: Fixed Key metrics are listed on monitoring section of Kafka documentation page > Please

Build failed in Jenkins: kafka-trunk-jdk7 #2670

2017-08-24 Thread Apache Jenkins Server
See Changes: [damian.guy] MINOR: Stateless transformation documentation -- [...truncated 915.81 KB...] kafka.controller.ControllerIntegrationTest >

Re: Confluence access rights

2017-08-24 Thread Kreiner Attila
Hi Guozhang, Thanks! Attila 2017-08-22 20:15 GMT+02:00 Guozhang Wang : > Attila, > > I have added you to the wiki page list. Cheers. > > > Guozhang > > On Tue, Aug 22, 2017 at 4:29 AM, Attila Kreiner wrote: > > > Hey All, > > > > I need to create a KIP

Build failed in Jenkins: kafka-trunk-jdk8 #1938

2017-08-24 Thread Apache Jenkins Server
See Changes: [damian.guy] MINOR: Stateless transformation documentation -- [...truncated 922.42 KB...] kafka.security.auth.SimpleAclAuthorizerTest >

[jira] [Resolved] (KAFKA-962) Add list topics to ClientUtils

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-962. - Resolution: Fixed Topic management methods are added to new admin client. > Add list topics to

[jira] [Resolved] (KAFKA-1339) Time based offset retrieval seems broken

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1339. -- Resolution: Fixed Time-based offset retrieval is improved with the introduction of message timestamp.

[jira] [Created] (KAFKA-5780) Long shutdown time when updated to 0.11.0

2017-08-24 Thread Raoufeh Hashemian (JIRA)
Raoufeh Hashemian created KAFKA-5780: Summary: Long shutdown time when updated to 0.11.0 Key: KAFKA-5780 URL: https://issues.apache.org/jira/browse/KAFKA-5780 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-1497) Change producer load-balancing algorithm in MirrorMaker

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1497. -- Resolution: Fixed MIrrorMaker now uses single producer instance. > Change producer load-balancing

[GitHub] kafka pull request #3728: Add group-id to the metrics tags

2017-08-24 Thread EtaCassiopeia
GitHub user EtaCassiopeia opened a pull request: https://github.com/apache/kafka/pull/3728 Add group-id to the metrics tags It is better to have group-id in the JMX metrics. It would improve debuggability of systems:

[GitHub] kafka pull request #3711: MINOR: Stateless transformation documentation

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3711 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-0.11.0-jdk7 #283

2017-08-24 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-5603; Don't abort TX for zombie tasks -- [...truncated 862.56 KB...] at

[DISCUSS] KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern

2017-08-24 Thread Attila Kreiner
Hi All, I created KIP-191: https://cwiki.apache.org/confluence/display/KAFKA/KIP-191%3A+KafkaConsumer.subscribe%28%29+overload+that+takes+just+Pattern Jira: https://issues.apache.org/jira/browse/KAFKA-5726 PR: https://github.com/apache/kafka/pull/3669 Please check it. Thanks, Attila

[GitHub] kafka pull request #3724: KAFKA-5769: Transient test failure org.apache.kafk...

2017-08-24 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/3724 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-4425) Topic created with CreateTopic command, does not list partitions in metadata

2017-08-24 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4425. -- Resolution: Not A Problem Fixed as per [~Fristi] comments > Topic created with CreateTopic command,

[GitHub] kafka-site issue #71: KAFKA-4869: Update 0.10.2.0 upgrade notes

2017-08-24 Thread omkreddy
Github user omkreddy commented on the issue: https://github.com/apache/kafka-site/pull/71 @ijuma minor doc cleanup --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] kafka-site pull request #71: KAFKA-4869: Update 0.10.2.0 upgrade notes

2017-08-24 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/kafka-site/pull/71 KAFKA-4869: Update 0.10.2.0 upgrade notes You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka-site cleanup Alternatively you

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-08-24 Thread Damian Guy
A quick update. There are 2 remaining issues, that both have patches available. Hopefully they will be merged soon and we can begin: https://issues.apache.org/jira/projects/KAFKA/versions/12340632 Thanks, Damian On Tue, 22 Aug 2017 at 10:29 Damian Guy wrote: > An update

[GitHub] kafka pull request #3727: KAFKA-5754 : Refactor Streams to use LogContext

2017-08-24 Thread umesh9794
GitHub user umesh9794 opened a pull request: https://github.com/apache/kafka/pull/3727 KAFKA-5754 : Refactor Streams to use LogContext This PR utilizes `org.apache.kafka.common.utils.LogContext` for logging in `KafkaStreams`. @hachikuji, @ijuma please review this and let me know

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Damian Guy
I've updated the kip to reflect Bill's comment and also to make StreamBuilder methods have topic as the first param, i.e., StreamBuilder#stream no longer accepts varargs. On Thu, 24 Aug 2017 at 09:12 Damian Guy wrote: > On Thu, 24 Aug 2017 at 02:49 Guozhang Wang

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Damian Guy
On Thu, 24 Aug 2017 at 02:49 Guozhang Wang wrote: > I have a couple of comments but otherwise it LGTM: > > 1. For these two functions in StreamsBuilder, the topic String is set as > the second parameter in between of two options. Would that be better to be > set as the first

[jira] [Created] (KAFKA-5779) Single message may exploit application based on KStream

2017-08-24 Thread Seweryn Habdank-Wojewodzki (JIRA)
Seweryn Habdank-Wojewodzki created KAFKA-5779: - Summary: Single message may exploit application based on KStream Key: KAFKA-5779 URL: https://issues.apache.org/jira/browse/KAFKA-5779

[jira] [Created] (KAFKA-5778) Kafka cluster is not responding when one broker hangs and resulted in too many connections in close_wait in other brokers

2017-08-24 Thread saichand (JIRA)
saichand created KAFKA-5778: --- Summary: Kafka cluster is not responding when one broker hangs and resulted in too many connections in close_wait in other brokers Key: KAFKA-5778 URL: