Re: [VOTE] KIP-159: Introducing Rich functions to Streams

Yes, the mail said only join so I wanted to clarify. On 17.11.2017 19:05, Matthias J. Sax wrote: Yes. But I think an aggregation is an many-to-one operation, too. For the stripping off part: internally, we can just keep some record context, but just do not allow users to access it (because

[GitHub] kafka-site issue #109: Added secondary nav to streams sub-page

Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/109 LGTM. Merged to asf-site. ---

[GitHub] kafka-site pull request #109: Added secondary nav to streams sub-page

Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/109 ---

Re: 答复: 答复: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

Hi, Charly, Thanks for the input. It makes sense. Hi, Hu, Perhaps we can keep the per partition records-lead-min and records-lead-avg as you had before, but just add the topic and the partition as the tags instead of prefix of the metric name. Thanks, Jun On Wed, Nov 15, 2017 at 4:58 AM,

[GitHub] kafka-site pull request #109: Added secondary nav to streams sub-page

GitHub user manjuapu opened a pull request: https://github.com/apache/kafka-site/pull/109 Added secondary nav to streams sub-page Added secondary nav to streams sub-page: quickstart.html tutorial.html developer-guide.html core-concepts.html @guozhangwang

Build failed in Jenkins: kafka-trunk-jdk9 #203

See Changes: [wangguoz] MINOR: improve StateStore JavaDocs -- [...truncated 1.42 MB...] kafka.javaapi.message.ByteBufferMessageSetTest > testWrittenEqualsRead PASSED

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

Hi, Thanks for your comments. I agree with Matthias partially. I think we should relax some requirements related with to() and through() methods. IMHO, Produced class can cover (existing/to be created) topic information, and which will ease our effort: KStream.to(Produced topicInfo)

[jira] [Resolved] (KAFKA-5721) Kafka broker stops after network failure

[ https://issues.apache.org/jira/browse/KAFKA-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-5721. --- Resolution: Fixed Fix Version/s: 0.11.0.2 The specific deadlock in the stack trace in

Build failed in Jenkins: kafka-trunk-jdk7 #2981

See Changes: [wangguoz] MINOR: improve StateStore JavaDocs -- [...truncated 383.18 KB...] kafka.controller.PartitionLeaderElectionAlgorithmsTest >

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 On 11/17/17 9:35 AM, Ted Yu wrote: > +1 > > On Fri, Nov 17, 2017 at 9:34 AM, Bill Bejeck wrote: > >> +1 >> >> Thanks, >> Bill >> >> On Fri, Nov 17, 2017 at 12:13 PM, Colin McCabe wrote: >> >>> +1 (non-binding) >>> >>> Colin >>> >>> On Tue, Nov 14,

Jenkins build is back to normal : kafka-0.11.0-jdk7 #337

See

Build failed in Jenkins: kafka-trunk-jdk9 #202

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

[jira] [Resolved] (KAFKA-6230) KafkaConsumer.poll(0) should not block forever if coordinator is not available

[ https://issues.apache.org/jira/browse/KAFKA-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6230. Resolution: Duplicate > KafkaConsumer.poll(0) should not block forever if coordinator is

Build failed in Jenkins: kafka-trunk-jdk8 #2220

See Changes: [wangguoz] MINOR: improve StateStore JavaDocs -- [...truncated 383.67 KB...] kafka.api.PlaintextConsumerTest >

Re: Stream Processing Meetup@LinkedIn (Dec 4th)

Hi Paolo, Yes, we will stream the meetup. Usually the link will be posted to the meetup website a couple of hours before the meetup. Feel free to ping me if you don't see it. Thanks, Jiangjie (Becket) Qin On Fri, Nov 17, 2017 at 11:59 AM, Paolo Patierno wrote: > Hi

KIP-199 - Could offset management be part of the Connect REST API?

Hi, I was reading KIP-199 [1] for adding a tool for Kafka Connect offset management. This would be a very useful functionality for users of the Debezium CDC connectors, too. What I was wondering, instead of having a separate tool for this, has it been considered to expose offset management via

[jira] [Resolved] (KAFKA-6231) Download page must link to source artifact

[ https://issues.apache.org/jira/browse/KAFKA-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebb resolved KAFKA-6231. - Resolution: Invalid Doh - sorry, wrong project - there are source links on Kafka > Download page must link to

Re: Stream Processing Meetup@LinkedIn (Dec 4th)

Hi Becket, I watched some of these meetups on the related YouTube channel in the past. Will be it available in streaming or just recorded for watching it later ? Thanks Paolo From: Becket Qin Sent: Friday, November 17, 2017 8:33:04 PM To:

[jira] [Created] (KAFKA-6231) Download page must link to source artifact

Sebb created KAFKA-6231: --- Summary: Download page must link to source artifact Key: KAFKA-6231 URL: https://issues.apache.org/jira/browse/KAFKA-6231 Project: Kafka Issue Type: Bug Reporter:

[GitHub] kafka pull request #4228: MINOR: improve StateStore JavaDocs

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4228 ---

Re: [ANNOUNCE] Apache Kafka 0.11.0.2 Released

Thanks for driving this release Rajini ! On Fri, Nov 17, 2017 at 11:15 AM, Rajini Sivaram wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka > 0.11.0.2. > > > This is a bug fix release and it includes fixes and improvements from 16 >

Fwd: [ANNOUNCE] Apache Kafka 0.11.0.2 Released

Resending to kaka-clients... The Apache Kafka community is pleased to announce the release for Apache Kafka 0.11.0.2. This is a bug fix release and it includes fixes and improvements from 16 JIRAs, including a few critical bugs. All of the changes in this release can be found in the release

Stream Processing Meetup@LinkedIn (Dec 4th)

Hi Kafka users and developers, We are going to host our quarterly Stream Processing Meetup@LinkedIn on Dec 4. There will be three speakers from Slack, Uber and LinkedIn. Please check the details below if you are interested. Thanks, Jiangjie (Becket) Qin *Stream Processing with Apache Kafka &

[jira] [Resolved] (KAFKA-6222) Download page must not link to dist.apache.org

[ https://issues.apache.org/jira/browse/KAFKA-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6222. --- Resolution: Fixed Fix Version/s: 0.11.0.2 Updated along with the 0.11.0.2 changes. >

[ANNOUNCE] Apache Kafka 0.11.0.2 Released

The Apache Kafka community is pleased to announce the release for Apache Kafka 0.11.0.2. This is a bug fix release and it includes fixes and improvements from 16 JIRAs, including a few critical bugs. All of the changes in this release can be found in the release notes:

[jira] [Created] (KAFKA-6230) KafkaConsumer.poll(0) should not block forever if coordinator is not available

Dong Lin created KAFKA-6230: --- Summary: KafkaConsumer.poll(0) should not block forever if coordinator is not available Key: KAFKA-6230 URL: https://issues.apache.org/jira/browse/KAFKA-6230 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk9 #201

See Changes: [ismael] KAFKA-6046; DeleteRecordsRequest to a follower should return NOT_LEADER -- [...truncated 1.42 MB...] kafka.controller.ControllerIntegrationTest >

Adding log4j-extras to Apache Kafka?

I'm curious if there is a reason we do not include log4j-extras in Kafka. If we had it, users could configure RollingFileAppender with compression. best, Colin

Re: [VOTE] KIP-159: Introducing Rich functions to Streams

Yes. But I think an aggregation is an many-to-one operation, too. For the stripping off part: internally, we can just keep some record context, but just do not allow users to access it (because the context context does not make sense for them) by hiding the corresponding APIs. -Matthias On

[jira] [Created] (KAFKA-6229) Controller node is not switched in ZK when existing is blocked using iptables

Navdeep Brar created KAFKA-6229: --- Summary: Controller node is not switched in ZK when existing is blocked using iptables Key: KAFKA-6229 URL: https://issues.apache.org/jira/browse/KAFKA-6229 Project:

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 On Fri, Nov 17, 2017 at 9:34 AM, Bill Bejeck wrote: > +1 > > Thanks, > Bill > > On Fri, Nov 17, 2017 at 12:13 PM, Colin McCabe wrote: > > > +1 (non-binding) > > > > Colin > > > > On Tue, Nov 14, 2017, at 10:02, Guozhang Wang wrote: > > > Hello folks, >

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 Thanks, Bill On Fri, Nov 17, 2017 at 12:13 PM, Colin McCabe wrote: > +1 (non-binding) > > Colin > > On Tue, Nov 14, 2017, at 10:02, Guozhang Wang wrote: > > Hello folks, > > > > I have filed a new KIP on adding AdminClient into Streams for internal > > topic management.

Re: [DISCUSS] Hide internal topics' directories

On Tue, Nov 14, 2017, at 19:50, Hu Xi wrote: > Hi all, > > Many new Kafka users are confused about the fact there are a lot of > sub-directories named '__consumer_offsets-***' or > '__transaction_state-***' under the broker data directory and ask if they > can be removed. > > Do you guys think

[jira] [Created] (KAFKA-6228) Intermittent test failure in FetchRequestTest.testDownConversionWithConnectionFailure

Ted Yu created KAFKA-6228: - Summary: Intermittent test failure in FetchRequestTest.testDownConversionWithConnectionFailure Key: KAFKA-6228 URL: https://issues.apache.org/jira/browse/KAFKA-6228 Project: Kafka

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Hello Jorge, I left some comments on the discuss thread. The wiki page itself looks good overall. Guozhang On Tue, Nov 14, 2017 at 10:02 AM, Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Added. > > El mar., 14 nov. 2017 a las 19:00, Ted Yu () >

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Hello Jorge, I made a pass over the wiki, and here are a few comments: 1. First, regarding to Tom's comment #2 above, I think if we are only going to include the String groupId. Then it is Okay to keep as a String than using a new wrapper class. However, I think we could include the

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 (non-binding) Colin On Tue, Nov 14, 2017, at 10:02, Guozhang Wang wrote: > Hello folks, > > I have filed a new KIP on adding AdminClient into Streams for internal > topic management. > > Please review and cast your vote on this thread. > >

Build failed in Jenkins: kafka-trunk-jdk8 #2219

See Changes: [ismael] KAFKA-6046; DeleteRecordsRequest to a follower should return NOT_LEADER -- [...truncated 384.77 KB...] kafka.security.auth.ResourceTypeTest >

Build failed in Jenkins: kafka-trunk-jdk7 #2980

See Changes: [ismael] KAFKA-6046; DeleteRecordsRequest to a follower should return NOT_LEADER -- [...truncated 383.46 KB...] kafka.log.BrokerCompressionTest >

[jira] [Resolved] (KAFKA-6103) one broker appear to dead lock after running serval hours with a fresh cluster

[ https://issues.apache.org/jira/browse/KAFKA-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6103. Resolution: Duplicate > one broker appear to dead lock after running serval hours with a fresh

[jira] [Created] (KAFKA-6227) Kafka 0.11.01 New consumer - multiple consumers under same group not working as expected

Ramkumar created KAFKA-6227: --- Summary: Kafka 0.11.01 New consumer - multiple consumers under same group not working as expected Key: KAFKA-6227 URL: https://issues.apache.org/jira/browse/KAFKA-6227

[jira] [Resolved] (KAFKA-6046) DeleteRecordsRequest to a non-leader

[ https://issues.apache.org/jira/browse/KAFKA-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6046. Resolution: Fixed > DeleteRecordsRequest to a non-leader > > >

[GitHub] kafka pull request #4052: KAFKA-6046 DeleteRecordsRequest to a non-leader sh...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4052 ---

[jira] [Resolved] (KAFKA-679) Phabricator for code review

[ https://issues.apache.org/jira/browse/KAFKA-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-679. --- Resolution: Won't Do Yes, this can be safely closed. > Phabricator for code review >

Build failed in Jenkins: kafka-trunk-jdk9 #200

See Changes: [ismael] MINOR: Avoiding attempt to connect to Zookeeper on closing consumer for -- [...truncated 1.42 MB...] kafka.zookeeper.ZooKeeperClientTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2218

See Changes: [ismael] MINOR: Avoiding attempt to connect to Zookeeper on closing consumer for -- [...truncated 1.89 MB...]

Build failed in Jenkins: kafka-trunk-jdk7 #2979

See Changes: [ismael] MINOR: Avoiding attempt to connect to Zookeeper on closing consumer for -- [...truncated 385.93 KB...] kafka.zk.KafkaZkClientTest >

[jira] [Created] (KAFKA-6226) Performance Consumer should print units in it's output, like the producer

Antony Stubbs created KAFKA-6226: Summary: Performance Consumer should print units in it's output, like the producer Key: KAFKA-6226 URL: https://issues.apache.org/jira/browse/KAFKA-6226 Project:

[jira] [Created] (KAFKA-6225) Add an option to performance consumer consume continuously

Antony Stubbs created KAFKA-6225: Summary: Add an option to performance consumer consume continuously Key: KAFKA-6225 URL: https://issues.apache.org/jira/browse/KAFKA-6225 Project: Kafka

[GitHub] kafka pull request #3301: MINOR: Avoiding attempt to connect to Zookeeper on...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3301 ---

[GitHub] kafka pull request #4230: KAFKA-5563: Moved comparison of connector name fro...

GitHub user soenkeliebau opened a pull request: https://github.com/apache/kafka/pull/4230 KAFKA-5563: Moved comparison of connector name from url against name … …from config to own function and added check to create connector call. You can merge this pull request into a

Re: [VOTE] KIP-159: Introducing Rich functions to Streams

Hey, ... and group by. And yes there is no logical context we can present. The context present has nothing todo with the record currently processed. Its just doesn't come out https://en.wikipedia.org/wiki/Relational_algebra#Aggregation I am all in on this approach. Best Jan On 17.11.2017

[GitHub] kafka pull request #4229: MINOR: Code cleanup

GitHub user Kamal15 opened a pull request: https://github.com/apache/kafka/pull/4229 MINOR: Code cleanup - Used arrays directly instead of constructing List while getting storeNames - Used proper Integer identifier in the Log. *More detailed description of your change,