Re: Producer becomes slow over time

Hi Erik, I've not tested it on a producer that is not a part of the kafka cluster. *Producer configuration on all machines:-* root@x.x.x.x:/a/kafka/config# cat producer.properties | egrep -v '^#|^$' metadata.broker.list=localhost:9092 producer.type=sync compression.codec=none

[jira] [Updated] (KAFKA-2597) Add Eclipse directories to .gitignore

[ https://issues.apache.org/jira/browse/KAFKA-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-2597: - Fix Version/s: 0.9.0.0 Status: Patch Available (was: Open) This contribution is ready

[jira] [Updated] (KAFKA-2494) Document ReplicaId in OffsetRequest in the protocol guide

[ https://issues.apache.org/jira/browse/KAFKA-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Magnus Reftel updated KAFKA-2494: - Summary: Document ReplicaId in OffsetRequest in the protocol guide (was: Documetn ReplicaId in

[jira] [Updated] (KAFKA-2593) KeyValueStores should not require use of the context's default serializers and deserializers

[ https://issues.apache.org/jira/browse/KAFKA-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-2593: - Status: Patch Available (was: Open) This contribution is ready for review. > KeyValueStores

[jira] [Updated] (KAFKA-2594) Add a key-value store that is a fixed-capacity in-memory LRU cache

[ https://issues.apache.org/jira/browse/KAFKA-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-2594: - Status: Patch Available (was: Open) This contribution is ready for review. > Add a key-value

Re: [DISCUSS] KIP-35 - Retrieve protocol version

If we create a protocol version negotiation api for clients, can we use it to replace or improve the ease of upgrades that break inter-broker messaging? Currently upgrades that break the wire protocol take 2 rolling restarts. The first restart we set inter.broker.protocol.version telling all

[jira] [Comment Edited] (KAFKA-2526) Console Producer / Consumer's serde config is not working

[ https://issues.apache.org/jira/browse/KAFKA-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935428#comment-14935428 ] Mayuresh Gharat edited comment on KAFKA-2526 at 9/29/15 4:53 PM: - Hi

[jira] [Commented] (KAFKA-2526) Console Producer / Consumer's serde config is not working

[ https://issues.apache.org/jira/browse/KAFKA-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935428#comment-14935428 ] Mayuresh Gharat commented on KAFKA-2526: Hi [~guozhang], can you list the steps to reproduce this

[GitHub] kafka pull request: Client Metadata internal state should be synch...

GitHub user eribeiro opened a pull request: https://github.com/apache/kafka/pull/263 Client Metadata internal state should be synchronized You can merge this pull request into a Git repository by running: $ git pull https://github.com/eribeiro/kafka KAFKA-2578 Alternatively

[GitHub] kafka pull request: KAFKA 2578 Client Metadata internal state shou...

Github user eribeiro closed the pull request at: https://github.com/apache/kafka/pull/263 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-2599) Metadata#getClusterForCurrentTopics can throw NPE even with null checking

[ https://issues.apache.org/jira/browse/KAFKA-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Ribeiro updated KAFKA-2599: -- Status: Patch Available (was: Open) > Metadata#getClusterForCurrentTopics can throw NPE even

[jira] [Commented] (KAFKA-2599) Metadata#getClusterForCurrentTopics can throw NPE even with null checking

[ https://issues.apache.org/jira/browse/KAFKA-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935835#comment-14935835 ] ASF GitHub Bot commented on KAFKA-2599: --- GitHub user eribeiro opened a pull request:

[jira] [Resolved] (KAFKA-2587) Transient test failure: `SimpleAclAuthorizerTest`

[ https://issues.apache.org/jira/browse/KAFKA-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani resolved KAFKA-2587. --- Resolution: Fixed Fix Version/s: 0.9.0.0 > Transient test failure:

[jira] [Created] (KAFKA-2599) Metadata#getClusterForCurrentTopics can throw NPE even with null checking

Edward Ribeiro created KAFKA-2599: - Summary: Metadata#getClusterForCurrentTopics can throw NPE even with null checking Key: KAFKA-2599 URL: https://issues.apache.org/jira/browse/KAFKA-2599 Project:

Jenkins build is back to normal : Kafka-trunk #649

See

[GitHub] kafka pull request: KAFKA 2578 Client Metadata internal state shou...

GitHub user eribeiro reopened a pull request: https://github.com/apache/kafka/pull/263 KAFKA 2578 Client Metadata internal state should be synchronized You can merge this pull request into a Git repository by running: $ git pull https://github.com/eribeiro/kafka KAFKA-2578

Re: [DISCUSS] KIP-35 - Retrieve protocol version

We should also consider what else should be negotiated between the broker and the client as this comes together. The version is definitely first, but there are other things, such as the max message size, that should not need to be replicated on both the broker and the client. Granted, max message

[jira] [Updated] (KAFKA-2578) Client Metadata internal state should be synchronized

[ https://issues.apache.org/jira/browse/KAFKA-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Ribeiro updated KAFKA-2578: -- Status: Patch Available (was: Open) > Client Metadata internal state should be synchronized >

[GitHub] kafka pull request: KAFKA-2587:Increasing timeout for the test ver...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/260 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request: KAFKA-2599 Metadata#getClusterForCurrentTopics...

GitHub user eribeiro opened a pull request: https://github.com/apache/kafka/pull/262 KAFKA-2599 Metadata#getClusterForCurrentTopics can throw NPE even wit… …h null checking You can merge this pull request into a Git repository by running: $ git pull

[jira] [Updated] (KAFKA-2599) Metadata#getClusterForCurrentTopics can throw NPE even with null checking

[ https://issues.apache.org/jira/browse/KAFKA-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Ribeiro updated KAFKA-2599: -- Description: While working on another issue I have just seen the following: {code} private

[jira] [Comment Edited] (KAFKA-2578) Client Metadata internal state should be synchronized

[ https://issues.apache.org/jira/browse/KAFKA-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934290#comment-14934290 ] Edward Ribeiro edited comment on KAFKA-2578 at 9/29/15 9:36 PM: Thanks!

Build failed in Jenkins: Kafka-trunk #650

See Changes: [harsha] KAFKA-2587; Increasing timeout for the test verification. -- [...truncated 5729 lines...] kafka.log.LogTest > testAppendAndReadWithSequentialOffsets PASSED kafka.log.LogTest >

[jira] [Commented] (KAFKA-2587) Transient test failure: `SimpleAclAuthorizerTest`

[ https://issues.apache.org/jira/browse/KAFKA-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936102#comment-14936102 ] Jason Gustafson commented on KAFKA-2587: [~parth.brahmbhatt] Can you take a look at this test

Re: [DISCUSS] KIP-31 - Message format change proposal

Hi Joel and other folks. I updated the KIP page with the two phase roll out, which avoids the conversion for majority of users. To do that we need to add a message.format.version configuration to broker. Other than that there is no interface change from the previous proposal. Please let me know

[GitHub] kafka pull request: KAFKA-2591: fix StreamingMetrics [WIP]

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/265 KAFKA-2591: fix StreamingMetrics [WIP] Remove state storage upon unclean shutdown and fix streaming metrics used for local state. You can merge this pull request into a Git repository by

[jira] [Commented] (KAFKA-2591) Remove Persistent Data before Restoringafter a Fault

[ https://issues.apache.org/jira/browse/KAFKA-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936273#comment-14936273 ] ASF GitHub Bot commented on KAFKA-2591: --- GitHub user guozhangwang opened a pull request:

[jira] [Commented] (KAFKA-2570) New consumer should commit before every rebalance when auto-commit is enabled

[ https://issues.apache.org/jira/browse/KAFKA-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936168#comment-14936168 ] ASF GitHub Bot commented on KAFKA-2570: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-2570) New consumer should commit before every rebalance when auto-commit is enabled

[ https://issues.apache.org/jira/browse/KAFKA-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2570. -- Resolution: Fixed Issue resolved by pull request 257 [https://github.com/apache/kafka/pull/257]

[GitHub] kafka pull request: MINOR: Set `sendTime` in `doSend` instead of `...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/264 MINOR: Set `sendTime` in `doSend` instead of `InFlightRequests.add` and rename method names for consistency @hachikuji @MayureshGharat @jjkoshy Thoughts? You can merge this pull request into a Git

[GitHub] kafka pull request: KAFKA-2570: commit offsets on rebalance/close ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/257 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : Kafka-trunk #651

See

[jira] [Commented] (KAFKA-2417) Ducktape tests for SSL/TLS

[ https://issues.apache.org/jira/browse/KAFKA-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935462#comment-14935462 ] Geoff Anderson commented on KAFKA-2417: --- [~rsivaram] Thanks for offering to help, this would be

Re: [DISCUSS] KIP-35 - Retrieve protocol version

Right. But there should be a max old version that the broker should support to avoid these incompatibility issues. For example, if the broker is at version X, it should be able to support the versions (clients and interbroker) till X-2. In case we have brokers and clients older than that it can

[jira] [Updated] (KAFKA-2598) Add Test with authorizer for producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2598: --- Fix Version/s: (was: 0.8.2.2) 0.9.0.0 Issue Type: Task (was: Bug) >

[jira] [Updated] (KAFKA-2598) Add Test with authorizer for producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2598: --- Issue Type: Sub-task (was: Task) Parent: KAFKA-1682 > Add Test with authorizer for producer

[jira] [Commented] (KAFKA-2598) Add Test with authorizer for producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935587#comment-14935587 ] Ismael Juma commented on KAFKA-2598: Thanks for filing this Parth. Do you have the cycles to work on

[jira] [Commented] (KAFKA-2598) Add Test with authorizer for producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935589#comment-14935589 ] Parth Brahmbhatt commented on KAFKA-2598: - I should be able to pick this one up next week. > Add

[jira] [Commented] (KAFKA-2058) ProducerTest.testSendWithDeadBroker transient failure

[ https://issues.apache.org/jira/browse/KAFKA-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935583#comment-14935583 ] Guozhang Wang commented on KAFKA-2058: -- I did not see this issue on my local machine either, but on

[GitHub] kafka pull request: MINOR: Quota's equals() is buggy.

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/182 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-2120: -- Resolution: Fixed Status: Resolved (was: Patch Available) +1 and committed to trunk. > Add a

[jira] [Created] (KAFKA-2598) Add Test with authorizer for producer and consumer

Parth Brahmbhatt created KAFKA-2598: --- Summary: Add Test with authorizer for producer and consumer Key: KAFKA-2598 URL: https://issues.apache.org/jira/browse/KAFKA-2598 Project: Kafka Issue

Build failed in Jenkins: Kafka-trunk #648

See Changes: [jjkoshy] KAFKA-2120; Add a request timeout to NetworkClient (KIP-19); reviewed by Jason Gustafson, Ismael Juma, Joel Koshy, Jun Rao, and Edward Ribeiro [wangguoz] MINOR: fix Quota's equal() function

[jira] [Commented] (KAFKA-2581) Run all existing ducktape tests with SSL-enabled clients and brokers

[ https://issues.apache.org/jira/browse/KAFKA-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935676#comment-14935676 ] Geoff Anderson commented on KAFKA-2581: --- [~rsivaram] My apologies for being behind on this

[jira] [Commented] (KAFKA-2598) Add Test with authorizer for producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935604#comment-14935604 ] Ismael Juma commented on KAFKA-2598: Awesome, thanks. > Add Test with authorizer for producer and

[GitHub] kafka pull request: HOTFIX: Checkstyle import fix

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/261 HOTFIX: Checkstyle import fix You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka checkstyle-import-fix Alternatively you can review and

[GitHub] kafka pull request: HOTFIX: Checkstyle import fix

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is