Re: producer-consumer issues during deployments

Hi, Thanks for your reply We have 4 phases of deploys and in each phase, we can take down few machines These releases happen every 2 weeks, because on all machines, there are a bunch of other micro services running along with the core system - Kafka in this case My only concern is that during

[jira] [Updated] (KAFKA-2882) Add constructor cache for Snappy and LZ4 Output/Input stream in Compressor.java

[ https://issues.apache.org/jira/browse/KAFKA-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2882: - Assignee: Maksim Logvinenko (was: Neha Narkhede) > Add constructor cache for Snappy and LZ4

Build failed in Jenkins: kafka_0.9.0_jdk7 #46

See Changes: [wangguoz] KAFKA-2882: Add constructor cache for Snappy and LZ4 Output/Input -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

[GitHub] kafka pull request: KAFKA-2361: unit test failure in ProducerFailu...

Github user ZoneMayor closed the pull request at: https://github.com/apache/kafka/pull/571 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2882) Add constructor cache for Snappy and LZ4 Output/Input stream in Compressor.java

[ https://issues.apache.org/jira/browse/KAFKA-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029495#comment-15029495 ] ASF GitHub Bot commented on KAFKA-2882: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-2882) Add constructor cache for Snappy and LZ4 Output/Input stream in Compressor.java

[ https://issues.apache.org/jira/browse/KAFKA-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2882. -- Resolution: Fixed Fix Version/s: 0.9.0.1 Issue resolved by pull request 580

[GitHub] kafka pull request: KAFKA-2882: Add constructor cache for Snappy a...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/580 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2361) Unit Test BUILD FAILED

[ https://issues.apache.org/jira/browse/KAFKA-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029528#comment-15029528 ] ASF GitHub Bot commented on KAFKA-2361: --- Github user ZoneMayor closed the pull request at:

Jenkins build is back to normal : kafka-trunk-jdk7 #859

See

Build failed in Jenkins: kafka-trunk-jdk8 #188

See Changes: [cshapi] KAFKA-2892 Consumer Docs Use Wrong Method -- [...truncated 4467 lines...] org.apache.kafka.connect.json.JsonConverterTest > timeToJson PASSED

[jira] [Commented] (KAFKA-2800) Update outdated dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028365#comment-15028365 ] Stevo Slavic commented on KAFKA-2800: - zkclient 0.7 is available

[jira] [Updated] (KAFKA-2890) Strange behaviour during partitions reassignment.

[ https://issues.apache.org/jira/browse/KAFKA-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Kukushkin updated KAFKA-2890: --- Attachment: reassign.json > Strange behaviour during partitions reassignment. >

[jira] [Updated] (KAFKA-2890) Strange behaviour during partitions reassignment.

[ https://issues.apache.org/jira/browse/KAFKA-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Kukushkin updated KAFKA-2890: --- Attachment: reassign.out > Strange behaviour during partitions reassignment. >

[jira] [Commented] (KAFKA-2890) Strange behaviour during partitions reassignment.

[ https://issues.apache.org/jira/browse/KAFKA-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028420#comment-15028420 ] Alexander Kukushkin commented on KAFKA-2890: 1) I've created cluster of three nodes, with

[jira] [Commented] (KAFKA-2800) Update outdated dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028447#comment-15028447 ] Ismael Juma commented on KAFKA-2800: Stevo, we are already using zkclient 0.7 in Kafka 0.9.0.0. >

[jira] [Comment Edited] (KAFKA-2890) Strange behaviour during partitions reassignment.

[ https://issues.apache.org/jira/browse/KAFKA-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028420#comment-15028420 ] Alexander Kukushkin edited comment on KAFKA-2890 at 11/26/15 9:50 AM: --

[jira] [Assigned] (KAFKA-2890) Strange behaviour during partitions reassignment.

[ https://issues.apache.org/jira/browse/KAFKA-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-2890: -- Assignee: Ismael Juma > Strange behaviour during partitions reassignment. >

[jira] [Commented] (KAFKA-2890) Strange behaviour during partitions reassignment.

[ https://issues.apache.org/jira/browse/KAFKA-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028459#comment-15028459 ] Ismael Juma commented on KAFKA-2890: Thanks, investigating. > Strange behaviour during partitions

producer-consumer issues during deployments

Hi, We arrange our kafka machines in groups and deploy these phases. For kafka, we’ll have to map groups with phases. During each phase of the release, all the machines in that group can go down. When this happens, there are a couple of cases:- 1. All replicas are residing in a group of

Re: Release source doesn't contain .gitignore

Hi Grant, Sorry for my stupid question, but it is usually a best practice to include such file in the src tar balls? I am certainly okay with including it, of course. :) But I didn't see it in ZooKeeper 3.4.7, Hadoop 2.4.6 or Cassandra 3.0 sources, for example. OTOH, I see the .gitattributes

[jira] [Commented] (KAFKA-1508) Scripts Break When Path Has Spaces

[ https://issues.apache.org/jira/browse/KAFKA-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028722#comment-15028722 ] Boris Charpiot commented on KAFKA-1508: --- Same problem occurs with the Windows batch files... For

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028771#comment-15028771 ] Rajini Sivaram commented on KAFKA-2891: --- [~benstopford] Thank you, it looks like the same problem as

[jira] [Created] (KAFKA-2897) Class NIOServerCnxn$Factory not found due to mismatch in dependencies

Yuval Steinbegr created KAFKA-2897: -- Summary: Class NIOServerCnxn$Factory not found due to mismatch in dependencies Key: KAFKA-2897 URL: https://issues.apache.org/jira/browse/KAFKA-2897 Project:

[jira] [Commented] (KAFKA-2897) Class NIOServerCnxn$Factory not found due to mismatch in dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028840#comment-15028840 ] Ismael Juma commented on KAFKA-2897: This is no longer an issue in the recently released Kafka 0.9.0.0

[jira] [Commented] (KAFKA-2897) Class NIOServerCnxn$Factory not found due to mismatch in dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028868#comment-15028868 ] Yuval Steinbegr commented on KAFKA-2897: Basically yes - solving it with Kafka 0.9.x is fine,

[jira] [Commented] (KAFKA-2897) Class NIOServerCnxn$Factory not found due to mismatch in dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028961#comment-15028961 ] Flavio Junqueira commented on KAFKA-2897: - I'm not aware of backward incompatible changes in

[jira] [Commented] (KAFKA-2897) Class NIOServerCnxn$Factory not found due to mismatch in dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029012#comment-15029012 ] Yuval Steinbegr commented on KAFKA-2897: Can you explain what are the implications of this problem

[jira] [Commented] (KAFKA-2897) Class NIOServerCnxn$Factory not found due to mismatch in dependencies

[ https://issues.apache.org/jira/browse/KAFKA-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029018#comment-15029018 ] Flavio Junqueira commented on KAFKA-2897: - Those are the classes that manage connections to a

Re: producer-consumer issues during deployments

Hi, Request your expertise on these doubts of mine Thanks, Prabhjot On Thu, Nov 26, 2015 at 4:43 PM, Prabhjot Bharaj wrote: > Hi, > > We arrange our kafka machines in groups and deploy these phases. > > For kafka, we’ll have to map groups with phases. During each phase

Re: producer-consumer issues during deployments

Hi Prabhjot I may have slightly misunderstood your question so apologies if that’s the case. The general approach to releases is to use a rolling upgrade where you take one machine offline at a time, restart it, wait for it to come online (you can monitor this via JMX) then move onto the next.

[jira] [Created] (KAFKA-2898) Kafka producer config incorrectly warns that serializer.* isn't a known config

Guillaume Grossetie created KAFKA-2898: -- Summary: Kafka producer config incorrectly warns that serializer.* isn't a known config Key: KAFKA-2898 URL: https://issues.apache.org/jira/browse/KAFKA-2898

[jira] [Updated] (KAFKA-2898) Kafka producer config incorrectly warns that serializer.* isn't a known config

[ https://issues.apache.org/jira/browse/KAFKA-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillaume Grossetie updated KAFKA-2898: --- Description: When using "serializer.encoding", "key.serializer.encoding" or

[jira] [Updated] (KAFKA-2898) Kafka producer config incorrectly warns that serializer.* isn't a known config

[ https://issues.apache.org/jira/browse/KAFKA-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guillaume Grossetie updated KAFKA-2898: --- Description: When using "serializer.encoding", "key.serializer.encoding" or

[jira] [Created] (KAFKA-2899) Should log unexpected exceptions thrown when reading from local log

Ben Stopford created KAFKA-2899: --- Summary: Should log unexpected exceptions thrown when reading from local log Key: KAFKA-2899 URL: https://issues.apache.org/jira/browse/KAFKA-2899 Project: Kafka

[jira] [Commented] (KAFKA-2899) Should log unexpected exceptions thrown when reading from local log

[ https://issues.apache.org/jira/browse/KAFKA-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029184#comment-15029184 ] ASF GitHub Bot commented on KAFKA-2899: --- GitHub user benstopford opened a pull request:

[GitHub] kafka pull request: KAFKA-2899: (trivial) Log unexpected exception...

GitHub user benstopford opened a pull request: https://github.com/apache/kafka/pull/593 KAFKA-2899: (trivial) Log unexpected exceptions thrown when reading local log Currently we don't log exceptions raised when reading from the local log which makes tracking down the cause of

[jira] [Assigned] (KAFKA-2900) Error Consuming From Kafka

[ https://issues.apache.org/jira/browse/KAFKA-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-2900: --- Assignee: Ben Stopford > Error Consuming From Kafka > -- > >

[jira] [Created] (KAFKA-2900) Error Consuming From Kafka

Ben Stopford created KAFKA-2900: --- Summary: Error Consuming From Kafka Key: KAFKA-2900 URL: https://issues.apache.org/jira/browse/KAFKA-2900 Project: Kafka Issue Type: Bug Reporter:

[jira] [Updated] (KAFKA-2900) Error Consuming From Kafka

[ https://issues.apache.org/jira/browse/KAFKA-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2900: Description: More consumer strangeness from the rolling upgrade test. Clients dumps out many

[GitHub] kafka pull request: Avoiding warning about generics in sample code

GitHub user nurkiewicz opened a pull request: https://github.com/apache/kafka/pull/594 Avoiding warning about generics in sample code You can merge this pull request into a Git repository by running: $ git pull https://github.com/nurkiewicz/kafka patch-1 Alternatively you