Re: Some questions about providing corrections to documentation.

2017-01-02 Thread Dhwani Katagade
Happy New Year Team :-), Could you please look at https://github.com/apache/kafka-site/pull/38 and let me know if this looks good. This is my first PR and I am just checking to see if I got the process right. thanks -dhwani On 12/31/2016 01:59 PM, Dhwani Katagade wrote: Thanks Gouzhang, I

[jira] [Work started] (KAFKA-3209) Support single message transforms in Kafka Connect

2017-01-02 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3209 started by Shikhar Bhushan. -- > Support single message transforms in Kafka Connect >

[jira] [Commented] (KAFKA-4576) Log segments close to max size break on fetch

2017-01-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794042#comment-15794042 ] huxi commented on KAFKA-4576: - Seems FileChannel.read does not fill up the 12-byte buffer although there are

[jira] [Commented] (KAFKA-4564) When the destination brokers are down or misconfigured in config, Streams should fail fast

2017-01-02 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793810#comment-15793810 ] Umesh Chaudhary commented on KAFKA-4564: Thank you [~ewencp]. > When the destination brokers are

[jira] [Resolved] (KAFKA-2322) Use Java 7 features to improve code quality

2017-01-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-2322. Resolution: Fixed We have done this incrementally via various PRs. Marking as Fixed. > Use Java 7

[jira] [Updated] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2017-01-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3172: --- Fix Version/s: (was: 0.10.2.0) > Consumer threads stay in 'Watiting' status and are blocked at

[jira] [Commented] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2017-01-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793692#comment-15793692 ] Ismael Juma commented on KAFKA-3172: Thanks [~oleg_gorobets]. JDK 8u112 includes the fix for the

[jira] [Commented] (KAFKA-4459) rat license check not running in Jenkins

2017-01-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793651#comment-15793651 ] Ismael Juma commented on KAFKA-4459: [~ewencp], the command for the job I linked to is: {code}

[jira] [Commented] (KAFKA-3173) Error while moving some partitions to OnlinePartition state

2017-01-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793643#comment-15793643 ] Ismael Juma commented on KAFKA-3173: Since we still don't know the source of this, removed the "Fix

[jira] [Updated] (KAFKA-3173) Error while moving some partitions to OnlinePartition state

2017-01-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3173: --- Fix Version/s: (was: 0.10.2.0) > Error while moving some partitions to OnlinePartition state >

[jira] [Updated] (KAFKA-4440) Make producer RecordMetadata non-final

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4440: - Fix Version/s: 0.10.2.0 > Make producer RecordMetadata non-final >

[jira] [Commented] (KAFKA-4459) rat license check not running in Jenkins

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793625#comment-15793625 ] Ewen Cheslack-Postava commented on KAFKA-4459: -- [~ijuma] Seems like the build logs have been

Re: 0.10.2.0 release planning

2017-01-02 Thread Ismael Juma
Thanks for the update and for managing the next release Ewen. :) Ismael On Mon, Jan 2, 2017 at 10:22 PM, Ewen Cheslack-Postava wrote: > Hey folks, > > We're quickly approaching our next time-based release. If you missed any of > the updates on the new time-based releases

0.10.2.0 release planning

2017-01-02 Thread Ewen Cheslack-Postava
Hey folks, We're quickly approaching our next time-based release. If you missed any of the updates on the new time-based releases we'll be following, see https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan for an explanation. I've started to organize the 0.10.2.0 release,

[jira] [Updated] (KAFKA-3304) KIP-35 - Retrieving protocol version

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3304: - Labels: kip (was: ) > KIP-35 - Retrieving protocol version >

Re: [VOTE] KIP-90 Remove zkClient dependency from Streams

2017-01-02 Thread Ewen Cheslack-Postava
Looks like this passes with 4 binding and 8 total +1 votes. Hojjat, I've moved it into the adopted KIPs table and marked the JIRA for 0.10.2.0 if we can get it into that release. -Ewen On Wed, Dec 21, 2016 at 12:55 AM, Matthias J. Sax wrote: > +1 > > > On 12/21/16 12:45

Re: [VOTE] KIP-100 - Relax Type constraints in Kafka Streams API

2017-01-02 Thread Ewen Cheslack-Postava
This passes with 4 binding and 7 total +1 votes. Xavier, I've marked the JIRA for 0.10.2.0, which I assume we'll be able to make, and moved it as WIP into the adopted KIPs section. -Ewen On Mon, Dec 19, 2016 at 2:33 PM, Guozhang Wang wrote: > +1. > > On Sat, Dec 17, 2016

[jira] [Updated] (KAFKA-4001) Improve Kafka Streams Join Semantics (KIP-77)

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4001: - Labels: kip (was: ) > Improve Kafka Streams Join Semantics (KIP-77) >

[jira] [Updated] (KAFKA-4259) Enable JAAS configuration for Kafka clients without a config file

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4259: - Labels: kip (was: ) > Enable JAAS configuration for Kafka clients without a

[jira] [Updated] (KAFKA-4458) Add per partition metrics for in-sync and assigned replica count

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4458: - Labels: kip (was: ) > Add per partition metrics for in-sync and assigned replica

[jira] [Updated] (KAFKA-4161) Decouple flush and offset commits

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4161: - Labels: kip needs-kip (was: needs-kip) > Decouple flush and offset commits >

[jira] [Updated] (KAFKA-4393) Improve invalid/negative TS handling

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4393: - Labels: kip (was: ) > Improve invalid/negative TS handling >

[jira] [Updated] (KAFKA-3452) Support session windows

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3452: - Labels: api kip (was: api) > Support session windows > --- >

[jira] [Updated] (KAFKA-4381) Add per partition lag metric to KafkaConsumer.

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4381: - Labels: kip (was: ) > Add per partition lag metric to KafkaConsumer. >

[jira] [Updated] (KAFKA-4462) Improved Kafka Client Compatibility Policy

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4462: - Labels: kip (was: ) > Improved Kafka Client Compatibility Policy >

[jira] [Updated] (KAFKA-4462) Improved Kafka Client Compatibility Policy

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4462: - Fix Version/s: 0.10.2.0 > Improved Kafka Client Compatibility Policy >

[jira] [Updated] (KAFKA-3853) Report offsets for empty groups in ConsumerGroupCommand

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3853: - Component/s: tools admin > Report offsets for empty groups in

[jira] [Updated] (KAFKA-3853) Report offsets for empty groups in ConsumerGroupCommand

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3853: - Labels: kip (was: ) > Report offsets for empty groups in ConsumerGroupCommand >

[jira] [Updated] (KAFKA-4481) Relax Kafka Streams API type constraints

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4481: - Labels: kip usability (was: usability) > Relax Kafka Streams API type

[jira] [Updated] (KAFKA-4481) Relax Kafka Streams API type constraints

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4481: - Fix Version/s: 0.10.2.0 > Relax Kafka Streams API type constraints >

[jira] [Updated] (KAFKA-4060) Remove ZkClient dependency in Kafka Streams

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4060: - Labels: kip (was: ) > Remove ZkClient dependency in Kafka Streams >

[jira] [Updated] (KAFKA-4060) Remove ZkClient dependency in Kafka Streams

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4060: - Fix Version/s: 0.10.2.0 > Remove ZkClient dependency in Kafka Streams >

[jira] [Commented] (KAFKA-4466) Add support to ducktape to run only a part of all tests

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793443#comment-15793443 ] Ewen Cheslack-Postava commented on KAFKA-4466: -- [~raghavgautam] Has this been resolved with

[jira] [Resolved] (KAFKA-4470) Exception (java.lang.RuntimeException) encountered during startup: org.codehaus.jackson.JsonParseException:

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4470. -- Resolution: Invalid Assignee: Ewen Cheslack-Postava Bug was filed on the

[jira] [Commented] (KAFKA-3959) __consumer_offsets wrong number of replicas at startup

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793433#comment-15793433 ] Ewen Cheslack-Postava commented on KAFKA-3959: -- [~onurkaraman] Marked for 0.10.2.0 as this

[jira] [Updated] (KAFKA-3959) __consumer_offsets wrong number of replicas at startup

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3959: - Fix Version/s: 0.10.2.0 > __consumer_offsets wrong number of replicas at startup

[jira] [Updated] (KAFKA-4569) Transient failure in org.apache.kafka.clients.consumer.KafkaConsumerTest.testWakeupWithFetchDataAvailable

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4569: - Assignee: Umesh Chaudhary > Transient failure in >

[jira] [Commented] (KAFKA-4564) When the destination brokers are down or misconfigured in config, Streams should fail fast

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793379#comment-15793379 ] Ewen Cheslack-Postava commented on KAFKA-4564: -- [~umesh9...@gmail.com] I have assigned you,

[jira] [Updated] (KAFKA-4564) When the destination brokers are down or misconfigured in config, Streams should fail fast

2017-01-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4564: - Assignee: Umesh Chaudhary > When the destination brokers are down or

Re: Multiple Consumer Group In Single Topic

2017-01-02 Thread Ewen Cheslack-Postava
Rico, Every consumer group will see all messages for the topics they are subscribed to. If you want to filter these messages by consumer group, you'd need to perform that filtering yourself after the messages are returned by the consumer. To do so, you'd need to include enough information in the

Re: New question / request on kafka consumer

2017-01-02 Thread Ewen Cheslack-Postava
This sounds related to https://issues.apache.org/jira/browse/KAFKA-1894 Currently the consumer won't timeout when it cannot contact the brokers. -Ewen On Wed, Dec 14, 2016 at 5:21 AM, Costache, Vlad < vlad.costa...@metrosystems.net> wrote: > Hello, > > > > We are trying to make a consumer for

[jira] [Commented] (KAFKA-4402) Kafka Producer's DefaultPartitioner is actually not round robin as said in the code comments "If no partition or key is present choose a partition in a round-robin fash

2017-01-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793141#comment-15793141 ] ASF GitHub Bot commented on KAFKA-4402: --- GitHub user yaojuncn reopened a pull request:

[GitHub] kafka pull request #2128: KAFKA-4402: make the KafkaProducer true round robi...

2017-01-02 Thread yaojuncn
GitHub user yaojuncn reopened a pull request: https://github.com/apache/kafka/pull/2128 KAFKA-4402: make the KafkaProducer true round robin per topic You can merge this pull request into a Git repository by running: $ git pull https://github.com/yaojuncn/kafka

[jira] [Commented] (KAFKA-4402) Kafka Producer's DefaultPartitioner is actually not round robin as said in the code comments "If no partition or key is present choose a partition in a round-robin fash

2017-01-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15793139#comment-15793139 ] ASF GitHub Bot commented on KAFKA-4402: --- Github user yaojuncn closed the pull request at:

[GitHub] kafka pull request #2128: KAFKA-4402: make the KafkaProducer true round robi...

2017-01-02 Thread yaojuncn
Github user yaojuncn closed the pull request at: https://github.com/apache/kafka/pull/2128 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is