Re: [VOTE] 0.10.0.1 RC0

Hi, I think we need a new RC because of https://issues.apache.org/jira/browse/KAFKA-4008 -Matthias On 07/29/2016 04:59 PM, Harsha Chintalapani wrote: > Hi Ismael, > I would like this JIRA to be included in the minor release > https://issues.apache.org/jira/browse/KAFKA-3950 > Thanks,

[jira] [Created] (KAFKA-4008) Module "tools" should ne be dependent on "core"

Matthias J. Sax created KAFKA-4008: -- Summary: Module "tools" should ne be dependent on "core" Key: KAFKA-4008 URL: https://issues.apache.org/jira/browse/KAFKA-4008 Project: Kafka Issue

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400428#comment-15400428 ] ASF GitHub Bot commented on KAFKA-3950: --- GitHub user omkreddy opened a pull request:

[GitHub] kafka pull request #1687: KAFKA-3950: kafka mirror maker tool is not respect...

GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/1687 KAFKA-3950: kafka mirror maker tool is not respecting whitelist option You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400419#comment-15400419 ] ASF GitHub Bot commented on KAFKA-3950: --- Github user omkreddy closed the pull request at:

[GitHub] kafka pull request #1615: KAFKA-3950: kafka mirror maker tool is not respect...

Github user omkreddy closed the pull request at: https://github.com/apache/kafka/pull/1615 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk7 #1451

See Changes: [cshapi] KAFKA-3946: Protocol guide should say that Produce request acks can o… -- [...truncated 3580 lines...] at

Build failed in Jenkins: kafka-trunk-jdk8 #786

See Changes: [cshapi] KAFKA-3946: Protocol guide should say that Produce request acks can o… -- [...truncated 1368 lines...] kafka.server.EdgeCaseRequestTest > testInvalidApiVersionRequest

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400224#comment-15400224 ] Jay Kreps commented on KAFKA-2063: -- Makes sense on both counts--I have no real opinion, just thought I'd

[GitHub] kafka pull request #1686: KAFKA-4002: task.open() should be invoked in case ...

GitHub user Ishiihara opened a pull request: https://github.com/apache/kafka/pull/1686 KAFKA-4002: task.open() should be invoked in case that 0 partitions is assigned to task You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4002) task.open() should be invoked in case that 0 partitions is assigned to task.

[ https://issues.apache.org/jira/browse/KAFKA-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400206#comment-15400206 ] ASF GitHub Bot commented on KAFKA-4002: --- GitHub user Ishiihara opened a pull request:

[jira] [Resolved] (KAFKA-3946) Protocol guide should say that Produce request acks can only be 0, 1, or -1

[ https://issues.apache.org/jira/browse/KAFKA-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-3946. - Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1680

[jira] [Commented] (KAFKA-3946) Protocol guide should say that Produce request acks can only be 0, 1, or -1

[ https://issues.apache.org/jira/browse/KAFKA-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400176#comment-15400176 ] ASF GitHub Bot commented on KAFKA-3946: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1680: KAFKA-3946: Protocol guide should say that Produce...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KAFKA-2063 Add possibility to bound fetch response size (was Re: [DISCUSS] Optimise memory used by replication process by using adaptive fetch message size)

Andrey - I’m not sure we quite have consensus on the Randomisation vs Round Robin issue but it’s probably worth you just raising a kip and put one of the options as a rejected alternative. B > On 29 Jul 2016, at 11:59, Ben Stopford wrote: > > Thanks for the kicking this

[GitHub] kafka pull request #1685: hotfix: move streams application reset tool from t...

GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1685 hotfix: move streams application reset tool from tools to core => required to remove core dependency from tools You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4000) Consumer per-topic metrics do not aggregate partitions from the same topic

[ https://issues.apache.org/jira/browse/KAFKA-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400130#comment-15400130 ] ASF GitHub Bot commented on KAFKA-4000: --- GitHub user vahidhashemian opened a pull request:

[GitHub] kafka pull request #1684: KAFKA-4000: Aggregate partitions of each topic for...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/1684 KAFKA-4000: Aggregate partitions of each topic for consumer metrics Fix the consumer metric collection to record metrics per topic instead of per partition of topic. You can merge this pull

Jenkins build is back to normal : kafka-0.10.0-jdk7 #172

See

[jira] [Created] (KAFKA-4007) Improve fetch pipelining for low values of max.poll.records

Jason Gustafson created KAFKA-4007: -- Summary: Improve fetch pipelining for low values of max.poll.records Key: KAFKA-4007 URL: https://issues.apache.org/jira/browse/KAFKA-4007 Project: Kafka

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400037#comment-15400037 ] Jason Gustafson commented on KAFKA-2063: Also, I actually prefer [~benstopford]'s suggestion to

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1544#comment-1544 ] Jason Gustafson commented on KAFKA-2063: I think the problem with keeping the partition-level

[jira] [Updated] (KAFKA-4006) Kafka connect fails sometime with InvalidTopicException in distributed mode

[ https://issues.apache.org/jira/browse/KAFKA-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Arrawatia updated KAFKA-4006: --- Description: I get trying to spin up a 3 node distributed connect cluster. Sometimes one of

[jira] [Created] (KAFKA-4006) Kafka connect fails sometime with InvalidTopicException in distributed mode

Sumit Arrawatia created KAFKA-4006: -- Summary: Kafka connect fails sometime with InvalidTopicException in distributed mode Key: KAFKA-4006 URL: https://issues.apache.org/jira/browse/KAFKA-4006

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399960#comment-15399960 ] Ben Stopford commented on KAFKA-2063: - [~jkreps] OK, let's see what GZ says on 1. I think it should be

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399928#comment-15399928 ] Konstantin Zadorozhny commented on KAFKA-2729: -- Seeing the same issue in our staging and

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399909#comment-15399909 ] Jay Kreps commented on KAFKA-2063: -- [~benstopford] 1. I guess the question is how do you load balance

Build failed in Jenkins: kafka-0.10.0-jdk7 #171

See Changes: [ismael] MINOR: Replace reference to HoppingWindows in streams.html -- [...truncated 5724 lines...] org.apache.kafka.streams.kstream.internals.KTableImplTest > testValueGetter

Re: [DISCUSS] KAFKA-2063 Add possibility to bound fetch response size (was Re: [DISCUSS] Optimise memory used by replication process by using adaptive fetch message size)

Thanks for the kicking this one off Andrey. Generally it looks great! I left a comment on the Jira regarding whether we should remove the existing limitBytes, along with a potential alternative to doing randomisation. B > On 29 Jul 2016, at 09:17, Andrey L. Neporada

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399855#comment-15399855 ] Ben Stopford commented on KAFKA-2063: - Thanks for the kicking this one off Andrey. A couple of things

[jira] [Resolved] (KAFKA-3766) Unhandled "not enough replicas" errors in SyncGroup

[ https://issues.apache.org/jira/browse/KAFKA-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-3766. Resolution: Duplicate > Unhandled "not enough replicas" errors in SyncGroup >

[DISCUSS] KAFKA-2063 Add possibility to bound fetch response size (was Re: [DISCUSS] Optimise memory used by replication process by using adaptive fetch message size)

Hi all! I would like to get your feedback on PR for bug KAFKA-2063. Looks like KIP is needed there, but it would be nice to get feedback first. Thanks, Andrey. > On 22 Jul 2016, at 12:26, Andrey L. Neporada wrote: > > Hi! > > Thanks for feedback - I agree that the

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399590#comment-15399590 ] ASF GitHub Bot commented on KAFKA-2063: --- GitHub user nepal opened a pull request:

[GitHub] kafka pull request #1683: KAFKA-2063: Add possibility to bound fetch respons...

GitHub user nepal opened a pull request: https://github.com/apache/kafka/pull/1683 KAFKA-2063: Add possibility to bound fetch response size Details are: 1. Protocol is extended with new version of FetchRequest with extra parameter limit_bytes. 2. New config setting

[jira] [Comment Edited] (KAFKA-3990) Kafka New Producer may raise an OutOfMemoryError

[ https://issues.apache.org/jira/browse/KAFKA-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399572#comment-15399572 ] Brice Dutheil edited comment on KAFKA-3990 at 7/29/16 4:04 PM: --- Hi after

[jira] [Updated] (KAFKA-3990) Kafka New Producer may raise an OutOfMemoryError

[ https://issues.apache.org/jira/browse/KAFKA-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brice Dutheil updated KAFKA-3990: - Environment: Docker, Base image : CentOS Java 8u77 Marathon was: Docker, Base image : CentOS

[jira] [Comment Edited] (KAFKA-3990) Kafka New Producer may raise an OutOfMemoryError

[ https://issues.apache.org/jira/browse/KAFKA-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399572#comment-15399572 ] Brice Dutheil edited comment on KAFKA-3990 at 7/29/16 4:03 PM: --- Hi after

[jira] [Commented] (KAFKA-3990) Kafka New Producer may raise an OutOfMemoryError

[ https://issues.apache.org/jira/browse/KAFKA-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399572#comment-15399572 ] Brice Dutheil commented on KAFKA-3990: -- Hi after further investigation we found out the issue came

Re: [kafka-clients] [VOTE] 0.10.0.1 RC0

+1 tested against kafka-python integration test suite = pass. Aside: as the scope of kafka gets bigger, it may be useful to organize release notes into functional groups like core, brokers, clients, kafka-streams, etc. I've found this useful when organizing kafka-python release notes. -Dana On

[GitHub] kafka pull request #1682: HOTFIX: non-unique state.dirs in integration tests...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1682 HOTFIX: non-unique state.dirs in integration tests causing build to hang Three Streams Integration tests were using the same directory for the state.dir config. This was causing the build to hang when

[jira] [Commented] (KAFKA-3766) Unhandled "not enough replicas" errors in SyncGroup

[ https://issues.apache.org/jira/browse/KAFKA-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399520#comment-15399520 ] Dustin Cote commented on KAFKA-3766: Marking this as a dupe of KAFKA-3590. I've tried to incorporate

[jira] [Commented] (KAFKA-3590) KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling

[ https://issues.apache.org/jira/browse/KAFKA-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399518#comment-15399518 ] Dustin Cote commented on KAFKA-3590: Thanks [~ijuma], I didn't see that one. Updated the PR to move

[jira] [Commented] (KAFKA-3590) KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling

[ https://issues.apache.org/jira/browse/KAFKA-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399465#comment-15399465 ] Ismael Juma commented on KAFKA-3590: This looks similar to KAFKA-3766 > KafkaConsumer fails with

[jira] [Comment Edited] (KAFKA-3590) KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling

[ https://issues.apache.org/jira/browse/KAFKA-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399465#comment-15399465 ] Ismael Juma edited comment on KAFKA-3590 at 7/29/16 3:08 PM: - This looks

[jira] [Updated] (KAFKA-3590) KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling

[ https://issues.apache.org/jira/browse/KAFKA-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated KAFKA-3590: --- Status: Patch Available (was: Open) > KafkaConsumer fails with "Messages are rejected since there

[jira] [Commented] (KAFKA-3590) KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling

[ https://issues.apache.org/jira/browse/KAFKA-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399460#comment-15399460 ] ASF GitHub Bot commented on KAFKA-3590: --- GitHub user cotedm opened a pull request:

[GitHub] kafka pull request #1681: KAFKA-3590: KafkaConsumer fails with "Messages are...

GitHub user cotedm opened a pull request: https://github.com/apache/kafka/pull/1681 KAFKA-3590: KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling This just improves the error message since it's confusing that a

Re: [VOTE] 0.10.0.1 RC0

Hi Ismael, I would like this JIRA to be included in the minor release https://issues.apache.org/jira/browse/KAFKA-3950 Thanks, Harsha On Fri, Jul 29, 2016 at 7:46 AM Ismael Juma wrote: > Hello Kafka users, developers and client-developers, > > This is the first

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399444#comment-15399444 ] Manikumar Reddy commented on KAFKA-3950: [~ijuma] Can we include this in 0.10.0.1 release? >

[VOTE] 0.10.0.1 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for the release of Apache Kafka 0.10.0.1. This is a bug fix release and it includes fixes and improvements from 50 JIRAs (including a few critical bugs). See the release notes for more details:

Re: Jars in Kafka 0.10

No, if you don't use streams you don't need them. If you have no clients (so also no mirror maker) running on the same machine you also don't need the client jar, if you run zookeeper separately you also don't need those. On Fri, Jul 29, 2016 at 4:22 PM Bhuvaneswaran Gopalasami <

[jira] [Commented] (KAFKA-3990) Kafka New Producer may raise an OutOfMemoryError

[ https://issues.apache.org/jira/browse/KAFKA-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399370#comment-15399370 ] Brice Dutheil commented on KAFKA-3990: -- Hi all, sorry for the delayed response I have busy with other

Jars in Kafka 0.10

I have recently started looking into Kafka I noticed the number of Jars in Kafka 0.10 has increased when compared to 0.8.2. Do we really need all those libraries to run Kafka ? Thanks, Bhuvanes

[jira] [Updated] (KAFKA-3990) Kafka New Producer may raise an OutOfMemoryError

[ https://issues.apache.org/jira/browse/KAFKA-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brice Dutheil updated KAFKA-3990: - Attachment: app-producer-config.log kafka-broker-logs.zip > Kafka New Producer

[GitHub] kafka pull request #1680: KAFKA-3946: Protocol guide should say that Produce...

GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/1680 KAFKA-3946: Protocol guide should say that Produce request acks can o… …nly be 0, 1, or -1 Rephrased the documentation string for the Produce request Updated the acks configuration

[jira] [Commented] (KAFKA-3946) Protocol guide should say that Produce request acks can only be 0, 1, or -1

[ https://issues.apache.org/jira/browse/KAFKA-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399367#comment-15399367 ] ASF GitHub Bot commented on KAFKA-3946: --- GitHub user mimaison opened a pull request:

[jira] [Assigned] (KAFKA-3946) Protocol guide should say that Produce request acks can only be 0, 1, or -1

[ https://issues.apache.org/jira/browse/KAFKA-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reassigned KAFKA-3946: - Assignee: Mickael Maison > Protocol guide should say that Produce request acks can only

[GitHub] kafka pull request #1679: MINOR: replace reference to HoppingWindows in stre...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1679 MINOR: replace reference to HoppingWindows in streams.html HoppingWindows was removed prior to the 0.10.0 release. I've updated the doc to refer to the correct TimeWindows You can merge this pull

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

> > > Hmm, operating on ConnectRecords probably doesn't work since you need to > emit the right type of record, which might mean instantiating a new one. I > think that means we either need 2 methods, one for SourceRecord, one for > SinkRecord, or we'd need to limit what parts of the message you