[jira] [Comment Edited] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568706#comment-15568706 ] Mazhar Shaikh edited comment on KAFKA-4128 at 10/13/16 2:18 PM: Hi Gwen

RE?? [DISCUSS] KIP-68 Add a consumed log retention before log retention

Hi Dong, Sorry for the delay, here are the comments: 1.I think we should distinguish these two cases: (1) group has no member, but has commit offset : In this case we should consider its commit offset (2) group has no member, no commit offset: Skip this group Is it ok? ListGroup API can

Re: [DISCUSS] KIP-81: Max in-flight fetches

I've now updated the KIP. New link as I've updated the title: https://cwiki.apache.org/confluence/display/KAFKA/KIP-81%3A+Bound+Fetch+memory+usage+in+the+consumer Any further feedback welcome ! On Tue, Oct 11, 2016 at 6:00 PM, Mickael Maison wrote: > Thanks for the

[GitHub] kafka pull request #2024: HOTFIX: fix npe in NamedCache if evict is called w...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2024 HOTFIX: fix npe in NamedCache if evict is called when the cache is empty If evict is called on a NamedCache and the cache is empty an NPE is thrown. This was reported on the user list from a developer

[jira] [Updated] (KAFKA-4300) NamedCache throws an NPE when evict is called and the cache is empty

[ https://issues.apache.org/jira/browse/KAFKA-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4300: -- Description: evict can be called on a NamedCache even though it is empty. This is due to the shared

[jira] [Created] (KAFKA-4301) Include some SSL/TLS logging to avoid need need for javax debug util every time an issue arises

Ryan P created KAFKA-4301: - Summary: Include some SSL/TLS logging to avoid need need for javax debug util every time an issue arises Key: KAFKA-4301 URL: https://issues.apache.org/jira/browse/KAFKA-4301

[jira] [Work started] (KAFKA-4300) NamedCache throws an NPE when evict is called and the cache is empty

[ https://issues.apache.org/jira/browse/KAFKA-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4300 started by Damian Guy. - > NamedCache throws an NPE when evict is called and the cache is empty >

Re: [kafka-clients] [VOTE] 0.10.1.0 RC2

Hi Jason, Really sorry, but we are going to need to cut another RC. There was a report on the user list w.r.t the NamedCache (in KafkaStreams) throwing a NullPointerException. I've looked into it and it is definitely a bug that needs to be fixed. jira is

[jira] [Updated] (KAFKA-4300) NamedCache throws an NPE when evict is called and the cache is empty

[ https://issues.apache.org/jira/browse/KAFKA-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4300: -- Status: Patch Available (was: In Progress) > NamedCache throws an NPE when evict is called and the

[jira] [Created] (KAFKA-4300) NamedCache throws an NPE when evict is called and the cache is empty

Damian Guy created KAFKA-4300: - Summary: NamedCache throws an NPE when evict is called and the cache is empty Key: KAFKA-4300 URL: https://issues.apache.org/jira/browse/KAFKA-4300 Project: Kafka

Re: [DISCUSS] KIP-68 Add a consumed log retention before log retention

Hi David, Thanks for your explanation. There still seems to be issue with this solution. Please see my comment inline. On Thu, Oct 13, 2016 at 8:46 AM, 东方甲乙 <254479...@qq.com> wrote: > Hi Dong, > Sorry for the delay, here are the comments: > 1.I think we should distinguish these two cases:

Re: [DISCUSS] KIP-82 - Add Record Headers

here's yet another use case of an organization using kafka in need of headers - https://issues.apache.org/jira/browse/AVRO-1704 they appear to be a 100% avro shop so they can make do with changes within avro (who in turn didnt mind defining an avro wire format with header support) On Wed, Oct 12,

Kafka-Client-0.9.0.1: Throwing an exception while Deserialization a kafka value message

All: I have a kind of semantic question on how the kafka client library is behaving when: 1. You are providing you own Serialization/Deserialization class by setting up this prop (value.serializer) 2. While deserializing, I am throwing a serialization exception Based on my tests, not only

[jira] [Commented] (KAFKA-4293) ByteBufferMessageSet.deepIterator burns CPU catching EOFExceptions

[ https://issues.apache.org/jira/browse/KAFKA-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572983#comment-15572983 ] ASF GitHub Bot commented on KAFKA-4293: --- GitHub user radai-rosenblatt opened a pull request:

[GitHub] kafka pull request #2025: KAFKA-4293 - improve ByteBufferMessageSet.deepIter...

GitHub user radai-rosenblatt opened a pull request: https://github.com/apache/kafka/pull/2025 KAFKA-4293 - improve ByteBufferMessageSet.deepIterator() performance by relying on underlying stream's available() implementation also: provided better available() for

Re: [VOTE] 0.10.1.0 RC2

Hi Jason, I tested the quickstart again with the new RC on Ubuntu Linux, Windows, and Mac. There are two more issues I noticed: I have not been able to run the Streams example on my Windows environments (when I build from the source, and also when I use the built version) due to some errors

Re: [kafka-clients] [VOTE] 0.10.1.0 RC2

No worries, it wouldn't be interesting unless there were a couple last-minute blockers! We're also got KAFKA-4298 to get in. -Jason On Thu, Oct 13, 2016 at 10:04 AM, Damian Guy wrote: > Hi Jason, > > Really sorry, but we are going to need to cut another RC. There was a >

[GitHub] kafka pull request #2024: KAFKA-4300: NamedCache throws an NPE when evict is...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2024 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4300) NamedCache throws an NPE when evict is called and the cache is empty

[ https://issues.apache.org/jira/browse/KAFKA-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573043#comment-15573043 ] ASF GitHub Bot commented on KAFKA-4300: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-4300) NamedCache throws an NPE when evict is called and the cache is empty

[ https://issues.apache.org/jira/browse/KAFKA-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4300: - Resolution: Fixed Status: Resolved (was: Patch Available) > NamedCache throws an NPE

Re: [VOTE] 0.10.1.0 RC2

Thanks Vahid, I'll see if I can reproduce the problem you're seeing on Step 6 of the quickstart. -Jason On Thu, Oct 13, 2016 at 1:04 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Jason, > > I tested the quickstart again with the new RC on Ubuntu Linux, Windows, > and Mac. > >

Build failed in Jenkins: kafka-trunk-jdk8 #977

See Changes: [wangguoz] KAFKA-4300: NamedCache throws an NPE when evict is called and the cache -- [...truncated 14110 lines...] org.apache.kafka.streams.kstream.internals.KStreamImplTest >

[jira] [Commented] (KAFKA-4299) Consumer offsets reset for all topics after increasing partitions for one topic

[ https://issues.apache.org/jira/browse/KAFKA-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573249#comment-15573249 ] Vahid Hashemian commented on KAFKA-4299: I was not able to reproduce this using the console

[GitHub] kafka pull request #2026: MINOR: Improve on Streams log4j

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/2026 MINOR: Improve on Streams log4j You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KMinor-improve-logging Alternatively

Re: [DISCUSS] KIP-68 Add a consumed log retention before log retention

Hi David, As explained in the motivation section of the KIP, the problem is that if log retention is too small, we may lose data; and if log retention is too large, then we waste disk space. Therefore, we need to solve one if the two problems -- allow data to be persisted longer for consumption

Jenkins build is back to normal : kafka-0.10.1-jdk7 #70

See

[GitHub] kafka pull request #1967: cherry-picking KAFKA-4244 to 0.10.1.0 branch

Github user gwenshap closed the pull request at: https://github.com/apache/kafka/pull/1967 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4244) Update our website look & feel

[ https://issues.apache.org/jira/browse/KAFKA-4244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573473#comment-15573473 ] ASF GitHub Bot commented on KAFKA-4244: --- Github user gwenshap closed the pull request at:

[jira] [Commented] (KAFKA-4280) Add REST resource for showing available connector plugin configs

[ https://issues.apache.org/jira/browse/KAFKA-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573476#comment-15573476 ] Gwen Shapira commented on KAFKA-4280: - Looking forward to the documentation PR :) > Add REST resource

Build failed in Jenkins: kafka-trunk-jdk7 #1629

See Changes: [jason] KAFKA-4254; Update producer's metadata before failing on non-existent -- [...truncated 3691 lines...] kafka.api.PlaintextConsumerTest > testSimpleConsumption PASSED

[jira] [Updated] (KAFKA-4299) Consumer offsets reset for all topics after increasing partitions for one topic

[ https://issues.apache.org/jira/browse/KAFKA-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juho Autio updated KAFKA-4299: -- Description: I increased partitions for one existing topic (2->10), but was surprised to see that it

[jira] [Updated] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4298: --- Description: When cleaning the log, we don't want to convert messages to the format configured for

[jira] [Comment Edited] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571432#comment-15571432 ] Ismael Juma edited comment on KAFKA-4298 at 10/14/16 3:58 AM: -- Great catch.

[jira] [Updated] (KAFKA-4298) LogCleaner writes inconsistent compressed message set if topic message format != message format

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4298: --- Summary: LogCleaner writes inconsistent compressed message set if topic message format != message

[GitHub] kafka pull request #1995: KAFKA-4254: Update producers metadata before faili...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1995 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4298) LogCleaner writes inconsistent compressed message set if topic message format != message format

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574148#comment-15574148 ] ASF GitHub Bot commented on KAFKA-4298: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-4298) LogCleaner writes inconsistent compressed message set if topic message format != message format

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4298. Resolution: Fixed Fix Version/s: (was: 0.10.0.2) Issue resolved by pull request

[GitHub] kafka pull request #2019: KAFKA-4298: Ensure compressed message sets are not...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2019 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

[ https://issues.apache.org/jira/browse/KAFKA-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573699#comment-15573699 ] Terence Yim commented on KAFKA-1696: May I ask for any update about this feature? Any idea in which

[jira] [Commented] (KAFKA-4254) Questionable handling of unknown partitions in KafkaProducer

[ https://issues.apache.org/jira/browse/KAFKA-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574020#comment-15574020 ] ASF GitHub Bot commented on KAFKA-4254: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-4254) Questionable handling of unknown partitions in KafkaProducer

[ https://issues.apache.org/jira/browse/KAFKA-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4254. Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.1.0

[jira] [Commented] (KAFKA-4299) Consumer offsets reset for all topics after increasing partitions for one topic

[ https://issues.apache.org/jira/browse/KAFKA-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574324#comment-15574324 ] Juho Autio commented on KAFKA-4299: --- Thanks for testing [~vahid]. What about offsets of the pre-existing

[jira] [Updated] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4298: --- Fix Version/s: (was: 0.10.1.1) 0.10.0.2 0.10.1.0 >

[jira] [Created] (KAFKA-4299) Consumer offsets reset for all topics after increasing partitions for one topic

Juho Autio created KAFKA-4299: - Summary: Consumer offsets reset for all topics after increasing partitions for one topic Key: KAFKA-4299 URL: https://issues.apache.org/jira/browse/KAFKA-4299 Project:

[jira] [Commented] (KAFKA-4229) Controller can't start after several zk expired event

[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571265#comment-15571265 ] Pengwei commented on KAFKA-4229: We test it on 0.9.0.0, but I found the controller code are nearly the

[jira] [Updated] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4298: --- Affects Version/s: 0.10.0.1 > LogCleaner does not convert compressed message sets properly >

[GitHub] kafka pull request #2020: Removed unnecessary if/else clause.

GitHub user himani1 opened a pull request: https://github.com/apache/kafka/pull/2020 Removed unnecessary if/else clause. You can merge this pull request into a Git repository by running: $ git pull https://github.com/himani1/kafka code_refactor Alternatively you can review

[jira] [Commented] (KAFKA-3559) Task creation time taking too long in rebalance callback

[ https://issues.apache.org/jira/browse/KAFKA-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571234#comment-15571234 ] Eno Thereska commented on KAFKA-3559: - [~guozhang] actually let's keep this JIRA, no need to create

[jira] [Commented] (KAFKA-4185) Abstract out password verifier in SaslServer as an injectable dependency

[ https://issues.apache.org/jira/browse/KAFKA-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571363#comment-15571363 ] Edoardo Comar commented on KAFKA-4185: -- Hi [~piyushvijay] I see that a KIP has been proposed as a

[jira] [Commented] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571432#comment-15571432 ] Ismael Juma commented on KAFKA-4298: Great catch. I'm a bit unsure why this hasn't been reported so

[jira] [Commented] (KAFKA-4299) Consumer offsets reset for all topics after increasing partitions for one topic

[ https://issues.apache.org/jira/browse/KAFKA-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571675#comment-15571675 ] Ismael Juma commented on KAFKA-4299: cc [~hachikuji] > Consumer offsets reset for all topics after

[GitHub] kafka pull request #2021: MINOR: remove duplicate doc headers

GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/2021 MINOR: remove duplicate doc headers You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka LATEST-DOC-CHANGE Alternatively you can

[jira] [Commented] (KAFKA-4292) Configurable SASL callback handlers

[ https://issues.apache.org/jira/browse/KAFKA-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571761#comment-15571761 ] ASF GitHub Bot commented on KAFKA-4292: --- GitHub user rajinisivaram opened a pull request:

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571793#comment-15571793 ] Ismael Juma commented on KAFKA-2066: Thanks David. Assigned to Jason as he said he's available to pick

[jira] [Work stopped] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2066 stopped by David Jacot. -- > Replace FetchRequest / FetchResponse with their >

[jira] [Updated] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-2066: --- Assignee: (was: David Jacot) > Replace FetchRequest / FetchResponse with their >

[GitHub] kafka pull request #2022: KAFKA-4292: Configurable SASL callback handlers

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/2022 KAFKA-4292: Configurable SASL callback handlers Implementation of KIP-86: https://cwiki.apache.org/confluence/display/KAFKA/KIP-86%3A+Configurable+SASL+callback+handlers You can merge this

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571702#comment-15571702 ] David Jacot commented on KAFKA-2066: Unfortunately, I won't have time in the next weeks. [~hachikuji],

[jira] [Updated] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2066: --- Assignee: Jason Gustafson > Replace FetchRequest / FetchResponse with their >

[GitHub] kafka pull request #2023: TRIVIAL: AbstractFetcherManager: shutdown speeedup

GitHub user resetius opened a pull request: https://github.com/apache/kafka/pull/2023 TRIVIAL: AbstractFetcherManager: shutdown speeedup You can merge this pull request into a Git repository by running: $ git pull https://github.com/resetius/kafka

[jira] [Comment Edited] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568706#comment-15568706 ] Mazhar Shaikh edited comment on KAFKA-4128 at 10/13/16 2:18 PM: Hi Gwen

[jira] [Updated] (KAFKA-4229) Controller can't start after several zk expired event

[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4229: - Assignee: Pengwei > Controller can't start after several zk expired event >

[jira] [Commented] (KAFKA-4229) Controller can't start after several zk expired event

[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570973#comment-15570973 ] Guozhang Wang commented on KAFKA-4229: -- I have assigned this JIRA to you [~pengwei]. BTW which