Re: Jars in Kafka 0.10

This is a combination of Connect and Streams, and actually probably more related to Connect because it pulls in a bunch of jars to implement its REST API. You don't need all of them to run any of the individual components, but they are currently bundled altogether in a way that is, unfortunately,

[jira] [Commented] (KAFKA-4010) ConfigDef.toRst() should create sections for each group

[ https://issues.apache.org/jira/browse/KAFKA-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405270#comment-15405270 ] ASF GitHub Bot commented on KAFKA-4010: --- GitHub user rekhajoshm reopened a pull request:

[GitHub] kafka pull request #1696: KAFKA-4010; ConfigDef.toRst() to have grouped sect...

GitHub user rekhajoshm reopened a pull request: https://github.com/apache/kafka/pull/1696 KAFKA-4010; ConfigDef.toRst() to have grouped sections with dependents info - Added sort method with group order - Added dependents info You can merge this pull request into a Git

[jira] [Commented] (KAFKA-4010) ConfigDef.toRst() should create sections for each group

[ https://issues.apache.org/jira/browse/KAFKA-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405266#comment-15405266 ] ASF GitHub Bot commented on KAFKA-4010: --- Github user rekhajoshm closed the pull request at:

[GitHub] kafka pull request #1696: KAFKA-4010; ConfigDef.toRst() to have grouped sect...

Github user rekhajoshm closed the pull request at: https://github.com/apache/kafka/pull/1696 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405222#comment-15405222 ] ASF GitHub Bot commented on KAFKA-3999: --- Github user vahidhashemian closed the pull request at:

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405223#comment-15405223 ] ASF GitHub Bot commented on KAFKA-3999: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses

Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1698 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses

GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1698 KAFKA-3999: Record raw size of fetch responses Currently, only the decompressed size of fetch responses is recorded. This PR adds a sensor to keep track of the raw size as well. You can

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

On Thu, Jul 28, 2016 at 11:58 PM, Shikhar Bhushan wrote: > > > > > > Hmm, operating on ConnectRecords probably doesn't work since you need to > > emit the right type of record, which might mean instantiating a new one. > I > > think that means we either need 2 methods, one

Jenkins build is back to normal : kafka-trunk-jdk8 #795

See

Re: JDK configuration for Kafka jobs in Jenkins

Thanks for the update Ismael. Guozhang On Mon, Aug 1, 2016 at 4:48 AM, Ismael Juma wrote: > Hi all, > > Just a quick update with regards to the JDK configuration for Kafka Jobs in > Jenkins. The Infra team has made some changes on how the JDK is installed > in Jenkins slaves

[jira] [Work started] (KAFKA-3989) Add JMH module for Benchmarks

[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3989 started by Bill Bejeck. -- > Add JMH module for Benchmarks > - > >

[jira] [Updated] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3999: --- Status: Patch Available (was: Open) > Consumer bytes-fetched metric uses decompressed

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/1698 KAFKA-3999: Record raw size of fetch responses Currently, only the decompressed size of fetch responses is recorded. This PR adds a sensor to keep track of the raw size as well. You can

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404984#comment-15404984 ] ASF GitHub Bot commented on KAFKA-3999: --- GitHub user vahidhashemian opened a pull request:

[jira] [Assigned] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian reassigned KAFKA-3999: -- Assignee: Vahid Hashemian > Consumer bytes-fetched metric uses decompressed message

[jira] [Updated] (KAFKA-4000) Consumer per-topic metrics do not aggregate partitions from the same topic

[ https://issues.apache.org/jira/browse/KAFKA-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4000: --- Status: Patch Available (was: In Progress) > Consumer per-topic metrics do not aggregate

[jira] [Updated] (KAFKA-4014) Use Collections.singletonList instead of Arrays.asList for single arguments

[ https://issues.apache.org/jira/browse/KAFKA-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-4014: --- Summary: Use Collections.singletonList instead of Arrays.asList for single arguments (was: Use

[jira] [Commented] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404901#comment-15404901 ] Jun Rao commented on KAFKA-3042: [~onurkaraman], there are a couple of things. 1. Currently when a broker

[jira] [Commented] (KAFKA-4014) Use Collections.singletonList instead of Arrays.asList for single arguments

[ https://issues.apache.org/jira/browse/KAFKA-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404900#comment-15404900 ] ASF GitHub Bot commented on KAFKA-4014: --- GitHub user rekhajoshm opened a pull request:

[GitHub] kafka pull request #1697: KAFKA-4014; Using Collections.singletonList instea...

GitHub user rekhajoshm opened a pull request: https://github.com/apache/kafka/pull/1697 KAFKA-4014; Using Collections.singletonList instead of Arrays.asList for single arguments Using Collections.singletonList instead of Arrays.asList for single arguments You can merge this pull

[jira] [Updated] (KAFKA-4014) Use Collections.singletonList instead of Arrays.asList for single arguments

[ https://issues.apache.org/jira/browse/KAFKA-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-4014: --- Description: Usage of Collections.singletonList instead of Arrays.asList for single arguments better

[jira] [Created] (KAFKA-4014) Use Collections.singletonList instead of Arrays.asList for unmodified single arguments

Rekha Joshi created KAFKA-4014: -- Summary: Use Collections.singletonList instead of Arrays.asList for unmodified single arguments Key: KAFKA-4014 URL: https://issues.apache.org/jira/browse/KAFKA-4014

[jira] [Updated] (KAFKA-4014) Use Collections.singletonList instead of Arrays.asList for unmodified single arguments

[ https://issues.apache.org/jira/browse/KAFKA-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-4014: --- Issue Type: Improvement (was: Bug) > Use Collections.singletonList instead of Arrays.asList for

[jira] [Assigned] (KAFKA-4014) Use Collections.singletonList instead of Arrays.asList for unmodified single arguments

[ https://issues.apache.org/jira/browse/KAFKA-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi reassigned KAFKA-4014: -- Assignee: Rekha Joshi > Use Collections.singletonList instead of Arrays.asList for unmodified

[GitHub] kafka pull request #1674: HOTFIX: Fixes to javadoc and to state store name f...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1674 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1690: MINOR: Use `close()` instead of `dispose()` in var...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1688: MINOR: Remove unnecessary synchronized block in or...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1688 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404814#comment-15404814 ] ASF GitHub Bot commented on KAFKA-3929: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-4010) ConfigDef.toRst() should create sections for each group

[ https://issues.apache.org/jira/browse/KAFKA-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404813#comment-15404813 ] ASF GitHub Bot commented on KAFKA-4010: --- GitHub user rekhajoshm opened a pull request:

[GitHub] kafka pull request #1649: KAFKA-3929: Add prefix for underlying clients conf...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1649 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2630) Add Namespaces to Kafka

[ https://issues.apache.org/jira/browse/KAFKA-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404811#comment-15404811 ] Vahid Hashemian commented on KAFKA-2630: Any update [~singhashish]? > Add Namespaces to Kafka >

[jira] [Updated] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3929: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch

[GitHub] kafka pull request #1696: KAFKA-4010; ConfigDef.toRst() to have grouped sect...

GitHub user rekhajoshm opened a pull request: https://github.com/apache/kafka/pull/1696 KAFKA-4010; ConfigDef.toRst() to have grouped sections with dependents info - Added sort method with group order - Added dependents info You can merge this pull request into a Git

[jira] [Commented] (KAFKA-4013) SaslServerCallbackHandler should include cause for exception

[ https://issues.apache.org/jira/browse/KAFKA-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404754#comment-15404754 ] ASF GitHub Bot commented on KAFKA-4013: --- GitHub user bbaugher opened a pull request:

[GitHub] kafka pull request #1695: KAFKA-4013: Included exception cause in SaslServer...

GitHub user bbaugher opened a pull request: https://github.com/apache/kafka/pull/1695 KAFKA-4013: Included exception cause in SaslServerCallbackHandler You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbaugher/kafka KAFKA-4013

[jira] [Created] (KAFKA-4013) SaslServerCallbackHandler should include cause for exception

Bryan Baugher created KAFKA-4013: Summary: SaslServerCallbackHandler should include cause for exception Key: KAFKA-4013 URL: https://issues.apache.org/jira/browse/KAFKA-4013 Project: Kafka

[jira] [Commented] (KAFKA-4012) KerberosShortNamer should implement toString()

[ https://issues.apache.org/jira/browse/KAFKA-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404741#comment-15404741 ] Bryan Baugher commented on KAFKA-4012: -- Pull request, https://github.com/apache/kafka/pull/1694 >

[jira] [Commented] (KAFKA-4012) KerberosShortNamer should implement toString()

[ https://issues.apache.org/jira/browse/KAFKA-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404738#comment-15404738 ] ASF GitHub Bot commented on KAFKA-4012: --- GitHub user bbaugher opened a pull request:

[GitHub] kafka pull request #1694: KAFKA-4012: Added #toString() to KerberosShortName...

GitHub user bbaugher opened a pull request: https://github.com/apache/kafka/pull/1694 KAFKA-4012: Added #toString() to KerberosShortNamer You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbaugher/kafka KAFKA-4012 Alternatively

[jira] [Created] (KAFKA-4012) KerberosShortNamer should implement toString()

Bryan Baugher created KAFKA-4012: Summary: KerberosShortNamer should implement toString() Key: KAFKA-4012 URL: https://issues.apache.org/jira/browse/KAFKA-4012 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-4010) ConfigDef.toRst() should create sections for each group

[ https://issues.apache.org/jira/browse/KAFKA-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi reassigned KAFKA-4010: -- Assignee: Rekha Joshi > ConfigDef.toRst() should create sections for each group >

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

I would like to revive this thread and ask for additional feedback on this KIP. There have already been some feedback, mostly in favor, plus some concern about the value gain considering the complexity and the semantics; i.e. how the eventually revoked assignments need to be processed in the

[jira] [Commented] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404545#comment-15404545 ] Onur Karaman commented on KAFKA-3042: - I'm still trying to understand the downsides to getting rid of

[jira] [Commented] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404439#comment-15404439 ] Roger Hoover commented on KAFKA-3752: - [~guozhang] You're assessment seems correct. It happened again

[jira] [Commented] (KAFKA-3420) Transient failure in OffsetCommitTest.testNonExistingTopicOffsetCommit

[ https://issues.apache.org/jira/browse/KAFKA-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404408#comment-15404408 ] Jason Gustafson commented on KAFKA-3420: I investigated this briefly, but could not reproduce the

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404404#comment-15404404 ] Jun Rao commented on KAFKA-1211: [~fpj], for #1 and #2, there are a couple scenarios that this proposal

[jira] [Commented] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404314#comment-15404314 ] Jun Rao commented on KAFKA-3042: Thinking about this a bit more. An alternative approach is to extend

[jira] [Comment Edited] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404245#comment-15404245 ] Flavio Junqueira edited comment on KAFKA-1211 at 8/2/16 4:14 PM: -

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404245#comment-15404245 ] Flavio Junqueira commented on KAFKA-1211: - [~junrao] let me ask a few clarification questions. #

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404147#comment-15404147 ] Jun Rao commented on KAFKA-2063: For #3, the main reason for people to customize partition-level fetch

[VOTE] 0.10.0.1 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for the release of Apache Kafka 0.10.0.1. This is a bug fix release and it includes fixes and improvements from 52 JIRAs (including a few critical bugs). See the release notes for more details:

Jenkins build is back to normal : kafka-trunk-jdk7 #1456

See

Build failed in Jenkins: kafka-trunk-jdk8 #794

See -- Started by user ijuma [EnvInject] - Loading node environment variables. Building remotely on jenkins-test-24f (jenkins-cloud-4GB cloud-slave Ubuntu ubuntu jenkins-cloud-8GB) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #793

See Changes: [ismael] HOTFIX: Start embedded kafka in KafkaStreamsTest to avoid hanging -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

[GitHub] kafka pull request #1693: HOTFIX: start embedded kafka in KafkaStreamsTest t...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1693 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : kafka-0.10.0-jdk7 #178

See

[GitHub] kafka pull request #1693: HOTFIX: start embedded kafka in KafkaStreamsTest t...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1693 HOTFIX: start embedded kafka in KafkaStreamsTest to avoid hanging The KafkaStreamsTest can occasionally hang if the test doesn't run fast enough. This is due to there being no brokers available on the

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403787#comment-15403787 ] Andrey Neporada commented on KAFKA-2063: 1. I will submit KIP. 2. Clear on that. 3. Yes, we will

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403700#comment-15403700 ] Ismael Juma commented on KAFKA-2063: [~nepal], I believe the answer is yes to 1) and 2). A few points

Build failed in Jenkins: kafka-0.10.0-jdk7 #177

See -- Started by user ijuma [EnvInject] - Loading node environment variables. Building remotely on H10 (docker Ubuntu ubuntu yahoo-not-h2) in workspace

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403676#comment-15403676 ] Andrey Neporada commented on KAFKA-2063: (a) I refer to some new server side setting - something

Build failed in Jenkins: kafka-0.10.0-jdk7 #175

See Changes: [me] KAFKA-4008: Module "tools" should not be dependent on "core" -- [...truncated 6390 lines...] org.apache.kafka.connect.storage.OffsetStorageWriterTest >

Build failed in Jenkins: kafka-trunk-jdk8 #792

See Changes: [me] KAFKA-4008: Module "tools" should not be dependent on "core" -- [...truncated 5923 lines...] kafka.api.SslEndToEndAuthorizationTest > testProduceConsumeViaSubscribe STARTED