[jira] [Updated] (KAFKA-4422) Drop support for Scala 2.10 (KIP-119)

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4422: --- Summary: Drop support for Scala 2.10 (KIP-119) (was: Drop support for Scala 2.10) > Drop support

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993933#comment-15993933 ] Matthias J. Sax commented on KAFKA-5154: Thanks for the details. We will investigate. If would

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 10:56 PM: -- Hi, we have a

[GitHub] kafka pull request #2926: KAFKA-5131: WriteTxnMarkers and complete commit/ab...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2926 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-5131) WriteTxnMarkers and complete commit/abort on partition immigration

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994087#comment-15994087 ] ASF GitHub Bot commented on KAFKA-5131: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-5131) WriteTxnMarkers and complete commit/abort on partition immigration

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5131: --- Resolution: Fixed Fix Version/s: 0.11.0.0 Status: Resolved (was: Patch Available)

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 11:10 PM: -- Hi, we have a

[jira] [Updated] (KAFKA-4955) Add network handler thread utilization to request quota calculation

2017-05-02 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-4955: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~junrao] Yes, thank you.

[jira] [Commented] (KAFKA-1313) Support adding replicas to existing topic partitions via kafka-topics tool without manually setting broker assignments

2017-05-02 Thread Steven Schlansker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993414#comment-15993414 ] Steven Schlansker commented on KAFKA-1313: -- I started using Kafka Streams recently. I did not

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2017-05-02 Thread Michael Noll (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993467#comment-15993467 ] Michael Noll commented on KAFKA-1194: - [~guozhang]: Do you happen to know the latest status of this

[jira] [Created] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-02 Thread Lawrence Weikum (JIRA)
Lawrence Weikum created KAFKA-5161: -- Summary: reassign-partitions to check if broker of ID exists in cluster Key: KAFKA-5161 URL: https://issues.apache.org/jira/browse/KAFKA-5161 Project: Kafka

[jira] [Updated] (KAFKA-3266) Implement KIP-140 RPCs and APIs for creating, altering, and listing ACLs

2017-05-02 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe updated KAFKA-3266: --- Summary: Implement KIP-140 RPCs and APIs for creating, altering, and listing ACLs (was:

Re: [DISCUSS] KIP-145: Classloading Isolation in Connect

2017-05-02 Thread Konstantine Karantasis
Thank you for your vote Colin! Unfortunately the discussion thread had to move because of a KIP-number collision. Here's a link to the active discussion thread: https://www.mail-archive.com/dev@kafka.apache.org/msg71453.html Apologies for the inconvenience. Konstantine On Mon, May 1, 2017 at

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-02 Thread Ewen Cheslack-Postava
Thanks for the KIP. A few responses inline, followed by additional comments. On Mon, May 1, 2017 at 9:50 PM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Gwen, Randall thank you for your very insightful observations. I'm glad you > find this first draft to be an adequate platform

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993594#comment-15993594 ] Guozhang Wang commented on KAFKA-5154: -- I think I saw a similar issue a days ago and was trying to

[jira] [Created] (KAFKA-5160) KIP-98 : broker side handling for the TxnOffsetCommitRequest

2017-05-02 Thread Apurva Mehta (JIRA)
Apurva Mehta created KAFKA-5160: --- Summary: KIP-98 : broker side handling for the TxnOffsetCommitRequest Key: KAFKA-5160 URL: https://issues.apache.org/jira/browse/KAFKA-5160 Project: Kafka

Re: [DISCUSS] KIP-136: Add Listener name and Security Protocol name to SelectorMetrics tags

2017-05-02 Thread Ismael Juma
Edoardo, Are you planning to do this only in the broker? Listener names only exist at the broker level. Also, clients only have a single security protocol, so maybe we should do this for brokers only. In that case, the compatibility impact is also lower because more users rely on the Yammer

Jenkins build is back to normal : kafka-trunk-jdk7 #2138

2017-05-02 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #2958: KAFKA-5162: Add a reference to AdminClient to docs...

2017-05-02 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2958 KAFKA-5162: Add a reference to AdminClient to docs/api.html You can merge this pull request into a Git repository by running: $ git pull https://github.com/cmccabe/kafka KAFKA-5162

[jira] [Commented] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993565#comment-15993565 ] ASF GitHub Bot commented on KAFKA-5162: --- GitHub user cmccabe opened a pull request:

[jira] [Commented] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-02 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993566#comment-15993566 ] Colin P. McCabe commented on KAFKA-5162: https://github.com/apache/kafka/pull/2958 > Add a

[jira] [Work started] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-02 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5162 started by Colin P. McCabe. -- > Add a reference to AdminClient to docs/api.html >

[jira] [Created] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-02 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-5162: -- Summary: Add a reference to AdminClient to docs/api.html Key: KAFKA-5162 URL: https://issues.apache.org/jira/browse/KAFKA-5162 Project: Kafka Issue

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

2017-05-02 Thread Ewen Cheslack-Postava
A couple of thoughts: First, agreed that we definitely want to expose header functionality. Thank you Mike for starting the conversation! Even if Connect doesn't do anything special with it, there's value in being able to access/set headers. On motivation -- I think there are much broader use

Build failed in Jenkins: kafka-trunk-jdk8 #1471

2017-05-02 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-5107; remove preferred replica election state from -- [...truncated 842.45 KB...] kafka.integration.SaslPlaintextTopicMetadataTest >

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993408#comment-15993408 ] Matthias J. Sax commented on KAFKA-5154: Thanks for reporting this [~Lukas Gemela]. I just double

[jira] [Updated] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

2017-05-02 Thread Arpan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpan updated KAFKA-5153: - Affects Version/s: 0.10.2.0 > KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting >

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-05-02 Thread Ismael Juma
Hi Matthias, Deprecating widely used APIs is a big deal. Build warnings are a nuisance and can potentially break the build for those who have a zero-warnings policy (which is good practice). It creates a bunch of busy work for our users and various resources like books, blog posts, etc. become

[GitHub] kafka pull request #2952: MINOR: fix some c/p error that was causing describ...

2017-05-02 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/2952 MINOR: fix some c/p error that was causing describe to delete @ijuma @cmccabe You can merge this pull request into a Git repository by running: $ git pull https://github.com/norwood/kafka

[GitHub] kafka pull request #2953: handle 0 futures in all()

2017-05-02 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/2953 handle 0 futures in all() if we pass in 0 futures to an AllOfAdapter, we should complete immediately @ijuma @cmccabe You can merge this pull request into a Git repository by running:

[jira] [Created] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
Lukas Gemela created KAFKA-5154: --- Summary: Kafka Streams throws NPE during rebalance Key: KAFKA-5154 URL: https://issues.apache.org/jira/browse/KAFKA-5154 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

2017-05-02 Thread Arpan (JIRA)
Arpan created KAFKA-5153: Summary: KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting Key: KAFKA-5153 URL: https://issues.apache.org/jira/browse/KAFKA-5153 Project: Kafka

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

2017-05-02 Thread Michael André Pearce
Hi Ewan, So on the point of JMS the predefined/standardised JMS and JMSX headers have predefined types. So these can be serialised/deserialised accordingly. Custom jms headers agreed could be a bit more difficult but on the 80/20 rule I would agree mostly they're string values and as anyhow

[GitHub] kafka pull request #2960: KAFKA-4343: Expose Connector type in REST API

2017-05-02 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/2960 KAFKA-4343: Expose Connector type in REST API https://cwiki.apache.org/confluence/display/KAFKA/KIP-151+Expose+Connector+type+in+REST+API You can merge this pull request into a Git repository by

[jira] [Commented] (KAFKA-4343) Connect REST API should expose whether each connector is a source or sink

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993709#comment-15993709 ] ASF GitHub Bot commented on KAFKA-4343: --- GitHub user norwood opened a pull request:

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 10:27 PM: -- Hi, we have a

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 10:33 PM: -- Hi, we have a

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 10:33 PM: -- Hi, we have a

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 10:34 PM: -- Hi, we have a

Re: Kafka Connect and Partitions

2017-05-02 Thread Randall Hauch
Hi, David. Excellent. I'm glad that you've solved the puzzle. Best regards, Randall On Tue, May 2, 2017 at 9:18 AM, wrote: > Hi Gwen/Randall, > > I think I've finally understood, more or less, how partitioning relates to > SourceRecords. > > Because I was using the

[jira] [Assigned] (KAFKA-4343) Connect REST API should expose whether each connector is a source or sink

2017-05-02 Thread dan norwood (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dan norwood reassigned KAFKA-4343: -- Assignee: dan norwood > Connect REST API should expose whether each connector is a source or

[GitHub] kafka pull request #2959: Created convenience method to create ZkUtils

2017-05-02 Thread bbaugher
GitHub user bbaugher opened a pull request: https://github.com/apache/kafka/pull/2959 Created convenience method to create ZkUtils You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbaugher/kafka zkutils Alternatively you can

[GitHub] kafka pull request #2961: MINOR: Serialize the real isolationLevel in FetchR...

2017-05-02 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/2961 MINOR: Serialize the real isolationLevel in FetchRequest You can merge this pull request into a Git repository by running: $ git pull https://github.com/apurvam/kafka

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela commented on KAFKA-5154: - Hi, we have a kafka streams app consuming from one topic,

[jira] [Created] (KAFKA-5164) SetSchemaMetadata does not replace the schemas in structs correctly

2017-05-02 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-5164: Summary: SetSchemaMetadata does not replace the schemas in structs correctly Key: KAFKA-5164 URL: https://issues.apache.org/jira/browse/KAFKA-5164

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-02 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993902#comment-15993902 ] Lukas Gemela edited comment on KAFKA-5154 at 5/2/17 10:35 PM: -- Hi, we have a

[jira] [Updated] (KAFKA-5127) Replace pattern matching with foreach where the case None is unused

2017-05-02 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balint Molnar updated KAFKA-5127: - Status: Patch Available (was: In Progress) > Replace pattern matching with foreach where the

[jira] [Updated] (KAFKA-4307) Inconsistent parameters between console producer and consumer

2017-05-02 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balint Molnar updated KAFKA-4307: - Status: Patch Available (was: In Progress) > Inconsistent parameters between console producer

[jira] [Updated] (KAFKA-4703) Test with two SASL_SSL listeners with different JAAS contexts

2017-05-02 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balint Molnar updated KAFKA-4703: - Status: Patch Available (was: In Progress) > Test with two SASL_SSL listeners with different

[VOTE] KIP-137: Enhance TopicCommand --describe to show topics marked for deletion

2017-05-02 Thread Mickael Maison
Hi, I'd like to start the vote on KIP-137: https://cwiki.apache.org/confluence/display/KAFKA/KIP-137%3A+Enhance+TopicCommand+--describe+to+show+topics+marked+for+deletion Thanks,

[jira] [Commented] (KAFKA-4772) Exploit #peek to implement #print() and other methods

2017-05-02 Thread james chien (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992704#comment-15992704 ] james chien commented on KAFKA-4772: my new PR is here https://github.com/apache/kafka/pull/2955 >

[GitHub] kafka pull request #2924: change connection refused message from level DEBUG...

2017-05-02 Thread jedichien
Github user jedichien closed the pull request at: https://github.com/apache/kafka/pull/2924 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2955: Replace KeyValuePrinter and KStreamForeach with KS...

2017-05-02 Thread jedichien
GitHub user jedichien opened a pull request: https://github.com/apache/kafka/pull/2955 Replace KeyValuePrinter and KStreamForeach with KStreamPeek I remove `KeyValuePrinter` and `KStreamForeach` two class, then implements them by `KStreamPeek`. So, now `KStreamPeek` can do

[jira] [Created] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-02 Thread JIRA
Petr Plavjaník created KAFKA-5155: - Summary: Messages can be deleted prematurely when some producers use timestamps and some not Key: KAFKA-5155 URL: https://issues.apache.org/jira/browse/KAFKA-5155

Re: [VOTE] KIP-137: Enhance TopicCommand --describe to show topics marked for deletion

2017-05-02 Thread Ismael Juma
Thanks for the KIP, +1 (binding). Ismael On Tue, May 2, 2017 at 11:43 AM, Mickael Maison wrote: > Hi, > > I'd like to start the vote on KIP-137: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

[GitHub] kafka pull request #2954: MINOR: Fix error logged if not enough alive broker...

2017-05-02 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2954 MINOR: Fix error logged if not enough alive brokers for transactions state topic You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

[jira] [Commented] (KAFKA-4422) Drop support for Scala 2.10

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992774#comment-15992774 ] Ismael Juma commented on KAFKA-4422: For 0.11.0.0, we will remove support for Scala 2.10, but we won't

Re: Request to add to the contributor list

2017-05-02 Thread Amit Daga
Hello, Wondering if you were able to look into it? Thanks, Amit Daga On Sun, Apr 30, 2017 at 1:29 PM, Amit Daga wrote: > Hello Team, > > Hope you are doing well. > > My name is Amit Daga. This is to request you to add me to the contributor > list. Also if KAFKA-4996

[GitHub] kafka pull request #2952: MINOR: fix some c/p error that was causing describ...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2952 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[DISCUSS] KIP 151 - Expose Connector type in REST API

2017-05-02 Thread dan
hello. in an attempt to make the connect rest endpoints more useful i'd like to add the Connector type (Sink/Source) in our rest endpoints to make them more self descriptive. KIP here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-151+Expose+Connector+type+in+REST+API initial pr:

Re: [VOTE] KIP-118: Drop Support for Java 7 in Kafka 0.11

2017-05-02 Thread Ismael Juma
Hi all, As I looked deeper into the details of the impact of this change, it became apparent to me that it may better to postpone it to a future release. Reasons follow: 1. Once we move to Java 8, there will be a ripple effect in all projects that depend on the Kafka clients jar. Given where we

Build failed in Jenkins: kafka-trunk-jdk7 #2139

2017-05-02 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5131; WriteTxnMarkers and complete commit/abort on partition -- [...truncated 849.20 KB...] kafka.server.DynamicConfigChangeTest >

Build failed in Jenkins: kafka-trunk-jdk8 #1472

2017-05-02 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5131; WriteTxnMarkers and complete commit/abort on partition -- [...truncated 846.70 KB...] kafka.integration.SaslPlaintextTopicMetadataTest >

[GitHub] kafka pull request #2953: handle 0 futures in all()

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2953 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-136: Add Listener name and Security Protocol name to SelectorMetrics tags

2017-05-02 Thread Jun Rao
Hi, Edo, Thanks for the proposal. It looks good to me. Jun On Thu, Mar 30, 2017 at 8:51 AM, Edoardo Comar wrote: > Hi all, > > We created KIP-136: Add Listener name and Security Protocol name to > SelectorMetrics tags > >

[jira] [Created] (KAFKA-5163) Support replicas movement between log directories (KIP-113)

2017-05-02 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5163: --- Summary: Support replicas movement between log directories (KIP-113) Key: KAFKA-5163 URL: https://issues.apache.org/jira/browse/KAFKA-5163 Project: Kafka Issue Type:

Re: [DISCUSS] KIP 151 - Expose Connector type in REST API

2017-05-02 Thread Ewen Cheslack-Postava
Both the proposal and PR look good to me. -Ewen On Tue, May 2, 2017 at 1:48 PM, dan wrote: > hello. > > in an attempt to make the connect rest endpoints more useful i'd like to > add the Connector type (Sink/Source) in our rest endpoints to make them > more self

[jira] [Assigned] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5161: --- Assignee: huxi > reassign-partitions to check if broker of ID exists in cluster >

[GitHub] kafka pull request #2963: Minor: Removed use of keySerde in CachingSessionSt...

2017-05-02 Thread KyleWinkelman
GitHub user KyleWinkelman opened a pull request: https://github.com/apache/kafka/pull/2963 Minor: Removed use of keySerde in CachingSessionStore. CachingSessionStore wasn't properly using the default keySerde if no Serde was supplied. I saw the below error in the logs for one of my

[jira] [Comment Edited] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994177#comment-15994177 ] huxi edited comment on KAFKA-5155 at 5/3/17 2:27 AM: - This is very similar with a jira

[jira] [Commented] (KAFKA-5130) Change InterBrokerSendThread to use a Queue per broker

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994187#comment-15994187 ] ASF GitHub Bot commented on KAFKA-5130: --- GitHub user guozhangwang opened a pull request:

Build failed in Jenkins: kafka-trunk-jdk8 #1473

2017-05-02 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5131; WriteTxnMarkers and complete commit/abort on partition [ismael] MINOR: Serialize the real isolationLevel in FetchRequest --

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

2017-05-02 Thread Ewen Cheslack-Postava
Michael, Aren't JMS headers an example where the variety is a problem? Unless I'm misunderstanding, there's not even a fixed serialization format expected for them since JMS defines the runtime types, not the wire format. For example, we have JMSCorrelationID (String), JMSExpires (Long), and

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-02 Thread Stephane Maarek
Thanks for the work, it’s definitely needed! I’d like to suggest to take it one step further. To me, I’d like to see Kafka Connect the same way we have Docker and Docker repositories. Here’s how I would envision the flow: - Kafka Connect workers are just workers. They come with no jars

Jenkins build is back to normal : kafka-trunk-jdk7 #2141

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-4667) Connect should create internal topics

2017-05-02 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994268#comment-15994268 ] Ewen Cheslack-Postava commented on KAFKA-4667: -- [~rhauch] Discussed some of these issues

Build failed in Jenkins: kafka-trunk-jdk8 #1474

2017-05-02 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Handle 0 futures in all() -- [...truncated 842.54 KB...] kafka.integration.SaslPlaintextTopicMetadataTest > testAutoCreateTopicWithCollision

[jira] [Commented] (KAFKA-3754) Kafka default -Xloggc settings should include GC log rotation flags

2017-05-02 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994280#comment-15994280 ] James Cheng commented on KAFKA-3754: FYI, I tried out this change in my cluster today. The JVM's GC

[GitHub] kafka pull request #2962: Kafka5161 reassign-partitions to check if broker o...

2017-05-02 Thread amethystic
GitHub user amethystic opened a pull request: https://github.com/apache/kafka/pull/2962 Kafka5161 reassign-partitions to check if broker of ID exists in cluster Added code to check existence of the brokers in the proposed plan. You can merge this pull request into a Git repository

[jira] [Commented] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994177#comment-15994177 ] huxi commented on KAFKA-5155: - This is very similar with a jira

[jira] [Commented] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994197#comment-15994197 ] huxi commented on KAFKA-5153: - Could you set `replica.lag.time.max.ms`, `replica.fetch.wait.max.ms` to larger

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-02 Thread Mathieu Fenniak
Hi Jeyhun, This approach would change ValueMapper (...etc) to be classes, rather than interfaces, which is also a backwards incompatible change. An alternative approach that would be backwards compatible would be to define new interfaces, and provide overrides where those interfaces are used.

[GitHub] kafka pull request #2957: KAFKA-5132: abort long running transactions

2017-05-02 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2957 KAFKA-5132: abort long running transactions Abort any ongoing transactions that haven't been touched for longer than the transaction timeout You can merge this pull request into a Git repository by

[jira] [Commented] (KAFKA-5132) Abort long running transactions

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993061#comment-15993061 ] ASF GitHub Bot commented on KAFKA-5132: --- GitHub user dguy opened a pull request:

[jira] [Created] (KAFKA-5158) Options for handling exceptions during processing

2017-05-02 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5158: --- Summary: Options for handling exceptions during processing Key: KAFKA-5158 URL: https://issues.apache.org/jira/browse/KAFKA-5158 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4743: --- Status: Patch Available (was: Open) > Add a tool to Reset Consumer Group Offsets >

[jira] [Updated] (KAFKA-4743) Add a tool to Reset Consumer Group Offsets

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4743: --- Fix Version/s: 0.11.0.0 > Add a tool to Reset Consumer Group Offsets >

[jira] [Updated] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Petr Plavjaník updated KAFKA-5155: -- Description: Some messages can be deleted prematurely and never read in following scenario. A

[jira] [Created] (KAFKA-5156) Options for handling exceptions in streams

2017-05-02 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5156: --- Summary: Options for handling exceptions in streams Key: KAFKA-5156 URL: https://issues.apache.org/jira/browse/KAFKA-5156 Project: Kafka Issue Type: Task

[jira] [Updated] (KAFKA-5006) KeyValueStore.put may throw exception unrelated to the current put attempt

2017-05-02 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-5006: Issue Type: Sub-task (was: Bug) Parent: KAFKA-5156 > KeyValueStore.put may throw exception

[jira] [Created] (KAFKA-5157) Options for handling corrupt data during deserialization

2017-05-02 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5157: --- Summary: Options for handling corrupt data during deserialization Key: KAFKA-5157 URL: https://issues.apache.org/jira/browse/KAFKA-5157 Project: Kafka Issue

[jira] [Commented] (KAFKA-4422) Drop support for Scala 2.10

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992994#comment-15992994 ] ASF GitHub Bot commented on KAFKA-4422: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2956: KAFKA-4422: Drop support for Scala 2.10

2017-05-02 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2956 KAFKA-4422: Drop support for Scala 2.10 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-4422-drop-support-scala-2.10

[jira] [Updated] (KAFKA-4422) Drop support for Scala 2.10

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4422: --- Status: Patch Available (was: Open) > Drop support for Scala 2.10 > --- > >

[jira] [Commented] (KAFKA-4955) Add network handler thread utilization to request quota calculation

2017-05-02 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993165#comment-15993165 ] Jun Rao commented on KAFKA-4955: [~rsivaram], now that KAFKA-4954 is committed, should we close this jira

RE: Kafka Connect and Partitions

2017-05-02 Thread david.franklin
Hi Gwen/Randall, I think I've finally understood, more or less, how partitioning relates to SourceRecords. Because I was using the SourceRecord constructor that doesn't provide values for key and key schema, the key is null. The DefaultPartioner appears to map null to a constant value rather

Build failed in Jenkins: kafka-trunk-jdk8 #1470

2017-05-02 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4623; Default unclean.leader.election.enabled to false (KIP-106) -- [...truncated 844.92 KB...]

[jira] [Updated] (KAFKA-5131) WriteTxnMarkers and complete commit/abort on partition immigration

2017-05-02 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-5131: -- Status: Patch Available (was: Open) > WriteTxnMarkers and complete commit/abort on partition

Re: [VOTE] KIP-137: Enhance TopicCommand --describe to show topics marked for deletion

2017-05-02 Thread Vahid S Hashemian
+1 (non-binding) Thanks Mickael. --Vahid From: Ismael Juma To: dev@kafka.apache.org Date: 05/02/2017 03:46 AM Subject:Re: [VOTE] KIP-137: Enhance TopicCommand --describe to show topics marked for deletion Sent by:isma...@gmail.com Thanks for

[jira] [Assigned] (KAFKA-4623) Change Default unclean.leader.election.enabled from True to False

2017-05-02 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-4623: -- Assignee: Ismael Juma (was: Sharad) > Change Default unclean.leader.election.enabled from

  1   2   >