[jira] [Commented] (KAFKA-4477) Node reduces its ISR to itself, and doesn't recover. Other nodes do not take leadership, cluster remains sick until node is restarted.

2016-12-07 Thread Jan Omar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731461#comment-15731461 ] Jan Omar commented on KAFKA-4477: - We're seeing the same issue on FreeBSD 10.3. Also Kafka

Re: [VOTE] 0.10.1.1 RC0

2016-12-07 Thread Ismael Juma
Thanks Guozhang. The Maven staging repo link doesn't seem to have 0.10.1.1. Can you please double-check? Ismael On 7 Dec 2016 10:47 pm, "Guozhang Wang" wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for the release of Apache Kafka 0.10.1.1. This >

[jira] [Updated] (KAFKA-4485) Follower should be in the isr if its FetchRequest has fetched up to the logEndOffset of leader

2016-12-07 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-4485: Description: As of current implementation, we will exclude follower from ISR if the begin offset of FetchRe

[jira] [Updated] (KAFKA-4485) Follower should be in the isr if its FetchRequest has fetched up to the logEndOffset of leader

2016-12-07 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-4485: Description: As of current implementation, we will exclude follower from ISR if the begin offset of FetchRe

[jira] [Updated] (KAFKA-4500) Kafka Code Improvements

2016-12-07 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-4500: --- Summary: Kafka Code Improvements (was: Code Improvements) > Kafka Code Improvements > ---

[jira] [Updated] (KAFKA-4500) Code Improvements

2016-12-07 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-4500: --- Priority: Minor (was: Trivial) > Code Improvements > - > > Key: KAFKA

[jira] [Commented] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731033#comment-15731033 ] ASF GitHub Bot commented on KAFKA-4447: --- GitHub user xiguantiaozhan reopened a pull

[GitHub] kafka pull request #2191: KAFKA-4447: Controller resigned but it also acts a...

2016-12-07 Thread xiguantiaozhan
GitHub user xiguantiaozhan reopened a pull request: https://github.com/apache/kafka/pull/2191 KAFKA-4447: Controller resigned but it also acts as a controller for a long time You can merge this pull request into a Git repository by running: $ git pull https://github.com/xigua

[jira] [Updated] (KAFKA-4500) Code Improvements

2016-12-07 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-4500: --- Summary: Code Improvements (was: Code Corrections) > Code Improvements > - > >

[jira] [Updated] (KAFKA-3796) SslTransportLayerTest.testInvalidEndpointIdentification fails on trunk

2016-12-07 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-3796: --- Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) > SslTransportLayerTest.test

[jira] [Commented] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730981#comment-15730981 ] ASF GitHub Bot commented on KAFKA-4447: --- Github user xiguantiaozhan closed the pull

[GitHub] kafka pull request #2191: KAFKA-4447: Controller resigned but it also acts a...

2016-12-07 Thread xiguantiaozhan
Github user xiguantiaozhan closed the pull request at: https://github.com/apache/kafka/pull/2191 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (KAFKA-4505) Cannot get topic lag since kafka upgrade from 0.8.1.0 to 0.10.1.0

2016-12-07 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730958#comment-15730958 ] huxi commented on KAFKA-4505: - Is the group active? Check if znode '/consumers//owners' exists

[jira] [Commented] (KAFKA-4468) Correctly calculate the window end timestamp after read from state stores

2016-12-07 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730787#comment-15730787 ] Bill Bejeck commented on KAFKA-4468: Unless I'm missing something, this task implies w

Re: [VOTE]: KIP-97: The client compatibility KIP

2016-12-07 Thread Gwen Shapira
+1 (binding) On Wed, Dec 7, 2016 at 9:17 AM, Colin McCabe wrote: > Hi all, > > I heard that the VOTE and DISCUSS threads for the KIP-97 discussion > appeared to be in the same email thread for some people using gmail. So > I'm reposting in hopes of getting a separate email thread this time for >

[jira] [Updated] (KAFKA-4494) Significant startup delays in KStreams app

2016-12-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4494: - Component/s: streams > Significant startup delays in KStreams app > --

[jira] [Updated] (KAFKA-4494) Significant startup delays in KStreams app

2016-12-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4494: - Labels: performance (was: ) > Significant startup delays in KStreams app > --

Build failed in Jenkins: kafka-trunk-jdk8 #1087

2016-12-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4492: Make the streams cache eviction policy tolerable to -- [...truncated 14480 lines...] org.apache.kafka.streams.KafkaStreamsTest > shouldNotGetAllTasksWhenNotR

[jira] [Updated] (KAFKA-4510) StreamThread must finish rebalance in state PENDING_SHUTDOWN

2016-12-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4510: --- Status: Patch Available (was: In Progress) > StreamThread must finish rebalance in state PEND

[jira] [Commented] (KAFKA-4454) Authorizer should also include the Principal generated by the PrincipalBuilder.

2016-12-07 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730371#comment-15730371 ] Mayuresh Gharat commented on KAFKA-4454: [~junrao], thanks a lot for the review. T

[jira] [Commented] (KAFKA-4510) StreamThread must finish rebalance in state PENDING_SHUTDOWN

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730369#comment-15730369 ] ASF GitHub Bot commented on KAFKA-4510: --- GitHub user mjsax opened a pull request:

[GitHub] kafka pull request #2227: KAFKA-4510: StreamThread must finish rebalance in ...

2016-12-07 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2227 KAFKA-4510: StreamThread must finish rebalance in state PENDING_SHUTDOWN You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-4510-f

[jira] [Created] (KAFKA-4510) StreamThread must finish rebalance in state PENDING_SHUTDOWN

2016-12-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-4510: -- Summary: StreamThread must finish rebalance in state PENDING_SHUTDOWN Key: KAFKA-4510 URL: https://issues.apache.org/jira/browse/KAFKA-4510 Project: Kafka

[jira] [Work started] (KAFKA-4510) StreamThread must finish rebalance in state PENDING_SHUTDOWN

2016-12-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4510 started by Matthias J. Sax. -- > StreamThread must finish rebalance in state PENDING_SHUTDOWN >

Re: [VOTE] 0.10.1.1 RC0

2016-12-07 Thread Guozhang Wang
One notification is that in this bug-fix release we include artifacts built from Scala 2.12.1 as well, as a pre-alpha product for the Scala community to try and test it out (it is built with Java8 while all other artifacts are built with Java7). We hope to formally add the scala 2.12 support in fut

[VOTE] 0.10.1.1 RC0

2016-12-07 Thread Guozhang Wang
Hello Kafka users, developers and client-developers, This is the first candidate for the release of Apache Kafka 0.10.1.1. This is a bug fix release and it includes fixes and improvements from 27 JIRAs. See the release notes for more details: http://home.apache.org/~guozhang/kafka-0.10.1.1-rc0/RE

Build failed in Jenkins: kafka-trunk-jdk8 #1086

2016-12-07 Thread Apache Jenkins Server
See Changes: [becket.qin] KAFKA-4445; PreferredLeaderElectionCommand should query zookeeper only -- [...truncated 16005 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnector

[jira] [Created] (KAFKA-4509) Task reusage on rebalance fails for threads on same host

2016-12-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-4509: -- Summary: Task reusage on rebalance fails for threads on same host Key: KAFKA-4509 URL: https://issues.apache.org/jira/browse/KAFKA-4509 Project: Kafka Is

[jira] [Work started] (KAFKA-4509) Task reusage on rebalance fails for threads on same host

2016-12-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4509 started by Matthias J. Sax. -- > Task reusage on rebalance fails for threads on same host >

[jira] [Updated] (KAFKA-4486) Kafka Streams - exception in process still commits offsets

2016-12-07 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-4486: Fix Version/s: 0.10.2.0 > Kafka Streams - exception in process still commits offsets > -

[jira] [Commented] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729783#comment-15729783 ] ASF GitHub Bot commented on KAFKA-4492: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2226: KAFKA-4492: java.lang.IllegalStateException: Attem...

2016-12-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2226 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-12-07 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729737#comment-15729737 ] Shikhar Bhushan commented on KAFKA-3209: [~snisarg] and [~jjchorrobe], I revived t

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

2016-12-07 Thread Shikhar Bhushan
Hi all, I have another iteration at a proposal for this feature here: https://cwiki.apache.org/confluence/display/KAFKA/Connect+Transforms+-+Proposed+Design I'd welcome your feedback and comments. Thanks, Shikhar On Tue, Aug 2, 2016 at 7:21 PM Ewen Cheslack-Postava wrote: On Thu, Jul 28, 201

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-07 Thread Rajini Sivaram
+1 (non-binding) On Wed, Dec 7, 2016 at 7:22 PM, Apurva Mehta wrote: > +1 (non-binding) > > On Wed, Dec 7, 2016 at 10:05 AM, Jason Gustafson > wrote: > > > +1 Thanks for the KIP! > > > > On Wed, Dec 7, 2016 at 2:53 AM, Ismael Juma wrote: > > > > > Thanks for the KIP, Vahid. +1 (binding) > > >

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-07 Thread Apurva Mehta
+1 (non-binding) On Wed, Dec 7, 2016 at 10:05 AM, Jason Gustafson wrote: > +1 Thanks for the KIP! > > On Wed, Dec 7, 2016 at 2:53 AM, Ismael Juma wrote: > > > Thanks for the KIP, Vahid. +1 (binding) > > > > On Mon, Dec 5, 2016 at 6:16 PM, Vahid S Hashemian < > > vahidhashem...@us.ibm.com > > >

[GitHub] kafka pull request #2221: MINOR: fix metric collection NPE during shutdown

2016-12-07 Thread xvrl
Github user xvrl closed the pull request at: https://github.com/apache/kafka/pull/2221 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] kafka pull request #2221: MINOR: fix metric collection NPE during shutdown

2016-12-07 Thread xvrl
GitHub user xvrl reopened a pull request: https://github.com/apache/kafka/pull/2221 MINOR: fix metric collection NPE during shutdown collecting socket server metrics during shutdown may throw NullPointerException You can merge this pull request into a Git repository by running:

[jira] [Resolved] (KAFKA-4445) PreferredLeaderElectionCommand should query zk only once per topic

2016-12-07 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-4445. - Resolution: Fixed > PreferredLeaderElectionCommand should query zk only once per topic > -

[jira] [Commented] (KAFKA-4445) PreferredLeaderElectionCommand should query zk only once per topic

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729435#comment-15729435 ] ASF GitHub Bot commented on KAFKA-4445: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4445) PreferredLeaderElectionCommand should query zk only once per topic

2016-12-07 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-4445: Affects Version/s: 0.10.1.0 Fix Version/s: 0.10.2.0 Issue Type: Improvement (was:

[GitHub] kafka pull request #2170: KAFKA-4445; PreferredLeaderElectionCommand should ...

2016-12-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2170 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-07 Thread Jason Gustafson
+1 Thanks for the KIP! On Wed, Dec 7, 2016 at 2:53 AM, Ismael Juma wrote: > Thanks for the KIP, Vahid. +1 (binding) > > On Mon, Dec 5, 2016 at 6:16 PM, Vahid S Hashemian < > vahidhashem...@us.ibm.com > > wrote: > > > Happy Monday, > > > > I'd like to start voting on KIP-88 ( > > https://cwiki.ap

[jira] [Created] (KAFKA-4508) Create system tests that run newer versions of the client against older versions of the broker

2016-12-07 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-4508: -- Summary: Create system tests that run newer versions of the client against older versions of the broker Key: KAFKA-4508 URL: https://issues.apache.org/jira/browse/KAFKA-4508

[jira] [Created] (KAFKA-4507) The client should send older versions of requests to the broker if necessary

2016-12-07 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-4507: -- Summary: The client should send older versions of requests to the broker if necessary Key: KAFKA-4507 URL: https://issues.apache.org/jira/browse/KAFKA-4507 Projec

[jira] [Created] (KAFKA-4506) Refactor AbstractRequest to contain version information

2016-12-07 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-4506: -- Summary: Refactor AbstractRequest to contain version information Key: KAFKA-4506 URL: https://issues.apache.org/jira/browse/KAFKA-4506 Project: Kafka Iss

[jira] [Commented] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729341#comment-15729341 ] ASF GitHub Bot commented on KAFKA-4492: --- GitHub user dguy opened a pull request:

[GitHub] kafka pull request #2226: KAFKA-4492: java.lang.IllegalStateException: Attem...

2016-12-07 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2226 KAFKA-4492: java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache The NamedCache wasn't correctly dealing with its re-entrant nature. This would result in the LRU

[VOTE]: KIP-97: The client compatibility KIP

2016-12-07 Thread Colin McCabe
Hi all, I heard that the VOTE and DISCUSS threads for the KIP-97 discussion appeared to be in the same email thread for some people using gmail. So I'm reposting in hopes of getting a separate email thread this time for those viewers. :) I'd like to start voting on KIP-97 (https://cwiki.apache.o

[jira] [Created] (KAFKA-4505) Cannot get topic lag since kafka upgrade from 0.8.1.0 to 0.10.1.0

2016-12-07 Thread Romaric Parmentier (JIRA)
Romaric Parmentier created KAFKA-4505: - Summary: Cannot get topic lag since kafka upgrade from 0.8.1.0 to 0.10.1.0 Key: KAFKA-4505 URL: https://issues.apache.org/jira/browse/KAFKA-4505 Project: Ka

[jira] [Commented] (KAFKA-4503) Expose the log dir for a partition as a metric

2016-12-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729154#comment-15729154 ] Ismael Juma commented on KAFKA-4503: Also see KAFKA-1614, which is a bit broader. > E

[jira] [Commented] (KAFKA-4503) Expose the log dir for a partition as a metric

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729150#comment-15729150 ] ASF GitHub Bot commented on KAFKA-4503: --- Github user ijuma closed the pull request a

[GitHub] kafka pull request #2224: KAFKA-4503: Expose the log dir for a partition as ...

2016-12-07 Thread ijuma
Github user ijuma closed the pull request at: https://github.com/apache/kafka/pull/2224 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Work started] (KAFKA-4486) Kafka Streams - exception in process still commits offsets

2016-12-07 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4486 started by Eno Thereska. --- > Kafka Streams - exception in process still commits offsets >

[jira] [Commented] (KAFKA-4486) Kafka Streams - exception in process still commits offsets

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729122#comment-15729122 ] ASF GitHub Bot commented on KAFKA-4486: --- GitHub user enothereska opened a pull reque

[jira] [Commented] (KAFKA-4486) Kafka Streams - exception in process still commits offsets

2016-12-07 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729125#comment-15729125 ] Eno Thereska commented on KAFKA-4486: - [~joel.lundell] thanks for the JIRA. I've opene

[GitHub] kafka pull request #2225: KAFKA-4486: Don't commit offsets on exception

2016-12-07 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2225 KAFKA-4486: Don't commit offsets on exception You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-4486-exception-commit

[jira] [Assigned] (KAFKA-4486) Kafka Streams - exception in process still commits offsets

2016-12-07 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-4486: --- Assignee: Eno Thereska > Kafka Streams - exception in process still commits offsets > ---

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

2016-12-07 Thread Damian Guy
Michael, We can only support outerJoin if both tables are keyed the same way. Lets say for example you can map both ways, however, the key for each table is of a different type. So t1 is long and t2 is string - what is the key type of the resulting GlobalKTable? So when you subsequently join to th

[jira] [Updated] (KAFKA-4504) Details of retention.bytes property at Topic level are not clear on how they impact partition size

2016-12-07 Thread Justin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justin updated KAFKA-4504: -- Description: Problem: Details of retention.bytes property at Topic level are not clear on how they impact part

[jira] [Created] (KAFKA-4504) Details of retention.bytes property at Topic level are not clear on how they impact on system

2016-12-07 Thread Justin (JIRA)
Justin created KAFKA-4504: - Summary: Details of retention.bytes property at Topic level are not clear on how they impact on system Key: KAFKA-4504 URL: https://issues.apache.org/jira/browse/KAFKA-4504 Project

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

2016-12-07 Thread Michael Noll
Damian, yes, that makes sense. But I am still wondering: In your example, there's no prior knowledge "can I map from t1->t2" that Streams can leverage for joining t1 and t2 other than blindly relying on the user to provide an appropriate KeyValueMapper for K1/V1 of t1 -> K2/V2 of t2. In other w

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

2016-12-07 Thread Damian Guy
Hi Michael, Sure. Say we have 2 input topics t1 & t2 below: t1{ int key; string t2_id; ... } t2 { string key; .. } If we create global tables out of these we'd get: GlobalKTable t1; GlobalKTable t2; So the join can only go in 1 direction, i.e, from t1 -> t2 as in order to perform the join

[jira] [Commented] (KAFKA-4503) Expose the log dir for a partition as a metric

2016-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728735#comment-15728735 ] ASF GitHub Bot commented on KAFKA-4503: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2224: KAFKA-4503: Expose the log dir for a partition as ...

2016-12-07 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2224 KAFKA-4503: Expose the log dir for a partition as a metric You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-4503-log-dir-for-par

[jira] [Created] (KAFKA-4503) Expose the log dir for a partition as a metric

2016-12-07 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4503: -- Summary: Expose the log dir for a partition as a metric Key: KAFKA-4503 URL: https://issues.apache.org/jira/browse/KAFKA-4503 Project: Kafka Issue Type: New Feat

[jira] [Updated] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2016-12-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3172: --- Fix Version/s: (was: 0.9.0.0) 0.10.2.0 > Consumer threads stay in 'Watiting' st

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-07 Thread Ismael Juma
Thanks for the KIP, Vahid. +1 (binding) On Mon, Dec 5, 2016 at 6:16 PM, Vahid S Hashemian wrote: > Happy Monday, > > I'd like to start voting on KIP-88 ( > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 88%3A+OffsetFetch+Protocol+Update > ). > The discussion thread can be found here: >

[jira] [Assigned] (KAFKA-4441) Kafka Monitoring is incorrect during rapid topic creation and deletion

2016-12-07 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar reassigned KAFKA-4441: Assignee: Edoardo Comar > Kafka Monitoring is incorrect during rapid topic creation and del

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

2016-12-07 Thread Michael Noll
> There is no outer-join for GlobalKTables as the tables may be keyed > differently. So you need to use the key from the left side of the join > along with the KeyValueMapper to resolve the right side of the join. This > wont work the other way around. Care to elaborate why it won't work the other

Re: [VOTE] KIP-94: Session Windows

2016-12-07 Thread Michael Noll
+1 (non-binding) On Wed, Dec 7, 2016 at 1:21 AM, Sriram Subramanian wrote: > +1 (binding) > > On Tue, Dec 6, 2016 at 3:43 PM, Ewen Cheslack-Postava > wrote: > > > +1 binding > > > > -Ewen > > > > On Tue, Dec 6, 2016 at 3:21 PM, Bill Bejeck wrote: > > > > > +1 > > > > > > On Tue, Dec 6, 2016 at

[jira] [Updated] (KAFKA-4502) Exception during startup, append offset to swap file

2016-12-07 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harald Kirsch updated KAFKA-4502: - Labels: (was: log) > Exception during startup, append offset to swap file >

[jira] [Created] (KAFKA-4502) Exception during startup, append offset to swap file

2016-12-07 Thread Harald Kirsch (JIRA)
Harald Kirsch created KAFKA-4502: Summary: Exception during startup, append offset to swap file Key: KAFKA-4502 URL: https://issues.apache.org/jira/browse/KAFKA-4502 Project: Kafka Issue Type

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-07 Thread Edoardo Comar
+1 (non-binding) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6

[jira] [Created] (KAFKA-4501) Support Java 9

2016-12-07 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4501: -- Summary: Support Java 9 Key: KAFKA-4501 URL: https://issues.apache.org/jira/browse/KAFKA-4501 Project: Kafka Issue Type: Improvement Reporter: Ismael

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

2016-12-07 Thread Damian Guy
Hi Matthias, Thanks for the feedback. There is no outer-join for GlobalKTables as the tables may be keyed differently. So you need to use the key from the left side of the join along with the KeyValueMapper to resolve the right side of the join. This wont work the other way around. On the bootst

[GitHub] kafka pull request #2219: HOTFIX: Disable this test until it's fixed (0.10.1...

2016-12-07 Thread enothereska
Github user enothereska closed the pull request at: https://github.com/apache/kafka/pull/2219 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is