Build failed in Jenkins: kafka-trunk-jdk8 #759

2016-07-19 Thread Apache Jenkins Server
See Changes: [cshapi] MINOR: Remove unused parameter in -- [...truncated 4653 lines...] kafka.server.LogRecoveryTest > testHWCheckpointWithFailuresSingleLogSegment PASSED kafka.server.Abstract

[jira] [Created] (KAFKA-3977) KafkaConsumer swallows exceptions raised from message deserializers

2016-07-19 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3977: -- Summary: KafkaConsumer swallows exceptions raised from message deserializers Key: KAFKA-3977 URL: https://issues.apache.org/jira/browse/KAFKA-3977 Project: Kafka

[GitHub] kafka pull request #1635: MINOR: Remove unused parameter in `checkIfPartitio...

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1635 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3375) Suppress and fix compiler warnings where reasonable and tweak compiler settings

2016-07-19 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385167#comment-15385167 ] Sriharsha Chintalapani commented on KAFKA-3375: --- [~ijuma] let me try that. T

[jira] [Comment Edited] (KAFKA-3375) Suppress and fix compiler warnings where reasonable and tweak compiler settings

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385166#comment-15385166 ] Ismael Juma edited comment on KAFKA-3375 at 7/20/16 1:35 AM: -

[jira] [Comment Edited] (KAFKA-3375) Suppress and fix compiler warnings where reasonable and tweak compiler settings

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385166#comment-15385166 ] Ismael Juma edited comment on KAFKA-3375 at 7/20/16 1:35 AM: -

[jira] [Commented] (KAFKA-3375) Suppress and fix compiler warnings where reasonable and tweak compiler settings

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385166#comment-15385166 ] Ismael Juma commented on KAFKA-3375: Can you please try removing just the following li

[jira] [Commented] (KAFKA-3375) Suppress and fix compiler warnings where reasonable and tweak compiler settings

2016-07-19 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385156#comment-15385156 ] Sriharsha Chintalapani commented on KAFKA-3375: --- Hi [~ijuma] as part of this

[DISCUSS] KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-07-19 Thread Vahid S Hashemian
Hi all, We have started a new KIP under https://cwiki.apache.org/confluence/display/KAFKA/KIP-70%3A+Revise+Partition+Assignment+Semantics+on+New+Consumer%27s+Subscription+Change Your feedback is much appreciated. Regards, Vahid Hashemian

Re: [DISCUSS] KIP-62: Allow consumer to send heartbeats from a background thread

2016-07-19 Thread Jason Gustafson
Hi Simon, Yeah, that makes sense. The current workaround for this kind of use case is to use the pause/resume APIs in order to suspend fetching. This basically lets you use poll() as a heartbeat() API, but you need a separate thread for the poll loop that and you still have to be able to flush any

[jira] [Commented] (KAFKA-3812) State store locking is incorrect

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385081#comment-15385081 ] ASF GitHub Bot commented on KAFKA-3812: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1641: HOTFIX: fix compilation error due to merge of KAFK...

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1641 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1641: HOTFIX: fix compilation error due to merge of KAFK...

2016-07-19 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1641 HOTFIX: fix compilation error due to merge of KAFKA-3812 Merge of KAFKA-3812 caused a compilation error in StreamThreadStateStoreProviderTest You can merge this pull request into a Git repository by

[jira] [Commented] (KAFKA-3812) State store locking is incorrect

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385079#comment-15385079 ] ASF GitHub Bot commented on KAFKA-3812: --- GitHub user dguy opened a pull request:

[jira] [Commented] (KAFKA-3740) Enable configuration of RocksDBStores

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385061#comment-15385061 ] ASF GitHub Bot commented on KAFKA-3740: --- GitHub user dguy opened a pull request:

[jira] [Updated] (KAFKA-3740) Enable configuration of RocksDBStores

2016-07-19 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-3740: -- Summary: Enable configuration of RocksDBStores (was: Add configs for RocksDBStores) > Enable configura

[GitHub] kafka pull request #1640: KAFKA-3740: Enable configuration of RocksDBStores

2016-07-19 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1640 KAFKA-3740: Enable configuration of RocksDBStores Add new config StreamsConfig.ROCKSDB_CONFIG_SETTER_CLASS_CONFIG to enable advanced RocksDB users to override default RocksDB configuration You can

[jira] [Commented] (KAFKA-3812) State store locking is incorrect

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385028#comment-15385028 ] ASF GitHub Bot commented on KAFKA-3812: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1628: KAFKA-3812 State store locking is incorrect

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1628 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-3812) State store locking is incorrect

2016-07-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3812. -- Resolution: Fixed Issue resolved by pull request 1628 [https://github.com/apache/kafka/pull/1628

[GitHub] kafka pull request #1639: MINOR: Remove slf4j-log4j from kafka-streams compi...

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1639: MINOR: Remove slf4j-log4j from kafka-streams compi...

2016-07-19 Thread mfenniak
GitHub user mfenniak opened a pull request: https://github.com/apache/kafka/pull/1639 MINOR: Remove slf4j-log4j from kafka-streams compile dependencies As kafka-streams is intended to be used by applications that may or may not wish to use log4j, kafka-streams itself should not have

[jira] [Assigned] (KAFKA-3740) Add configs for RocksDBStores

2016-07-19 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-3740: - Assignee: Damian Guy (was: Henry Cai) > Add configs for RocksDBStores >

[jira] [Commented] (KAFKA-3912) Query local state stores

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384850#comment-15384850 ] ASF GitHub Bot commented on KAFKA-3912: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3912) Query local state stores

2016-07-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3912. -- Resolution: Fixed Issue resolved by pull request 1565 [https://github.com/apache/kafka/pull/1565

[GitHub] kafka pull request #1565: KAFKA-3912: Query local state stores

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1565 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Jenkins build is back to normal : kafka-trunk-jdk8 #757

2016-07-19 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3911) Enforce KTable materialization

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384726#comment-15384726 ] ASF GitHub Bot commented on KAFKA-3911: --- GitHub user enothereska opened a pull reque

[GitHub] kafka pull request #1638: KAFKA-3911: Initial source materialization (WiP)

2016-07-19 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1638 KAFKA-3911: Initial source materialization (WiP) You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-3911-ktable-materi

[jira] [Commented] (KAFKA-3940) Log should check the return value of dir.mkdirs()

2016-07-19 Thread Ishita Mandhan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384663#comment-15384663 ] Ishita Mandhan commented on KAFKA-3940: --- I think we should convert the dir.mkdirs()

[jira] [Commented] (KAFKA-3922) Add a copy-constructor to AbstractStream

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384592#comment-15384592 ] ASF GitHub Bot commented on KAFKA-3922: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3922) Add a copy-constructor to AbstractStream

2016-07-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3922. -- Resolution: Fixed Fix Version/s: 0.10.0.1 0.10.1.0 Issue resolved by p

[GitHub] kafka pull request #1581: KAFKA-3922: add constructor to AbstractStream clas...

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1581 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1637: KAFKA-2311: Consumer's ensureNotClosed method not ...

2016-07-19 Thread tbrooks8
GitHub user tbrooks8 opened a pull request: https://github.com/apache/kafka/pull/1637 KAFKA-2311: Consumer's ensureNotClosed method not thread safe Here is the patch on github @ijuma. Acquiring the consumer lock (the single thread access controls) requires that the consumer

[jira] [Commented] (KAFKA-2311) Consumer's ensureNotClosed method not thread safe

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384528#comment-15384528 ] ASF GitHub Bot commented on KAFKA-2311: --- GitHub user tbrooks8 opened a pull request:

[jira] [Commented] (KAFKA-2311) Consumer's ensureNotClosed method not thread safe

2016-07-19 Thread Tim Brooks (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384483#comment-15384483 ] Tim Brooks commented on KAFKA-2311: --- Yes. Sorry, I had not been checking in with develop

[jira] [Updated] (KAFKA-3970) Message Listener(that can hit callback registered)

2016-07-19 Thread rajan verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajan verma updated KAFKA-3970: --- Labels: features (was: ) > Message Listener(that can hit callback registered) > -

[jira] [Created] (KAFKA-3976) Kafka Controller gets stuck, potentially due to zookeeper session id reuse

2016-07-19 Thread Tom Crayford (JIRA)
Tom Crayford created KAFKA-3976: --- Summary: Kafka Controller gets stuck, potentially due to zookeeper session id reuse Key: KAFKA-3976 URL: https://issues.apache.org/jira/browse/KAFKA-3976 Project: Kafka

[jira] [Resolved] (KAFKA-3855) Guard race conditions in TopologyBuilder

2016-07-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3855. -- Resolution: Fixed Fix Version/s: 0.10.0.1 Issue resolved by pull request 1633 [https://gi

[jira] [Commented] (KAFKA-3855) Guard race conditions in TopologyBuilder

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384388#comment-15384388 ] ASF GitHub Bot commented on KAFKA-3855: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1633: KAFKA-3855: Guard race conditions in TopologyBuild...

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1633 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Assigned] (KAFKA-3975) Error if zookeeper.set.acl is true and ZK security is not enabled

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-3975: -- Assignee: Ismael Juma > Error if zookeeper.set.acl is true and ZK security is not enabled > ---

[jira] [Created] (KAFKA-3975) Error if zookeeper.set.acl is true and ZK security is not enabled

2016-07-19 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3975: -- Summary: Error if zookeeper.set.acl is true and ZK security is not enabled Key: KAFKA-3975 URL: https://issues.apache.org/jira/browse/KAFKA-3975 Project: Kafka

[GitHub] kafka pull request #1517: [Kafka Streams] Clean-up script [WIP]

2016-07-19 Thread mjsax
Github user mjsax closed the pull request at: https://github.com/apache/kafka/pull/1517 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3915) LogCleaner IO buffers do not account for potential size difference due to message format change

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384060#comment-15384060 ] Ismael Juma commented on KAFKA-3915: [~twbecker], the issue is that consumers might no

[jira] [Updated] (KAFKA-3185) Allow users to cleanup internal data

2016-07-19 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3185: --- Status: Patch Available (was: Open) > Allow users to cleanup internal data >

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

2016-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384036#comment-15384036 ] ASF GitHub Bot commented on KAFKA-3185: --- GitHub user mjsax opened a pull request:

[GitHub] kafka pull request #1636: KAFKA-3185: Allow users to cleanup internal Kafka ...

2016-07-19 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1636 KAFKA-3185: Allow users to cleanup internal Kafka Streams data You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-3185 Alternative

[jira] [Commented] (KAFKA-3972) kafka java consumer poll returns 0 records after seekToBeginning

2016-07-19 Thread don caldwell (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384018#comment-15384018 ] don caldwell commented on KAFKA-3972: - Perfect! Thank you for the correction. I see it

[jira] [Commented] (KAFKA-3915) LogCleaner IO buffers do not account for potential size difference due to message format change

2016-07-19 Thread Tommy Becker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384017#comment-15384017 ] Tommy Becker commented on KAFKA-3915: - [~junrao] Yes I understand the max message size

Build failed in Jenkins: kafka-trunk-jdk8 #756

2016-07-19 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix typo in Operations section -- [...truncated 6608 lines...] kafka.utils.ReplicationUtilsTest > testUpdateLeaderAndIsr PASSED kafka.utils.ReplicationUtilsTest > t

Re: [DISCUSS] KIP-62: Allow consumer to send heartbeats from a background thread

2016-07-19 Thread Simon Souter
Hi Jason, Thanks for the response. The additional timeout is certainly a welcome addition. The issue with the onPartitionsRevoked() mechanism is that it is driven through a call to poll() which works well when consuming from a single thread in a loop. We consume via a event driven wrapper aroun

Jenkins build is back to normal : kafka-trunk-jdk8 #755

2016-07-19 Thread Apache Jenkins Server
See

[jira] [Comment Edited] (KAFKA-3689) Exception when attempting to decrease connection count for address with no connections

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383936#comment-15383936 ] Ismael Juma edited comment on KAFKA-3689 at 7/19/16 10:50 AM: --

[jira] [Commented] (KAFKA-3689) Exception when attempting to decrease connection count for address with no connections

2016-07-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383936#comment-15383936 ] Ismael Juma commented on KAFKA-3689: So, looking at that NPE gives a clue. It turns ou

[jira] [Commented] (KAFKA-2894) WorkerSinkTask doesn't handle rewinding offsets on rebalance

2016-07-19 Thread Lucas Ariel Martinez (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383859#comment-15383859 ] Lucas Ariel Martinez commented on KAFKA-2894: - I apologize if I am asking in t

[GitHub] kafka pull request #1630: MINOR: Fix typo in Operations section

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1630 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1607: MINOR: Doc of 'retries' config should mention abou...

2016-07-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1607 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3972) kafka java consumer poll returns 0 records after seekToBeginning

2016-07-19 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383832#comment-15383832 ] Rajini Sivaram commented on KAFKA-3972: --- The code invokes {{seekToBeginning}} of ass

[GitHub] kafka pull request #1635: MINOR: Remove unused parameter in `checkIfPartitio...

2016-07-19 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1635 MINOR: Remove unused parameter in `checkIfPartitionReassignmentSucceeded` and clean-ups You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kaf