[jira] [Updated] (KAFKA-2387) Improve KafkaConsumer API

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2387: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Improve KafkaConsumer API >

[jira] [Updated] (KAFKA-2500) Expose fetch response high watermark in ConsumerRecords

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2500: --- Fix Version/s: 0.10.2.0 > Expose fetch response high watermark in ConsumerRecords >

[jira] [Updated] (KAFKA-2500) Expose fetch response high watermark in ConsumerRecords

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2500: --- Summary: Expose fetch response high watermark in ConsumerRecords (was: Make logEndOffset

[jira] [Updated] (KAFKA-3987) Allow configuration of the hash algorithm used by the LogCleaner's offset map

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3987: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Allow configuration of the

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2273: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Add rebalance with a minimal

[GitHub] kafka pull request #1903: KAFKA-4213: First set of system tests for replicat...

2016-09-23 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/1903 KAFKA-4213: First set of system tests for replication throttling Added the first set of system tests for replication quotas. These tests validate throttling behavior during partition reassigment.

[jira] [Work started] (KAFKA-4213) Add system tests for replication throttling (KIP-73)

2016-09-23 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4213 started by Apurva Mehta. --- > Add system tests for replication throttling (KIP-73) >

Build failed in Jenkins: kafka-trunk-jdk8 #909

2016-09-23 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-3590; Handle not-enough-replicas errors when writing to offsets [ismael] KAFKA-3719; Allow underscores in hostname -- [...truncated 3550 lines...]

[jira] [Commented] (KAFKA-3829) Warn that kafka-connect group.id must not conflict with connector names

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517622#comment-15517622 ] Jason Gustafson commented on KAFKA-3829: [~liquanpei] Going to go ahead and pick this up since the

[jira] [Assigned] (KAFKA-3829) Warn that kafka-connect group.id must not conflict with connector names

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-3829: -- Assignee: Jason Gustafson (was: Liquan Pei) > Warn that kafka-connect group.id must

[jira] [Updated] (KAFKA-316) disallow recursively compressed message

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-316: -- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > disallow recursively compressed

[jira] [Updated] (KAFKA-1326) New consumer checklist

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1326: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > New consumer checklist >

[jira] [Updated] (KAFKA-2435) More optimally balanced partition assignment strategy

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2435: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > More optimally balanced

[jira] [Updated] (KAFKA-2617) Move protocol field default values to Protocol

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2617: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Move protocol field default

[jira] [Commented] (KAFKA-4213) Add system tests for replication throttling (KIP-73)

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517875#comment-15517875 ] ASF GitHub Bot commented on KAFKA-4213: --- GitHub user apurvam opened a pull request:

[GitHub] kafka pull request #1903: KAFKA-4213: First set of system tests for replicat...

2016-09-23 Thread apurvam
Github user apurvam closed the pull request at: https://github.com/apache/kafka/pull/1903 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-4214) kafka-reassign-partitions fails all the time when brokers are bounced during reassignment

2016-09-23 Thread Apurva Mehta (JIRA)
Apurva Mehta created KAFKA-4214: --- Summary: kafka-reassign-partitions fails all the time when brokers are bounced during reassignment Key: KAFKA-4214 URL: https://issues.apache.org/jira/browse/KAFKA-4214

Build failed in Jenkins: kafka-trunk-jdk7 #1565

2016-09-23 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-3590; Handle not-enough-replicas errors when writing to offsets -- [...truncated 11978 lines...] ^

[jira] [Commented] (KAFKA-4207) Partitions stopped after a rapid restart of a broker

2016-09-23 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517727#comment-15517727 ] Dustin Cote commented on KAFKA-4207: Agreed, marking this one as a duplicate > Partitions stopped

[jira] [Updated] (KAFKA-3177) Kafka consumer can hang when position() is called on a non-existing partition.

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3177: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Kafka consumer can hang when

[jira] [Resolved] (KAFKA-4207) Partitions stopped after a rapid restart of a broker

2016-09-23 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote resolved KAFKA-4207. Resolution: Duplicate > Partitions stopped after a rapid restart of a broker >

[jira] [Commented] (KAFKA-3177) Kafka consumer can hang when position() is called on a non-existing partition.

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517724#comment-15517724 ] Jason Gustafson commented on KAFKA-3177: Kicking this to 0.10.2. Improving the logging alone

[jira] [Updated] (KAFKA-4064) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4064: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Add support for infinite

[jira] [Commented] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517803#comment-15517803 ] Guozhang Wang commented on KAFKA-4058: -- [~mjsax] Could you take a look at this issue again before the

[jira] [Assigned] (KAFKA-4211) Change system tests to use the new consumer by default

2016-09-23 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian reassigned KAFKA-4211: -- Assignee: Vahid Hashemian > Change system tests to use the new consumer by default >

[GitHub] kafka pull request #1856: KAFKA-3719: Allow underscores in hostname

2016-09-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1856 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3719) Pattern regex org.apache.kafka.common.utils.Utils.HOST_PORT_PATTERN is too narrow

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517614#comment-15517614 ] ASF GitHub Bot commented on KAFKA-3719: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-3719) Pattern regex org.apache.kafka.common.utils.Utils.HOST_PORT_PATTERN is too narrow

2016-09-23 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3719. Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1856

[jira] [Updated] (KAFKA-3359) Parallel log-recovery of un-flushed segments on startup

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3359: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Parallel log-recovery of

Re: [DISCUSS] KIP-72 Allow Sizing Incoming Request Queue in Bytes

2016-09-23 Thread Jun Rao
Hi, Radai, Thanks for the updated KIP. A few more questions/comments below. 10. For "the mute/unmute happens just before poll(), which means as a worst case there will be no reads for 300ms if memory was unavailable", I am thinking that memory-pool could track if there is any pending request and

[jira] [Updated] (KAFKA-3545) Generalized Serdes for List/Map

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3545: - Fix Version/s: (was: 0.10.1.0) > Generalized Serdes for List/Map >

[jira] [Updated] (KAFKA-1300) Added WaitForReplaction admin tool.

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1300: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Added WaitForReplaction

[jira] [Updated] (KAFKA-3715) Higher granularity streams metrics

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3715: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Higher granularity streams

[jira] [Commented] (KAFKA-2500) Make logEndOffset available in the 0.8.3 Consumer

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517826#comment-15517826 ] Jason Gustafson commented on KAFKA-2500: Renaming this ticket to avoid confusion with KIP-79 which

[jira] [Updated] (KAFKA-2955) Add Prompt to kafka-console-producer

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2955: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Add Prompt to

[jira] [Updated] (KAFKA-3462) Allow SinkTasks to disable consumer offset commit

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3462: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Allow SinkTasks to disable

[jira] [Commented] (KAFKA-4213) Add system tests for replication throttling (KIP-73)

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517878#comment-15517878 ] ASF GitHub Bot commented on KAFKA-4213: --- Github user apurvam closed the pull request at:

Build failed in Jenkins: kafka-trunk-jdk7 #1566

2016-09-23 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3719; Allow underscores in hostname -- [...truncated 1004 lines...] kafka.utils.ZkUtilsTest > testClusterIdentifierJsonParsing STARTED kafka.utils.ZkUtilsTest >

[jira] [Commented] (KAFKA-4207) Partitions stopped after a rapid restart of a broker

2016-09-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517526#comment-15517526 ] Jun Rao commented on KAFKA-4207: This seems to be the same issue as reported in

[jira] [Updated] (KAFKA-4001) Improve Kafka Streams Join Semantics (KIP-77)

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4001: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Improve Kafka Streams Join

[jira] [Updated] (KAFKA-3452) Support session windows besides time interval windows

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3452: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Support session windows besides

[jira] [Updated] (KAFKA-3973) Investigate feasibility of caching bytes vs. records

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3973: - Resolution: Fixed Status: Resolved (was: Patch Available) > Investigate feasibility of

[jira] [Updated] (KAFKA-3600) Enhance java clients to use ApiVersion Req/Resp to check if the broker they are talking to supports required api versions

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3600: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Enhance java clients to use

[jira] [Updated] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3514: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Stream timestamp computation

[jira] [Updated] (KAFKA-3705) Support non-key joining in KTable

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3705: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Support non-key joining in

[jira] [Updated] (KAFKA-3429) Remove Serdes needed for repartitioning in KTable stateful operations

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3429: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Remove Serdes needed for

[jira] [Updated] (KAFKA-3262) Make KafkaStreams debugging friendly

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3262: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Make KafkaStreams debugging

[jira] [Updated] (KAFKA-3903) Convert tests to use static helper methods for Consumer/Producer/StreamsConfigs setup

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3903: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Convert tests to use static

[jira] [Created] (KAFKA-4215) Consumers miss messages during partition reassignment

2016-09-23 Thread Apurva Mehta (JIRA)
Apurva Mehta created KAFKA-4215: --- Summary: Consumers miss messages during partition reassignment Key: KAFKA-4215 URL: https://issues.apache.org/jira/browse/KAFKA-4215 Project: Kafka Issue

[jira] [Updated] (KAFKA-4214) kafka-reassign-partitions fails all the time when brokers are bounced during reassignment

2016-09-23 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-4214: Description: Due to KAFKA-4204, we never realized that the existing system test for testing

[jira] [Updated] (KAFKA-3304) KIP-35 - Retrieving protocol version

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3304: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > KIP-35 - Retrieving protocol

[jira] [Closed] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson closed KAFKA-3283. -- > Remove beta from new consumer documentation > --- > >

[jira] [Updated] (KAFKA-3281) Improve message of stop scripts when no processes are running

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3281: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Improve message of stop

[jira] [Updated] (KAFKA-1894) Avoid long or infinite blocking in the consumer

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1894: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Avoid long or infinite

[jira] [Updated] (KAFKA-1044) change log4j to slf4j

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1044: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > change log4j to slf4j >

[jira] [Commented] (KAFKA-4213) Add system tests for replication throttling (KIP-73)

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517913#comment-15517913 ] ASF GitHub Bot commented on KAFKA-4213: --- GitHub user apurvam opened a pull request:

[GitHub] kafka pull request #1904: KAFKA-4213: First set of system tests for replicat...

2016-09-23 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/1904 KAFKA-4213: First set of system tests for replication throttling, KIP-73. This patch also fixes the following: 1. KafkaService.verify_reassign_partitions did not check whether

[jira] [Created] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-23 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4212: - Summary: Add a key-value store that is a TTL persistent cache Key: KAFKA-4212 URL: https://issues.apache.org/jira/browse/KAFKA-4212 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-1056) Evenly Distribute Intervals in OffsetIndex

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1056: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Evenly Distribute Intervals

[jira] [Updated] (KAFKA-3625) Move kafka-streams test fixtures into a published package

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3625: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Move kafka-streams test

[jira] [Updated] (KAFKA-1722) static analysis code coverage for pci audit needs

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1722: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > static analysis code

[jira] [Updated] (KAFKA-3835) Streams is creating two ProducerRecords for each send via RecordCollector

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3835: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Streams is creating two

[jira] [Updated] (KAFKA-3534) Deserialize on demand when default time extractor used

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3534: - Fix Version/s: (was: 0.10.1.0) > Deserialize on demand when default time extractor used >

[jira] [Updated] (KAFKA-3184) Add Checkpoint for In-memory State Store

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3184: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Add Checkpoint for In-memory

[jira] [Updated] (KAFKA-4168) More precise accounting of memory usage

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4168: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > More precise accounting of

[jira] [Updated] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3537: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Provide access to low-level

[jira] [Updated] (KAFKA-1449) Extend wire protocol to allow CRC32C

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1449: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Extend wire protocol to

[jira] [Updated] (KAFKA-2145) An option to add topic owners.

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2145: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > An option to add topic

[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1207: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Launch Kafka from within

[jira] [Created] (KAFKA-4213) Add system tests for replication throttling (KIP-73)

2016-09-23 Thread Apurva Mehta (JIRA)
Apurva Mehta created KAFKA-4213: --- Summary: Add system tests for replication throttling (KIP-73) Key: KAFKA-4213 URL: https://issues.apache.org/jira/browse/KAFKA-4213 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-1313) Support adding replicas to existing topic partitions

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1313: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Support adding replicas to

[jira] [Updated] (KAFKA-3455) Connect custom processors with the streams DSL

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3455: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Connect custom processors

[jira] [Updated] (KAFKA-3186) KIP-50: Move Authorizer and related classes to separate package.

2016-09-23 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3186: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > KIP-50: Move Authorizer and

[jira] [Updated] (KAFKA-3559) Task creation time taking too long in rebalance callback

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3559: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Task creation time taking too

[jira] [Updated] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3779: - Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Add the LRU cache for

Re: Does Kafka 0.9 can guarantee not loss data

2016-09-23 Thread Kafka
Oh please ignore my last reply. I find if leaderReplica.highWatermark.messageOffset >= requiredOffset , this can ensure all replicas’ leo in curInSyncReplicas is >= the requiredOffset. > 在 2016年9月23日,下午3:39,Kafka 写道: > > OK, the example before is not enough to exposure

[GitHub] kafka pull request #1901: MINOR: Fix Javadoc for KafkaConsumer.poll

2016-09-23 Thread reftel
GitHub user reftel opened a pull request: https://github.com/apache/kafka/pull/1901 MINOR: Fix Javadoc for KafkaConsumer.poll You can merge this pull request into a Git repository by running: $ git pull https://github.com/reftel/kafka feature/poll_javadoc Alternatively you

[jira] [Commented] (KAFKA-2170) 10 LogTest cases failed for file.renameTo failed under windows

2016-09-23 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515615#comment-15515615 ] Harald Kirsch commented on KAFKA-2170: -- [~soumyajitsahu] This is great news. I assume the pull

Re: Does Kafka 0.9 can guarantee not loss data

2016-09-23 Thread Kafka
OK, the example before is not enough to exposure problem. What will happen to the situation under the numAcks is 1,and curInSyncReplica.size >= minIsr,but in fact the replica in curInSyncReplica only have one replica has caught up to leader, and this replica is the leader replica itself,this is

[jira] [Updated] (KAFKA-4209) Reduce time taken to run quota integration tests

2016-09-23 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-4209: -- Status: Patch Available (was: Open) > Reduce time taken to run quota integration tests >

[jira] [Commented] (KAFKA-4209) Reduce time taken to run quota integration tests

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516137#comment-15516137 ] ASF GitHub Bot commented on KAFKA-4209: --- GitHub user rajinisivaram opened a pull request:

[jira] [Commented] (KAFKA-2170) 10 LogTest cases failed for file.renameTo failed under windows

2016-09-23 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515792#comment-15515792 ] Harald Kirsch commented on KAFKA-2170: -- Better, but not yet there, it seems. Here is what I did. I

[jira] [Created] (KAFKA-4209) Reduce time taken to run quota integration tests

2016-09-23 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-4209: - Summary: Reduce time taken to run quota integration tests Key: KAFKA-4209 URL: https://issues.apache.org/jira/browse/KAFKA-4209 Project: Kafka Issue Type:

[jira] [Comment Edited] (KAFKA-2170) 10 LogTest cases failed for file.renameTo failed under windows

2016-09-23 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515792#comment-15515792 ] Harald Kirsch edited comment on KAFKA-2170 at 9/23/16 8:37 AM: --- Better, but

[GitHub] kafka pull request #1902: KAFKA-4209: Reduce run time for quota integration ...

2016-09-23 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/1902 KAFKA-4209: Reduce run time for quota integration tests Run quota tests which expect throttling only until the first produce/consume request is throttled. You can merge this pull request

[jira] [Commented] (KAFKA-2392) Kafka Server does not accept 0 as a port

2016-09-23 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516397#comment-15516397 ] Stig Rohde Døssing commented on KAFKA-2392: --- I don't know if this helps you, but this can

[jira] [Commented] (KAFKA-3396) Unauthorized topics are returned to the user

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516761#comment-15516761 ] ASF GitHub Bot commented on KAFKA-3396: --- Github user edoardocomar closed the pull request at:

[GitHub] kafka pull request #1428: KAFKA-3396 : Unauthorized topics are returned to t...

2016-09-23 Thread edoardocomar
Github user edoardocomar closed the pull request at: https://github.com/apache/kafka/pull/1428 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Created] (KAFKA-4210) Improve Replication Follower Throttling Stability By Checking Quota During Backoff

2016-09-23 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4210: --- Summary: Improve Replication Follower Throttling Stability By Checking Quota During Backoff Key: KAFKA-4210 URL: https://issues.apache.org/jira/browse/KAFKA-4210

[jira] [Updated] (KAFKA-4201) Add an --assignment-strategy option to new-consumer-based Mirror Maker

2016-09-23 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4201: --- Summary: Add an --assignment-strategy option to new-consumer-based Mirror Maker (was: Add an

[jira] [Resolved] (KAFKA-3906) Connect logical types do not support nulls.

2016-09-23 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-3906. Resolution: Fixed I think we should handle null values at the converter layer to avoid

[jira] [Commented] (KAFKA-4211) Change system tests to use the new consumer by default

2016-09-23 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517177#comment-15517177 ] Vahid Hashemian commented on KAFKA-4211: [~ijuma] So the default consumer in all those tests needs

[jira] [Created] (KAFKA-4211) Change system tests to use the new consumer by default

2016-09-23 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4211: -- Summary: Change system tests to use the new consumer by default Key: KAFKA-4211 URL: https://issues.apache.org/jira/browse/KAFKA-4211 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-4211) Change system tests to use the new consumer by default

2016-09-23 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517183#comment-15517183 ] Ismael Juma commented on KAFKA-4211: [~vahid], I haven't looked in detail, so I am not sure to be

[jira] [Commented] (KAFKA-4204) KafkaService.verify_reassign_partitions is a no-op

2016-09-23 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517207#comment-15517207 ] Apurva Mehta commented on KAFKA-4204: - Another issue with `KafkaService.verify_reassign_partitions`:

[jira] [Comment Edited] (KAFKA-4204) KafkaService.verify_reassign_partitions is a no-op

2016-09-23 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517207#comment-15517207 ] Apurva Mehta edited comment on KAFKA-4204 at 9/23/16 6:36 PM: -- Another issue

[jira] [Commented] (KAFKA-4201) Add an --assignment-strategy option to Mirror Maker

2016-09-23 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517269#comment-15517269 ] Vahid Hashemian commented on KAFKA-4201: [~hachikuji] It seems to me that the default assignment

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-09-23 Thread Gwen Shapira
Is it updated? are all concerns addressed? do you want to start a vote? Sorry for being pushy, I do appreciate that we are all volunteers and finding time is difficult. This feature is important for anything that integrates with Kafka (stream processors, Flume, NiFi, etc) and I don't want to see

[jira] [Commented] (KAFKA-3590) KafkaConsumer fails with "Messages are rejected since there are fewer in-sync replicas than required." when polling

2016-09-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517451#comment-15517451 ] ASF GitHub Bot commented on KAFKA-3590: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1859: KAFKA-3590: Handle not-enough-replicas errors when...

2016-09-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1859 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   >