[jira] [Commented] (KAFKA-1293) Mirror maker housecleaning

2015-04-04 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395991#comment-14395991 ] Jay Kreps commented on KAFKA-1293: -- [~mwarhaftig] Did we get you wiki access? Mirror

[jira] [Resolved] (KAFKA-1996) Scaladoc error: unknown tag parameter

2015-04-04 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1996. -- Resolution: Fixed Reviewer: Jay Kreps Scaladoc error: unknown tag parameter

[jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

2015-03-31 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388879#comment-14388879 ] Jay Kreps commented on KAFKA-2076: -- This makes sense, and would be useful. The question

[jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

2015-03-31 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389020#comment-14389020 ] Jay Kreps commented on KAFKA-2076: -- Hey [~granthenke] I don't really get the relationship

[jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

2015-03-31 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389700#comment-14389700 ] Jay Kreps commented on KAFKA-2076: -- I guess the question we need to answer is whether we

[jira] [Commented] (KAFKA-2035) Add a topic config cache.

2015-03-31 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389468#comment-14389468 ] Jay Kreps commented on KAFKA-2035: -- Currently this is the log itself--Log.config always

[jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

2015-03-31 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389483#comment-14389483 ] Jay Kreps commented on KAFKA-2076: -- Actually rather than trying to ensure we have

[jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

2015-03-31 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389553#comment-14389553 ] Jay Kreps commented on KAFKA-2076: -- In terms of mechanics we did a discussion on the

[jira] [Commented] (KAFKA-2046) Delete topic still doesn't work

2015-03-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386942#comment-14386942 ] Jay Kreps commented on KAFKA-2046: -- Hmm, so we have a configuration which, if you set it

[jira] [Commented] (KAFKA-2045) Memory Management on the consumer

2015-03-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385387#comment-14385387 ] Jay Kreps commented on KAFKA-2045: -- Okay so since most the discussion here is on

[jira] [Commented] (KAFKA-2045) Memory Management on the consumer

2015-03-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385375#comment-14385375 ] Jay Kreps commented on KAFKA-2045: -- The challenge with a rewrite is that it will be hard

[jira] [Resolved] (KAFKA-936) Kafka Metrics Memory Leak

2015-03-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-936. - Resolution: Fixed Kafka Metrics Memory Leak -- Key: KAFKA-936

[jira] [Created] (KAFKA-2063) Bound fetch response size

2015-03-28 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-2063: Summary: Bound fetch response size Key: KAFKA-2063 URL: https://issues.apache.org/jira/browse/KAFKA-2063 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-2045) Memory Management on the consumer

2015-03-27 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384100#comment-14384100 ] Jay Kreps commented on KAFKA-2045: -- [~rzidane] I do think a prototype would help show

[jira] [Commented] (KAFKA-2045) Memory Management on the consumer

2015-03-27 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384558#comment-14384558 ] Jay Kreps commented on KAFKA-2045: -- Yeah, as you say, I think bounding memory would still

[jira] [Commented] (KAFKA-2045) Memory Management on the consumer

2015-03-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383344#comment-14383344 ] Jay Kreps commented on KAFKA-2045: -- Hey [~rzidane], one statically allocated ByteBuffer

[jira] [Commented] (KAFKA-1501) transient unit tests failures due to port already in use

2015-03-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382431#comment-14382431 ] Jay Kreps commented on KAFKA-1501: -- Fantastic! transient unit tests failures due to

[jira] [Commented] (KAFKA-527) Compression support does numerous byte copies

2015-03-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382880#comment-14382880 ] Jay Kreps commented on KAFKA-527: - Do we have any kind of before/after performance

[jira] [Commented] (KAFKA-527) Compression support does numerous byte copies

2015-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380706#comment-14380706 ] Jay Kreps commented on KAFKA-527: - Yeah it would be great to get the [~guozhang]'s patch in

[jira] [Commented] (KAFKA-2050) Avoid calling .size() on java.util.ConcurrentLinkedQueue

2015-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381337#comment-14381337 ] Jay Kreps commented on KAFKA-2050: -- Nice catch. Avoid calling .size() on

[jira] [Commented] (KAFKA-2045) Memory Management on the consumer

2015-03-24 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378476#comment-14378476 ] Jay Kreps commented on KAFKA-2045: -- There are really two issues: 1. Bounding fetch size

[jira] [Commented] (KAFKA-1912) Create a simple request re-routing facility

2015-03-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367966#comment-14367966 ] Jay Kreps commented on KAFKA-1912: -- 1. I think this can be a single thread. The number of

[jira] [Commented] (KAFKA-1912) Create a simple request re-routing facility

2015-03-17 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365766#comment-14365766 ] Jay Kreps commented on KAFKA-1912: -- I think this is easier than I thought. We have an

[jira] [Commented] (KAFKA-2020) I expect ReplicaNotAvailableException to have proper Javadocs

2015-03-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361868#comment-14361868 ] Jay Kreps commented on KAFKA-2020: -- Is this the case where we are sending back an error

[jira] [Commented] (KAFKA-2020) I expect ReplicaNotAvailableException to have proper Javadocs

2015-03-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361952#comment-14361952 ] Jay Kreps commented on KAFKA-2020: -- Yeah we need to just fix that. I actually strongly

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-03-12 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359829#comment-14359829 ] Jay Kreps commented on KAFKA-1646: -- Yeah I was proposing doing this across the board

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-03-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358063#comment-14358063 ] Jay Kreps commented on KAFKA-1546: -- Well iiuc the wonderfulness of this feature is that

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-03-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358039#comment-14358039 ] Jay Kreps commented on KAFKA-1546: -- Personally I don't think it really needs a KIP, it

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2015-03-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1646: - Reviewer: (was: Jay Kreps) Improve consumer read performance for Windows

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-03-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358125#comment-14358125 ] Jay Kreps commented on KAFKA-1646: -- Hey [~waldenchen] this patch is adding a TON of

[jira] [Commented] (KAFKA-1930) Move server over to new metrics library

2015-03-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354376#comment-14354376 ] Jay Kreps commented on KAFKA-1930: -- Hey [~gwenshap] this is wheel reinvention, no

[jira] [Updated] (KAFKA-527) Compression support does numerous byte copies

2015-03-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-527: Assignee: Yasuhiro Matsuda (was: Jay Kreps) Compression support does numerous byte copies

[jira] [Commented] (KAFKA-1313) Support adding replicas to existing topic partitions

2015-03-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352246#comment-14352246 ] Jay Kreps commented on KAFKA-1313: -- This is actually in the alter topic command today, it

[jira] [Commented] (KAFKA-527) Compression support does numerous byte copies

2015-03-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352227#comment-14352227 ] Jay Kreps commented on KAFKA-527: - The clients already use MemoryRecords, so 0.8.2 and

[jira] [Assigned] (KAFKA-527) Compression support does numerous byte copies

2015-03-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps reassigned KAFKA-527: --- Assignee: Jay Kreps (was: Yasuhiro Matsuda) Compression support does numerous byte copies

[jira] [Updated] (KAFKA-2009) Fix UncheckedOffset.removeOffset synchronization and trace logging issue in mirror maker

2015-03-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-2009: - Resolution: Fixed Reviewer: Jay Kreps Status: Resolved (was: Patch Available) Committed,

[jira] [Commented] (KAFKA-1998) Partitions Missing From MetadataResponse

2015-03-04 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347740#comment-14347740 ] Jay Kreps commented on KAFKA-1998: -- This seems like a bug, shouldn't we always return all

[jira] [Resolved] (KAFKA-789) Producer-side persistence for delivery guarantee

2015-03-03 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-789. - Resolution: Duplicate Producer-side persistence for delivery guarantee

[jira] [Commented] (KAFKA-1660) Ability to call close() with a timeout on the Java Kafka Producer.

2015-03-02 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344481#comment-14344481 ] Jay Kreps commented on KAFKA-1660: -- [~parth.brahmbhatt] Yeah this was exactly what I was

[jira] [Commented] (KAFKA-902) Randomize backoff on the clients for metadata requests

2015-03-02 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344500#comment-14344500 ] Jay Kreps commented on KAFKA-902: - This looks good to me. I'd second Grant's comments: 1. I

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Resolution: Fixed Status: Resolved (was: Patch Available) Add a flush() call to the new

[jira] [Created] (KAFKA-1990) Add unlimited time-based log retention

2015-02-28 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1990: Summary: Add unlimited time-based log retention Key: KAFKA-1990 URL: https://issues.apache.org/jira/browse/KAFKA-1990 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-1877) Expose version via JMX for 'new' producer

2015-02-28 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341744#comment-14341744 ] Jay Kreps commented on KAFKA-1877: -- The metrics are just for metrics which are by nature

[jira] [Commented] (KAFKA-330) Add delete topic support

2015-02-27 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340767#comment-14340767 ] Jay Kreps commented on KAFKA-330: - +1 on enabling by default. Add delete topic support

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Attachment: KAFKA-1865_2015-02-26_10:37:16.patch Add a flush() call to the new producer API

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338880#comment-14338880 ] Jay Kreps commented on KAFKA-1865: -- Updated reviewboard

[jira] [Commented] (KAFKA-1985) Document on possible error codes for each response type

2015-02-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337214#comment-14337214 ] Jay Kreps commented on KAFKA-1985: -- Totally agree. The documentation for this should

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337636#comment-14337636 ] Jay Kreps commented on KAFKA-1865: -- Updated reviewboard

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Attachment: KAFKA-1865_2015-02-25_17:15:26.patch Add a flush() call to the new producer API

[jira] [Commented] (KAFKA-1910) Refactor KafkaConsumer

2015-02-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337621#comment-14337621 ] Jay Kreps commented on KAFKA-1910: -- Where is the RB? Refactor KafkaConsumer

[jira] [Commented] (KAFKA-1979) LogCleaner delete file asynchronously and can cause inconsistency between log cleaner checkpoint and first dirty log segment file.

2015-02-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14333703#comment-14333703 ] Jay Kreps commented on KAFKA-1979: -- Can you expand on this a bit. The delete protocol is

[jira] [Created] (KAFKA-1981) Make log compaction point configurable

2015-02-23 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1981: Summary: Make log compaction point configurable Key: KAFKA-1981 URL: https://issues.apache.org/jira/browse/KAFKA-1981 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-1981) Make log compaction point configurable

2015-02-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1981: - Labels: newbie++ (was: ) Make log compaction point configurable --

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Attachment: KAFKA-1865_2015-02-23_18:29:16.patch Add a flush() call to the new producer API

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334281#comment-14334281 ] Jay Kreps commented on KAFKA-1865: -- Updated reviewboard

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-22 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Attachment: KAFKA-1865_2015-02-22_16:26:46.patch Add a flush() call to the new producer API

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-22 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14332450#comment-14332450 ] Jay Kreps commented on KAFKA-1865: -- Updated reviewboard

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-22 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14332452#comment-14332452 ] Jay Kreps commented on KAFKA-1865: -- Uploaded a new patch that tracks all incomplete

[jira] [Resolved] (KAFKA-1919) Metadata request issued with no backoff in new producer if there are no topics

2015-02-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1919. -- Resolution: Fixed Double committed against trunk and 0.8.2 Metadata request issued with no backoff in

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14332020#comment-14332020 ] Jay Kreps commented on KAFKA-1865: -- Actually this approach is fundamentally flawed. This

[jira] [Commented] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14331364#comment-14331364 ] Jay Kreps commented on KAFKA-1865: -- Updated reviewboard

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-02-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Attachment: KAFKA-1865_2015-02-21_15:36:54.patch Add a flush() call to the new producer API

[jira] [Commented] (KAFKA-1969) NPE in unit test for new consumer

2015-02-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14330447#comment-14330447 ] Jay Kreps commented on KAFKA-1969: -- Cool. Hey [~guozhang] let me know if I can be

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-02-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329143#comment-14329143 ] Jay Kreps commented on KAFKA-1546: -- Yes, this was exactly what I was thinking...

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-02-19 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328298#comment-14328298 ] Jay Kreps commented on KAFKA-1546: -- Yeah that is true. I think we are in agreement that

[jira] [Commented] (KAFKA-1961) Looks like its possible to delete _consumer_offsets topic

2015-02-17 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324770#comment-14324770 ] Jay Kreps commented on KAFKA-1961: -- Makes sense. [~jjkoshy] Deleting the topic would

[jira] [Commented] (KAFKA-1961) Looks like its possible to delete _consumer_offsets topic

2015-02-17 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324545#comment-14324545 ] Jay Kreps commented on KAFKA-1961: -- This would be hard to do accidentally, right, you

[jira] [Commented] (KAFKA-1961) Looks like its possible to delete _consumer_offsets topic

2015-02-17 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324924#comment-14324924 ] Jay Kreps commented on KAFKA-1961: -- Yeah I think since the cache would be totally out of

[jira] [Commented] (KAFKA-1956) new consumer client can't fetch records from kafka server

2015-02-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323107#comment-14323107 ] Jay Kreps commented on KAFKA-1956: -- Gotcha. Yes, that is just a mismatch of assumptions I

[jira] [Updated] (KAFKA-1956) New consumer client can return early from a poll() call

2015-02-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1956: - Summary: New consumer client can return early from a poll() call (was: new consumer client can't fetch

[jira] [Commented] (KAFKA-1954) Speed Up The Unit Tests

2015-02-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321668#comment-14321668 ] Jay Kreps commented on KAFKA-1954: -- Some data: Here are the slow tests:

[jira] [Created] (KAFKA-1954) Speed Up The Unit Tests

2015-02-14 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1954: Summary: Speed Up The Unit Tests Key: KAFKA-1954 URL: https://issues.apache.org/jira/browse/KAFKA-1954 Project: Kafka Issue Type: Improvement Reporter:

[jira] [Commented] (KAFKA-1955) Explore disk-based buffering in new Kafka Producer

2015-02-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321719#comment-14321719 ] Jay Kreps commented on KAFKA-1955: -- Created reviewboard

[jira] [Updated] (KAFKA-1954) Speed Up The Unit Tests

2015-02-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1954: - Labels: newbie++ (was: ) Speed Up The Unit Tests --- Key:

[jira] [Created] (KAFKA-1955) Explore disk-based buffering in new Kafka Producer

2015-02-14 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1955: Summary: Explore disk-based buffering in new Kafka Producer Key: KAFKA-1955 URL: https://issues.apache.org/jira/browse/KAFKA-1955 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-1952) High CPU Usage in 0.8.2 release

2015-02-13 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1952: Summary: High CPU Usage in 0.8.2 release Key: KAFKA-1952 URL: https://issues.apache.org/jira/browse/KAFKA-1952 Project: Kafka Issue Type: Bug Affects Versions:

[jira] [Commented] (KAFKA-1659) Ability to cleanly abort the KafkaProducer

2015-02-13 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320981#comment-14320981 ] Jay Kreps commented on KAFKA-1659: -- But there would be a race condition between the

[jira] [Commented] (KAFKA-1659) Ability to cleanly abort the KafkaProducer

2015-02-13 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321071#comment-14321071 ] Jay Kreps commented on KAFKA-1659: -- I understood the original problem we were trying to

[jira] [Commented] (KAFKA-1659) Ability to cleanly abort the KafkaProducer

2015-02-13 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321015#comment-14321015 ] Jay Kreps commented on KAFKA-1659: -- Hmm, but how useful is being able to shutdown the

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-02-13 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321134#comment-14321134 ] Jay Kreps commented on KAFKA-1926: -- Yes but the whole point of these code cleanups is to

[jira] [Resolved] (KAFKA-1938) [doc] Quick start example should reference appropriate Kafka version

2015-02-12 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1938. -- Resolution: Fixed [doc] Quick start example should reference appropriate Kafka version

[jira] [Commented] (KAFKA-1938) [doc] Quick start example should reference appropriate Kafka version

2015-02-12 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318628#comment-14318628 ] Jay Kreps commented on KAFKA-1938: -- Committed. Let me know if you see any issues. [doc]

[jira] [Commented] (KAFKA-1374) LogCleaner (compaction) does not support compressed topics

2015-02-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316526#comment-14316526 ] Jay Kreps commented on KAFKA-1374: -- Hey guys, the test kafka.tools.TestLogCleaning is a

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-02-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316747#comment-14316747 ] Jay Kreps commented on KAFKA-1646: -- Hey [~waldenchen] yeah I think what you are saying is

[jira] [Commented] (KAFKA-1374) LogCleaner (compaction) does not support compressed topics

2015-02-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316735#comment-14316735 ] Jay Kreps commented on KAFKA-1374: -- Great! LogCleaner (compaction) does not support

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-02-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316759#comment-14316759 ] Jay Kreps commented on KAFKA-1926: -- At a high level this looks good. The main thrust of

[jira] [Commented] (KAFKA-1660) Ability to call close() with a timeout on the Java Kafka Producer.

2015-02-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317335#comment-14317335 ] Jay Kreps commented on KAFKA-1660: -- Yeah I'm not proposing calling thread.stop(), we

[jira] [Created] (KAFKA-1941) Timeout connections in the clients

2015-02-10 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1941: Summary: Timeout connections in the clients Key: KAFKA-1941 URL: https://issues.apache.org/jira/browse/KAFKA-1941 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-1661) Move MockConsumer and MockProducer from src/main to src/test

2015-02-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1661. -- Resolution: Fixed Hey guys, I'd like to close this. The mock is in the public part of the main jar

[jira] [Commented] (KAFKA-1927) Replace requests in kafka.api with requests in org.apache.kafka.common.requests

2015-02-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312581#comment-14312581 ] Jay Kreps commented on KAFKA-1927: -- Hey [~tongli] Gwen is right that this will be a

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-02-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312598#comment-14312598 ] Jay Kreps commented on KAFKA-1926: -- Hey [~tongli] this is a great bug to start with.

[jira] [Resolved] (KAFKA-1934) Add a shutdownNow() call to new producer

2015-02-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1934. -- Resolution: Duplicate Add a shutdownNow() call to new producer

[jira] [Updated] (KAFKA-1934) Add a shutdownNow() call to new producer

2015-02-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1934: - Issue Type: New Feature (was: Bug) Add a shutdownNow() call to new producer

[jira] [Commented] (KAFKA-1660) Ability to call close() with a timeout on the Java Kafka Producer.

2015-02-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311699#comment-14311699 ] Jay Kreps commented on KAFKA-1660: -- This is very similar to KAFKA-1659 and KAFKA-1934.

[jira] [Commented] (KAFKA-1934) Add a shutdownNow() call to new producer

2015-02-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311684#comment-14311684 ] Jay Kreps commented on KAFKA-1934: -- This is a public interface change so we should do a

[jira] [Commented] (KAFKA-1919) Metadata request issued with no backoff in new producer if there are no topics

2015-02-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311683#comment-14311683 ] Jay Kreps commented on KAFKA-1919: -- That's reasonable. Patch here:

[jira] [Commented] (KAFKA-1933) Fine-grained locking in log append

2015-02-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311690#comment-14311690 ] Jay Kreps commented on KAFKA-1933: -- This is very interesting but also kind of scary. My

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-02-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310912#comment-14310912 ] Jay Kreps commented on KAFKA-1646: -- Hey guys if this forces full recovery the impact on

[jira] [Updated] (KAFKA-1865) Investigate adding a flush() call to new producer API

2015-02-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1865: - Assignee: Jay Kreps Status: Patch Available (was: Open) Investigate adding a flush() call to new

[jira] [Commented] (KAFKA-1865) Investigate adding a flush() call to new producer API

2015-02-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310927#comment-14310927 ] Jay Kreps commented on KAFKA-1865: -- Created reviewboard

<    1   2   3   4   5   6   7   8   9   10   >