[jira] [Updated] (KAFKA-2001) OffsetCommitTest hang during setup

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2001: - Fix Version/s: 0.8.3 OffsetCommitTest hang during setup

[jira] [Updated] (KAFKA-1986) Producer request failure rate should not include InvalidMessageSizeException and OffsetOutOfRangeException

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1986: - Fix Version/s: 0.8.3 Producer request failure rate should not include InvalidMessageSizeException

[jira] [Updated] (KAFKA-1938) [doc] Quick start example should reference appropriate Kafka version

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1938: - Fix Version/s: 0.8.3 [doc] Quick start example should reference appropriate Kafka version

[jira] [Updated] (KAFKA-1925) Coordinator Node Id set to INT_MAX breaks coordinator metadata updates

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1925: - Fix Version/s: 0.8.3 Coordinator Node Id set to INT_MAX breaks coordinator metadata updates

[jira] [Updated] (KAFKA-1943) Producer request failure rate should not include MessageSetSizeTooLarge and MessageSizeTooLargeException

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1943: - Fix Version/s: 0.8.3 Producer request failure rate should not include MessageSetSizeTooLarge

[jira] [Updated] (KAFKA-1957) code doc typo

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1957: - Fix Version/s: 0.8.3 code doc typo - Key: KAFKA-1957 URL

[jira] [Updated] (KAFKA-1948) kafka.api.consumerTests are hanging

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1948: - Fix Version/s: 0.8.3 kafka.api.consumerTests are hanging

[jira] [Updated] (KAFKA-1959) Class CommitThread overwrite group of Thread class causing compile errors

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1959: - Fix Version/s: 0.8.3 Class CommitThread overwrite group of Thread class causing compile errors

[jira] [Updated] (KAFKA-1969) NPE in unit test for new consumer

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1969: - Fix Version/s: 0.8.3 NPE in unit test for new consumer

[jira] [Updated] (KAFKA-1964) testPartitionReassignmentCallback hangs occasionally

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1964: - Fix Version/s: 0.8.3 testPartitionReassignmentCallback hangs occasionally

[jira] [Updated] (KAFKA-1960) .gitignore does not exclude test generated files and folders.

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1960: - Fix Version/s: 0.8.3 .gitignore does not exclude test generated files and folders

Re: [VOTE] KIP-15 add a close method with timeout to KafkaProducer

2015-03-11 Thread Joe Stein
(time); close() and why close has its own timeout also? Lastly, what is the forceClose flag? This isn't documented in the public interface so it isn't clear how to completely use the feature just by reading the KIP. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358058#comment-14358058 ] Joe Stein commented on KAFKA-1546: -- we could also mark the JIRA as a bug instead

[jira] [Updated] (KAFKA-2009) Fix UncheckedOffset.removeOffset synchronization and trace logging issue in mirror maker

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2009: - Fix Version/s: 0.8.3 Fix UncheckedOffset.removeOffset synchronization and trace logging issue

[jira] [Updated] (KAFKA-1914) Count TotalProduceRequestRate and TotalFetchRequestRate in BrokerTopicMetrics

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1914: - Fix Version/s: 0.8.3 Count TotalProduceRequestRate and TotalFetchRequestRate in BrokerTopicMetrics

[jira] [Updated] (KAFKA-1865) Add a flush() call to the new producer API

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1865: - Fix Version/s: 0.8.3 Add a flush() call to the new producer API

[jira] [Updated] (KAFKA-1852) OffsetCommitRequest can commit offset on unknown topic

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1852: - Fix Version/s: 0.8.3 OffsetCommitRequest can commit offset on unknown topic

[jira] [Updated] (KAFKA-1910) Refactor KafkaConsumer

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1910: - Fix Version/s: 0.8.3 Refactor KafkaConsumer -- Key: KAFKA-1910

[jira] [Updated] (KAFKA-1831) Producer does not provide any information about which host the data was sent to

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1831: - Fix Version/s: 0.8.2.0 Producer does not provide any information about which host the data was sent

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358017#comment-14358017 ] Joe Stein commented on KAFKA-1546: -- Shouldn't we have a KIP for this? It seems like we

[jira] [Commented] (KAFKA-1461) Replica fetcher thread does not implement any back-off behavior

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358018#comment-14358018 ] Joe Stein commented on KAFKA-1461: -- Shouldn't there be a KIP for this? Replica fetcher

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358054#comment-14358054 ] Joe Stein commented on KAFKA-1546: -- if folks are going to read the KIP to understand

[jira] [Commented] (KAFKA-1461) Replica fetcher thread does not implement any back-off behavior

2015-03-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358056#comment-14358056 ] Joe Stein commented on KAFKA-1461: -- I personally think it is over kill but i bring it up

[jira] [Commented] (KAFKA-1930) Move server over to new metrics library

2015-03-10 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355335#comment-14355335 ] Joe Stein commented on KAFKA-1930: -- +1 to KIP, I think one thing that is going

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-10 Thread Joe Stein
Thanks Jun for getting this release out the door and everyone that contributed to the work in 0.8.2.1, awesome! ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Mon, Mar 9, 2015 at 2:12 PM, Jun Rao j...@confluent.io wrote

Re: Can I be added as a contributor?

2015-03-09 Thread Joe Stein
Grant, I added you. Grayson and Grant, you should both also please setup Confluence accounts and we can grant perms to Confluence also too for your username. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Tue, Mar 10, 2015 at 12:54 AM

Re: [DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-03-08 Thread Joe Stein
of the change and how it fits into other efforts that could happen in the area really helps keep things focused on what you want. -Jay On Wed, Jan 21, 2015 at 10:11 PM, Joe Stein joe.st...@stealth.ly wrote: Posted a KIP for --re-balance for partition assignment in reassignment tool. https

[jira] [Updated] (KAFKA-2007) update offsetrequest for more useful information we have on broker about partition

2015-03-06 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2007: - Description: this will need a KIP via [~jkreps] in KIP-6 discussion about KAFKA-1694 The other

[jira] [Created] (KAFKA-2006) switch the broker server over to the new java protocol definitions

2015-03-06 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-2006: Summary: switch the broker server over to the new java protocol definitions Key: KAFKA-2006 URL: https://issues.apache.org/jira/browse/KAFKA-2006 Project: Kafka

[jira] [Created] (KAFKA-2007) update offsetrequest for more useful information we have on broker about partition

2015-03-06 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-2007: Summary: update offsetrequest for more useful information we have on broker about partition Key: KAFKA-2007 URL: https://issues.apache.org/jira/browse/KAFKA-2007 Project

[jira] [Commented] (KAFKA-1995) JMS to Kafka: Inbuilt JMSAdaptor/JMSProxy/JMSBridge (Client can speak JMS but hit Kafka)

2015-03-05 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348951#comment-14348951 ] Joe Stein commented on KAFKA-1995: -- This sounds like a good idea, but I think it doesn't

[jira] [Updated] (KAFKA-1845) KafkaConfig should use ConfigDef

2015-03-05 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1845: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch Andrii

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-03 Thread Joe Stein
) at kafka.api.ProducerFailureHandlingTest.testNotEnoughReplicasAfterBrokerShutdown(ProducerFailureHandlingTest.scala:355) This happens to me all the time on a few different machines. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Mon, Mar 2, 2015 at 7:36 PM, Jun Rao j...@confluent.io wrote: +1

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-03 Thread Joe Stein
Ok, lets fix the transient test failure on trunk agreed not a blocker. +1 quick start passed, verified artifacts, updates in scala https://github.com/stealthly/scala-kafka/tree/0.8.2.1 and go https://github.com/stealthly/go_kafka_client/tree/0.8.2.1 look good ~ Joe Stein

Re: [VOTE] KIP-2 - Refactor brokers to allow listening on multiple ports and IPs

2015-03-03 Thread Joe Stein
+1 ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Tue, Mar 3, 2015 at 3:14 PM, Gwen Shapira gshap...@cloudera.com wrote: Details are in the wiki: https://cwiki.apache.org/confluence/display/KAFKA/KIP-2+-+Refactor+brokers+to+allow

[jira] [Updated] (KAFKA-1882) Create extendable channel interface and default implementations

2015-03-02 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1882: - Status: Patch Available (was: Open) Create extendable channel interface and default implementations

[jira] [Updated] (KAFKA-1882) Create extendable channel interface and default implementations

2015-03-02 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1882: - Priority: Blocker (was: Major) Fix Version/s: 0.8.3 supported in this patch https

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-03-02 Thread Joe Stein
manage better? To discuss https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals in progress and related JIRA that are interdependent and common work. ~ Joe Stein On Tue, Feb 24, 2015 at 2:59 PM, Jay Kreps jay.kr...@gmail.com wrote: Let's stay on Google hangouts

[jira] [Commented] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

2015-02-25 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14336573#comment-14336573 ] Joe Stein commented on KAFKA-1792: -- [~Dmitry Pekar] we should have this discussion

Re: Announcing the Confluent Platform built on Apache Kafka

2015-02-25 Thread Joe Stein
Awesome! The future of schema management, has arrived ~ Joestein On Wed, Feb 25, 2015 at 1:34 PM, Gwen Shapira gshap...@cloudera.com wrote: Congrats, Confluent team. This is super exciting :) On Wed, Feb 25, 2015 at 10:31 AM, Neha Narkhede n...@confluent.io wrote: Folks, We,

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-02-24 Thread Joe Stein
offset), what is the compaction point, etc. I think that done right this would be the successor to the very awkward OffsetRequest we have today. -Jay On Wed, Jan 21, 2015 at 10:27 PM, Joe Stein joe.st

Re: How to get a JIRA assigned

2015-02-23 Thread Joe Stein
Jay, I thought it was the same issue like with confluence and comments and why we have to grant rights for that. Bots coming and reassigning everything to them or something in JIRA. We could ask/open a ticket with INFRA, if nothing else maybe help come up with a different way to solve it. ~

[jira] [Commented] (KAFKA-1856) Add PreCommit Patch Testing

2015-02-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14333560#comment-14333560 ] Joe Stein commented on KAFKA-1856: -- [~singhashish] I didn't want to make these changes

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 1

2015-02-22 Thread Joe Stein
Jun, Can we also add https://issues.apache.org/jira/browse/KAFKA-1724 to the next RC please? Thanks! ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Sun, Feb 22, 2015 at 11:59 AM, Jun Rao j...@confluent.io wrote: We identified

Re: [VOTE] 0.8.2.1 Candidate 1

2015-02-21 Thread Joe Stein
-1729 please. +1 (binding) ~ Joe Stein On Fri, Feb 20, 2015 at 9:08 PM, ted won realtime...@gmail.com wrote: +1 On Friday, February 20, 2015, Guozhang Wang wangg...@gmail.com wrote: +1 binding. Checked the md5, and quick start. Some minor comments: 1. The quickstart section would

Re: [VOTE] KIP-8: Add a flush() method to the new producer

2015-02-18 Thread Joe Stein
+1 binding ~ Joestein On Feb 18, 2015 6:50 PM, Jay Kreps j...@confluent.io wrote: https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Add+a+flush+method+to+the+producer+API +1 binding -Jay

Re: [DISCUSS] KIP-12 - Kafka Sasl/Kerberos implementation

2015-02-11 Thread Joe Stein
Thanks Harsha, looks good so far. How were you thinking of running the KerberosTicketManager as a standalone process or like controller or is it a layer of code that does the plumbing pieces everywhere? ~ Joestein On Wed, Feb 11, 2015 at 12:18 PM, Harsha ka...@harsha.io wrote: Hi, Here is

Re: Build failed in Jenkins: Kafka-trunk #389

2015-02-11 Thread Joe Stein
I ran into this issue locally too. I left it running overnight and it was stuck when I got back to it. This is where I had to kill the terminal at this morning. kafka.admin.TopicCommandTest testConfigPreservationAcrossPartitionAlteration PASSED kafka.api.ApiUtilsTest testShortStringASCII

Re: Review Request 29647: Patch for KAFKA-1697

2015-02-11 Thread Joe Stein
://reviews.apache.org/r/29647/#comment118051 Could we change this to a match case? requiredAcks match { case 0 = {} case 1 = {} case -1 = {} case _ = {} } make it more concise to read through and scalish - Joe Stein On Feb. 12, 2015, 2:47 a.m., Gwen Shapira wrote

Re: [DISCUSS] KIP-8 Add a flush method to the new Java producer

2015-02-10 Thread Joe Stein
Jay, The .flush() call seems like it would be the best way if you wanted to-do a clean shutdown of the new producer? So, you could in your code stop all incoming requests producer.flush() system.exit(value) and know pretty much you won't drop anything on the floor. This can be done with the

Re: [DISCUSS] KIPs

2015-02-09 Thread Joe Stein
requirement): 3 binding +1 votes and no binding vetoes. I have updated the wiki to lazy consensus - but can change it back if there is a reasonable objection. On Thu, Feb 05, 2015 at 06:17:44PM -0500, Joe Stein wrote: +1

[jira] [Commented] (KAFKA-1856) Add PreCommit Patch Testing

2015-02-09 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313509#comment-14313509 ] Joe Stein commented on KAFKA-1856: -- [~singhashish] I created a new jenkins build https

Re: [DISCUSS] KIPs

2015-02-09 Thread Joe Stein
these while they are getting built out... -Jay On Mon, Feb 9, 2015 at 6:10 PM, Joe Stein joe.st...@stealth.ly wrote: I like the round-up, looks good, thanks Joel. I should be able to get KIP-5 and KIP-6 to have more detail in the coming days. ~ Joestein On Mon, Feb 9, 2015 at 9:01

Re: org.apache.common migration

2015-02-08 Thread Joe Stein
Argh, I just realized that the producer and consumer have already almost removed that so it wouldn't be in common but just something for the broker. Maybe later this year 0.9/1.0 item to crack into. On Sun, Feb 8, 2015 at 11:34 AM, Joe Stein joe.st...@stealth.ly wrote: Jay, Can we add

[jira] [Updated] (KAFKA-1856) Add PreCommit Patch Testing

2015-02-08 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1856: - Attachment: KAFKA-1845.result.txt really cool, just tried this out {code} python dev-utils/test

Re: Review Request 29893: Patch for KAFKA-1856

2015-02-08 Thread Joe Stein
have a patch that has to go in 2 branches then we just then have 2 JIRA which is ok by me. - Joe Stein On Feb. 4, 2015, 11:44 p.m., Ashish Singh wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: org.apache.common migration

2015-02-08 Thread Joe Stein
Jay, Can we add another package (or two) to org.apache.kafka.common for metadata and consensus. We can call them something else but the idea would be to have 1 common layer for meta data information (right now we put the json into zookeeper) and 1 common layer for asynchronous watches (which we

[jira] [Commented] (KAFKA-1898) compatibility testing framework

2015-02-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311098#comment-14311098 ] Joe Stein commented on KAFKA-1898: -- Updated the description. The part that the client

[jira] [Updated] (KAFKA-1898) compatibility testing framework

2015-02-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1898: - Description: There are a few different scenarios where you want/need to know the status/state

[jira] [Updated] (KAFKA-1898) compatibility testing framework

2015-02-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1898: - Attachment: cctk.png compatibility testing framework

Re: [DISCUSS] ConfigDec Broker Changes on Trunk

2015-02-06 Thread Joe Stein
at 9:34 AM, Joe Stein joe.st...@stealth.ly wrote: I updated the RB changing some of the HIGH to MEDIUM and LOW. There might be other or different opinions and they may change over time so I don't really see h/m/l as a blocker to the patch going in. It would be great to take all the rb

Re: [DISCUSS] KIPs

2015-02-06 Thread Joe Stein
of things getting lost in the shuffle and missing changes, which does, will and always happen. We also need to discuss 0.8.3.0, 0.9.0.0 and such https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan it should all be KIP we think should be in where, right? - Joe Stein On Fri, Feb 6, 2015

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-02-06 Thread Joe Stein
on Guozhang's hot spot point. 3) anymore feedback? - Joe Stein On Fri, Jan 23, 2015 at 3:15 PM, Guozhang Wang wangg...@gmail.com wrote: A centralized admin operation protocol would be very useful. One more general comment here is that controller is originally designed to only talk to other

Fwd: [jira] [Created] (AURORA-985) Move Aurora website source to subdirectory of git repo

2015-02-06 Thread Joe Stein
this looks like it might help us too with getting the release documentation content/changes along with code test contributions in patches without the extra step with the site in the commits with svn -- Forwarded message -- From: Dave Lester (JIRA) j...@apache.org Date: Tue, Dec

Re: [DISCUSS] KIPs

2015-02-05 Thread Joe Stein
...@cloudera.com wrote: +1 Will be happy to provide a KIP for the multiple-listeners patch. Gwen On Sat, Jan 17, 2015 at 8:10 AM, Joe Stein joe.st...@stealth.ly wrote: +1 to everything we have been saying and where this (has settled

Re: Cannot stop Kafka server if zookeeper is shutdown first

2015-02-04 Thread Joe Stein
it works for different groups of folks. I think whoever might be interested in working on that should chime in, write up the KIP and lets start getting that discussion / release planning / work moving ahead. - Joe Stein On Wed, Feb 4, 2015 at 11:27 AM, Dana Powers dana.pow...@rd.io wrote: While

[jira] [Updated] (KAFKA-1904) run sanity failed test

2015-02-03 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1904: - Priority: Blocker (was: Major) run sanity failed test -- Key

Re: Review Request 30126: Patch for KAFKA-1845

2015-02-03 Thread Joe Stein
https://reviews.apache.org/r/30126/#comment116153 MEDIUM - Joe Stein On Jan. 21, 2015, 5:49 p.m., Andrii Biletskyi wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30126

Re: [DISCUSS] ConfigDec Broker Changes on Trunk

2015-02-03 Thread Joe Stein
changes for a new patch. Then over the next day or two review, test and commit to trunk (or re-work if necessary). /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http

[jira] [Commented] (KAFKA-1912) Create a simple request re-routing facility

2015-02-02 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301956#comment-14301956 ] Joe Stein commented on KAFKA-1912: -- I think this makes sense. Do you want to fold re

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 3

2015-02-02 Thread Joe Stein
Huzzah! Thanks Jun for preparing the release candidates and getting this out to the community. - Joe Stein On Mon, Feb 2, 2015 at 2:27 PM, Jun Rao j...@confluent.io wrote: The following are the results of the votes. +1 binding = 3 votes +1 non-binding = 1 votes -1 = 0 votes 0 = 0 votes

[DISCUSS] ConfigDec Broker Changes on Trunk

2015-02-02 Thread Joe Stein
in 0.8.3 and think we should make sure it is what we want if so then: review, commit and keep going. Thoughts? /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http

[jira] [Created] (KAFKA-1904) run sanity failured test

2015-01-28 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1904: Summary: run sanity failured test Key: KAFKA-1904 URL: https://issues.apache.org/jira/browse/KAFKA-1904 Project: Kafka Issue Type: Bug Reporter: Joe

[jira] [Updated] (KAFKA-1904) run sanity failed test

2015-01-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1904: - Summary: run sanity failed test (was: run sanity failured test) run sanity failed test

[jira] [Updated] (KAFKA-1904) run sanity failed test

2015-01-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1904: - Attachment: run_sanity.log.gz attached run on trunk, 1 failure lots of skips run sanity failed test

[jira] [Commented] (KAFKA-1904) run sanity failed test

2015-01-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296179#comment-14296179 ] Joe Stein commented on KAFKA-1904: -- 0.8.2 works = Total failures count : 0 run sanity

[jira] [Updated] (KAFKA-1904) run sanity failed test

2015-01-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1904: - Fix Version/s: (was: 0.8.2) 0.8.3 run sanity failed test

[jira] [Commented] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-01-28 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295614#comment-14295614 ] Joe Stein commented on KAFKA-1901: -- The same way you are suggesting for the brokers

[jira] [Commented] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-01-27 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294838#comment-14294838 ] Joe Stein commented on KAFKA-1901: -- Can we collect that info during a meta data fetch

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-26 Thread Joe Stein
build, topic deletion, compaction and random testing On Mon, Jan 26, 2015 at 6:14 AM, Neha Narkhede n...@confluent.io wrote: +1 (binding) Verified keys, quick start, unit tests. On Sat, Jan 24, 2015 at 4:26 PM, Joe Stein joe.st...@stealth.ly wrote: That makes sense, thanks! On Sat

[jira] [Commented] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

2015-01-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292368#comment-14292368 ] Joe Stein commented on KAFKA-1792: -- [~Dmitry Pekar] can you writeup a design for what you

Re: What to do when file.rename fails?

2015-01-25 Thread Joe Stein
This feels like another type of symptom from people using /tmp/ for their logs. Perosnally, I would rather use /mnt/data or something and if that doesn't exist on their machine we can exception, or no default and force set it. /*** Joe Stein Founder

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-24 Thread Joe Stein
ask that question right? -Jay On Fri, Jan 23, 2015 at 9:06 PM, Joe Stein joe.st...@stealth.ly wrote: Should value.serializer in the new java producer be defaulted to Array[Byte] ? I was working on testing some upgrade paths and got this ! return exception in callback when buffer

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-24 Thread Joe Stein
is something you basically have to think about to use Kafka and trying to guess just makes things worse. -Jay On Sat, Jan 24, 2015 at 2:51 PM, Joe Stein joe.st...@stealth.ly wrote: Maybe. I think the StringSerialzer could look more like a typical type of message. Instead of encoding being

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-23 Thread Joe Stein
I think that before we start making more changes to Mirror Maker there should be unit tests in place for it. Currently Mirror Maker is broker on trunk (there is a patch to fix it) because of a recent change. That is only going to get more unwieldily as more change happens. On Wed, Jan 21, 2015

[jira] [Created] (KAFKA-1898) compatibility testing framework

2015-01-23 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1898: Summary: compatibility testing framework Key: KAFKA-1898 URL: https://issues.apache.org/jira/browse/KAFKA-1898 Project: Kafka Issue Type: Bug Reporter

Re: [KIP-DISCUSSION] KIP-7 Security - IP Filtering

2015-01-22 Thread Joe Stein
. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop / On Wed, Jan 21, 2015 at 8:47 PM, Jeff Holoman jholo...@cloudera.com wrote

[jira] [Updated] (KAFKA-1845) KafkaConfig should use ConfigDef

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1845: - Fix Version/s: 0.8.3 KafkaConfig should use ConfigDef

[jira] [Updated] (KAFKA-1890) Fix bug preventing Mirror Maker from successful rebalance.

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1890: - Fix Version/s: 0.8.3 Fix bug preventing Mirror Maker from successful rebalance

[jira] [Updated] (KAFKA-1890) Fix bug preventing Mirror Maker from successful rebalance.

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1890: - Description: Follow-up patch for KAFKA-1650 Fix bug preventing Mirror Maker from successful rebalance

[jira] [Updated] (KAFKA-1890) Fix bug preventing Mirror Maker from successful rebalance.

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1890: - Summary: Fix bug preventing Mirror Maker from successful rebalance. (was: Follow-up patch for KAFKA-1650

[jira] [Updated] (KAFKA-1890) Fix bug preventing Mirror Maker from successful rebalance.

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1890: - Reviewer: Gwen Shapira Fix bug preventing Mirror Maker from successful rebalance

[jira] [Updated] (KAFKA-1890) Follow-up patch for KAFKA-1650

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1890: - Description: (was: Fix bug preventing Mirror Maker from successful rebalance.) Follow-up patch

Re: Review Request 30199: Patch for KAFKA-1890

2015-01-22 Thread Joe Stein
to apply the test cases, run test, see the failure, apply fix, verify the success. Thanks! - Joe Stein On Jan. 22, 2015, 11:25 p.m., Jiangjie Qin wrote: --- This is an automatically generated e-mail. To reply, visit: https

[jira] [Updated] (KAFKA-1891) MirrorMaker hides consumer exception - making troubleshooting challenging

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1891: - Resolution: Fixed Status: Resolved (was: Patch Available) committed to trunk MirrorMaker hides

[jira] [Commented] (KAFKA-1888) Add a rolling upgrade system test

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288694#comment-14288694 ] Joe Stein commented on KAFKA-1888: -- I agree this is something that we need. I don't know

[jira] [Updated] (KAFKA-1891) MirrorMaker hides consumer exception - making troubleshooting challenging

2015-01-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1891: - Fix Version/s: 0.8.3 MirrorMaker hides consumer exception - making troubleshooting challenging

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-01-22 Thread Joe Stein
offset), what is the compaction point, etc. I think that done right this would be the successor to the very awkward OffsetRequest we have today. yes! -Jay On Wed, Jan 21, 2015 at 10:27 PM, Joe Stein joe.st...@stealth.ly wrote: Hi, created a KIP https://cwiki.apache.org/confluence

Re: [DISCUSS] KIP-8 - Decommission a broker

2015-01-22 Thread Joe Stein
On Wed, Jan 21, 2015 at 10:20 PM, Joe Stein joe.st...@stealth.ly wrote: Hi, created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Decommission+a+broker JIRA related https://issues.apache.org/jira/browse/KAFKA-1753 I took out the compatibility, migration section since

Re: [DISCUSS] KIP-5 - Broker Configuration Management

2015-01-22 Thread Joe Stein
and change control. And trying to support both may or may not be better. -Jay On Wed, Jan 21, 2015 at 10:34 PM, Joe Stein joe.st...@stealth.ly wrote: Created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-5+-+Broker+Configuration+Management JIRA https://issues.apache.org/jira

<    1   2   3   4   5   6   7   8   9   10   >