Re: new mailing lists

2012-11-28 Thread Neha Narkhede
Thanks for the note, Owen ! Filed a ticket for Kafka's website - https://issues.apache.org/jira/browse/INFRA-5577 -Neha On Wed, Nov 28, 2012 at 4:43 PM, Owen O'Malley omal...@apache.org wrote: You need to file an INFRA jira. For the list of infra tickets that we used in Giraph, look at:

[jira] [Commented] (KAFKA-622) Create mbeans per client

2012-11-28 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506119#comment-13506119 ] Neha Narkhede commented on KAFKA-622: - 9. Sounds good. 14. That's a good suggestion but

[jira] [Comment Edited] (KAFKA-637) Separate log4j environment variable from KAFKA_OPTS in kafka-run-class.sh

2012-11-28 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506190#comment-13506190 ] David Arthur edited comment on KAFKA-637 at 11/29/12 3:48 AM: --

Re: Kafka svn repo removed from incubator

2012-11-29 Thread Daniel Shahaf
I see someone filed a jira, we'll answer there Neha Narkhede wrote on Wed, Nov 28, 2012 at 16:43:08 -0800: Gavin, Thanks for moving the repository. Any idea what needs to be done to get the website moved ? -Neha On Wed, Nov 28, 2012 at 4:08 PM, Gavin McDonald ga...@16degrees.com.au

[jira] [Created] (KAFKA-640) System Test Failures : kafka.common.InvalidClientIdException in broker log4j messages

2012-11-29 Thread John Fung (JIRA)
John Fung created KAFKA-640: --- Summary: System Test Failures : kafka.common.InvalidClientIdException in broker log4j messages Key: KAFKA-640 URL: https://issues.apache.org/jira/browse/KAFKA-640 Project:

Re: Git

2012-11-29 Thread Neha Narkhede
Yes, we are working on it. We will notify everyone once the git repo is ready. Thanks, Neha On Thu, Nov 29, 2012 at 7:25 AM, David Arthur mum...@gmail.com wrote: Has there ever been discussion of moving to Git? -David

[jira] [Commented] (KAFKA-133) Publish kafka jar to a public maven repository

2012-11-29 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506824#comment-13506824 ] Otis Gospodnetic commented on KAFKA-133: There you have it: zkclient 0.2:

[jira] [Commented] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-11-29 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506858#comment-13506858 ] Neha Narkhede commented on KAFKA-633: - That happens due to the test failure. If the

[jira] [Updated] (KAFKA-640) System Test Failures : kafka.common.InvalidClientIdException in broker log4j messages

2012-11-29 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-640: Attachment: kafka-640.patch This happened because ClientId.validate(clientId) in SimpleConsumer did

[jira] [Assigned] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-11-29 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy reassigned KAFKA-633: Assignee: Joel Koshy AdminTest.testShutdownBroker fails --

[jira] [Commented] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-11-29 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506917#comment-13506917 ] Jay Kreps commented on KAFKA-633: - But that's a problem, no? Those test harnesses are

Re: Protocol documentation draft

2012-11-29 Thread Jay Kreps
Okay here is a proposal to address the issues I raised. 1, 2. Correlation id. This is not strictly speaking needed, but it is maybe useful for debugging to be able to trace a particular request from client to server. So we will extend this across all the requests. 3. For metadata response I will

Re: Protocol documentation draft

2012-11-30 Thread David Arthur
Is the 0.8 protocol pretty much frozen at this point? If so, I'd like to start updating my python client. Also, I'm guessing 0.8 will be backwards compatible with 0.7 (due to the API versioning) -David On Nov 29, 2012, at 7:47 PM, Jay Kreps wrote: Okay here is a proposal to address the

Re: Protocol documentation draft

2012-11-30 Thread Jay Kreps
Not quite. I noticed a few bugs that I pointed out in the previous email. I would like to correct these today before we officially freeze it. So maybe give me through Monday? At that point it would be absolutely fantastic to have someone try to work off the document rather than off our code, and

[jira] [Closed] (KAFKA-640) System Test Failures : kafka.common.InvalidClientIdException in broker log4j messages

2012-11-30 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-640. --- System Test Failures : kafka.common.InvalidClientIdException in broker log4j messages

Re: new mailing lists

2012-11-30 Thread Neha Narkhede
Looks like the previous one got closed due to a Apache process issue. Filed another one identical to Giraph's - https://issues.apache.org/jira/browse/INFRA-5583 Thanks, Neha On Wed, Nov 28, 2012 at 5:19 PM, Neha Narkhede neha.narkh...@gmail.com wrote: Thanks for the note, Owen ! Filed a ticket

[jira] [Updated] (KAFKA-598) decouple fetch size from max message size

2012-11-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-598: - Attachment: KAFKA-598-v1.patch I spent the better part of a day rebasing - serves me right for letting

[jira] Subscription: outstanding kafka patches

2012-12-03 Thread jira
Issue Subscription Filter: outstanding kafka patches (55 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-642 Protocol tweaks for 0.8 https://issues.apache.org/jira/browse/KAFKA-642 KAFKA-637 Separate log4j environment

[jira] [Closed] (KAFKA-608) getTopicMetadata does not respect producer config settings

2012-12-03 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-608. --- getTopicMetadata does not respect producer config settings

How to unsubscribe from mailing list?

2012-12-03 Thread Marv Lush
I've tried sending an email to: kafka-dev-unsubscr...@incubator.apache.org kafka-dev-unsubscr...@kafka.apache.org No luck. any ideas? thanks, /m

[jira] [Updated] (KAFKA-597) Refactor KafkaScheduler

2012-12-03 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-597: Attachment: KAFKA-597-v1.patch This patch refactors the scheduler as described above except that I didn't

Re: maintainers

2012-12-04 Thread Joe Stein
I signed up on some. cool. We should maybe match these to JIRA components? On Mon, Dec 3, 2012 at 2:42 PM, Jonathan Creasy jcre...@box.com wrote: I signed up under command line tools since no one had. I'll work on getting up to speed there. Looking forward to working with you all! On Dec

Re: maintainers

2012-12-04 Thread Jay Kreps
Yeah that is a good idea. -Jay On Tue, Dec 4, 2012 at 5:32 AM, Joe Stein crypt...@gmail.com wrote: I signed up on some. cool. We should maybe match these to JIRA components? On Mon, Dec 3, 2012 at 2:42 PM, Jonathan Creasy jcre...@box.com wrote: I signed up under command line tools

Re: Protocol documentation draft

2012-12-04 Thread Jun Rao
Thanks for drafting this. Made some minor edits and added some comments. Thanks, Jun On Thu, Nov 29, 2012 at 3:17 PM, Jay Kreps jay.kr...@gmail.com wrote: I started trying to document the 0.8 protocol from the code and write a guide to client implementation. This is meant to be a more

[jira] [Commented] (KAFKA-645) Create a shell script to run System Test with DEBUG details and tee console output to a file

2012-12-04 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509943#comment-13509943 ] John Fung commented on KAFKA-645: - Attached kafka-645-v1.patch which is a simple patch to

[jira] [Assigned] (KAFKA-646) Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level

2012-12-04 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike reassigned KAFKA-646: --- Assignee: Swapnil Ghike Provide aggregate stats at the high level Producer and

[jira] [Closed] (KAFKA-532) Multiple controllers can co-exist during soft failures

2012-12-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-532. - Multiple controllers can co-exist during soft failures --

[jira] [Closed] (KAFKA-514) Replication with Leader Failure Test: Log segment files checksum mismatch

2012-12-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-514. - Replication with Leader Failure Test: Log segment files checksum mismatch

[jira] [Updated] (KAFKA-496) high level producer send should return a response

2012-12-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-496: -- Fix Version/s: (was: 0.8) 0.8.1 Moving this to 0.8.1. high level

[jira] [Closed] (KAFKA-444) Simple message replication test with multiple partitions and log segments

2012-12-04 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung closed KAFKA-444. --- Simple message replication test with multiple partitions and log segments

[jira] [Closed] (KAFKA-446) Message replication with failures and varied producer acks

2012-12-04 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung closed KAFKA-446. --- Message replication with failures and varied producer acks

[jira] [Resolved] (KAFKA-450) Test in sync replica changes due to slow or stuck followers

2012-12-04 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung resolved KAFKA-450. - Resolution: Fixed testcase_0301 ~ testcase_0308 cover the test requirements of this JIRA. So mark this

[jira] [Commented] (KAFKA-608) getTopicMetadata does not respect producer config settings

2012-12-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510663#comment-13510663 ] Jun Rao commented on KAFKA-608: --- I guess that you are talking about ClientUtils. Currently,

Re: changes in zkClient library

2012-12-05 Thread Neha Narkhede
Jae, We modified the zkclient read API to expose the zookeeper Stat object. This is because we need to do conditional writes in some places in Kafka. Exposing the Stat object allows us to read the previous version of the zookeeper value, and we can use that to write the new value if the expected

[jira] [Updated] (KAFKA-595) Decouple producer side compression from server-side compression.

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-595: Labels: feature (was: feature features) Description: In 0.7 Kafka always appended messages to the

[jira] [Commented] (KAFKA-642) Protocol tweaks for 0.8

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511489#comment-13511489 ] Jay Kreps commented on KAFKA-642: - 60. This isn't an implict conversion. In java the method

[jira] [Updated] (KAFKA-252) Generalize getOffsetsBefore API to a new more general API getLeaderMetadata

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-252: Priority: Major (was: Critical) Description: The relevant discussion is here -

[jira] [Created] (KAFKA-659) Support request pipelining in the network server

2012-12-06 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-659: --- Summary: Support request pipelining in the network server Key: KAFKA-659 URL: https://issues.apache.org/jira/browse/KAFKA-659 Project: Kafka Issue Type: New Feature

[jira] [Updated] (KAFKA-560) Garbage Collect obsolete topics

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-560: Labels: project (was: ) Garbage Collect obsolete topics ---

[jira] [Updated] (KAFKA-554) Move all per-topic configuration into ZK and add to the CreateTopicCommand

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-554: Labels: project (was: ) Move all per-topic configuration into ZK and add to the CreateTopicCommand

[jira] [Commented] (KAFKA-642) Protocol tweaks for 0.8

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511571#comment-13511571 ] Jay Kreps commented on KAFKA-642: - Ack, you're right. Protocol tweaks for

[jira] [Updated] (KAFKA-330) Add delete topic support

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-330: Labels: features project (was: features) Add delete topic support -

Re: mirror maker wiki

2012-12-06 Thread Joel Koshy
Good point - fixed. On Wed, Dec 5, 2012 at 9:22 PM, Jay Kreps jay.kr...@gmail.com wrote: Hey your wiki on mirror maker is very good. It doesn't actually say how to run it, though, does it? -Jay

[jira] [Commented] (KAFKA-654) Irrecoverable error while trying to roll a segment that already exists

2012-12-06 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13512081#comment-13512081 ] Neha Narkhede commented on KAFKA-654: - The bug is inside

[jira] [Updated] (KAFKA-660) Change (topic, partition) tuples to TopicAndPartition

2012-12-06 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-660: Affects Version/s: (was: 0.8) 0.8.1 Change (topic, partition)

[jira] [Updated] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-12-06 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-633: - Attachment: KAFKA-633-v1.patch This is a timing issue that affects low-volume topics (and in this case an

[jira] [Commented] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-12-06 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526028#comment-13526028 ] Jun Rao commented on KAFKA-633: --- Thanks for the patch. +1.

[jira] [Closed] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-12-06 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy closed KAFKA-633. Checked into 0.8. Will file separate jira to protect the ISR from re-expansion.

[jira] [Resolved] (KAFKA-633) AdminTest.testShutdownBroker fails

2012-12-06 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-633. -- Resolution: Fixed AdminTest.testShutdownBroker fails --

[jira] [Updated] (KAFKA-642) Protocol tweaks for 0.8

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-642: Attachment: KAFKA-642-remove-response-versions.patch This patch removes the response version. There was a

[jira] [Commented] (KAFKA-642) Protocol tweaks for 0.8

2012-12-06 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526125#comment-13526125 ] Jay Kreps commented on KAFKA-642: - It also baselines all versions, including the message

[jira] [Updated] (KAFKA-581) provides windows batch script for starting Kafka/Zookeeper

2012-12-07 Thread antoine vianey (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] antoine vianey updated KAFKA-581: - Attachment: zookeeper-server-stop.bat kafka-server-stop.bat Can you add this

[jira] [Comment Edited] (KAFKA-581) provides windows batch script for starting Kafka/Zookeeper

2012-12-07 Thread antoine vianey (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526440#comment-13526440 ] antoine vianey edited comment on KAFKA-581 at 12/7/12 3:11 PM:

0.8/HEAD Console consumer breakage?

2012-12-07 Thread ben fleis
So I was testing my own code, and using the console consumer against my seemingly-working-producer code. Since the last update, the console consumer crashes. I am going to try to track it down in the debugger and will come back with a patch if found.

[jira] [Created] (KAFKA-663) Add deploy feature to System Test

2012-12-07 Thread John Fung (JIRA)
John Fung created KAFKA-663: --- Summary: Add deploy feature to System Test Key: KAFKA-663 URL: https://issues.apache.org/jira/browse/KAFKA-663 Project: Kafka Issue Type: Task Reporter:

[jira] [Created] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-664: --- Summary: Kafka server threads die due to OOME during long running test Key: KAFKA-664 URL: https://issues.apache.org/jira/browse/KAFKA-664 Project: Kafka

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526590#comment-13526590 ] Neha Narkhede commented on KAFKA-664: - Another observation - The server is probably

[jira] [Updated] (KAFKA-651) Create testcases on auto create topics

2012-12-07 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-651: Status: Patch Available (was: Open) Create testcases on auto create topics

[jira] [Updated] (KAFKA-651) Create testcases on auto create topics

2012-12-07 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-651: Attachment: kafka-651-v1.patch Uploaded kafka-651-v1.patch with 1 testcase to cover each functional group:

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526719#comment-13526719 ] Neha Narkhede commented on KAFKA-664: - Heap dump is here -

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526720#comment-13526720 ] Neha Narkhede commented on KAFKA-664: - I'm re-running the tests with that option now

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526808#comment-13526808 ] Neha Narkhede commented on KAFKA-664: - The root cause seems to be that watchersForKey

[jira] [Commented] (KAFKA-644) System Test should run properly with mixed File System Pathname

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526851#comment-13526851 ] Neha Narkhede commented on KAFKA-644: - +1. Thanks for the patch !

[jira] [Closed] (KAFKA-644) System Test should run properly with mixed File System Pathname

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-644. --- System Test should run properly with mixed File System Pathname

[jira] [Updated] (KAFKA-597) Refactor KafkaScheduler

2012-12-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-597: Attachment: KAFKA-597-v4.patch Patch v4. - Rebased - Makes use of thread factory - Fixed broken scaladoc

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526876#comment-13526876 ] Joel Koshy commented on KAFKA-664: -- To clarify, the map itself shouldn't grow indefinitely

[jira] [Updated] (KAFKA-636) Make log segment delete asynchronous

2012-12-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-636: Attachment: KAFKA-636-v1.patch This patch implements asynchronous delete in the log. To do this Log.scala

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526883#comment-13526883 ] Joel Koshy commented on KAFKA-664: -- Okay I'm slightly confused. Even on expiration the

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526887#comment-13526887 ] Jay Kreps commented on KAFKA-664: - Another issue is that we are saving the full producer

[jira] [Updated] (KAFKA-644) System Test should run properly with mixed File System Pathname

2012-12-07 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-644: Attachment: kafka-644-v2.patch Uploaded kafka-644-v2.patch which supports the property auto_create_topic

[jira] [Updated] (KAFKA-646) Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level

2012-12-07 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-646: Attachment: kafka-646-patch-num1-v1.patch This patch has a bunch of refactoring changes and a

[jira] [Updated] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-664: Attachment: watchersForKey.png kafka-664-draft.patch The problem was ever

[jira] [Comment Edited] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13526973#comment-13526973 ] Neha Narkhede edited comment on KAFKA-664 at 12/8/12 1:56 AM: --

[jira] [Updated] (KAFKA-597) Refactor KafkaScheduler

2012-12-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-597: Attachment: KAFKA-597-v5.patch Thanks, new patch v5 addresses your comments: - Improved javadoc - This is

[jira] [Commented] (KAFKA-597) Refactor KafkaScheduler

2012-12-08 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13527168#comment-13527168 ] Jay Kreps commented on KAFKA-597: - Nice catch on the brace, will fix before check in. With

Re: Kafka TLP website move

2012-12-10 Thread Joe Schaefer
You need to tell us HOW to create it, either as a CMS site or using svnpubsub! From: Jay Kreps jay.kr...@gmail.com To: infrastruct...@apache.org infrastruct...@apache.org Cc: dev@kafka.apache.org Sent: Monday, December 10, 2012 12:30 PM Subject: Re: Kafka

[jira] [Commented] (KAFKA-604) Add missing metrics in 0.8

2012-12-10 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528116#comment-13528116 ] Yang Ye commented on KAFKA-604: --- Sure, I'll do that soon Best, ---

[jira] [Resolved] (KAFKA-654) Irrecoverable error while trying to roll a segment that already exists

2012-12-10 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-654. - Resolution: Fixed Assignee: Neha Narkhede Thanks for the review, committed patch v1 to 0.8

Re: Kafka TLP website move

2012-12-10 Thread Jay Kreps
Cool, makes sense. Let's go with SVN and svnpubsub then. The site subdirectory that we would published is https://svn.apache.org/repos/asf/kafka/site In the future if we switch to git we will just leave the site in svn and continue to use that for site updates. -Jay On Mon, Dec 10, 2012 at

Async segment delete patch

2012-12-10 Thread Jay Kreps
Hello fellow log maintainers, I have a patch and would love your feedback: https://issues.apache.org/jira/browse/KAFKA-636 There will be a few more in this series as I finish off the log compaction work. This patch is against trunk, though we may end up needing to backport it if we hit

Re: Kafka TLP website move

2012-12-10 Thread Ted Dunning
Our experience with CMS has been good, btw. Consider as an option. You get a very simple mark-down based web site with browser editing if you like it. Works very well. On Mon, Dec 10, 2012 at 10:26 AM, Jay Kreps jay.kr...@gmail.com wrote: Cool, makes sense. Let's go with SVN and svnpubsub

[jira] Subscription: outstanding kafka patches

2012-12-10 Thread jira
Issue Subscription Filter: outstanding kafka patches (57 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-664 Kafka server threads die due to OOME during long running test https://issues.apache.org/jira/browse/KAFKA-664

[jira] [Commented] (KAFKA-646) Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level

2012-12-10 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528183#comment-13528183 ] Neha Narkhede commented on KAFKA-646: - Patch v2 looks good to me. Few minor questions -

[jira] [Updated] (KAFKA-646) Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level

2012-12-10 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-646: Attachment: kafka-646-patch-num1-v3.patch Thanks for reviewing. Patch v3: 1. Oh, that's because

[jira] [Updated] (KAFKA-647) Provide a property in System Test for no. of topics and topics string will be generated automatically

2012-12-10 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-647: Attachment: kafka-647-v1.patch Uploaded kafka-647-v1.patch for the following changes: 1. To let System

[jira] [Updated] (KAFKA-647) Provide a property in System Test for no. of topics and topics string will be generated automatically

2012-12-10 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-647: Status: Patch Available (was: Open) Provide a property in System Test for no. of topics and topics

[jira] [Updated] (KAFKA-646) Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level

2012-12-10 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-646: Attachment: kafka-646-patch-num1-v4.patch Fixed a typo in FetchRequestAndResponseStats mbean

[jira] [Created] (KAFKA-667) Rename .highwatermark file

2012-12-10 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-667: --- Summary: Rename .highwatermark file Key: KAFKA-667 URL: https://issues.apache.org/jira/browse/KAFKA-667 Project: Kafka Issue Type: Improvement Affects Versions:

Objections to doing this in 0.8?

2012-12-10 Thread Jay Kreps
https://issues.apache.org/jira/browse/KAFKA-667 Goal would just be forward compatibility with a more sane naming scheme... -Jay

Re: Objections to doing this in 0.8?

2012-12-10 Thread Neha Narkhede
Prefer doing this now than later. Thanks, Neha On Mon, Dec 10, 2012 at 3:05 PM, Jay Kreps jay.kr...@gmail.com wrote: https://issues.apache.org/jira/browse/KAFKA-667 Goal would just be forward compatibility with a more sane naming scheme... -Jay

[jira] [Commented] (KAFKA-513) Add state change log to Kafka brokers

2012-12-10 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528432#comment-13528432 ] Jay Kreps commented on KAFKA-513: - It would be nice if we updated our log4j.properties as

[jira] [Commented] (KAFKA-646) Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level

2012-12-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528559#comment-13528559 ] Jun Rao commented on KAFKA-646: --- Thanks for patch v4. Looks good overall. A few minor

Re: Objections to doing this in 0.8?

2012-12-10 Thread Jun Rao
That sounds goods to me. Thanks, Jun On Mon, Dec 10, 2012 at 3:05 PM, Jay Kreps jay.kr...@gmail.com wrote: https://issues.apache.org/jira/browse/KAFKA-667 Goal would just be forward compatibility with a more sane naming scheme... -Jay

[jira] [Commented] (KAFKA-581) provides windows batch script for starting Kafka/Zookeeper

2012-12-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528688#comment-13528688 ] Jun Rao commented on KAFKA-581: --- Thanks for the patch. Committed the stop scripts to 0.8.

[jira] [Commented] (KAFKA-374) Move to java CRC32 implementation

2012-12-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528690#comment-13528690 ] Jun Rao commented on KAFKA-374: --- Should this be a post 0.8 item? Move to

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528707#comment-13528707 ] Jun Rao commented on KAFKA-664: --- If the problem is due to an expired request not being

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528723#comment-13528723 ] Jun Rao commented on KAFKA-664: --- Got it. So the issue is that for low volume topics, the

[jira] [Comment Edited] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-10 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528733#comment-13528733 ] Neha Narkhede edited comment on KAFKA-664 at 12/11/12 6:45 AM:

[jira] [Commented] (KAFKA-374) Move to java CRC32 implementation

2012-12-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528932#comment-13528932 ] Jay Kreps commented on KAFKA-374: - Yes, this should go on trunk. Move to

[jira] [Commented] (KAFKA-664) Kafka server threads die due to OOME during long running test

2012-12-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528948#comment-13528948 ] Jay Kreps commented on KAFKA-664: - This seems to iterate the whole list for every

  1   2   3   4   5   6   7   8   9   10   >