Jenkins build is back to normal : kafka-1.0-jdk7 #4

2017-10-05 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-10-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5877. - Resolution: Fixed > Controller should only update reassignment znode if there is change in the >

[GitHub] kafka pull request #3839: KAFKA-5877; Controller should only update reassign...

2017-10-05 Thread lindong28
Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/3839 ---

Re: Contributing to kafka

2017-10-05 Thread Guozhang Wang
Hi Gilles, Thanks for your interest in contributing, has added you to the list. Cheers, Guozhang On Thu, Oct 5, 2017 at 1:09 PM, Gilles Degols wrote: > Hello, > > > > As I use Kafka during my day-job I would like to contribute to the project > in my spare time. According

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Ismael Juma
You can update your properties file in the same way with the current clients, right? I don't understand how mapping properties into a single string makes things easier. Ismael On Thu, Oct 5, 2017 at 11:22 PM, Clebert Suconic wrote: > Another useful feature for

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

2017-10-05 Thread Richard Yu
We should split KAFKA-4499 into several sub-issues with 4499 being the parent issue. Adding the implementation to CachingWindowStore, RocksDBWindowStore, etc will each require the addition of a test and implementing the methods which is not trivial. This way, it should be easier to manage the

[GitHub] kafka pull request #4031: MINOR: log4j improvements on assigned tasks and st...

2017-10-05 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4031 MINOR: log4j improvements on assigned tasks and store changelog reader You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka

[GitHub] kafka pull request #3819: KAFKA-5576: RocksDB upgrade to 5.8, plus one bug f...

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3819 ---

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-10-05 Thread Matthias J. Sax
Jorge, KIP-198 (that got merged already) overlaps with this KIP. Can you please update your KIP accordingly? Also, while working on KIP-198, we identified some shortcomings in AdminClient that do not allow us to move StreamsResetter our of core package. We want to address those shortcoming in

[GitHub] kafka pull request #3607: [DO NOT MERGE] Existing StreamThread exception han...

2017-10-05 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/3607 ---

[GitHub] kafka pull request #4032: MINOR: Fix typo

2017-10-05 Thread jeffwidman
GitHub user jeffwidman opened a pull request: https://github.com/apache/kafka/pull/4032 MINOR: Fix typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/jeffwidman/kafka patch-3 Alternatively you can review and apply these

[GitHub] kafka pull request #4023: KAFKA-5829: Only delete producer snapshots before ...

2017-10-05 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4023 KAFKA-5829: Only delete producer snapshots before the recovery point You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2017-10-05 Thread Tom Bentley
I'd like to raise a somewhat subtle point about how the proposed API should behave. The current CreateTopicPolicy gets passed either the request partition count and replication factor, or the requested assignment. So if the request had specified partition count and replication factor, the policy

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Jay Kreps
Hey Clebert, Is there a motivation for adding a second way? We generally try to avoid having two ways to do something unless it's really needed...I suspect you have a reason for wanting this, though. -Jay On Mon, Oct 2, 2017 at 6:15 AM Clebert Suconic wrote: > At

[jira] [Resolved] (KAFKA-6012) NoSuchElementException in markErrorMeter during TransactionsBounceTest

2017-10-05 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6012. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4024

[GitHub] kafka pull request #4017: Rename streams tutorial and quickstart

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4017 ---

[GitHub] kafka pull request #4024: KAFKA-6012: Close request metrics only after closi...

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4024 ---

[GitHub] kafka-site pull request #89: Back out changes to index

2017-10-05 Thread joel-hamill
Github user joel-hamill closed the pull request at: https://github.com/apache/kafka-site/pull/89 ---

[GitHub] kafka pull request #4002: KAFKA-5989: resume consumption of tasks that have ...

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4002 ---

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Clebert Suconic
Just as a facility for users... I think it would be easier to prototype consumers and producer by simply doing new Consumer("tcp://HOST:PORT") or new Producer("tcp://HOST:PORT")... on the other project I work (ActiveMQ Artemis) we used to do a similar way to what Kafka does..we then provided the

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Clebert Suconic
I can start a KIP discussion on this.. or not if you really think this is against basic rules... I will need authorization to create the page.. if you could assign me regardless so I can have it for next time? On Thu, Oct 5, 2017 at 10:31 AM, Clebert Suconic wrote: >

[jira] [Resolved] (KAFKA-5978) Transient failure in SslTransportLayerTest.testNetworkThreadTimeRecorded

2017-10-05 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-5978. --- Resolution: Fixed Assignee: Rajini Sivaram This could be because the times are too

[GitHub] kafka pull request #4025: KAFKA-5989: resume consumption of tasks that have ...

2017-10-05 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/4025 KAFKA-5989: resume consumption of tasks that have state stores but no changelogging Stores where logging is disabled where never consumed as the partitions were paused, but never resumed. You can

[jira] [Resolved] (KAFKA-5903) Create Connect metrics for workers

2017-10-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5903. -- Resolution: Fixed Issue resolved by pull request 4011

[GitHub] kafka pull request #4011: KAFKA-5903: Added Connect metrics to the worker an...

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4011 ---

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Colin McCabe
We used URIs as file paths in Hadoop. I think it was a mistake, for a few different reasons. URIs are actually very complex. You probably know about scheme, host, and port, but did you know about authority, user-info, query, fragment, scheme-specific-part? Do you know what they do in Hadoop?

[DISCUSS] KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change

2017-10-05 Thread Colin McCabe
Hi all, I created a KIP for discussion about fixing a corner case in ListOffsetsResponse. Check it out at: https://cwiki.apache.org/confluence/display/KAFKA/KIP-207%3A+Offsets+returned+by+ListOffsetsResponse+should+be+monotonically+increasing+even+during+a+partition+leader+change cheers, Colin

[jira] [Resolved] (KAFKA-2376) Add Kafka Connect metrics

2017-10-05 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-2376. -- Resolution: Fixed All of the subtasks have been completed, so marking this as fixed. > Add

[GitHub] kafka pull request #4028: Update docs to reflect kafka trademark status

2017-10-05 Thread derrickdoo
GitHub user derrickdoo opened a pull request: https://github.com/apache/kafka/pull/4028 Update docs to reflect kafka trademark status Updated a couple places in docs with the 'registered' trademark symbol. You can merge this pull request into a Git repository by running: $ git

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Clebert Suconic
On Thu, Oct 5, 2017 at 2:20 PM, Colin McCabe wrote: > We used URIs as file paths in Hadoop. I think it was a mistake, for a > few different reasons. > > URIs are actually very complex. You probably know about scheme, host, > and port, but did you know about authority,

[GitHub] kafka pull request #4026: KAFKA-5746: Document new broker metrics added for ...

2017-10-05 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/4026 KAFKA-5746: Document new broker metrics added for health checks You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka

[GitHub] kafka pull request #4027: MINOR: fix inconsistance

2017-10-05 Thread lisa2lisa
GitHub user lisa2lisa opened a pull request: https://github.com/apache/kafka/pull/4027 MINOR: fix inconsistance You can merge this pull request into a Git repository by running: $ git pull https://github.com/lisa2lisa/kafka typo-fix Alternatively you can review and apply

[GitHub] kafka-site issue #90: Kafka registered trademark

2017-10-05 Thread junrao
Github user junrao commented on the issue: https://github.com/apache/kafka-site/pull/90 @derrickdoo : Thanks for the patch. LGTM ---

[GitHub] kafka-site pull request #90: Kafka registered trademark

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/90 ---

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Michael Pearce
To me, this is a lot more in line with many other systems connections, to have the ability to have a single connection string / uri, is this really that left field suggesting or wanting this? If anything this bring kafka more standardised approach imo, to have a unified resource identifier,

[GitHub] kafka pull request #4028: Update docs to reflect kafka trademark status

2017-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4028 ---

[GitHub] kafka-site pull request #90: Kafka registered trademark

2017-10-05 Thread derrickdoo
GitHub user derrickdoo opened a pull request: https://github.com/apache/kafka-site/pull/90 Kafka registered trademark Update art assets and content to reflect registered status of the Kafka trademark You can merge this pull request into a Git repository by running: $ git pull

[jira] [Resolved] (KAFKA-5904) Create Connect metrics for worker rebalances

2017-10-05 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-5904. -- Resolution: Fixed Resolved as part of the [PR](https://github.com/apache/kafka/pull/4011) for

[GitHub] kafka pull request #4025: KAFKA-5989: resume consumption of tasks that have ...

2017-10-05 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/4025 ---

Contributing to kafka

2017-10-05 Thread Gilles Degols
Hello, As I use Kafka during my day-job I would like to contribute to the project in my spare time. According the kafka.apache.org website, I need someone to add me to the contributor list, to assign myself some JIRA tickets. Could someone add me to the contributor list (username:

[GitHub] kafka pull request #4029: KAFKA-6016: Make the reassign partitions system te...

2017-10-05 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/4029 KAFKA-6016: Make the reassign partitions system test use the idempotent producer With these changes, we are ensuring that the partitions being reassigned are from non-zero offsets. We also ensure

[GitHub] kafka pull request #4030: KAFKA-5953: Register all jdbc drivers available in...

2017-10-05 Thread kkonstantine
GitHub user kkonstantine opened a pull request: https://github.com/apache/kafka/pull/4030 KAFKA-5953: Register all jdbc drivers available in plugin and class paths You can merge this pull request into a Git repository by running: $ git pull

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

2017-10-05 Thread Matthias J. Sax
Thanks for driving this and sorry for late response. With release deadline it was pretty busy lately. Can you please add a description for the suggested method, what they are going to return? It's a little unclear to me atm. It would also be helpful to discuss, for which use case each method is

Re: [DISCUSS] URIs on Producer and Consumer

2017-10-05 Thread Clebert Suconic
Another useful feature for this... Say that I am writing an application... if I write this URI on any of my internal properties.. I can tweak my Consumer or Producer without changing any code. Say, you store the URI on your project's configuration xml..read it and start your consumer... later on