[GitHub] kafka pull request #3811: KAFKA-5839: Upgrade Guide doc changes for KIP-130

2017-09-07 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/3811

KAFKA-5839: Upgrade Guide doc changes for KIP-130



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka KAFKA-5839

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3811.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3811


commit 08e5d5e76c852c3a52def1480daec96c4439d310
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2017-09-07T19:19:04Z

KAFKA-5839: Upgrade Guide doc changes for KIP-130




---


[GitHub] kafka pull request #2612: KAFKA-4819: Expose states for active tasks to publ...

2017-02-28 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/2612

KAFKA-4819: Expose states for active tasks to public API

Simple implementation of the feature : 
[KAFKA-4819](https://issues.apache.org/jira/browse/KAFKA-4819)
 KAFKA-4819

This PR adds a new method `threadStates` to public API of `KafkaStreams` 
which returns all currently states of running threads and active tasks.

Below is a example for a simple topology consuming from topics; test-p2 and 
test-p4.

[{"name":"StreamThread-1","state":"RUNNING","activeTasks":[{"id":"0_0", 
"assignments":["test-p4-0","test-p2-0"], 
"consumedOffsetsByPartition":[{"topicPartition":"test-p2-0","offset":"test-p2-0"}]},
 {"id":"0_2", "assignments":["test-p4-2"], "consumedOffsetsByPartition":[]}]}, 
{"name":"StreamThread-2","state":"RUNNING","activeTasks":[{"id":"0_1", 
"assignments":["test-p4-1","test-p2-1"], 
"consumedOffsetsByPartition":[{"topicPartition":"test-p2-1","offset":"test-p2-1"}]},
 {"id":"0_3", "assignments":["test-p4-3"], "consumedOffsetsByPartition":[]}]}]

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka KAFKA-4819

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/2612.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2612


commit 0f8b8123cabdbfcfb44fe59b9be20e13ac253c95
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2017-02-23T22:08:01Z

KAFKA-4819: Expose states for active tasks to public API




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] kafka pull request #2604: KAFKA-4794: Add access to OffsetStorageReader from...

2017-02-27 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/2604

KAFKA-4794: Add access to OffsetStorageReader from SourceConnector

This a first attempt to implement Add access to OffsetStorageReader from 
Source Connector.
I am not sure if I did it right. I prefer to take your feedbacks before 
writing some tests.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka KAFKA-4794

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/2604.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2604


commit e2bb682afd052cf1c83c68933c1165b584a0acc9
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2017-02-27T22:35:33Z

KAFKA-4794: Add access to OffsetStorageReader from SourceConnector




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] kafka pull request #1581: KAFKA-3922: add constructor to AbstractStream clas...

2016-07-03 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/1581

KAFKA-3922: add constructor to AbstractStream class

https://issues.apache.org/jira/browse/KAFKA-3922

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka KAFKA-3922

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/1581.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1581


commit 4229dce1220b5cbd7b41683c0d3c45fa101866f9
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2016-07-03T16:21:48Z

KAFKA-3922 add constructor to AbstractStream class




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] kafka pull request: KAFKA-3737: Change log level for error during ...

2016-05-20 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/1415

KAFKA-3737: Change log level for error during produce request

Minor change for https://issues.apache.org/jira/browse/KAFKA-3737

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka kafka-3737

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/1415.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1415


commit e2dac4a834c84808a8d171dbfdc149f6207e6d4a
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2016-05-20T14:24:29Z

KAFKA-3737: Change log level for error during produce request




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] kafka pull request: KAFKA-3496 - add policies for client reconnect...

2016-04-02 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/1179

KAFKA-3496 - add policies for client reconnect attempts

In addition, this PR fixes some log level as describe in this issue : 
https://issues.apache.org/jira/browse/KAFKA-2998

This implementation is inspired from the cassandra client driver.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka client-reconnect-policy

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/1179.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1179


commit 179f571fc75762f39d7769c895ba59f9eed86b95
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2016-04-02T15:56:30Z

KAFKA-3496 - add policies for client reconnect attempts




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] kafka pull request: add some enhancements to MockConsumer

2016-03-05 Thread fhussonnois
GitHub user fhussonnois opened a pull request:

https://github.com/apache/kafka/pull/1016

add some enhancements to MockConsumer

The MockConsumer class should support adding records concurrently.
This allow to implement more complex test scenarios in which records are 
added concurrently with the records are polled.

In addition, I've implemented the rebalance callback in simple manner.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/fhussonnois/kafka trunk

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/1016.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1016


commit 04de0d66124eb0669568c9c292a50decdae4826f
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2016-03-05T09:59:50Z

Fix MockConsumer must support concurrent adding records

commit c180d914e249764339192db6ce0a2a2e88325b12
Author: Florian Hussonnois <florian.hussonn...@gmail.com>
Date:   2016-03-05T10:04:24Z

Add rebalance callbacks MockConsumer




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---