[GitHub] kafka pull request #4324: KAFKA-6360: Clear RocksDB Segments when store is c...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4324

KAFKA-6360: Clear RocksDB Segments when store is closed 

Now that we support re-initializing state stores, we need to clear the 
segments when the store is closed so that they can be re-opened.

### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation 
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-6360

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4324.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4324


commit 4c84af7522d847f82b14e5b3b4c589b0223a5bd8
Author: Damian Guy <damian@gmail.com>
Date:   2017-12-14T10:13:44Z

clear segments on close




---

[GitHub] kafka pull request #4318: MINOR: fix warn logging in RecordCollectorImpl

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4318

MINOR: fix warn logging in RecordCollectorImpl

Fix warn log message in RecordCollectorImpl so it prints the exception 
message rather than `{}`

### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation 
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-logging-record-collector

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4318.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4318


commit 7b793d55b3d49f28580e7003fe76f7c2e70f67c8
Author: Damian Guy <damian@gmail.com>
Date:   2017-12-12T14:59:44Z

fix logging




---

[GitHub] kafka pull request #4317: KAFKA-6349: fix concurrent modification exception ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4317

KAFKA-6349: fix concurrent modification exception in AbstractStateManager 
during restore

Fixes a `ConcurrentModificationException` in`AbstractStateManager` that is 
triggered when a `StateStore` is re-initialized and there are multiple stores 
in the context.

### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation 
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-6349

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4317.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4317


commit f4a25c9ef0c1cba66b7ac15d7e5b14f28e565c24
Author: Damian Guy <damian@gmail.com>
Date:   2017-12-12T14:28:02Z

fix concurrent modification exception in AbstractStateManager




---

[GitHub] kafka pull request #4239: KAFKA-6214: enable use of in-memory store for stan...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4239

KAFKA-6214: enable use of in-memory store for standby tasks

Remove the flag in `ProcessorStateManager` that checks if a store is 
persistent when registering it as a standby task.
Updated the smoke test to use an in-memory store.

### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation 
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-6214

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4239.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4239


commit a9cc7b3bbf2bc42462d0876c6c13fdc8173f47ec
Author: Damian Guy <damian@gmail.com>
Date:   2017-11-20T13:30:35Z

enable use of in-memory store for standby tasks




---

[GitHub] kafka pull request #4074: MINOR: add equals to SessionWindows

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4074

MINOR: add equals to SessionWindows



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-session-window-equals

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4074.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4074






---

[GitHub] kafka-site issue #91: Adding google tracking file for youtube metrics

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/91
  
Merged to asf-site


---

[GitHub] kafka pull request #4025: KAFKA-5989: resume consumption of tasks that have ...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/4025


---

[GitHub] kafka pull request #4025: KAFKA-5989: resume consumption of tasks that have ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4025

KAFKA-5989: resume consumption of tasks that have state stores but no 
changelogging

Stores where logging is disabled where never consumed as the partitions 
were paused, but never resumed.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka 1.0

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4025.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4025


commit 387cc7adb77bc3439cd2860870269a28a78c3c3d
Author: Damian Guy <damian@gmail.com>
Date:   2017-10-05T15:28:35Z

applying patch from trunk




---

[GitHub] kafka pull request #3740: MINOR: reduce logging to trace in NetworkClient wh...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3740


---

[GitHub] kafka pull request #4001: KAFKA-6001: remove <Bytes, byte[]> from Materializ...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/4001


---

[GitHub] kafka-site issue #77: MINOR: Add streams child topics to left-hand nav

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/77
  
@miguno


---

[GitHub] kafka pull request #4002: KAFKA-5989: resume consumption of tasks that have ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4002

KAFKA-5989: resume consumption of tasks that have state stores but no 
changelogging

Stores where logging is disabled where never consumed as the partitions 
were paused, but never resumed.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka restore

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4002.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4002


commit 1e1dec0db90f6d0a28a4d6b497593e22523f4380
Author: Damian Guy <damian@gmail.com>
Date:   2017-10-02T17:37:44Z

resume consumption of tasks that have state stores but no changelogging




---

[GitHub] kafka pull request #4001: KAFKA-6001: remove <Bytes, byte[]> from Materializ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/4001

KAFKA-6001: remove <Bytes, byte[]> from Materialized usages

Make the API simpler by removing `<Bytes, byte[]>` from usages of 
`Materialized`. This is already enforced when by 
`Materialized.as(KeyValueBytesStore)` etc.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka remove-types-from-materialized

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/4001.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #4001


commit ccb10351f890e36f2fbf92b1bb75ae15143028c0
Author: Damian Guy <damian@gmail.com>
Date:   2017-10-02T15:58:03Z

remove <Bytes, byte[]> from Materialized usages




---

[GitHub] kafka pull request #3984: MINOR: update streams quickstart for KIP-182

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3984

MINOR: update streams quickstart for KIP-182



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka quickstart-update

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3984.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3984


commit 98c3fd602b92c9cee45a1f626e4e8ca63882b9aa
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-28T14:54:02Z

update quickstart




---

[GitHub] kafka pull request #3983: KAFKA-5986: Streams State Restoration never comple...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3983

KAFKA-5986: Streams State Restoration never completes when logging is 
disabled

When logging is disabled and there are state stores the task never 
transitions from restoring to running. This is because we only ever check if 
the task has state stores and return false on initialization if it does. The 
check should be if we have changelog partitions, i.e., we need to restore.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka restore-test

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3983.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3983


commit c60856362a9dfe1f8b68d76cbb5a783eef6abfff
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-28T11:52:34Z

fix task initialization when logging disabled




---

[GitHub] kafka pull request #3981: HOTFIX: fix build compilation error

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3981

HOTFIX: fix build compilation error



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka fix-build

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3981.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3981


commit 2a8289e1c556608d8ca3e2423840609207ad4eef
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-28T10:31:49Z

fix build breakage




---

[GitHub] kafka pull request #3971: MINOR: additional kip-182 doc updates

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3971

MINOR: additional kip-182 doc updates



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kip-182-docs

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3971.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3971


commit af565471eea0e15bd90c75dbd07b2cfe9fbdf821
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-27T09:47:55Z

use Materialized rather than StateStoreSupplier

commit ca6a0bbf58a461ec6c3bd5d1a13a98bd51b874aa
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-27T10:20:09Z

update window docs etc




---

[GitHub] kafka-site issue #86: MINOR:Updating Rabobank description and Zalando image ...

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/86
  
Thanks @manjuapu, LGTM. Can you please also file a PR against apache kafka 
for the change to `streams/index.html'? Otherwise that change will be lost.


---

[GitHub] kafka pull request #3943: MINOR: always set Serde.Long on count operations

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3943

MINOR: always set Serde.Long on count operations



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka count-materialized

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3943.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3943


commit f2471f1caaccc1262c830fdc6f10c5b202bd7f2e
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-22T06:32:08Z

always set Serde.Long on count operations




---

[GitHub] kafka pull request #3936: KAFKA-5956: use serdes from materialized in table ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3936

KAFKA-5956: use serdes from materialized in table and globalTable

The new overloads `StreamBuilder.table(String, Materialized)` and 
`StreamsBuilder.globalTable(String, Materialized)` need to set the serdes from 
`Materialized` on the internal `Consumed` instance that is created, otherwise 
the defaults will be used and may result in serialization errors

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka table-materialized

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3936.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3936


commit a9dac7ef6499312d7e2a333fee80f3363c9f573b
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-21T18:16:52Z

use serdes from materialized in table and globaltable




---

[GitHub] kafka-site issue #82: Adding minor style changes

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/82
  
@manjuapu you should be able to close it yourself? I can't close it.


---

[GitHub] kafka pull request #3921: MINOR: add upgrade note for KIP-173 topic configs

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3921

MINOR: add upgrade note for KIP-173 topic configs



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-kip-173-docs

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3921.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3921


commit 1d34eb692a2ab20cc72a53ee69d6b3ce9bbf63c2
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-20T12:55:47Z

add note for topic configs




---

[GitHub] kafka pull request #3905: MINOR: change task initialization logging levels

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3905

MINOR: change task initialization logging levels

In `AssignedTasks` log at debug all task ids that are yet to be initialized.
In `StreamsTask` log at trace when the task is initialized.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-task-init-logging

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3905.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3905


commit 82e87062504a42ff7827fd1da72994aeac0af451
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-19T16:16:24Z

change logging levels




---

[GitHub] kafka pull request #3903: KAFKA-5931: deprecate KTable#through and KTable#to

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3903

KAFKA-5931: deprecate KTable#through and KTable#to



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka deprectate-to-through

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3903.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3903






---

[GitHub] kafka pull request #3902: KAFKA-5922: Add SessionWindowedKStream

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3902

KAFKA-5922: Add SessionWindowedKStream

Add `SessionWindowedKStream` and implementation. Deprecate existing 
`SessionWindow` `aggregate` methods on `KGroupedStream`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5922

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3902.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3902


commit 0e1b3e0f5eff1eae5608f3cd37bc247e3cf0b8d6
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-18T12:11:33Z

initial blah"

commit 5e80cfde3c4deb1c4bb006ceb3af1c1668541c6b
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-19T11:02:43Z

add SessionWindowedKStream




---

[GitHub] kafka pull request #3892: MINOR: use StoreBuilder in KStreamImpl rather than...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3892

MINOR: use StoreBuilder in KStreamImpl rather than StateStoreSupplier



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka cleanup-state-stores

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3892.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3892


commit 5d7b5b594770bbec8b6a82e748d724b7aad0b2c1
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-18T15:19:43Z

use StoreBuilder in KStreamImpl




---

[GitHub] kafka pull request #3889: KAFKA-5921: add Materialized overloads to windowed...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3889

KAFKA-5921: add Materialized overloads to windowed kstream

Add `Materialized` overloads to `WindowedKStream`. Deprecate existing 
methods on `KGroupedStream`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5921

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3889.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3889


commit 0c4d78f696c36ba632895b16cc83e3517b3637be
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-18T11:25:35Z

add materialized to windowed kstream




---

[GitHub] kafka pull request #3858: MINOR: update docs to add note about removing SNAP...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3858


---

[GitHub] kafka-site issue #77: MINOR: Add streams child topics to left-hand nav

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/77
  
as per: https://github.com/apache/kafka-site/pull/78#issuecomment-329644776


---

[GitHub] kafka-site issue #78: MINOR: Add header items

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/78
  
@joel-hamill thanks for the PR. However... these changes should be made 
against the Apache Kafka project - otherwise we run the risk of losing them.


---

[GitHub] kafka pull request #3868: KAFKA-5908: fix range query in CompositeReadOnlyWi...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3868

KAFKA-5908: fix range query in CompositeReadOnlyWindowStore

The `NextIteratorFunction` in `CompositeReadOnlyWindowStore` was 
incorrectly using the `timeFrom` as the `timeTo`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka window-store-range-scan

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3868.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3868


commit 925f7aa400d876187032cfda191c7f120d9a141f
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-15T09:02:33Z

fix range query




---

[GitHub] kafka pull request #3857: MINOR: Bump version in streams quickstart archetyp...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3857


---

[GitHub] kafka pull request #3858: MINOR: update docs to add note about removing SNAP...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3858

MINOR: update docs to add note about removing SNAPSHOT from streams 
dependency



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka docs

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3858.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3858


commit e912689afe6fd2687934aa0b63176da28bec730c
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-14T10:50:10Z

update docs to remove SNAPSHOT




---

[GitHub] kafka pull request #3857: MINOR: Bump version in streams quickstart archetyp...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3857

MINOR: Bump version in streams quickstart archetype pom.xml



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka fix-archetype-version

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3857.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3857


commit 0566abbba4e8149074d38819f3c75736ead9585f
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-14T10:42:23Z

update version in streams archetype pom




---

[GitHub] kafka pull request #3847: MINOR: update tutorial doc to match ak-site

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3847

MINOR: update tutorial doc to match ak-site



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-doc-update

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3847.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3847


commit 94820fc5508893d7ac0133422ad01967a96ab738
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-13T12:54:43Z

update tutorial doc to match ak-site




---

[GitHub] kafka pull request #3846: MINOR: update release script for streams quickstar...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3846

MINOR: update release script for streams quickstart



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-release-script

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3846.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3846


commit 3ee5c9c6ca3ddbc0b448afee8da0a79807cc69c0
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-13T12:40:47Z

update release script for streams quickstart




---

[GitHub] kafka pull request #3837: KAFKA-5873: add materialized overloads to StreamsB...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3837

KAFKA-5873: add materialized overloads to StreamsBuilder

Add overloads for `table` and `globalTable` that use `Materialized`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5873

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3837.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3837


commit 51a1de8d7e38cb50eeb62678b18e7b93b9913873
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-12T12:52:17Z

materialized table and global table




---

[GitHub] kafka pull request #3829: KAFKA-5655: materialized count, aggregate, reduce ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3829

KAFKA-5655: materialized count, aggregate, reduce to KGroupedTable

Add overloads of `count`, `aggregate`, `reduce` using `Materialized` to 
`KGroupedTable`
deprecate other overloads

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5655

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3829.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3829


commit 85d97e101fdb72d6dd0ac61a441a578f9efbb216
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-11T16:30:06Z

materialized count, aggregate, reduce




---

[GitHub] kafka pull request #3827: KAFKA-5654: add materialized count, reduce, aggreg...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3827

KAFKA-5654: add materialized count, reduce, aggregate to KGroupedStream

Add overloads of `count`, `reduce`, and `aggregate` that are `Materialized` 
to `KGroupedStream`.
Refactor common parts between `KGroupedStream` and `WindowedKStream`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5654

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3827.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3827


commit 4385f90908e2de28a2141ae2c675fa635bc4ecd5
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-11T14:22:05Z

materialized count, reduce, aggregate




---

[GitHub] kafka pull request #3826: KAFKA:5653: add join overloads to KTable

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3826

KAFKA:5653: add join overloads to KTable

Add `join`, `leftJoin`, `outerJoin` overloads that use `Materialized` to 
`KTable`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5653

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3826.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3826


commit 9a4c0fde08d14bc7c0bf6f9eeea7d420f41df9e5
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-11T10:52:53Z

add Materialized to KTable join




---

[GitHub] kafka pull request #3825: KAFKA-5817: [FOLLOW-UP] add SerializedInternal

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3825

KAFKA-5817: [FOLLOW-UP] add SerializedInternal

Add `SerializedInternal` class and remove getters from `Serialized`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5817-follow-up

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3825.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3825


commit 3d6b53e0c56880313e00f68d94be070d071789c3
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-11T09:19:34Z

add SerializedInternal




---

[GitHub] kafka pull request #3817: MINOR: make Printed copy ctor protected

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3817

MINOR: make Printed copy ctor protected



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka printed-ctor-protected

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3817.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3817


commit 172303a61979209049f90654f422c7a4a6e17b23
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-08T17:35:55Z

make Printed copy ctor protected




---

[GitHub] kafka pull request #3816: MINOR: make Consumed copy ctor protected

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3816

MINOR: make Consumed copy ctor protected



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka consumed-ctor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3816.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3816


commit ba7016b40adbec1da5ac510fcef149ef475a45b2
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-08T17:18:20Z

make Consumed copy ctor protected




---

[GitHub] kafka pull request #3810: KAFKA-5816: [FOLLOW UP] - create ProducedInternal ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3810

KAFKA-5816: [FOLLOW UP] - create ProducedInternal class

Create `ProducedInternal` and remove getters from `Produced`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5816-follow-up

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3810.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3810


commit 3c27419193217d4b4e8bc7ec53cdcc07d552febe
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-07T17:26:28Z

create ProducedInternal class




---

[GitHub] kafka pull request #3809: KAFKA-5853: implement WindowedKStream

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3809

KAFKA-5853: implement WindowedKStream

Add the `WindowedKStream` interface and implementation of methods that 
don't require `Materialized`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kgrouped-stream-windowed-by

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3809.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3809


commit 78b99500f40eb31644f88e0effcaea6cfba0a3d0
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-07T15:54:38Z

implement WindowedKStream




---

[GitHub] kafka pull request #3807: KAFKA-5852: Add filter, filterNot, mapValues and M...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3807

KAFKA-5852: Add filter, filterNot, mapValues and Materialized to KTable

Add overloads of `filter`, `filterNot`, `mapValues` that take 
`Materialized` as a param to `KTable`. Deprecate overloads using `storeName` 
and `storeSupplier`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka ktable-filter-map

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3807.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3807


commit 1ee7c5f22488b593748ebec4bf78bfa607349835
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-07T11:52:56Z

blah

commit 259127ff3daf1db77f1c2dcc57d50d643b02
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-07T12:34:43Z

KTable filter, filterNot, mapValues and Materialized




---

[GitHub] kafka pull request #3802: KAFKA-5844: add groupBy(selector, serialized) to K...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3802

KAFKA-5844: add groupBy(selector, serialized) to Ktable

add `KTable#groupBy(KeyValueMapper, Serialized)` and deprecate the overload 
with `Serde` params


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kip-182-ktable-groupby

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3802.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3802


commit 56bfba7ab8b58a20287f93ce662d9a2b3a0ae141
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-06T13:48:37Z

add groupBy(selector, serialized) to Ktable




---

[GitHub] kafka pull request #3793: MINOR: add mvn-pgp-plugin to sign streams quicksta...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3793

MINOR: add mvn-pgp-plugin to sign streams quickstart jars



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka sign-mvn-jars

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3793.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3793


commit daecefcd46a9afb657bae86cdf7303260f037fea
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-05T16:03:25Z

add mvn-pgp-plugin




---

[GitHub] kafka pull request #3790: MINOR: fix scalaVersion variable in templateData.j...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3790

MINOR: fix scalaVersion variable in templateData.js



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka fix-js-tempate

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3790.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3790


commit 7d58ffc1e9f58208cf6601fe54fe5717140549ff
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-05T10:41:03Z

fix templateData.js




---

[GitHub] kafka pull request #3786: MINOR: preparing for bug fix release

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3786


---

[GitHub] kafka pull request #3786: MINOR: preparing for bug fix release

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3786

MINOR: preparing for bug fix release



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka 0.11.0

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3786.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3786


commit cddca6bd22da4e2766f129bced1b6225058c99bb
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-04T16:48:05Z

preparing for release




---

[GitHub] kafka pull request #3784: KAFKA-5832: add Consumed and change StreamBuilder ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3784

KAFKA-5832: add Consumed and change StreamBuilder to use it

Added `Consumed` class.
Updated `StreamBuilder#stream`, `StreamBuilder#table`, 
`StreamBuilder#globalTable`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kip-182-stream-builder

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3784.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3784


commit a511db38acad36f5bbbe50b96cb3a73e0343f7ac
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-04T14:56:27Z

add Consumed and change StreamBuiler




---

[GitHub] kafka pull request #3783: KAFKA-5515: Remove date formatting from Segments

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3783

KAFKA-5515: Remove date formatting from Segments

Remove date formatting from `Segments` and use the `segementId` instead.
Add tests to make sure can load old segments.
Rename old segment dirs to new formatting at load time.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5515

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3783.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3783


commit 2a6220f3d8302e2edcd78de666cb1f4a4909b0e3
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-04T12:29:12Z

blah

commit c62b086d5a46f4df91fb166f958d407b11bb9942
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-04T13:05:36Z

use segment id rather than date




---

[GitHub] kafka pull request #3776: KAFKA-5819: Add Joined class and relevant KStream ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3776

KAFKA-5819: Add Joined class and relevant KStream join overloads

Add the `Joined` class and the overloads to `KStream` that use it.
Deprecate existing methods that have `Serde` params

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kip-182-stream-join

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3776.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3776


commit 5be7a49c245f762479ec02c7e1625a1da882bde9
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-01T08:44:16Z

add Joined class and overloads for KStream#join

commit d3991b13e5fd6f9c926c1d6cf3d4e15e77eea7ba
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-01T09:05:39Z

KStream#leftJoin(KStream...)

commit d8b007304e462b7d0e59e3fb4d4f2fa10a78d05b
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-01T09:25:13Z

stream table leftJoin

commit eeed855e153df766f1341469132f45fff62a13ce
Author: Damian Guy <damian@gmail.com>
Date:   2017-09-01T09:40:01Z

outerJoin




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3772: KAFKA-5817: Add Serialized class and overloads to ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3772

KAFKA-5817: Add Serialized class and overloads to KStream#groupBy and 
KStream#groupByKey

Part of KIP-182
- Add the `Serialized` class
- implement overloads of `KStream#groupByKey` and KStream#groupBy`
- deprecate existing methods that have more than default arguments

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5817

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3772.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3772


commit 2ccec406738a91ffbd091632221299d794e8d035
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-31T18:24:10Z

Add Serialized class and overloads to KStream#groupBy and KStream#groupByKey




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3770: KAFKA-5816: add Produced class, KStream#to(topic, ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3770

KAFKA-5816: add Produced class, KStream#to(topic, Produced), and 
KStream#through(topic, Produced)

Add the `Produced` class and `KStream` overloads that use it:
`KStream#to(String, Produced)`
`KStream#through(String, Produced)`
Deprecate all other to and through methods accept the single param methods 
that take a topic param

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5652-produced

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3770.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3770


commit b50c2c9f2ab4d0a7968889426ccd64a52147c73f
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-31T17:30:19Z

add Produced class, KStream#to(topic, Produced), and KStream#through(topic, 
Produced)




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3768: KAFKA:5652 add Printed class and KStream#print(pri...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3768

KAFKA:5652 add Printed class and KStream#print(printed)

Part of KIP-182
- Add `Printed` class and `KStream#print(Printed)`
- deprecate all other `print` and `writeAsText` methods

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5652-printed

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3768.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3768


commit 408984a486d96e004013793f82fe0c5a2abd1702
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-31T15:52:36Z

add Printed class and KStream#print(printed)




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3767: KAFKA-5650: add StateStoreBuilder interface and im...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3767

KAFKA-5650: add StateStoreBuilder interface and implementations

Part of KIP-182

- Add `StateStoreBuilder` interface and `WindowStateStoreBuilder`, 
`KeyValueStateStoreBuilder`, and `SessionStateStoreBuilder` implementations
- Add `StoreSupplier`, `WindowBytesStoreSupplier`, 
`KeyValueBytesStoreSupplier`, `SessionBytesStoreSupplier` interfaces and 
implementations
- Add new methods to `Stores` to create the newly added `StoreSupplier` and 
`StateStoreBuilder` implementations
- Update `Topology` and `InternalTopology` to use the interfaces

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5650

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3767.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3767


commit ee543690317581dc09d3d3f06d52df0685501960
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-25T16:10:35Z

add StateStoreBuilder interface and implementations




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3759: [WIP]: extract and make public KeySchema & HasNext...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3759


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3759: [WIP]: extract and make public KeySchema & HasNext...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3759

[WIP]: extract and make public KeySchema & HasNextCondition



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka keyschema-extract

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3759.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3759


commit fb1cabe5fcba96564c62ff4f475493079fce16ff
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-30T12:51:33Z

extract and make public KeySchema & HasNextCondition




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3754: KAFKA-5804: retain duplicates in ChangeLoggingWind...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3754

KAFKA-5804: retain duplicates in ChangeLoggingWindowBytesStore

`ChangeLoggingWindowBytesStore` needs to have the same `retainDuplicates` 
functionality as `RocksDBWindowStore` else data could be lost upon 
failover/restoration.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka hotfix-changelog-window-store

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3754.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3754


commit d63358a67a98d2fbd53ea47f9b7d54c5dd65b937
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-29T15:18:31Z

retain duplicates in ChangeLoggingWindowBytesStore




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3747: KAFKA-5787: StoreChangelogReader needs to restore ...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3747


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3747: KAFKA-5787: StoreChangelogReader needs to restore ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3747

KAFKA-5787: StoreChangelogReader needs to restore partitions that were 
added post initialization

If a task fails during initialization due to a LockException, its changelog 
partitions are not immediately added to the StoreChangelogReader as the thread 
doesn't hold the lock. However StoreChangelogReader#restore will be called and 
it sets the initialized flag. On a subsequent successfull call to initialize 
the new tasks the partitions are added to the StoreChangelogReader, however as 
it is already initialized these new partitions will never be restored. So the 
task would remain in a non-running state forever.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5787-0.11

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3747.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3747


commit 5569a472a03dc883e3b79c6c6e232a5dbaec5379
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-27T09:57:20Z

backport fix from trunk




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3740: MINOR: reduce logging to trace in NetworkClient wh...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3740

MINOR: reduce logging to trace in NetworkClient when an old server API is 
being used

logging in `NetworkClient#doSend´ at debug level is spamming the logs when 
you have a producer that is sending many requests. It makes it extremely 
difficult to debug. Reducing to trace to remove the noise from the logs

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-network-client-logging

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3740.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3740


commit 89a07a5bbdd11bd2e88bd98dae9bde48d3530eaf
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-25T11:25:36Z

reduce logging to trace in NetworkClient when an old server API is being 
used




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3736: KAFKA-5787: StoreChangelogReader needs to restore ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3736

KAFKA-5787: StoreChangelogReader needs to restore partitions that were 
added post initialization

If a task fails during initialization due to a LockException, its changelog 
partitions are not immediately added to the StoreChangelogReader as the thread 
doesn't hold the lock. However StoreChangelogReader#restore will be called and 
it sets the initialized flag. On a subsequent successfull call to initialize 
the new tasks the partitions are added to the StoreChangelogReader, however as 
it is already initialized these new partitions will never be restored. So the 
task would remain in a non-running state forever.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5787

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3736.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3736


commit 451b6a746cc5173b22d8110497bbbe33842d18a3
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-25T09:36:05Z

StoreChangelogReader needs to restore partitions that were added post 
initialization




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3729: KAFKA-5749: Add MeteredSessionStore and Changelogg...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3729

KAFKA-5749: Add MeteredSessionStore and ChangeloggingSessionBytesStore.

Make MeteredSessionStore the outermost store.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5749

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3729.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3729


commit 1dabd6a7ee8675d6e69df38a30c456e4e913339c
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-22T17:46:42Z

Add MeteredSessionStore and ChangeloggingSessionBytesStore.
Make MeteredSessionStore the outermost store




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3724: KAFKA-5769: Transient test failure org.apache.kafk...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3724


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3725: HOTFIX: reduce streams benchmark input records to ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3725

HOTFIX: reduce streams benchmark input records to 10 million

We are occasionally hitting some timeouts due to processing not finishing. 
So rather than failing the build for these reasons it would be better to reduce 
the runtime.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka fix-system-test

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3725.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3725


commit 333f0389cdc63f4ed286fbe19d8d891062e8afeb
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-23T16:23:20Z

reduce records to 10 million




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3724: KAFKA-5769: Transient test failure org.apache.kafk...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3724

KAFKA-5769: Transient test failure 
org.apache.kafka.streams.integration.KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperationsWithZeroSizedCache

Don't start the consumer until streams has transitioned to the running state

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5769

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3724.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3724


commit 0d832fc9f179f3ec9a0b22ba3dc0908787267f44
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-23T13:20:48Z

don't bother starting consumer until streams has transitioned to running 
state




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3692: KAFKA-5689:Add MeteredWindowStore and refactor sto...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3692

KAFKA-5689:Add MeteredWindowStore and refactor store hierarchy

Add MeteredWindowStore and ChangeLoggingWindowBytesStore.
Refactor Store hierarchy such that Metered is always the outermost store
Do serialization in MeteredWindowStore

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5689

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3692.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3692


commit ec177b0c4464830fd9838214852887849aa24b2e
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-18T08:10:50Z

Add MeteredWindowStore and refactor store hierarchy such that Metered is 
always the outer store.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3685: KAFKA-5668: fetch across stores in CompositeReadOn...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3685

KAFKA-5668: fetch across stores in CompositeReadOnlyWindowStore & 
CompositeReadOnlySessionStore

Fix range queries in `CompositeReadOnlyWindowStore` and 
`CompositeReadOnlySessionStore` to fetch across all stores (was previously just 
looking in the first store)

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5668

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3685.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3685


commit 7ff079be4615208dc0253b66f6c28067dcbba43e
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-17T09:59:39Z

fetch range correctly in CompositeReadOnlyWindowStore & 
CompositeReadOnlySessionStore




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3675: KAFKA-5152: perform state restoration in poll loop

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3675

KAFKA-5152: perform state restoration in poll loop



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5152

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3675.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3675


commit 4da235927f9eebf2442533b44bf017454d372747
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-14T17:23:53Z

perform state restoration in poll loop




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3170: KAFKA-5054: ChangeLoggingKeyValueByteStore delete ...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3170


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3653: KAFKA-5152: move state restoration out of rebalanc...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3653


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3654: KAFKA-5562: Do streams state directory cleanup on ...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3654


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3654: KAFKA-5562: Do streams state directory cleanup on ...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3654

KAFKA-5562: Do streams state directory cleanup on a single thread

Backported from trunk: https://github.com/apache/kafka/pull/3516

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka cherry-pick-stream-thread-cleanup

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3654.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3654


commit 5df82dabac2ccc1cb035f89ee45cf3405e42ab06
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-26T09:10:50Z

Use a single `StateDirectory` per streams instance.
Use threadId to determine which thread owns the lock.
Only allow the owning thread to unlock.
Execute cleanup on a scheduled thread in `KafkaStreams`

commit ddb66fde7c0c4cfb10107ce89531356ab99b8a21
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-10T11:39:42Z

backport stream thread cleaning to 0.11




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3653: KAFKA-5152: move state restoration out of rebalanc...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3653

KAFKA-5152: move state restoration out of rebalance and into poll loop

In `onPartitionsAssigned`: 
1. release all locks for non-assigned suspended tasks.
2. resume any suspended tasks.
3. Create new tasks, but don't attempt to take the state lock.
4. Pause partitions for any new tasks.
5. set the state to `PARTITIONS_ASSIGNED`

In `StreamThread#runLoop`
1. poll
2. if state is `PARTITIONS_ASSIGNED`
 2.1  attempt to initialize any new tasks, i.e, take out the state locks 
and init state stores
 2.2 restore some data for changelogs, i.e., poll once on the restore 
consumer and return the partitions that have been fully restored
 2.3 update tasks with restored partitions and move any that have completed 
restoration to running
 2.4 resume consumption for any tasks where all partitions have been 
restored.
 2.5 if all active tasks are running, transition to `RUNNING` and assign 
standby partitions to the restoreConsumer.
 


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka 0.11.0-restore-on-poll

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3653.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3653


commit 27016b9e9706ee95bcedd9a1408c71e62a0f178e
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-09T19:02:17Z

restore state on the poll loop




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3652: MINOR: change log level in ThreadCache to trace

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3652


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3652: MINOR: change log level in ThreadCache to trace

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3652

MINOR: change log level in ThreadCache to trace

cache eviction logging at debug level is too high volume

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-cache-log-level

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3652.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3652


commit fd02e947264be60a92f358be4b66f57c0722
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-10T07:42:28Z

change log level in ThreadCache to trace




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3633: MINOR: streams memory management docs

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3633


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3650: KAFKA-5717: InMemoryKeyValueStore should delete ke...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3650

KAFKA-5717: InMemoryKeyValueStore should delete keys with null values 
during restore

Fixed a bug in the InMemoryKeyValueStore restoration where a key with a 
`null` value is written in to the map rather than being deleted.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5717

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3650.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3650






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3633: MINOR: streams memory management docs

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3633

MINOR: streams memory management docs

update streams memory management docs

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka mem-doc-011

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3633.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3633


commit b40bce07fe6eed4600dba1abf80faa52486f20f0
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-07T09:23:41Z

memory management docs




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3624: KAFKA-5702: extract refactor StreamThread

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3624

KAFKA-5702: extract refactor StreamThread

Extracted `TaskManager` to handle all task related activities.
Make `StandbyTaskCreator`, `TaskCreator`, and `RebalanceListener` static 
classes so they must define their dependencies and can be testing independently 
of `StreamThread`
Added interfaces between `StreamPartitionAssignor` & `StreamThread` to 
reduce coupling.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka stream-thread-refactor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3624.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3624


commit 1d46a295a2ac10cd612b89c336790a033a9a9afa
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-03T12:42:27Z

extract taskmanager from stream thread
make partition assignor test work




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3604: MINOR: add memory management section to streams do...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3604

MINOR: add memory management section to streams docs



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka memory-management-docs

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3604.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3604


commit 10a970a62425c6b2c832cf9bee534e36acc1419d
Author: Damian Guy <damian@gmail.com>
Date:   2017-08-01T12:05:51Z

add memory management section




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3592: KAFKA-5673: refactor KeyValueStore hierarchy to ma...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3592

KAFKA-5673: refactor KeyValueStore hierarchy to make MeteredKeyValueStore 
outermost

refactor StateStoreSuppliers such that a `MeteredKeyValueStore`  is the 
outermost store. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka key-value-store-refactor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3592.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3592






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3588: HOTFIX: fix threading issue in MeteredKeyValueStor...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3588

HOTFIX: fix threading issue in MeteredKeyValueStore

`MeteredKeyValueStore` wasn't thread safe. Interleaving operations could 
modify the state, i.e, the `key` and/or `value` which could result in incorrect 
behaviour.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka hotfix-metered-kv-store

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3588.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3588


commit 560574ba7878e02a314b17aa78a4b33122fd454c
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-27T14:53:01Z

fix threading issue in MeteredKeyValueStore




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3516: KAFKA-5562: execute state dir cleanup on single th...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3516

KAFKA-5562: execute state dir cleanup on single thread

Use a single `StateDirectory` per streams instance.
Use threadId to determine which thread owns the lock.
Only allow the owning thread to unlock.
Execute cleanup on a scheduled thread in `KafkaStreams`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-5562

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3516.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3516


commit 3ef084d34be8fafb368a5e9ceced1339b345d5f2
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-07T08:44:37Z

execute state dir cleanup on single thread




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka-site issue #65: MINOR: add Interactive Queries docs

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/65
  
@guozhangwang , yep had the discussion with @ijuma today. Managed to break 
everything in the process due to changes that weren't in `kafka` that were in 
`kafka-site` and changes in `kafka` that were broken. Anyway, it was fun! ;-)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka-site pull request #65: MINOR: add Interactive Queries docs

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka-site/pull/65


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3502: HOTFIX: fix paths in streams index

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3502

HOTFIX: fix paths in streams index



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka doc-fixes

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3502.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3502


commit 22e21159bae0c2f3ba3e43ae60d63cc5ef13e064
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-07T13:55:51Z

fix paths in streams index




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka-site issue #65: MINOR: add Interactive Queries docs

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/65
  
Can't i just merge this PR? The process there seems more about creating a 
new version for a release, i.e, i don't want to update everything


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3493: HOTFIX: fix broken streams test

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3493

HOTFIX: fix broken streams test



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka hotfix-test-failure

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3493.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3493


commit 0e940198076ea65387b408587e146bb08aa75e3a
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-06T11:05:35Z

fix broken tests




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka-site pull request #65: MINOR: add Interactive Queries docs

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka-site/pull/65

MINOR: add Interactive Queries docs



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka-site iq-doc-update

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka-site/pull/65.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #65


commit 1bd56196b679d2923bcf72c0d1bc61ac111f700e
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-06T08:19:59Z

add IQ docs




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka-site issue #65: MINOR: add Interactive Queries docs

[dguy]

Github user dguy commented on the issue:

https://github.com/apache/kafka-site/pull/65
  
@guozhangwang 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3484: MINOR: add IQ docs to streams documentation

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3484

MINOR: add IQ docs to streams documentation



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka iq-doc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3484.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3484


commit 24df0e4ec90d742d8e2c46af3ce2a468a734f0a8
Author: Damian Guy <damian@gmail.com>
Date:   2017-07-04T11:55:28Z

add iq docs to website




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3469: MINOR: remove unused eosEnabled field from Process...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3469

MINOR: remove unused eosEnabled field from ProcessorStateManager

remove unused eosEnabled field from ProcessorStateManager

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka minor-remove-unused-boolean

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3469.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3469


commit 38f21eb14b6983ff9d7e7b2b72932406dd6d82aa
Author: Damian Guy <damian@gmail.com>
Date:   2017-06-30T15:40:24Z

remove unused field




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3459: KAFKA-3741: allow users to specify default topic c...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3459

KAFKA-3741: allow users to specify default topic configs for internal topics

Allow users to specify default topic configs for streams internal topics by 
supplying properties from `TopicConfig` with a prefix.
Supplied defaults are used when creating the internal topics. They are 
overridden by the configs supplied along with the `InternalTopicConfig`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-3741

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3459.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3459


commit 415e3130ae77aceefc2d3209b95e32178ba39348
Author: Damian Guy <damian@gmail.com>
Date:   2017-06-29T15:34:52Z

allow users to specify default topic configs with a prefix via StreamsConfig




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3410: KAFKA-4913: prevent creation of window stores with...

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3410

KAFKA-4913: prevent creation of window stores with less than 2 segments

Throw IllegalArgumentException when attempting to create a `WindowStore` 
via `Stores` or directly with `RocksDBWindowStoreSupplier` when it has less 
than 2 segments.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka kafka-4913

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3410.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3410


commit 16a0772f39a91195941cdb4be9e4639bdb20c84e
Author: Damian Guy <damian@gmail.com>
Date:   2017-06-22T15:30:48Z

prevent creation of window store with < 2 segments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3384: MINOR: remove unused hitRatio field in NamedCache

[dguy]

GitHub user dguy opened a pull request:

https://github.com/apache/kafka/pull/3384

MINOR: remove unused hitRatio field in NamedCache



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dguy/kafka remove-unused-field

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/3384.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3384


commit a971277f5348934c4196d4b7508a4b9907e1a96a
Author: Damian Guy <damian@gmail.com>
Date:   2017-06-20T13:24:34Z

remove unused field




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #3255: KAFKA-3741: add min.insync.replicas config to Stre...

[dguy]

Github user dguy closed the pull request at:

https://github.com/apache/kafka/pull/3255


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---