[jira] [Issue Comment Deleted] (KAFKA-4392) Failed to lock the state directory due to an unexpected exception

2017-03-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elias Levy updated KAFKA-4392: -- Comment: was deleted (was: I am still seeing this error in 0.10.2.0 during rebalances. Reopen or

[jira] [Commented] (KAFKA-4392) Failed to lock the state directory due to an unexpected exception

2017-03-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937388#comment-15937388 ] Elias Levy commented on KAFKA-4392: --- I am still seeing this error in 0.10.2.0 during rebalances. Reopen

[jira] [Commented] (KAFKA-4392) Failed to lock the state directory due to an unexpected exception

2017-03-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937389#comment-15937389 ] Elias Levy commented on KAFKA-4392: --- I am still seeing this error in 0.10.2.0 during rebalances. Reopen

[jira] [Updated] (KAFKA-4919) Document that stores must not be closed when Processors are closed

2017-03-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elias Levy updated KAFKA-4919: -- Summary: Document that stores must not be closed when Processors are closed (was: Streams job fails

[jira] [Commented] (KAFKA-4919) Streams job fails with InvalidStateStoreException: Store is currently closed

2017-03-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936714#comment-15936714 ] Elias Levy commented on KAFKA-4919: --- Thanks for the information. It is something that should probably

[jira] [Commented] (KAFKA-4919) Streams job fails with InvalidStateStoreException: Store is currently closed

2017-03-21 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935711#comment-15935711 ] Elias Levy commented on KAFKA-4919: --- I believe I found the issue. I am closing the store when my

[jira] [Commented] (KAFKA-4919) Streams job fails with InvalidStateStoreException: Store is currently closed

2017-03-21 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935252#comment-15935252 ] Elias Levy commented on KAFKA-4919: --- The issue appears to be that a {{RocksDBStore}} segment of a

[jira] [Updated] (KAFKA-4919) Streams job fails with InvalidStateStoreException: Store is currently closed

2017-03-19 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elias Levy updated KAFKA-4919: -- Summary: Streams job fails with InvalidStateStoreException: Store is currently closed (was: Streams

[jira] [Created] (KAFKA-4919) Streams job fails with StreamsExceptio

2017-03-19 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4919: - Summary: Streams job fails with StreamsExceptio Key: KAFKA-4919 URL: https://issues.apache.org/jira/browse/KAFKA-4919 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-4887) Enabling caching on a persistent window store breaks support for duplicate insertion

2017-03-13 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922826#comment-15922826 ] Elias Levy commented on KAFKA-4887: --- It is a bit complicated. I am abusing the {{RocksDBWnidowStore}}

[jira] [Created] (KAFKA-4887) Enabling caching on a persistent window store breaks support for duplicate insertion

2017-03-11 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4887: - Summary: Enabling caching on a persistent window store breaks support for duplicate insertion Key: KAFKA-4887 URL: https://issues.apache.org/jira/browse/KAFKA-4887

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2017-02-15 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868971#comment-15868971 ] Elias Levy commented on KAFKA-2729: --- Hit this again during testing with 0.10.0.1 on a 10 node broker

[jira] [Created] (KAFKA-4748) Need a way to shutdown all workers in a Streams application at the same time

2017-02-08 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4748: - Summary: Need a way to shutdown all workers in a Streams application at the same time Key: KAFKA-4748 URL: https://issues.apache.org/jira/browse/KAFKA-4748 Project: Kafka

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

2017-01-24 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836739#comment-15836739 ] Elias Levy commented on KAFKA-4144: --- What Matthias said. The issue has nothing to do with different

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

2017-01-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833913#comment-15833913 ] Elias Levy commented on KAFKA-4144: --- Jeyhun, sorry if I was not clear. My comment about not being able

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

2017-01-22 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833649#comment-15833649 ] Elias Levy commented on KAFKA-4144: --- That's fine. I am less concerned about the implementation details

[jira] [Created] (KAFKA-4683) Mismatch between Stream windowed store and broker log retention logic

2017-01-20 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4683: - Summary: Mismatch between Stream windowed store and broker log retention logic Key: KAFKA-4683 URL: https://issues.apache.org/jira/browse/KAFKA-4683 Project: Kafka

[jira] [Created] (KAFKA-4639) Kafka Streams metrics are undocumented

2017-01-16 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4639: - Summary: Kafka Streams metrics are undocumented Key: KAFKA-4639 URL: https://issues.apache.org/jira/browse/KAFKA-4639 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-4608) RocksDBWindowStore.fetch() is inefficient for large ranges

2017-01-08 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4608: - Summary: RocksDBWindowStore.fetch() is inefficient for large ranges Key: KAFKA-4608 URL: https://issues.apache.org/jira/browse/KAFKA-4608 Project: Kafka Issue

[jira] [Commented] (KAFKA-4217) KStream.transform equivalent of flatMap

2016-10-07 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556371#comment-15556371 ] Elias Levy commented on KAFKA-4217: --- That would work as well. > KStream.transform equivalent of flatMap

[jira] [Commented] (KAFKA-4217) KStream.transform equivalent of flatMap

2016-10-07 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1654#comment-1654 ] Elias Levy commented on KAFKA-4217: --- It would seem to be the same request: allow a transform that emits

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-28 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531353#comment-15531353 ] Elias Levy commented on KAFKA-4212: --- I am using the {{KStream.transform}} API, the {{Transform}}

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-28 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531116#comment-15531116 ] Elias Levy commented on KAFKA-4212: --- But joins are not performed on hopping windows, they are performed

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-28 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531022#comment-15531022 ] Elias Levy commented on KAFKA-4212: --- Not sure I follow. > Add a key-value store that is a TTL

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-28 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530995#comment-15530995 ] Elias Levy commented on KAFKA-4212: --- I would described it as a TTL, not LRU. We want the records to

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-27 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527841#comment-15527841 ] Elias Levy commented on KAFKA-4212: --- Looks like using {{WindowStore}} is not quite so simple, as you

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

2016-09-27 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527301#comment-15527301 ] Elias Levy commented on KAFKA-4144: --- Indeed, that is how it is handled today. But it's not a very clean

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-26 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524513#comment-15524513 ] Elias Levy commented on KAFKA-4212: --- More generally, the use case is: I've told a bunch of folks about

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-26 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524402#comment-15524402 ] Elias Levy commented on KAFKA-4212: --- The general use case is the joining of updates to two tables over a

[jira] [Comment Edited] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-25 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15521287#comment-15521287 ] Elias Levy edited comment on KAFKA-4212 at 9/25/16 7:17 PM: It should be noted

[jira] [Commented] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-25 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15521287#comment-15521287 ] Elias Levy commented on KAFKA-4212: --- I should be noted that a variable-capacity memory-overflowing TTL

[jira] [Created] (KAFKA-4219) Permit setting of event time in stream processor

2016-09-25 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4219: - Summary: Permit setting of event time in stream processor Key: KAFKA-4219 URL: https://issues.apache.org/jira/browse/KAFKA-4219 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-4120) byte[] keys in RocksDB state stores do not work as expected

2016-09-25 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15521271#comment-15521271 ] Elias Levy commented on KAFKA-4120: --- {{o.a.k.common.utils.Bytes}} is not a documented class. > byte[]

[jira] [Created] (KAFKA-4218) Enable access to key in {{ValueTransformer}}

2016-09-24 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4218: - Summary: Enable access to key in {{ValueTransformer}} Key: KAFKA-4218 URL: https://issues.apache.org/jira/browse/KAFKA-4218 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-4217) KStream.transform equivalent of flatMap

2016-09-24 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4217: - Summary: KStream.transform equivalent of flatMap Key: KAFKA-4217 URL: https://issues.apache.org/jira/browse/KAFKA-4217 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-4212) Add a key-value store that is a TTL persistent cache

2016-09-23 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4212: - Summary: Add a key-value store that is a TTL persistent cache Key: KAFKA-4212 URL: https://issues.apache.org/jira/browse/KAFKA-4212 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-14 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491553#comment-15491553 ] Elias Levy commented on KAFKA-4153: --- I've updated the PR to reverse the before & after semantics as

[jira] [Commented] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-12 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485826#comment-15485826 ] Elias Levy commented on KAFKA-4153: --- Why would the other value be undefined? Default it to zero. >

[jira] [Commented] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-12 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485700#comment-15485700 ] Elias Levy commented on KAFKA-4153: --- You could do that, but it would be non-obvious to someone reading

[jira] [Commented] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-12 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485561#comment-15485561 ] Elias Levy commented on KAFKA-4153: --- As a side note, the API for {{JoinWindows}} has become mangled

[jira] [Updated] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-12 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elias Levy updated KAFKA-4153: -- Flags: Patch > Incorrect KStream-KStream join behavior with asymmetric time window >

[jira] [Created] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-12 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4153: - Summary: Incorrect KStream-KStream join behavior with asymmetric time window Key: KAFKA-4153 URL: https://issues.apache.org/jira/browse/KAFKA-4153 Project: Kafka

[jira] [Resolved] (KAFKA-4146) Kafka Stream ignores Serde exceptions leading to silently broken apps

2016-09-09 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elias Levy resolved KAFKA-4146. --- Resolution: Invalid > Kafka Stream ignores Serde exceptions leading to silently broken apps >

[jira] [Created] (KAFKA-4146) Kafka Stream ignores Serde exceptions leading to silently broken apps

2016-09-09 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4146: - Summary: Kafka Stream ignores Serde exceptions leading to silently broken apps Key: KAFKA-4146 URL: https://issues.apache.org/jira/browse/KAFKA-4146 Project: Kafka

[jira] [Created] (KAFKA-4144) Allow per stream/table timestamp extractor

2016-09-08 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-4144: - Summary: Allow per stream/table timestamp extractor Key: KAFKA-4144 URL: https://issues.apache.org/jira/browse/KAFKA-4144 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-3932) Consumer fails to consume in a round robin fashion

2016-07-06 Thread Elias Levy (JIRA)
Elias Levy created KAFKA-3932: - Summary: Consumer fails to consume in a round robin fashion Key: KAFKA-3932 URL: https://issues.apache.org/jira/browse/KAFKA-3932 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-2359) New consumer - partitions auto assigned only on poll

2016-06-23 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346678#comment-15346678 ] Elias Levy commented on KAFKA-2359: --- I wonder if the calling pause() before calling poll() and

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-02-04 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133716#comment-15133716 ] Elias Levy edited comment on KAFKA-2729 at 2/5/16 5:55 AM: --- Had the same issue

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-02-04 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133716#comment-15133716 ] Elias Levy commented on KAFKA-2729: --- Had the same issue happen here while testing a 5 node Kafka cluster