[jira] [Closed] (KAFKA-6376) Improve Streams metrics for skipped records

2018-04-27 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler closed KAFKA-6376. --- All the work for this issue is merged in the linked GH PRs. > Improve Streams metrics for skipped

[jira] [Commented] (KAFKA-6905) Document that Processor objects can be reused

2018-05-15 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476447#comment-16476447 ] John Roesler commented on KAFKA-6905: - Thanks for the report, [~glasser], Can you provide some more

[jira] [Commented] (KAFKA-6925) Memory leak in org.apache.kafka.streams.processor.internals.StreamThread$StreamsMetricsThreadImpl

2018-05-24 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489252#comment-16489252 ] John Roesler commented on KAFKA-6925: - I read the ticket and took another look at parentSensors in

[jira] [Assigned] (KAFKA-6925) Memory leak in org.apache.kafka.streams.processor.internals.StreamThread$StreamsMetricsThreadImpl

2018-05-24 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-6925: --- Assignee: John Roesler > Memory leak in >

[jira] [Updated] (KAFKA-6925) Memory leak in org.apache.kafka.streams.processor.internals.StreamThread$StreamsMetricsThreadImpl

2018-05-24 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-6925: Description: *Note: this issue was fixed incidentally in 2.0, so it is only present in versions

[jira] [Commented] (KAFKA-7004) Support configurable restore consumer poll timeout

2018-06-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504743#comment-16504743 ] John Roesler commented on KAFKA-7004: - Hi Shawn,   That sounds good to me. What you say seems to be

[jira] [Updated] (KAFKA-7072) Kafka Streams may drop rocksb window segments before they expire

2018-06-18 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7072: Description: The current implementation of Segments used by Rocks Session and Time window stores

[jira] [Updated] (KAFKA-7072) Kafka Streams may drop rocksb window segments before they expire

2018-06-18 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7072: Description: The current implementation of Segments used by Rocks Session and Time window stores

[jira] [Created] (KAFKA-7072) Kafka Streams may drop rocksb window segments before they expire

2018-06-18 Thread John Roesler (JIRA)
John Roesler created KAFKA-7072: --- Summary: Kafka Streams may drop rocksb window segments before they expire Key: KAFKA-7072 URL: https://issues.apache.org/jira/browse/KAFKA-7072 Project: Kafka

[jira] [Updated] (KAFKA-7072) Kafka Streams may drop rocksb window segments before they expire

2018-06-18 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7072: Description: The current implementation of Segments used by Rocks Session and Time window stores

[jira] [Updated] (KAFKA-7072) Kafka Streams may drop rocksb window segments before they expire

2018-06-18 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7072: Priority: Minor (was: Major) > Kafka Streams may drop rocksb window segments before they expire >

[jira] [Commented] (KAFKA-6889) Fix Streams system test to only specify used log files

2018-06-19 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517343#comment-16517343 ] John Roesler commented on KAFKA-6889: - Perhaps instead of "fixing" the tests, we can add the ability

[jira] [Created] (KAFKA-6978) Make Streams Window retention time strict

2018-05-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-6978: --- Summary: Make Streams Window retention time strict Key: KAFKA-6978 URL: https://issues.apache.org/jira/browse/KAFKA-6978 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-6978) Make Streams Window retention time strict

2018-05-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-6978: --- Assignee: John Roesler > Make Streams Window retention time strict >

[jira] [Created] (KAFKA-7000) KafkaConsumer.position should wait for assignment metadata

2018-06-05 Thread John Roesler (JIRA)
John Roesler created KAFKA-7000: --- Summary: KafkaConsumer.position should wait for assignment metadata Key: KAFKA-7000 URL: https://issues.apache.org/jira/browse/KAFKA-7000 Project: Kafka Issue

[jira] [Commented] (KAFKA-7004) Support configurable restore consumer poll timeout

2018-06-06 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503912#comment-16503912 ] John Roesler commented on KAFKA-7004: - Hi Shawn, Thanks for the report. Coincidentally, I think

[jira] [Reopened] (KAFKA-5697) StreamThread.shutdown() need to interrupt the stream threads to break the loop

2018-05-29 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reopened KAFKA-5697: - Assignee: John Roesler > StreamThread.shutdown() need to interrupt the stream threads to break

[jira] [Resolved] (KAFKA-6783) consumer poll(timeout) blocked infinitely when no available bootstrap server

2018-05-29 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-6783. - Resolution: Duplicate Hey [~koqizhao], We've merged

[jira] [Closed] (KAFKA-6783) consumer poll(timeout) blocked infinitely when no available bootstrap server

2018-05-29 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler closed KAFKA-6783. --- > consumer poll(timeout) blocked infinitely when no available bootstrap server >

[jira] [Closed] (KAFKA-6978) Make Streams Window retention time strict

2018-06-25 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler closed KAFKA-6978. --- > Make Streams Window retention time strict > - > >

[jira] [Resolved] (KAFKA-6978) Make Streams Window retention time strict

2018-06-25 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-6978. - Resolution: Fixed Fix Version/s: 2.1.0 This feature was merged in 

[jira] [Created] (KAFKA-7080) WindowStoreBuilder incorrectly initializes CachingWindowStore

2018-06-20 Thread John Roesler (JIRA)
John Roesler created KAFKA-7080: --- Summary: WindowStoreBuilder incorrectly initializes CachingWindowStore Key: KAFKA-7080 URL: https://issues.apache.org/jira/browse/KAFKA-7080 Project: Kafka

[jira] [Created] (KAFKA-7106) Remove segment/segmentInterval from Window definition

2018-06-26 Thread John Roesler (JIRA)
John Roesler created KAFKA-7106: --- Summary: Remove segment/segmentInterval from Window definition Key: KAFKA-7106 URL: https://issues.apache.org/jira/browse/KAFKA-7106 Project: Kafka Issue

[jira] [Created] (KAFKA-7107) Ability to configure state store for JoinWindows in KStream-KStream join

2018-06-26 Thread John Roesler (JIRA)
John Roesler created KAFKA-7107: --- Summary: Ability to configure state store for JoinWindows in KStream-KStream join Key: KAFKA-7107 URL: https://issues.apache.org/jira/browse/KAFKA-7107 Project: Kafka

[jira] [Assigned] (KAFKA-6556) allow to attach callbacks in kafka streams, to be triggered when a window is expired

2018-06-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-6556: --- Assignee: John Roesler > allow to attach callbacks in kafka streams, to be triggered when a

[jira] [Commented] (KAFKA-7240) -total metrics in Streams are incorrect

2018-08-03 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568382#comment-16568382 ] John Roesler commented on KAFKA-7240: - Thanks for the report [~slendle]. That does indeed sound like

[jira] [Commented] (KAFKA-7240) -total metrics in Streams are incorrect

2018-08-03 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568557#comment-16568557 ] John Roesler commented on KAFKA-7240: - Oh, by all means, go ahead! I'll assign it to you.   If you

[jira] [Commented] (KAFKA-7240) -total metrics in Streams are incorrect

2018-08-03 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568560#comment-16568560 ] John Roesler commented on KAFKA-7240: - [~slendle] For some reason, I can't assign this ticket to

[jira] [Created] (KAFKA-7223) KIP-328: Add in-memory Suppression

2018-07-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7223: --- Summary: KIP-328: Add in-memory Suppression Key: KAFKA-7223 URL: https://issues.apache.org/jira/browse/KAFKA-7223 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7224) KIP-328: Add spill-to-disk for Suppression

2018-07-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7224: --- Summary: KIP-328: Add spill-to-disk for Suppression Key: KAFKA-7224 URL: https://issues.apache.org/jira/browse/KAFKA-7224 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-7223) KIP-328: Add in-memory Suppression

2018-07-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-7223: --- Assignee: John Roesler > KIP-328: Add in-memory Suppression >

[jira] [Created] (KAFKA-7222) KIP-328: Add Window Grace Period (and deprecate Window Retention)

2018-07-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7222: --- Summary: KIP-328: Add Window Grace Period (and deprecate Window Retention) Key: KAFKA-7222 URL: https://issues.apache.org/jira/browse/KAFKA-7222 Project: Kafka

[jira] [Commented] (KAFKA-7269) KStream.merge is not documented

2018-08-10 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576361#comment-16576361 ] John Roesler commented on KAFKA-7269: - Hi [~virgilp],  Thanks for the tip! It's not in scope to

[jira] [Created] (KAFKA-7277) Migrate Streams API to Duration instead of longMs times

2018-08-10 Thread John Roesler (JIRA)
John Roesler created KAFKA-7277: --- Summary: Migrate Streams API to Duration instead of longMs times Key: KAFKA-7277 URL: https://issues.apache.org/jira/browse/KAFKA-7277 Project: Kafka Issue

[jira] [Commented] (KAFKA-7277) Migrate Streams API to Duration instead of longMs times

2018-08-10 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576854#comment-16576854 ] John Roesler commented on KAFKA-7277: - I recommend that we validate each duration argument using a

[jira] [Created] (KAFKA-7275) Prototype lock-free metrics

2018-08-10 Thread John Roesler (JIRA)
John Roesler created KAFKA-7275: --- Summary: Prototype lock-free metrics Key: KAFKA-7275 URL: https://issues.apache.org/jira/browse/KAFKA-7275 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-7250) Kafka-Streams-Scala DSL transform shares transformer instance

2018-08-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574974#comment-16574974 ] John Roesler commented on KAFKA-7250: - I've created [https://github.com/apache/kafka/pull/5481] to

[jira] [Created] (KAFKA-7267) KafkaStreams Scala DSL process method should accept a ProcessorSupplier

2018-08-09 Thread John Roesler (JIRA)
John Roesler created KAFKA-7267: --- Summary: KafkaStreams Scala DSL process method should accept a ProcessorSupplier Key: KAFKA-7267 URL: https://issues.apache.org/jira/browse/KAFKA-7267 Project: Kafka

[jira] [Created] (KAFKA-7284) Producer getting fenced may cause Streams to shut down

2018-08-13 Thread John Roesler (JIRA)
John Roesler created KAFKA-7284: --- Summary: Producer getting fenced may cause Streams to shut down Key: KAFKA-7284 URL: https://issues.apache.org/jira/browse/KAFKA-7284 Project: Kafka Issue

[jira] [Updated] (KAFKA-7284) Producer getting fenced may cause Streams to shut down

2018-08-13 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7284: Issue Type: Bug (was: Improvement) > Producer getting fenced may cause Streams to shut down >

[jira] [Commented] (KAFKA-7277) Migrate Streams API to Duration instead of longMs times

2018-08-14 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580175#comment-16580175 ] John Roesler commented on KAFKA-7277: - Hey [~NIzhikov], Thanks for picking this up. Ideally, we

[jira] [Resolved] (KAFKA-7222) KIP-328: Add Window Grace Period (and deprecate Window Retention)

2018-08-14 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-7222. - Resolution: Fixed Fix Version/s: 2.1.0 [https://github.com/apache/kafka/pull/5369] is

[jira] [Commented] (KAFKA-7015) Enhance RecordCollectorImpl exceptions with more context information

2018-08-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575212#comment-16575212 ] John Roesler commented on KAFKA-7015: - It's probably good to avoid displaying the values in error

[jira] [Created] (KAFKA-7269) KStream.merge is not documented

2018-08-09 Thread John Roesler (JIRA)
John Roesler created KAFKA-7269: --- Summary: KStream.merge is not documented Key: KAFKA-7269 URL: https://issues.apache.org/jira/browse/KAFKA-7269 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-7269) KStream.merge is not documented

2018-08-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7269: Affects Version/s: 1.0.0 1.0.1 1.0.2

[jira] [Updated] (KAFKA-7269) KStream.merge is not documented

2018-08-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7269: Component/s: streams > KStream.merge is not documented > --- > >

[jira] [Created] (KAFKA-7270) Add latest releases to streams_upgrade_test.py

2018-08-09 Thread John Roesler (JIRA)
John Roesler created KAFKA-7270: --- Summary: Add latest releases to streams_upgrade_test.py Key: KAFKA-7270 URL: https://issues.apache.org/jira/browse/KAFKA-7270 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7271) Fix ignored test in streams_upgrade_test.py: test_upgrade_downgrade_brokers

2018-08-09 Thread John Roesler (JIRA)
John Roesler created KAFKA-7271: --- Summary: Fix ignored test in streams_upgrade_test.py: test_upgrade_downgrade_brokers Key: KAFKA-7271 URL: https://issues.apache.org/jira/browse/KAFKA-7271 Project:

[jira] [Created] (KAFKA-7272) Fix ignored test in streams_upgrade_test.py: test_simple_upgrade_downgrade

2018-08-09 Thread John Roesler (JIRA)
John Roesler created KAFKA-7272: --- Summary: Fix ignored test in streams_upgrade_test.py: test_simple_upgrade_downgrade Key: KAFKA-7272 URL: https://issues.apache.org/jira/browse/KAFKA-7272 Project:

[jira] [Created] (KAFKA-7315) Streams serialization docs contain a broken link for Avro

2018-08-20 Thread John Roesler (JIRA)
John Roesler created KAFKA-7315: --- Summary: Streams serialization docs contain a broken link for Avro Key: KAFKA-7315 URL: https://issues.apache.org/jira/browse/KAFKA-7315 Project: Kafka Issue

[jira] [Commented] (KAFKA-7277) Migrate Streams API to Duration instead of longMs times

2018-08-17 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584175#comment-16584175 ] John Roesler commented on KAFKA-7277: - I'll take a look. Thanks! > Migrate Streams API to Duration

[jira] [Commented] (KAFKA-7290) Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version"

2018-08-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587544#comment-16587544 ] John Roesler commented on KAFKA-7290: - There's one thread, and two consumers: 2018-08-14 09:08:14

[jira] [Comment Edited] (KAFKA-7290) Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version"

2018-08-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587544#comment-16587544 ] John Roesler edited comment on KAFKA-7290 at 8/21/18 2:55 PM: -- There's one

[jira] [Commented] (KAFKA-7290) Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version"

2018-08-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587551#comment-16587551 ] John Roesler commented on KAFKA-7290: - Also the network selector's node ids look funny to me:

[jira] [Commented] (KAFKA-7290) Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version"

2018-08-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587554#comment-16587554 ] John Roesler commented on KAFKA-7290: - These are just the logs for one Streams process. Are there

[jira] [Commented] (KAFKA-7290) Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version"

2018-08-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587568#comment-16587568 ] John Roesler commented on KAFKA-7290: - I know the circumstances with that rocks exception are

[jira] [Commented] (KAFKA-7345) Potentially unclosed FileChannel in StateDirectory#unlock

2018-08-27 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593818#comment-16593818 ] John Roesler commented on KAFKA-7345: - Hi Ted, I'm not familiar with the semantics of FileLock. Is

[jira] [Commented] (KAFKA-6033) Kafka Streams does not work with musl-libc (alpine linux)

2018-08-21 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587598#comment-16587598 ] John Roesler commented on KAFKA-6033: - This is, unfortunately, correct, and there's not much we can

[jira] [Commented] (KAFKA-7345) Potentially unclosed FileChannel in StateDirectory#unlock

2018-08-27 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593885#comment-16593885 ] John Roesler commented on KAFKA-7345: - Thanks. I'll just respond on the PR. I wasn't sure which one

[jira] [Resolved] (KAFKA-4988) JVM crash when running on Alpine Linux

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-4988. - Resolution: Won't Fix I think this issue is out of our hands. If you think there is something

[jira] [Updated] (KAFKA-3596) Kafka Streams: Window expiration needs to consider more than event time

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-3596: Fix Version/s: 2.1.0 > Kafka Streams: Window expiration needs to consider more than event time >

[jira] [Created] (KAFKA-7367) Verify that Streams never creates RocksDB stores unless they are needed

2018-08-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7367: --- Summary: Verify that Streams never creates RocksDB stores unless they are needed Key: KAFKA-7367 URL: https://issues.apache.org/jira/browse/KAFKA-7367 Project: Kafka

[jira] [Updated] (KAFKA-7367) Verify that Streams never creates RocksDB stores unless they are needed

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7367: Labels: newbie (was: ) > Verify that Streams never creates RocksDB stores unless they are needed

[jira] [Commented] (KAFKA-6033) Kafka Streams does not work with musl-libc (alpine linux)

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599098#comment-16599098 ] John Roesler commented on KAFKA-6033: - Also, I've just found

[jira] [Created] (KAFKA-7368) Support joining Windowed KTables

2018-08-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7368: --- Summary: Support joining Windowed KTables Key: KAFKA-7368 URL: https://issues.apache.org/jira/browse/KAFKA-7368 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-7214) Mystic FATAL error

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598992#comment-16598992 ] John Roesler commented on KAFKA-7214: - Hi [~habdank], I've commented on

[jira] [Commented] (KAFKA-7367) Verify that Streams never creates RocksDB stores unless they are needed

2018-09-05 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604478#comment-16604478 ] John Roesler commented on KAFKA-7367: - Sorry, I should have said "someone mentioned it to me in

[jira] [Updated] (KAFKA-7386) Streams Scala wrapper should not cache serdes

2018-09-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7386: Component/s: streams > Streams Scala wrapper should not cache serdes >

[jira] [Updated] (KAFKA-7386) Streams Scala wrapper should not cache serdes

2018-09-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7386: Affects Version/s: 2.1.0 2.0.0 > Streams Scala wrapper should not cache

[jira] [Created] (KAFKA-7386) Streams Scala wrapper should not cache serdes

2018-09-07 Thread John Roesler (JIRA)
John Roesler created KAFKA-7386: --- Summary: Streams Scala wrapper should not cache serdes Key: KAFKA-7386 URL: https://issues.apache.org/jira/browse/KAFKA-7386 Project: Kafka Issue Type: Bug

[jira] [Comment Edited] (KAFKA-7214) Mystic FATAL error

2018-09-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607436#comment-16607436 ] John Roesler edited comment on KAFKA-7214 at 9/7/18 6:00 PM: - Since you do

[jira] [Updated] (KAFKA-7386) Streams Scala wrapper should not cache serdes

2018-09-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-7386: Fix Version/s: 2.1.0 2.0.1 > Streams Scala wrapper should not cache serdes >

[jira] [Commented] (KAFKA-7214) Mystic FATAL error

2018-09-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607436#comment-16607436 ] John Roesler commented on KAFKA-7214: - Since you do not have an OutOfMemoryException in your logs, I

[jira] [Commented] (KAFKA-6777) Wrong reaction on Out Of Memory situation

2018-09-06 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605926#comment-16605926 ] John Roesler commented on KAFKA-6777: - Yes, it certainly seems safer to generally avoid catching

[jira] [Commented] (KAFKA-7214) Mystic FATAL error

2018-09-06 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606303#comment-16606303 ] John Roesler commented on KAFKA-7214: - Hi [~habdank], If I understood the scenario, you get

[jira] [Created] (KAFKA-7393) Consider making suppression node names independent of topologically numbered names.

2018-09-10 Thread John Roesler (JIRA)
John Roesler created KAFKA-7393: --- Summary: Consider making suppression node names independent of topologically numbered names. Key: KAFKA-7393 URL: https://issues.apache.org/jira/browse/KAFKA-7393

[jira] [Commented] (KAFKA-6556) allow to attach callbacks in kafka streams, to be triggered when a window is expired

2018-09-10 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609420#comment-16609420 ] John Roesler commented on KAFKA-6556: - Yes, you're right. I was thinking superficially before, but

[jira] [Commented] (KAFKA-6777) Wrong reaction on Out Of Memory situation

2018-09-07 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607574#comment-16607574 ] John Roesler commented on KAFKA-6777: - Hi [~habdank], When Java processes are under extreme memory

[jira] [Resolved] (KAFKA-7080) WindowStoreBuilder incorrectly initializes CachingWindowStore

2018-07-10 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-7080. - Resolution: Fixed Fixed in https://github.com/apache/kafka/pull/5257 > WindowStoreBuilder

[jira] [Commented] (KAFKA-6127) Streams should never block infinitely

2018-07-03 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531763#comment-16531763 ] John Roesler commented on KAFKA-6127: - Good call, [~Yohan123], I'll update the description. >

[jira] [Updated] (KAFKA-6127) Streams should never block infinitely

2018-07-03 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-6127: Description: Streams uses three consumer APIs that can block infinite: {{commitSync()}},

[jira] [Created] (KAFKA-7161) KTable Reduce should check for invalid conditions

2018-07-13 Thread John Roesler (JIRA)
John Roesler created KAFKA-7161: --- Summary: KTable Reduce should check for invalid conditions Key: KAFKA-7161 URL: https://issues.apache.org/jira/browse/KAFKA-7161 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7402) Kafka Streams should implement AutoCloseable where appropriate

2018-09-11 Thread John Roesler (JIRA)
John Roesler created KAFKA-7402: --- Summary: Kafka Streams should implement AutoCloseable where appropriate Key: KAFKA-7402 URL: https://issues.apache.org/jira/browse/KAFKA-7402 Project: Kafka

[jira] [Created] (KAFKA-7399) FunctionConversions in Streams-Scala should be private

2018-09-11 Thread John Roesler (JIRA)
John Roesler created KAFKA-7399: --- Summary: FunctionConversions in Streams-Scala should be private Key: KAFKA-7399 URL: https://issues.apache.org/jira/browse/KAFKA-7399 Project: Kafka Issue

[jira] [Assigned] (KAFKA-7396) KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde

2018-09-11 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-7396: --- Assignee: John Roesler > KIP-365: Materialized, Serialized, Joined, Consumed and Produced

[jira] [Commented] (KAFKA-7396) KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde

2018-09-11 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610839#comment-16610839 ] John Roesler commented on KAFKA-7396: - [~j...@goyeau.com] is working on this, but I couldn't assign

[jira] [Assigned] (KAFKA-7399) FunctionConversions in Streams-Scala should be private

2018-09-11 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-7399: --- Assignee: John Roesler > FunctionConversions in Streams-Scala should be private >

[jira] [Commented] (KAFKA-7399) FunctionConversions in Streams-Scala should be private

2018-09-11 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610842#comment-16610842 ] John Roesler commented on KAFKA-7399: - [~j...@goyeau.com] is working on this, but I couldn't assign

[jira] [Commented] (KAFKA-6474) Rewrite test to use new public TopologyTestDriver

2018-03-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393415#comment-16393415 ] John Roesler commented on KAFKA-6474: - Hi Filipe, I have been working on a similar task (KAFKA-6473)

[jira] [Commented] (KAFKA-6474) Rewrite test to use new public TopologyTestDriver

2018-03-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393444#comment-16393444 ] John Roesler commented on KAFKA-6474: - Also worth mentioning is [~guozhang]'s reply: {quote}I think I

[jira] [Commented] (KAFKA-6535) Set default retention ms for Streams repartition topics to infinity

2018-03-09 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393587#comment-16393587 ] John Roesler commented on KAFKA-6535: - I don't think it's that important in this context, but it's

[jira] [Assigned] (KAFKA-4730) Streams does not have an in-memory windowed store

2018-03-13 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-4730: --- Assignee: John Roesler (was: Nikki Thean) > Streams does not have an in-memory windowed

[jira] [Assigned] (KAFKA-6376) Improve Streams metrics for skipped records

2018-03-13 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-6376: --- Assignee: John Roesler > Improve Streams metrics for skipped records >

[jira] [Assigned] (KAFKA-5697) StreamThread.close() need to interrupt the stream threads to break the loop

2018-03-13 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-5697: --- Assignee: John Roesler > StreamThread.close() need to interrupt the stream threads to break

[jira] [Commented] (KAFKA-6474) Rewrite test to use new public TopologyTestDriver

2018-03-15 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400912#comment-16400912 ] John Roesler commented on KAFKA-6474: - Hi Filipe, I hope you're doing well. I'm trying to figure out

[jira] [Commented] (KAFKA-6473) Add MockProcessorContext to public test-utils

2018-03-08 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391741#comment-16391741 ] John Roesler commented on KAFKA-6473: - I have created

[jira] [Commented] (KAFKA-6399) Consider reducing "max.poll.interval.ms" default for Kafka Streams

2018-03-08 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392493#comment-16392493 ] John Roesler commented on KAFKA-6399: - I'm not sure, since I haven't had a lot of time so far to build

[jira] [Commented] (KAFKA-6474) Rewrite test to use new public TopologyTestDriver

2018-04-06 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16428837#comment-16428837 ] John Roesler commented on KAFKA-6474: - Thanks for the PR. I'll review it and comment as soon as I can.

[jira] [Commented] (KAFKA-6376) Improve Streams metrics for skipped records

2018-04-05 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427321#comment-16427321 ] John Roesler commented on KAFKA-6376: - Hey [~guozhang], I'm chasing down those possible skip areas you

[jira] [Comment Edited] (KAFKA-6376) Improve Streams metrics for skipped records

2018-04-05 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427321#comment-16427321 ] John Roesler edited comment on KAFKA-6376 at 4/5/18 5:47 PM: - Hey [~guozhang],

  1   2   3   4   5   6   7   8   9   10   >