[GitHub] [kafka] chia7712 commented on pull request #8659: KAFKA-9617 Replica Fetcher can mark partition as failed when max.mess…

2020-05-14 Thread GitBox
chia7712 commented on pull request #8659: URL: https://github.com/apache/kafka/pull/8659#issuecomment-629044613 @guozhangwang @showuon Could you take a look? thanks! This is an automated message from the Apache Git Service.

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-14 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425577307 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/ChangeLoggingWindowBytesStore.java ## @@ -114,7 +105,7 @@ public void

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-14 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425577094 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/StoreChangeLogger.java ## @@ -1,71 +0,0 @@ -/* - * Licensed to the

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-14 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425576674 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractProcessorContext.java ## @@ -113,10 +113,12 @@ public void

[GitHub] [kafka] jiameixie commented on pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
jiameixie commented on pull request #8489: URL: https://github.com/apache/kafka/pull/8489#issuecomment-629033628 @cmccabe I updated it to openjdk:11. Is that ok? This is an automated message from the Apache Git Service. To

[jira] [Resolved] (KAFKA-8311) Better consumer timeout exception handling

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8311. Resolution: Duplicate Closing this ticket – KIP-572 / KAFKA-9274 does subsume it. >

[GitHub] [kafka] jiameixie commented on pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
jiameixie commented on pull request #8489: URL: https://github.com/apache/kafka/pull/8489#issuecomment-629031848 @OneCricketeer So if update to OpenJDK 11, there is no need to set default_jdk according to machine architecture. Thanks for your reminding

[GitHub] [kafka] jiameixie commented on pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
jiameixie commented on pull request #8489: URL: https://github.com/apache/kafka/pull/8489#issuecomment-629030715 @OneCricketeer Openjdk:11 is multi-arch, and openjdk:8 is not multi-arch. It's ok to run command "docker run -it openjdk:11 bash" on both arm and x86, while running command

[GitHub] [kafka] jiameixie commented on pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
jiameixie commented on pull request #8489: URL: https://github.com/apache/kafka/pull/8489#issuecomment-629027425 @OneCricketeer I tested just now. Openjdk:11 is a multi-arch. X86 and arm use the same image name. This is

[jira] [Commented] (KAFKA-7912) In-memory key-value store does not support concurrent access

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107921#comment-17107921 ] Matthias J. Sax commented on KAFKA-7912: Can you dig out the ticket or PR? And than close this

[jira] [Commented] (KAFKA-6520) When a Kafka Stream can't communicate with the server, it's Status stays RUNNING

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107917#comment-17107917 ] Matthias J. Sax commented on KAFKA-6520: This is a quite tricky one... You can of course try.

[GitHub] [kafka] OneCricketeer commented on a change in pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
OneCricketeer commented on a change in pull request #8489: URL: https://github.com/apache/kafka/pull/8489#discussion_r425549885 ## File path: tests/docker/ducker-ak ## @@ -42,7 +42,14 @@ docker_run_memory_limit="2000m" default_num_nodes=14 # The default OpenJDK base image.

[GitHub] [kafka] OneCricketeer commented on a change in pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
OneCricketeer commented on a change in pull request #8489: URL: https://github.com/apache/kafka/pull/8489#discussion_r425550291 ## File path: tests/docker/ducker-ak ## @@ -42,7 +42,14 @@ docker_run_memory_limit="2000m" default_num_nodes=14 # The default OpenJDK base image.

[GitHub] [kafka] guozhangwang commented on a change in pull request #8661: KAFKA-9603: Do not turn on bulk loading for segmented stores on stand-by tasks

2020-05-14 Thread GitBox
guozhangwang commented on a change in pull request #8661: URL: https://github.com/apache/kafka/pull/8661#discussion_r425549980 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/AbstractRocksDBSegmentedBytesStore.java ## @@ -248,17 +243,6 @@ void

[jira] [Commented] (KAFKA-7041) Using RocksDB bulk loading for StandbyTasks

2020-05-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107901#comment-17107901 ] Guozhang Wang commented on KAFKA-7041: -- I'd agree with your assessment, actually I'm thinking that,

[GitHub] [kafka] jiameixie commented on pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-14 Thread GitBox
jiameixie commented on pull request #8489: URL: https://github.com/apache/kafka/pull/8489#issuecomment-629007067 @OneCricketeer Yes, you're right. I recommitted the pr and upgraded openjdk 8 to openjdk 11. This is an

[jira] [Commented] (KAFKA-6520) When a Kafka Stream can't communicate with the server, it's Status stays RUNNING

2020-05-14 Thread Vince Mu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107900#comment-17107900 ] Vince Mu commented on KAFKA-6520: - Can i be assigned this ticket? I would love to give it a shot.  >

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-14 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425544374 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractReadOnlyDecorator.java ## @@ -0,0 +1,252 @@ +/* + * Licensed

[jira] [Commented] (KAFKA-7041) Using RocksDB bulk loading for StandbyTasks

2020-05-14 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107885#comment-17107885 ] Sophie Blee-Goldman commented on KAFKA-7041: > we should also be careful here: just calling

[jira] [Commented] (KAFKA-7912) In-memory key-value store does not support concurrent access

2020-05-14 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107884#comment-17107884 ] Sophie Blee-Goldman commented on KAFKA-7912: I think I actually did end up fixing this in a

[jira] [Resolved] (KAFKA-7985) Cleanup AssignedTasks / AbstractTask logic

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7985. Resolution: Abandoned Given that this ticket is old and the code was refactored multiple

[jira] [Updated] (KAFKA-7912) In-memory key-value store does not support concurrent access

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-7912: --- Fix Version/s: (was: 2.3.0) > In-memory key-value store does not support concurrent

[jira] [Commented] (KAFKA-7174) Improve version probing of subscription info

2020-05-14 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107880#comment-17107880 ] Sophie Blee-Goldman commented on KAFKA-7174: Technically w.r.t version probing we still just

[jira] [Resolved] (KAFKA-7708) [kafka-streams-scala] Invalid signature for KTable join in 2.12

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7708. Resolution: Abandoned > [kafka-streams-scala] Invalid signature for KTable join in 2.12 >

[jira] [Resolved] (KAFKA-7445) Branch one Stream in multiple Streams

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7445. Resolution: Not A Problem > Branch one Stream in multiple Streams >

[GitHub] [kafka] wanwenli closed pull request #1779: KAFKA-4083: fix different replication factor during replica reassignment

2020-05-14 Thread GitBox
wanwenli closed pull request #1779: URL: https://github.com/apache/kafka/pull/1779 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (KAFKA-7271) Fix ignored test in streams_upgrade_test.py: test_upgrade_downgrade_brokers

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107876#comment-17107876 ] Matthias J. Sax commented on KAFKA-7271: [~bbejeck] This is marked as blocker for 2.6 – are you

[GitHub] [kafka] dengziming commented on pull request #7862: KAFKA-9246:Update Heartbeat timeout when ConsumerCoordinator commit offset

2020-05-14 Thread GitBox
dengziming commented on pull request #7862: URL: https://github.com/apache/kafka/pull/7862#issuecomment-628997216 @hachikuji hi Jason, PTAL, thank you. This is an automated message from the Apache Git Service. To respond to

[jira] [Resolved] (KAFKA-7203) Improve Streams StickyTaskAssingor

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7203. Resolution: Fixed > Improve Streams StickyTaskAssingor >

[jira] [Resolved] (KAFKA-7209) Kafka stream does not rebalance when one node gets down

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7209. Resolution: Abandoned > Kafka stream does not rebalance when one node gets down >

[jira] [Commented] (KAFKA-7174) Improve version probing of subscription info

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107869#comment-17107869 ] Matthias J. Sax commented on KAFKA-7174: [~guozhang] [~vvcephei] [~ableegoldman] Given the latest

[jira] [Resolved] (KAFKA-7133) DisconnectException every 5 minutes in single restore consumer thread

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7133. Resolution: Abandoned > DisconnectException every 5 minutes in single restore consumer

[jira] [Commented] (KAFKA-7041) Using RocksDB bulk loading for StandbyTasks

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107868#comment-17107868 ] Matthias J. Sax commented on KAFKA-7041: Given that bulk-loading results in an increase number of

[jira] [Resolved] (KAFKA-7035) Kafka Processor's init() method sometimes is not called

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7035. Resolution: Abandoned > Kafka Processor's init() method sometimes is not called >

[jira] [Resolved] (KAFKA-7015) Enhance RecordCollectorImpl exceptions with more context information

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7015. Resolution: Not A Problem We should actually not log sensitive information like key and

[jira] [Resolved] (KAFKA-7004) Support configurable restore consumer poll timeout

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7004. Resolution: Fixed > Support configurable restore consumer poll timeout >

[jira] [Resolved] (KAFKA-6977) Kafka Streams - java.lang.IllegalStateException: Unexpected error code 2 while fetching data

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6977. Resolution: Abandoned > Kafka Streams - java.lang.IllegalStateException: Unexpected error

[jira] [Commented] (KAFKA-4748) Need a way to shutdown all workers in a Streams application at the same time

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107865#comment-17107865 ] Matthias J. Sax commented on KAFKA-4748: If we have a mechanism to stop all threads/instances if

[jira] [Resolved] (KAFKA-6822) Kafka Consumer 0.10.2.1 can not normally read data from Kafka 1.0.0

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6822. Resolution: Abandoned > Kafka Consumer 0.10.2.1 can not normally read data from Kafka

[jira] [Resolved] (KAFKA-6888) java.lang.UnsatisfiedLinkError: librocksdbjni4271925274440341234.dll: âÑX

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6888. Resolution: Abandoned > java.lang.UnsatisfiedLinkError:

[jira] [Resolved] (KAFKA-6821) The producer attempted to use a producer id which is not currently assigned to its transactional id

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6821. Resolution: Cannot Reproduce A lot of work on EOS was done recently. Closing this ticket

[jira] [Commented] (KAFKA-5578) Streams Task Assignor should consider the staleness of state directories when allocating tasks

2020-05-14 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107862#comment-17107862 ] Sophie Blee-Goldman commented on KAFKA-5578: Yup, this pretty much sums up what we've

[jira] [Resolved] (KAFKA-6804) Event values should not be included in log messages

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6804. Resolution: Fixed I believe this is fixed via KAFKA-8501. > Event values should not be

[jira] [Resolved] (KAFKA-6461) TableTableJoinIntegrationTest is unstable if caching is enabled

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6461. Resolution: Cannot Reproduce > TableTableJoinIntegrationTest is unstable if caching is

[jira] [Resolved] (KAFKA-6237) stream stopped working after exception: Cannot execute transactional method because we are in an error state

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6237. Resolution: Cannot Reproduce There was a lot of EOS work recently. Closing this ticket.

[jira] [Resolved] (KAFKA-6182) Automatic co-partitioning of topics via automatic intermediate topic with matching partitions

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6182. Resolution: Fixed KIP-221 is implemented now. Closing this ticket. > Automatic

[jira] [Resolved] (KAFKA-6125) Avoid third party exception to flow through streams code base

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6125. Resolution: Not A Problem > Avoid third party exception to flow through streams code base

[jira] [Resolved] (KAFKA-6124) Revisit default config for internal client with regard to resilience

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6124. Resolution: Abandoned We changed couple of default values (also in consumer/producer/admin

[jira] [Commented] (KAFKA-6039) Improve TaskAssignor to be more load balanced

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107852#comment-17107852 ] Matthias J. Sax commented on KAFKA-6039: [~ableegoldman] [~vvcephei] [~guozhang] I think we can

[jira] [Resolved] (KAFKA-6000) streams 0.10.2.1 - kafka 0.11.0.1 state restore not working

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6000. Resolution: Abandoned > streams 0.10.2.1 - kafka 0.11.0.1 state restore not working >

[jira] [Resolved] (KAFKA-5625) Invalid subscription data may cause streams app to throw BufferUnderflowException

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5625. Resolution: Abandoned > Invalid subscription data may cause streams app to throw >

[jira] [Resolved] (KAFKA-5581) Avoid creating changelog topics for state stores that are materialized from a source topic

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5581. Resolution: Fixed > Avoid creating changelog topics for state stores that are materialized

[jira] [Commented] (KAFKA-5578) Streams Task Assignor should consider the staleness of state directories when allocating tasks

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107848#comment-17107848 ] Matthias J. Sax commented on KAFKA-5578: [~ableegoldman] [~cadonna] [~vvcephei] Does KIP-441

[jira] [Resolved] (KAFKA-5393) in-memory state store memory issue

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5393. Resolution: Abandoned > in-memory state store memory issue >

[jira] [Resolved] (KAFKA-5240) Make persistent checkpointedOffsets optionable

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5240. Resolution: Fixed > Make persistent checkpointedOffsets optionable >

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425521117 ## File path: docs/security.html ## @@ -767,7 +767,7 @@ 7.3 Authentication using SASL > bin/kafka-configs.sh --zookeeper localhost:2182

[jira] [Commented] (KAFKA-4996) Fix findbugs multithreaded correctness warnings for streams

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107845#comment-17107845 ] Matthias J. Sax commented on KAFKA-4996: Is this still an issue? > Fix findbugs multithreaded

[jira] [Resolved] (KAFKA-5071) ERROR StreamThread:783 StreamThread-128 - stream-thread [StreamThread-128] Failed to commit StreamTask 0_304 state: org.apache.kafka.streams.errors.ProcessorStateExcept

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5071. Resolution: Abandoned > ERROR StreamThread:783 StreamThread-128 - stream-thread

[GitHub] [kafka] showuon edited a comment on pull request #8622: MINOR: Update stream documentation

2020-05-14 Thread GitBox
showuon edited a comment on pull request #8622: URL: https://github.com/apache/kafka/pull/8622#issuecomment-628563253 Hi @bbejeck , I appended more fixs for the streams documents while I'm reading it. Please review it when available. Thank you.

[jira] [Resolved] (KAFKA-4934) Add streams test with RocksDb failures

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4934. Resolution: Abandoned > Add streams test with RocksDb failures >

[jira] [Resolved] (KAFKA-4887) Enabling caching on a persistent window store breaks support for duplicate insertion

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4887. Resolution: Fixed > Enabling caching on a persistent window store breaks support for

[GitHub] [kafka] showuon removed a comment on pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon removed a comment on pull request #8623: URL: https://github.com/apache/kafka/pull/8623#issuecomment-628403219 Hi @kkonstantine , could you please review this small PR? Thanks. This is an automated message from the

[GitHub] [kafka] showuon commented on pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on pull request #8623: URL: https://github.com/apache/kafka/pull/8623#issuecomment-628981965 hi @ijuma @kkonstantine @mjsax , I've put more fix in the documentation while I'm reading it. Please help review it when available. Thank you.

[jira] [Resolved] (KAFKA-4778) OOM on kafka-streams instances with high numbers of unreaped Record classes

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4778. Resolution: Abandoned Does not seem to be an issue in newer released any more? > OOM on

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425518608 ## File path: docs/connect.html ## @@ -129,9 +129,11 @@ TransformationsThe file source connector reads each line as a String. We will wrap each line in a

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425522378 ## File path: docs/security.html ## @@ -1193,7 +1193,7 @@ 7.3 Authentication using SASL7.4 Authorization and ACLs Kafka ships with a pluggable

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r420534565 ## File path: docs/security.html ## @@ -398,7 +398,7 @@ Host Name Verification ssl.keystore.password=test1234

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r420533008 ## File path: docs/ops.html ## @@ -477,16 +477,20 @@ Limiting Bandwidth Usage during Da Throttle was removed. The administrator can also validate

[jira] [Resolved] (KAFKA-4742) ResetTool does not commit offsets correclty

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4742. Resolution: Abandoned This ticket only affect 0.10.0.x and 0.10.1.x and it's very unlikely

[jira] [Resolved] (KAFKA-4697) Simplify Streams Reset Tool

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4697. Resolution: Abandoned This tickets only affect 0.10.0.x and 0.10.1.x versions and it's

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425523260 ## File path: docs/security.html ## @@ -2158,23 +2158,23 @@ 7.6.2 Migrating cluste Perform a rolling restart of brokers setting the JAAS login

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425523260 ## File path: docs/security.html ## @@ -2158,23 +2158,23 @@ 7.6.2 Migrating cluste Perform a rolling restart of brokers setting the JAAS login

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425522820 ## File path: docs/security.html ## @@ -1438,7 +1438,7 @@ Examples bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181

[jira] [Updated] (KAFKA-4327) Move Reset Tool from core to streams

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4327: --- Fix Version/s: 3.0.0 > Move Reset Tool from core to streams >

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425522820 ## File path: docs/security.html ## @@ -1438,7 +1438,7 @@ Examples bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181

[jira] [Updated] (KAFKA-4327) Move Reset Tool from core to streams

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4327: --- Priority: Blocker (was: Minor) > Move Reset Tool from core to streams >

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425522820 ## File path: docs/security.html ## @@ -1438,7 +1438,7 @@ Examples bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181

[jira] [Resolved] (KAFKA-7566) Add sidecar job to leader (or a random single follower) only

2020-05-14 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-7566. Resolution: Won't Fix > Add sidecar job to leader (or a random single follower) only >

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425522378 ## File path: docs/security.html ## @@ -1193,7 +1193,7 @@ 7.3 Authentication using SASL7.4 Authorization and ACLs Kafka ships with a pluggable

[jira] [Resolved] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3779. Resolution: Won't Fix `KTable#to()` was removed from the API. > Add the LRU cache for

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425521117 ## File path: docs/security.html ## @@ -767,7 +767,7 @@ 7.3 Authentication using SASL > bin/kafka-configs.sh --zookeeper localhost:2182

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425521117 ## File path: docs/security.html ## @@ -767,7 +767,7 @@ 7.3 Authentication using SASL > bin/kafka-configs.sh --zookeeper localhost:2182

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425521117 ## File path: docs/security.html ## @@ -767,7 +767,7 @@ 7.3 Authentication using SASL > bin/kafka-configs.sh --zookeeper localhost:2182

[jira] [Resolved] (KAFKA-10) Kafka deployment on EC2 should be WHIRR based, instead of current contrib/deploy code based solution

2020-05-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10. -- Resolution: Won't Fix (was: Abandoned) Apache Whirr has been retired. > Kafka deployment on

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425521117 ## File path: docs/security.html ## @@ -767,7 +767,7 @@ 7.3 Authentication using SASL > bin/kafka-configs.sh --zookeeper localhost:2182

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425521117 ## File path: docs/security.html ## @@ -767,7 +767,7 @@ 7.3 Authentication using SASL > bin/kafka-configs.sh --zookeeper localhost:2182

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425520647 ## File path: docs/connect.html ## @@ -309,7 +311,7 @@ Connector } -We will define the FileStreamSourceTask class below. Next, we add

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425519960 ## File path: docs/connect.html ## @@ -174,7 +176,7 @@ TransformationsInsertField - Add a field using either static data or record metadata

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425519960 ## File path: docs/connect.html ## @@ -174,7 +176,7 @@ TransformationsInsertField - Add a field using either static data or record metadata

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425518608 ## File path: docs/connect.html ## @@ -129,9 +129,11 @@ TransformationsThe file source connector reads each line as a String. We will wrap each line in a

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425518608 ## File path: docs/connect.html ## @@ -129,9 +129,11 @@ TransformationsThe file source connector reads each line as a String. We will wrap each line in a

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425517884 ## File path: docs/connect.html ## @@ -103,7 +103,7 @@ Configuring Connecto topics.regex - A Java regular expression of topics to use as input

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425517884 ## File path: docs/connect.html ## @@ -103,7 +103,7 @@ Configuring Connecto topics.regex - A Java regular expression of topics to use as input

[GitHub] [kafka] showuon commented on a change in pull request #8623: MINOR: Update the documentations

2020-05-14 Thread GitBox
showuon commented on a change in pull request #8623: URL: https://github.com/apache/kafka/pull/8623#discussion_r425517411 ## File path: docs/connect.html ## @@ -32,7 +32,7 @@ 8.1 Overview 8.2 User Guide -The quickstart provides a brief example of how to run a

[GitHub] [kafka] mjsax commented on a change in pull request #8670: KAFKA-10001: Should trigger store specific callback if it is also a listener

2020-05-14 Thread GitBox
mjsax commented on a change in pull request #8670: URL: https://github.com/apache/kafka/pull/8670#discussion_r425514013 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StoreChangelogReader.java ## @@ -522,6 +523,12 @@ private void

[jira] [Commented] (KAFKA-9981) Running a dedicated mm2 cluster with more than one nodes,When the configuration is updated the task is not aware and will lose the update operation.

2020-05-14 Thread victor (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107816#comment-17107816 ] victor commented on KAFKA-9981: --- A new topic/partition  is created, but the data is not synchronized. >

[jira] [Updated] (KAFKA-10001) Store's own restore listener should be triggered in store changelog reader

2020-05-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10001: -- Description: Streams' state store ``register()`` function passed in `restoreCallback` can

[jira] [Assigned] (KAFKA-10001) Store's own restore listener should be triggered in store changelog reader

2020-05-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-10001: - Assignee: Guozhang Wang > Store's own restore listener should be triggered in store

[jira] [Created] (KAFKA-10001) Store's own restore listener should be triggered in store changelog reader

2020-05-14 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10001: - Summary: Store's own restore listener should be triggered in store changelog reader Key: KAFKA-10001 URL: https://issues.apache.org/jira/browse/KAFKA-10001

[GitHub] [kafka] guozhangwang opened a new pull request #8670: MINOR: Should trigger store specific callback if it is also a listener

2020-05-14 Thread GitBox
guozhangwang opened a new pull request #8670: URL: https://github.com/apache/kafka/pull/8670 The store's registered callback could also be a restore listener, in which case it should be triggered along with the user specified global listener as well. ### Committer Checklist

  1   2   >