Slack digest for #general - 2020-03-25

2020-03-25 Thread Apache Pulsar Slack
2020-03-24 11:15:06 UTC - ikeda: Hi, I’m researching Pulsar because I’m interested in geo replication. Is there any limitation to the number of regions(clusters)? The architecture which has 5 to 10 clusters is highly feasibile architecture? Please let me know if you have any ideas or use case

Unexpected behavior with Key_Shared (Multiple messages with the same key go to different consumers)

2020-03-25 Thread Hiroyuki Yamada
Hi, I'm checking Key_Shared feature and faced some unexpected behavior. What happened roughly is, multiple messages with the same key go to different consumers (consumer threads) even though Key_Shared is set. Also, the distribution of messages to consumers is quite skewed. Let me explain what I

Re: Unexpected behavior with Key_Shared (Multiple messages with the same key go to different consumers)

2020-03-25 Thread Sijie Guo
Hi Hiroyuki, > First, multiple messages with the same key go to the same consumer thread as described below. If there is a new consumer joining a subscription, the key distribution will be split. So you are expected to see the messages of a key is dispatched from one consumer to another consumer.

Re: Unable to consume messages, need to re-subscribe or restart

2020-03-25 Thread Sijie Guo
Hi Gaurav, There are a couple of things to check. 1) Which version of Pulsar are you using? 2) Which language of Pulsar client are you using? 3) Did your consumers acknowledge the messages after processing them? 4) When the issue happens, did you happen to capture the stats of the topic? You can

#TGIPulsar Episode 003 - Secure a Pulsar cluster with TLS

2020-03-25 Thread Sijie Guo
Hi all, Our weekly live stream "TGI Pulsar" ( https://www.youtube.com/channel/UCywxUI5HlIyc0VEKYR4X9Pg/live) continues this week. In this week's episode, we are going to talk about how to secure a Pulsar cluster with TLS. It will cover not only brokers and proxies but also bookies as well. If you

Re: Unexpected behavior with Key_Shared (Multiple messages with the same key go to different consumers)

2020-03-25 Thread Hiroyuki Yamada
Hi, Thank you Sijie > > If there is a new consumer joining a subscription, the key distribution > > will be split. So you are expected to see the messages of a key is > > dispatched from one consumer to another consumer. If the consumers of a > > subscription are stable, you will see the messa