GitHub user abhilashmandaliya deleted a comment on the discussion: Bookkeeper
startup error: NoNode for /ledgers/LAYOUT
Zookeeper CLI output
```
[zk: localhost:2181(CONNECTED) 2] ls /
[zookeeper]
[zk: localhost:2181(CONNECTED) 3]
```
GitHub link:
https://github.com/apache/pulsar/discussions/
GitHub user abhilashmandaliya added a comment to the discussion: Bookkeeper
startup error: NoNode for /ledgers/LAYOUT
Zookeeper CLI output
```
[zk: localhost:2181(CONNECTED) 2] ls /
[zookeeper]
[zk: localhost:2181(CONNECTED) 3]
```
GitHub link:
https://github.com/apache/pulsar/discussions/19
GitHub user yehancha edited a discussion: How to tweak a Pulsar cluster to have
a large number of topics with a reasonable throughput
My requirement is to create 200K topics and get 100K msg/s throughput across
all those topics. (Each topic gets 1 msg every 2 seconds and these are 1KB
message
GitHub user dao-jun added a comment to the discussion: [Bug] pulsar
分区topic通过接口创建，直接报错
1. Please explain yourself in English in the community.
2. According the context you provided, I think you missed some parameters
 and you can start with
th
GitHub user jak78 edited a comment on the discussion: How to start to
understand and learn this technology?
Hi @XiaoYaoheihei, and welcome to the community!
I would recommend enrolling in courses from [StreamNative
Academy](https://www.academy.streamnative.io/tracks)
and you can start with th
GitHub user jak78 edited a comment on the discussion: How to start to
understand and learn this technology?
Hi @XiaoYaoheihei, and welcome to the community!
I would recommend enrolling in courses from [StreamNative
Academy](https://www.academy.streamnative.io/tracks) and you can start with
th
GitHub user jak78 added a comment to the discussion: How to start to understand
and learn this technology?
Hi @XiaoYaoheihei, and welcome to the community!
I would recommend watching some videos from [StreamNative
Academy](https://www.academy.streamnative.io/tracks) and you can start with
thi
GitHub user valkenburg-prevue-ch added a comment to the discussion: Using
Pulsar inside Istio Service Mesh?
Thanks for your help. I now moved to using the streamnative Pulsar Operator as
you suggested, and indeed it works under istio without any extra effort, simply
provisioning a cluster wit
GitHub user startjava edited a discussion: about "PIP 6: Guaranteed Message
Deduplication"
https://github.com/apache/pulsar/wiki/PIP-6:-Guaranteed-Message-Deduplication
`If the state change from processing the data and the message id associated
with the data are updated atomically, then the a
GitHub user y00273676 added a comment to the discussion: Within EKS to offload
a topic to S3 got AuthorizationException
> @y00273676 Can you use the same credential to access AWS S3 successfully by
> AWS CLI? Looks like the secret key missing? You may check if it exists in the
> AWS
The secr
GitHub user zymap added a comment to the discussion: Within EKS to offload a
topic to S3 got AuthorizationException
How did you deploy pulsar to EKS? Do you have any configuration files? Do you
deploy the cluster with helm charts?
GitHub link:
https://github.com/apache/pulsar/discussions/197
GitHub user codelipenghui added a comment to the discussion: Within EKS to
offload a topic to S3 got AuthorizationException
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19791#discussioncomment-5275162
This is an
GitHub user zymap added a comment to the discussion: Within EKS to offload a
topic to S3 got AuthorizationException
@y00273676 Can you use the same credential to access AWS S3 successfully by AWS
CLI? Looks like the secret key missing? You may check if it exists in the AWS
GitHub link:
https
GitHub user y00273676 created a discussion: Within EKS to offload a topic to S3
got AuthorizationException
**Describe the bug**
As deploying Pulsar inside AWS EKS (Kubernetes hosted by AWS), while trying to
use the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY to assume the AWS
credential in o
GitHub user jak78 added a comment to the discussion: HTTP 422 Invalid schema
definition data for PROTOBUF schema
FYI the doc has been fixed:
https://pulsar.apache.org/docs/next/admin-api-schemas/
Thanks, @raymondBourges, for your feedback!
GitHub link:
https://github.com/apache/pulsar/discus
GitHub user startjava edited a discussion: about "PIP 6: Guaranteed Message
Deduplication"
https://github.com/apache/pulsar/wiki/PIP-6:-Guaranteed-Message-Deduplication
`If the state change from processing the data and the message id associated
with the data are updated atomically, then the a
GitHub user startjava added a comment to the discussion: why ”only applied once“
`Since with topic reader we can cover the the "message consumption" side, to
close the circle we need to ensure that messages are published exactly one time
in the topic.`
what is "circle",why close it ?
GitHub
GitHub user ericsyh edited a comment on the discussion: Using Pulsar inside
Istio Service Mesh?
I guess for now there are some extra efforts to make `pulsar-helm-chart`
running with Istio b/c several components have initContainers in the chart.
I didn't try hacking to disable bk's initContain
GitHub user ericsyh added a comment to the discussion: Using Pulsar inside
Istio Service Mesh?
I guess for now there are some extra efforts to make `pulsar-helm-chart`
running with Istio b/c several components have initContainers.
I didn't try hacking to disable bk's initContainers before, bu
GitHub user github-actions[bot] deleted a comment on the discussion: All
instances of the production cluster are full gc, and topic fenced cannot be
written
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19757#discussio
GitHub user keyboardbobo edited a discussion: All instances of the production
cluster are full gc, and topic fenced cannot be written
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and
found nothing similar.
There are 9 brokers and 9 bookie
GitHub user codelipenghui added a comment to the discussion: [Bug] All
instances of the production cluster are full gc, and topic fenced cannot be
written
> CPU load is relatively high
Do you see which threads consumed lots of the CPU? If you are able to reproduce
the issue. It's better to d
GitHub user tisonkun added a comment to the discussion: [Bug] All instances of
the production cluster are full gc, and topic fenced cannot be written
Moved to discussion. It's more a usage question than a bug.
GitHub link:
https://github.com/apache/pulsar/discussions/19757#discussioncomment-5
GitHub user github-actions[bot] added a comment to the discussion: [Bug] All
instances of the production cluster are full gc, and topic fenced cannot be
written
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19757#discu
GitHub user jak78 added a comment to the discussion: does Pulsar has data
repair mechanism like read repair in Cassandra?
Hi @huangydyn! Pulsar uses BookKeeper as persistence storage, and BookKeeper
has an _AutoRecovery_ mechanism. It is responsible for bringing the cluster
back to full repli
GitHub user momo-jun added a comment to the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@startjava To my best understanding, when the holding timeout is reached, it's
correct for producers to send
GitHub user sanchit-sign3 added a comment to the discussion: Want to contribute
to the Project but unable to setup IDE.
Yep. I did it all.
And the screenshot where you see that lombok annotations(ex - @Slf4j) are
not acknowledged, I explicitly marked the java folder as sources root.
It still do
GitHub user jak78 added a comment to the discussion: Want to contribute to the
Project but unable to setup IDE.
Could you double-check you have installed the Lombok plugin?
Did you also try to rebuild the project? Build -> Rebuild Project
GitHub link:
https://github.com/apache/pulsar/discussi
GitHub user sanchit-sign3 added a comment to the discussion: Want to contribute
to the Project but unable to setup IDE.
So I did the following as well:
1. Already reloaded maven modules from right click menu in any pom.xml file
2. Invalidated the cache
https://user-images.githubusercontent.com/
GitHub user tisonkun added a comment to the discussion: Want to contribute to
the Project but unable to setup IDE.
We have a setting up IDE guide https://pulsar.apache.org/contribute/setup-ide.
For your concrete case, the relativePath warning is a known issue, should not
affect indexing and c
GitHub user sanchit-sign3 edited a comment on the discussion: Want to
contribute to the Project but unable to setup IDE.
So I am using **intellij**. I configured the project to use jdk17 and maven to
use the project JDK. I am able to build the project using "mvn clean install"
via the command
GitHub user sanchit-sign3 edited a comment on the discussion: Want to
contribute to the Project but unable to setup IDE.
So I am using **intellij**. I configured the project to use jdk17 and maven to
use the project JDK. I am able to build the project using "mvn clean install"
via the command
GitHub user sanchit-sign3 edited a comment on the discussion: Want to
contribute to the Project but unable to setup IDE.
So I am using **intellij**. I configured the project to use jdk17 and maven to
use the project JDK. I am able to build the project using "mvn clean install"
via the command
GitHub user sanchit-sign3 edited a comment on the discussion: Want to
contribute to the Project but unable to setup IDE.
So I am using **intellij**. I configured the project to use jdk17 and maven to
use the project JDK. I am able to build the project using "mvn clean install"
via the command
GitHub user sanchit-sign3 edited a comment on the discussion: Want to
contribute to the Project but unable to setup IDE.
So I am using **intellij**. I configured the project to use jdk17 and maven to
use the project JDK. I am able to build the project using "mvn clean install"
via the command
GitHub user sanchit-sign3 added a comment to the discussion: Want to contribute
to the Project but unable to setup IDE.
So I am using **intellij**. I configured the project to use jdk17 and maven to
use the project JDK. I am able to build the project using "mvn clean install"
via the command
GitHub user jak78 added a comment to the discussion: Want to contribute to the
Project but unable to setup IDE.
Hi @sanchit-sign3, and welcome to the community! I'd be happy to help. Could
you please describe the issue you are facing?
GitHub link:
https://github.com/apache/pulsar/discussions
GitHub user momo-jun added a comment to the discussion: what mean
"destination_storage" and "message_age", doc not find !
@startjava you can find answers from the search results of the reference site,
like
[here](https://pulsar.apache.org/reference/#/next/pulsar-admin/namespaces?id=set-backlo
GitHub user nodece added a comment to the discussion: what mean
"destination_storage" and "message_age", doc not find !
@momo-jun Could you check that?
GitHub link:
https://github.com/apache/pulsar/discussions/19722#discussioncomment-5212636
This is an automatically sent email for commi
GitHub user sourabhaggrawal added a comment to the discussion: Bookkeeper
Direct Memory Consumption is High
I see many request to non existing namespace coming to my broker cluster, I am
checking with internal team on it already.
Is it possible so many request can lead to consumption of so mu
GitHub user sourabhaggrawal added a comment to the discussion: Bookkeeper
Direct Memory Consumption is High
Hi @lhotari, I have enabled the leak detection log with simple and after
running it for 3 days I don't see anything when I search for LEAK.
I am looking for it in bookkeeper component
GitHub user laglangyue added a comment to the discussion: [Java-client] Invalid
hostname : pulsar_e2e:6650，but curl http://pulsar_e2e:8080 is ok
I solve the question，`_` in hostname is invalid
GitHub link:
https://github.com/apache/pulsar/discussions/19714#discussioncomment-5205184
This
GitHub user laglangyue added a comment to the discussion: [Java-client] Invalid
hostname : pulsar_e2e:6650，but curl http://pulsar_e2e:8080 is ok
test code
```java
PulsarClient client = PulsarClient.builder()
.serviceUrl("pulsar://pulsar_e2e:6650").build();
Consumer subscrib
GitHub user Shoothzj added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
@Maslino would you mind rebuild a image to replace zookeeper library inside lib
directory?
GitHub link:
https://github.com/apache/pulsar/discussions/19709#discu
GitHub user tisonkun added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
Well. Then it can be a problem 🤣
GitHub link:
https://github.com/apache/pulsar/discussions/19709#discussioncomment-5199547
This is an automatically sent em
GitHub user Maslino added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
I am using the official pulsar-all docker image.
GitHub link:
https://github.com/apache/pulsar/discussions/19709#discussioncomment-5199526
This is an automa
GitHub user tisonkun added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
@Maslino I think it's because the zk client in broker classpath is >= 3.6.3.
You may try to replace the zookeeper JARs under `$PULSAR_HOME/lib` with 3.5.x
versio
GitHub user Maslino added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
[issue #14675](https://github.com/apache/pulsar/issues/14675) shows that pulsar
2.10.x is not compatible with ZK 3.5.x
When I upgrade pulsar 2.7.4 to 2.10.3 witho
GitHub user tisonkun added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
BTW, perhaps a compatible matrix helps?
GitHub link:
https://github.com/apache/pulsar/discussions/19709#discussioncomment-5199249
This is an automatically
GitHub user tisonkun edited a comment on the discussion: upgrade pulsar 2.7.x
to 2.10.x: curator and zookeeper compatibility problem
I don't remember that we use any new features of ZK/Curator on the Pulsar side,
so such ZK/Curator version shift should all work.
cc @eolivelli @merlimat
GitH
GitHub user tisonkun added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
I don't remember that we use any new features of ZK/Curator on the Pulsar side,
so such ZK/Curator version shift should all work.
cc @eolivelli
GitHub link:
h
GitHub user Shoothzj added a comment to the discussion: upgrade pulsar 2.7.x to
2.10.x: curator and zookeeper compatibility problem
I think it will works
GitHub link:
https://github.com/apache/pulsar/discussions/19709#discussioncomment-5199214
This is an automatically sent email for com
GitHub user valkenburg-prevue-ch added a comment to the discussion: Using
Pulsar inside Istio Service Mesh?
Thanks! Yes, that limitation is absolutely what is going on.
I see, so what is the most sustainable way to go: use your operator, or fork
this helm chart and simply drop the initcontai
GitHub user jak78 edited a comment on the discussion: HTTP 422 Invalid schema
definition data for PROTOBUF schema
@raymondBourges I'm happy you succeeded! I'll improve the doc. But you can also
contribute if you want, that would be amazing :-)
GitHub link:
https://github.com/apache/pulsar/d
GitHub user jak78 added a comment to the discussion: HTTP 422 Invalid schema
definition data for PROTOBUF schema
@raymondBourges I'm happy you made it! I'll improve the doc. But you can also
contribute if you want, that would be amazing :-)
GitHub link:
https://github.com/apache/pulsar/disc
GitHub user raymondBourges added a comment to the discussion: HTTP 422 Invalid
schema definition data for PROTOBUF schema
Thank you @jak78 and @visortelle,
I have a test and it's works.
But I still confusing between schema type and schema definition...
Waiting full `protobuf` support I will
GitHub user ericsyh added a comment to the discussion: Using Pulsar inside
Istio Service Mesh?
@valkenburg-prevue-ch I think your issue is caused by the [Istio
limitation](https://discuss.istio.io/t/k8s-istio-sidecar-injection-with-other-init-containers/845).
Like the issue mentioned, there i
GitHub user Maslino edited a comment on the discussion: OOM on running
pulsar-perf
What's your jdk version? I have the same problem with jdk1.8.0_181 and Pulsar
2.10.3.
update:
It's ok if client and server are in the same data center. If across geo region,
OOM. So it's related to RTT?
GitHu
GitHub user Maslino edited a comment on the discussion: OOM on running
pulsar-perf
What's your jdk version? I have the same problem with jdk1.8.0_181 and Pulsar
2.10.3
GitHub link:
https://github.com/apache/pulsar/discussions/18930#discussioncomment-5188514
This is an automatically sen
GitHub user Maslino added a comment to the discussion: OOM on running
pulsar-perf
What's your Java version? I have the same problem with Java 8 and Pulsar 2.10.3
GitHub link:
https://github.com/apache/pulsar/discussions/18930#discussioncomment-5188514
This is an automatically sent email
GitHub user startjava edited a comment on the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@momo-jun
source comment：
/** Policy which holds producer's send request until the resource
become
GitHub user startjava edited a comment on the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@momo-jun
source comment：
/** Policy which holds producer's send request until the resource
become
GitHub user startjava edited a comment on the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@momo-jun
source comment：
/** Policy which holds producer's send request until the resource
become
GitHub user startjava added a comment to the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@momo-jun
doc：
producer_request_hold | The producer holds the message and retris until client
configuration
GitHub user startjava edited a comment on the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
doc：
/** Policy which holds producer's send request until the resource
becomes available (or holdin
GitHub user startjava edited a comment on the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@merlimat @tisonkun @MarvinCai
GitHub link:
https://github.com/apache/pulsar/discussions/19695#discussion
GitHub user startjava edited a discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
```
// long sizeLimit = 2147483648L;/
long sizeLimit = 5L;// 50KB
int t
GitHub user startjava edited a discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
```
// long sizeLimit = 2147483648L;/
long sizeLimit = 5L;// 50KB
int t
GitHub user startjava edited a discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
```
// long sizeLimit = 2147483648L;/
long sizeLimit = 5L;// 50KB
int t
GitHub user startjava edited a discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
```
// long sizeLimit = 2147483648L;/
long sizeLimit = 5L;// 50KB
int t
GitHub user startjava edited a discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
```
// long sizeLimit = 2147483648L;/
long sizeLimit = 5L;// 50KB
int t
GitHub user startjava edited a discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
// long sizeLimit = 2147483648L;/
long sizeLimit = 5L;// 50KB
int timeL
GitHub user startjava added a comment to the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
@merlimat @tisonkun
GitHub link:
https://github.com/apache/pulsar/discussions/19695#discussioncomment-5184
GitHub user startjava added a comment to the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
doc：
/** Policy which holds producer's send request until the resource
becomes available (or holding
GitHub user visortelle added a comment to the discussion: HTTP 422 Invalid
schema definition data for PROTOBUF schema
Hi @raymondBourges 🙂
`PROTOBUF` schema type uses AVRO schema definition format:
https://docs.oracle.com/cd/E26161_02/html/GettingStartedGuide/avroschemas.html#avro-record-defi
GitHub user jak78 added a comment to the discussion: HTTP 422 Invalid schema
definition data for PROTOBUF schema
The human-readable version of this schema:
```json
{
"type": "record",
"name": "Personne",
"fields": [
{
"name": "nom",
"type": "str
GitHub user jak78 edited a comment on the discussion: HTTP 422 Invalid schema
definition data for PROTOBUF schema
Hi @raymondBourges, and welcome to the community!
The `schema` has to be described in JSON format.
Can you try this?
```json
{
"type":"PROTOBUF",
"properties":{},
"sc
GitHub user jak78 added a comment to the discussion: HTTP 422 Invalid schema
definition data for PROTOBUF schema
Hi @raymondBourges, and welcome to the community!
The `schema` field has to be described in JSON format.
Can you try this?
```json
{
"type":"PROTOBUF",
"properties":{},
GitHub user startjava added a comment to the discussion: use
"BacklogQuota.RetentionPolicy.producer_request_hold;"，sendTimeout exceeded(no
ack) ,but producer always retry send message！
but doc :
https://pulsar.apache.org/docs/2.11.x/cookbooks-retention-expiry/#backlog-quotas
say ：
The producer
GitHub user Apurva007 added a comment to the discussion: Topic Level Replication
Right. I thought the same. But interestingly, the guide in the pulsar docs are
not matching the actual results. So was wondering if anyone else had tried this
out.
GitHub link:
https://github.com/apache/pulsar/d
GitHub user gauravAshok added a comment to the discussion: Topic Level
Replication
I dont think so. setting this on namespace will probably enable replication for
all topics under it.
GitHub link:
https://github.com/apache/pulsar/discussions/19682#discussioncomment-5176098
This is an a
GitHub user Apurva007 added a comment to the discussion: Topic Level Replication
So in 2.11.0 these configs are enabled by default. So didnt see any issues
there.
Quick question. To set topic level replication, is the parent namespace
replication required to be enabled as well?
GitHub link:
GitHub user gauravAshok edited a comment on the discussion: Topic Level
Replication
ok. :)
Then the only thing I can think of is the pulsar broker configuration
important ones are:
systemTopicEnabled=true
topicLevelPoliciesEnabled=true
Other than the above you should look into the broker logs
GitHub user gauravAshok added a comment to the discussion: Topic Level
Replication
ok. :)
Can then the only thing I can think of is the pulsar broker configuration
important ones are:
systemTopicEnabled=true
topicLevelPoliciesEnabled=true
Other than the above you should look into the broker l
GitHub user Apurva007 added a comment to the discussion: Topic Level Replication
Yes. I ran the same command that you have specified. While typing the question
I was using example cluster names.
GitHub link:
https://github.com/apache/pulsar/discussions/19682#discussioncomment-5175973
Th
GitHub user gauravAshok edited a comment on the discussion: Topic Level
Replication
Then I think the command you meant to run for topic replication is
```shell
bin/pulsar-admin topics set-replication-clusters --clusters test-A,test-B
public/geo/geo-topic
```
GitHub link:
https://github.com/a
201 - 300 of 14389 matches
Mail list logo
