GitHub user liangyuanpeng added a comment to the discussion: [Question]How to
use websocket in k8s
I think it is a k8s question about use websocket.
GitHub link:
https://github.com/apache/pulsar/discussions/20171#discussioncomment-5703537
This is an automatically sent email for
GitHub user wangyun5583 created a discussion: [Question]How to use websocket in
k8s
Pulsar documents
https://pulsar.apache.org/docs/en/client-libraries-websocket/
Question
1、I configured [websocketserviceenabled = true] in [configmap] of k8s
2、Restart pod
3、What should I do next？
GitHub user sourabhaggrawal edited a comment on the discussion: Bookkeeper
Direct Memory Consumption is High
Hi @lhotari I am also seeing this error in my broker logs
10:02:31.667 [BookKeeperClientWorker-OrderedExecutor-1-0] INFO
org.apache.bookkeeper.client.PendingReadOp - Error: Bookie
GitHub user sourabhaggrawal added a comment to the discussion: Bookkeeper
Direct Memory Consumption is High
Hi @lhotari I am also seeing this error in my broker logs
10:02:31.667 [BookKeeperClientWorker-OrderedExecutor-1-0] INFO
org.apache.bookkeeper.client.PendingReadOp - Error: Bookie
GitHub user hpvd added a comment to the discussion: Pulsar Shell: native image
with GraalVM
could Quarkus provide some help moving in this direction?
see
> **Quarkus tailors your application for GraalVM** and HotSpot. Amazingly fast
> boot time, incredibly low RSS memory (not just heap
GitHub user codelipenghui added a comment to the discussion: [question]How many
consumers or producers can be created on a pulsar client?
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/20103#discussioncomment-5613741
GitHub user wmccarley added a comment to the discussion: [question]How many
consumers or producers can be created on a pulsar client?
In the Java implementation the `PulsarClient` class stores producer and
consumer instances in a set backed by a `ConcurrentHashMap` so the count is
GitHub user xuesongxs created a discussion: [question]How many consumers or
producers can be created on a pulsar client?
How many consumers or producers can be created on a pulsar client?
GitHub link: https://github.com/apache/pulsar/discussions/20103
This is an automatically sent email
GitHub user codelipenghui added a comment to the discussion: Develop for Java
Client Plusar Statistics
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/20102#discussioncomment-5613725
This is an automatically sent
GitHub user complone created a discussion: Develop for Java Client Plusar
Statistics
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always
frustrated when [...]
**Describe the solution you'd like**
I am
GitHub user prime-minister-of-fun added a comment to the discussion: Debezium
Demo Doesn't Work with 2.9.1 and Aurora 5.x
Here's the output from running pulsar standalone. I stopped it towards the end:
`2022-02-15T20:07:57,250+ [main] INFO
GitHub user github-actions[bot] added a comment to the discussion: Debezium
Demo Doesn't Work with 2.9.1 and Aurora 5.x
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/20101#discussioncomment-5613700
This is an
GitHub user github-actions[bot] added a comment to the discussion: Debezium
Demo Doesn't Work with 2.9.1 and Aurora 5.x
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/20101#discussioncomment-5613701
This is an
GitHub user tisonkun added a comment to the discussion: Pulsar Shell: native
image with GraalVM
Moved to the general discussion topic. This is hard to do because GraalVM
requires developer to help marking all reflections and resources, as well as
some subtle runtime issues.
Ref -
*
GitHub user github-actions[bot] added a comment to the discussion: Pulsar
Shell: native image with GraalVM
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/20095#discussioncomment-5611443
This is an automatically
GitHub user svabra added a comment to the discussion: [Bug] Failed to pull-up
docker-compose for broker, bookie, zk and pulsar-sql
@tisonkun thanks for having a look. Yes, as Java Developer I know. But, think
of it not for me, but for people new to Pulsar and PulsarSQL. Why are we not
GitHub user jeantil edited a discussion: pulsar admin client in
pulsar-client-all logs a ClassNotFoundException at startup
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and
found nothing similar.
### Version
2.11.0
### Minimal
GitHub user tisonkun added a comment to the discussion: [Bug] pulsar admin
client in pulsar-client-all logs a ClassNotFoundException at startup
This should be expected. The class `org.conscrypt.Conscrypt` is not shaded, and
it's logically different from the Netty's one.
Please check if it's
GitHub user tisonkun added a comment to the discussion: [Bug] Failed to pull-up
docker-compose for broker, bookie, zk and pulsar-sql
Anyway, this seems to be a usage problem instead of an issue. Moved to the Q
discussion forum.
GitHub link:
GitHub user tisonkun added a comment to the discussion: [Bug] Failed to pull-up
docker-compose for broker, bookie, zk and pulsar-sql
The error logs said "IllegalArgumentException", maybe you can change:
```
pulsar.nar-extraction-directory=System.getProperty("java.io.tmpdir")
```
to
```
GitHub user svabra added a comment to the discussion: [Bug] Failed to pull-up
docker-compose for broker, bookie, zk and pulsar-sql
I was wondering. If the CLI is triggering the Gateway, which includes the REST
service according to this [presentation](https://youtu.be/DnXu0Q0mvTM?t=962),
then
GitHub user tisonkun added a comment to the discussion: [Bug] Failed to pull-up
docker-compose for broker, bookie, zk and pulsar-sql
Also, the root cause is:
```
pulsar-sql | at
org.apache.pulsar.client.admin.internal.PulsarAdminBuilderImpl.authentication(PulsarAdminBuilderImpl.java:94)
GitHub user elysian-gc edited a comment on the discussion: when a etcd down,
bookkeeper cannot boot.
> Hello, Are you using the Etcd driver in production? Or are you only testing
> it?
>
> Are you on k8s?
>
> (Tagging @merlimat who tested etcd support)
@eolivelli thank your reply, because
GitHub user elysian-gc added a comment to the discussion: when a etcd down,
bookkeeper cannot boot.
> Hello, Are you using the Etcd driver in production? Or are you only testing
> it?
>
> Are you on k8s?
>
> (Tagging @merlimat who tested etcd support)
because other applications use etcd
GitHub user eolivelli added a comment to the discussion: when a etcd down,
bookkeeper cannot boot.
Hello,
Are you using the Etcd driver in production? Or are you only testing it?
Are you on k8s?
(Tagging @merlimat who tested etcd support)
GitHub link:
GitHub user tisonkun added a comment to the discussion: [Bug] boot broker
failed with etcd
Please open a new thread so that we can focus one by one and don't mix up
topics.
A quick answer can be: it's not errors but warnings. Generally, the client
should reconnect to other server if the
GitHub user elysian-gc added a comment to the discussion: [Bug] boot broker
failed with etcd
@tisonkun sorry,I want ask another question,when run bookie, and edit
bookkeeper.conf
GitHub user tisonkun added a comment to the discussion: Docker Swarm Deployment
> I tried the old version of pulsar and successfully deployed it using Docker
> Swarm, but the latest version failed
Can you create a reproduce repo for sharing what you exactly do and how it
fails?
GitHub link:
GitHub user dadafan added a comment to the discussion: Docker Swarm Deployment
#6264
This is a reference to previous versions that can be successful
GitHub link:
https://github.com/apache/pulsar/discussions/20038#discussioncomment-5551938
This is an automatically sent email for
GitHub user tisonkun added a comment to the discussion: [Bug] boot broker
failed with etcd
Good to know!
GitHub link:
https://github.com/apache/pulsar/discussions/19940#discussioncomment-5551289
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please
GitHub user elysian-gc added a comment to the discussion: [Bug] boot broker
failed with etcd
> Or can you try it 2.11.0? I run the same command on master and cannot
> reproduce.
thank you so much,`2.11.0` work well.
GitHub link:
GitHub user elysian-gc added a comment to the discussion: [Bug] boot broker
failed with etcd
use `IP:port`
```
root@ubuntu2-virtual-machine:/data/pulsar/bookie# ./bin/pulsar
initialize-cluster-metadata -c pulsar-cluster -cms
GitHub user tisonkun added a comment to the discussion: [Bug] boot broker
failed with etcd
Or can you try it 2.11.0? I run the same command on master and cannot reproduce.
GitHub link:
https://github.com/apache/pulsar/discussions/19940#discussioncomment-5551047
This is an
GitHub user tisonkun added a comment to the discussion: [Bug] boot broker
failed with etcd
It seems that the DNS cannot resolve your domain name `Failed to resolve name`.
Is it possible to use the `IP:port` pattern?
GitHub link:
GitHub user elysian-gc added a comment to the discussion: [Bug] boot broker
failed with etcd
pulsar version `2.10.3`，jdk version `18.0.2.1`
GitHub link:
https://github.com/apache/pulsar/discussions/19940#discussioncomment-5550956
This is an automatically sent email for
GitHub user elysian-gc added a comment to the discussion: [Bug] boot broker
failed with etcd
> @elysian-gc do you still suffer from this issue? It reads like a usage issue
> than a bug.
>
> The error log indicates that you configure the port as `-1`. I run a three
> processes etcd cluster
GitHub user chrisxrepo edited a discussion: P999 of write increases largely
while Pulsar disk reads increase
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and
found nothing similar.
### Version
v2.10.3 journal nvme + ledger hdd
###
GitHub user chrisxrepo added a comment to the discussion: P99 of write
increases largely while Pulsar disk reads increase
-done
GitHub link:
https://github.com/apache/pulsar/discussions/20017#discussioncomment-5538872
This is an automatically sent email for commits@pulsar.apache.org.
GitHub user chrisxrepo deleted a comment on the discussion: P99 of write
increases largely while Pulsar disk reads increase
ok
GitHub link:
https://github.com/apache/pulsar/discussions/20017#discussioncomment-5534436
This is an automatically sent email for commits@pulsar.apache.org.
To
GitHub user chrisxrepo added a comment to the discussion: P99 of write
increases largely while Pulsar disk reads increase
ok
GitHub link:
https://github.com/apache/pulsar/discussions/20017#discussioncomment-5534436
This is an automatically sent email for commits@pulsar.apache.org.
To
GitHub user laglangyue edited a discussion: what happend for this exception
STDOUT: 2023-04-05 14:30:05,358 CRIT uncaptured python exception, closing
channel (stdout)> (:[Errno 29] Illegal seek
[/usr/lib/python2.7/dist-packages/supervisor/supervisord.py|runforever|221]
GitHub user laglangyue edited a discussion: what happend for this exception
```log
STDOUT: 2023-04-05 14:30:05,358 CRIT uncaptured python exception, closing
channel (stdout)> (:[Errno 29] Illegal seek
[/usr/lib/python2.7/dist-packages/supervisor/supervisord.py|runforever|221]
GitHub user laglangyue edited a discussion: what happend for this exception
```text
STDOUT: 2023-04-05 14:30:05,358 CRIT uncaptured python exception, closing
channel (stdout)> (:[Errno 29] Illegal seek
[/usr/lib/python2.7/dist-packages/supervisor/supervisord.py|runforever|221]
GitHub user laglangyue edited a discussion: what happend for this exception
`
STDOUT: 2023-04-05 14:30:05,358 CRIT uncaptured python exception, closing
channel (stdout)> (:[Errno 29] Illegal seek
[/usr/lib/python2.7/dist-packages/supervisor/supervisord.py|runforever|221]
GitHub user laglangyue edited a comment on the discussion: what happend for
this exception
I notice a exception when start bellow
```log
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
error)
GitHub user laglangyue added a comment to the discussion: what happend for this
exception
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
error)
GitHub link:
GitHub user chrisxrepo edited a discussion: P99 of write increases largely
while Pulsar disk reads increase
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and
found nothing similar.
### Version
v2.10.3 journal nvme + ledger hdd
###
GitHub user tisonkun added a comment to the discussion: P99 of write increases
largely while Pulsar disk reads increase
This should be a use-case question. Moved to the Q forum.
Also, please translate the content to English for most community members
reading your questions.
GitHub link:
GitHub user laglangyue edited a comment on the discussion: Pulsar canal is not
the same as general canal json formats such as Flink cdc?
for multi row ，all row will be in data
and consumer need to split row,such as this，may I use fieldNum to spilt the row?
GitHub user laglangyue edited a comment on the discussion: Pulsar canal is not
the same as general canal json formats such as Flink cdc?
for multi row ，all row will be in data
and consumer need to split row,such as this，may I use fieldNum to spilt the row?
![Uploading image.png…]()
GitHub
GitHub user laglangyue edited a comment on the discussion: Pulsar canal is not
the same as general canal json formats such as Flink cdc?
for multi row ，all row will be in data
and consumer need to split row,such as this，may I use fieldNum to spilt the row?
GitHub user laglangyue added a comment to the discussion: Pulsar canal is not
the same as general canal json formats such as Flink cdc?
and for insert sql，all row will be in data
and consumer need to split row
GitHub link:
GitHub user codelipenghui deleted a comment on the discussion: [QUESTION]
Pulsar adapter for ogg
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19995#discussioncomment-5500270
This is an automatically sent email
GitHub user wolfstudy added a comment to the discussion: [QUESTION] Pulsar
adapter for ogg
> Hi all:
> I saw an article by Lakala on the Internet saying that messages can be
> obtained from OGG(Oracle Golden Gate) through the pulsar adapter. Is there
> any plan to develop this adapter in the
GitHub user dik111 created a discussion: [QUESTION] Pulsar adapter for ogg
Hi all:
I saw an article by Lakala on the Internet saying that messages can be obtained
from OGG(Oracle Golden Gate) through the pulsar adapter. Is there any plan to
develop this adapter in the future?
[对 Kafka 和
GitHub user codelipenghui added a comment to the discussion: [QUESTION] Pulsar
adapter for ogg
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19995#discussioncomment-5500270
This is an automatically sent email for
GitHub user laglangyue edited a discussion: Pulsar canal is not the same as
general canal json formats such as Flink cdc?
it's pulsar data about columns
it's pulsar data about flink
GitHub user laglangyue added a comment to the discussion: Pulsar canal is not
the same as general canal json formats such as Flink cdc?
because of the difference, we cann't migrate directly
GitHub link:
https://github.com/apache/pulsar/discussions/19994#discussioncomment-5500187
This
GitHub user startjava added a comment to the discussion: Which about "least 3
regions"？？
For example, assume a Pulsar instance with the following clusters us-west,
us-east, us-central, eu-central, ap-south. Also assume, each cluster has its
own local ZK servers named such as the following:
GitHub user nicoloboschi added a comment to the discussion: what mean "a
one-node cluster"
One node cluster is a Pulsar cluster deployed in a single machine, possibly in
a single process (pulsar standalone).
In these cases you'd probably have only one bookie so the all the above options
GitHub user raymondBourges edited a discussion: "cannot be cast to class" in a
pulsar function producing un new message
Hi all,
I continue to explore pulsar.
I'm trying to make a function that reroutes a message if a check fails.
Here is how the function is defined:
```
pulsar-admin
GitHub user livk-cloud added a comment to the discussion: The pulsar client
generics have an exception
Thank you for your answer, currently using Object should be the optimal solution
GitHub link:
https://github.com/apache/pulsar/discussions/19946#discussioncomment-5452739
This is an
GitHub user tisonkun added a comment to the discussion: M1 chip running docker
in centos8 virtual machine running pulsar error
Hi @spiritdxl! Pulsar has not currently released Docker image for ARM64
platform.
You can package by yourself, which is supported by
GitHub user tisonkun added a comment to the discussion: The pulsar client
generics have an exception
Another approach is to annotate the field manually:
```java
@Data
@NoArgsConstructor
@AllArgsConstructor
public static class PulsarMessage {
private LocalDateTime time;
GitHub user tisonkun added a comment to the discussion: The pulsar client
generics have an exception
Hi @livk-cloud!
Cross refer to:
* https://github.com/apache/pulsar/discussions/18849
* https://github.com/apache/avro/pull/356
* https://issues.apache.org/jira/browse/AVRO-2248
Quick answer:
GitHub user livk-cloud edited a comment on the discussion: The pulsar client
generics have an exception
```java
public class Main {
public static void main(String[] args) throws PulsarClientException {
try (PulsarClient pulsarClient = PulsarClient.builder()
GitHub user livk-cloud edited a comment on the discussion: The pulsar client
generics have an exception
```java
public class Main {
public static void main(String[] args) throws PulsarClientException {
try (PulsarClient pulsarClient = PulsarClient.builder()
GitHub user livk-cloud added a comment to the discussion: The pulsar client
generics have an exception
```java
public class Main {
public static void main(String[] args) throws PulsarClientException {
try (PulsarClient pulsarClient = PulsarClient.builder()
GitHub user jak78 added a comment to the discussion: The pulsar client generics
have an exception
Hi @livk-cloud!
Because of the Java compiler's [generics type
erasure](https://www.baeldung.com/java-type-erasure), the type information of
the `data` field of the `PulsarMessage` class is lost
GitHub user livk-cloud edited a discussion: The pulsar client generics have an
exception
The code is shown below
```java
public class Main {
public static void main(String[] args) throws PulsarClientException {
try (PulsarClient pulsarClient = PulsarClient.builder()
GitHub user ericsyh edited a discussion: [ANNOUNCEMENT] Pulsar Admin Go Library
introduction
Hi Community,
We want to announce and introduce the [Pulsar Admin Go
Library](https://github.com/streamnative/pulsar-admin-go) which has been open
sourced and cut the first release.
The original
GitHub user tisonkun added a comment to the discussion: [Bug] boot broker
failed with etcd
It will be nice if you can make a minimal repro e.g. with docker-compose.
Otherwise, it's more possible an env issue.
GitHub link:
GitHub user tisonkun added a comment to the discussion: [Bug] boot broker
failed with etcd
@elysian-gc do you still suffer from this issue? It reads like a usage issue
than a bug.
The error log indicates that you configure the port as `-1`. I run a three
processes etcd cluster and connect
GitHub user github-actions[bot] added a comment to the discussion: [Bug] boot
broker failed with etcd
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19940#discussioncomment-5442774
This is an automatically sent
GitHub user tisonkun added a comment to the discussion: Facilitate Pulsar Shell
download and installation
Since it's more as feature ideas, moved to open-ended discussion before we has
a clear plan or volunteers want to figure out how to improve the case.
GitHub link:
GitHub user shy-share added a comment to the discussion: Facilitate Pulsar
Shell download and installation
@nicoloboschi now only the msi for windows is missing?
GitHub link:
https://github.com/apache/pulsar/discussions/19938#discussioncomment-5442149
This is an automatically sent
GitHub user github-actions[bot] added a comment to the discussion: Facilitate
Pulsar Shell download and installation
The issue had no activity for 30 days, mark with Stale label.
GitHub link:
https://github.com/apache/pulsar/discussions/19938#discussioncomment-5442150
This is an
GitHub user tisonkun added a comment to the discussion: [Annoucne]: Pulsar
Admin Go Library introduction
Sounds interesting :)
GitHub link:
https://github.com/apache/pulsar/discussions/19932#discussioncomment-5436057
This is an automatically sent email for commits@pulsar.apache.org.
To
GitHub user ericsyh edited a discussion: [Annoucne]: Pulsar Admin Go Library
introduction
Hi Community,
We want to announce and introduce the [Pulsar Admin Go
Library](https://github.com/streamnative/pulsar-admin-go) which has been open
sourced and cut the first release.
The original
GitHub user tianshimoyi deleted a comment on the discussion: Does pulsar
delayed index use Heap Memory or Direct Memory？
@mattisonchao Thank you for your help, the official document has too little
introduction to the delay message, I would like to ask the next few questions
1. Does every
GitHub user tianshimoyi added a comment to the discussion: Does pulsar delayed
index use Heap Memory or Direct Memory？
@mattisonchao Thank you for your help, the official document has too little
introduction to the delay message, I would like to ask the next few questions
1. Does every
GitHub user mattisonchao added a comment to the discussion: Does pulsar delayed
index use Heap Memory or Direct Memory？
Direct. : )
Link:
https://github.com/apache/pulsar/blob/master/pulsar-common/src/main/java/org/apache/pulsar/common/util/collections/TripleLongPriorityQueue.java
GitHub
GitHub user snailxr added a comment to the discussion: Can I config the pulsar
TLS Encryption at tenant level?
@yuweisung Could you give me some steps or some links that I can refer to?
GitHub link:
https://github.com/apache/pulsar/discussions/19907#discussioncomment-5412697
This is an
GitHub user snailxr added a comment to the discussion: Can I config the pulsar
TLS Encryption at tenant level?
Thanks for your reply @yuweisung .
@jak78 Our product serves different customers who use the same Pulsar cluster,
but each customer has different security requirements.
GitHub link:
GitHub user jak78 edited a comment on the discussion: Can I config the pulsar
TLS Encryption at tenant level?
@snailxr welcome to the community! As @yuweisung wrote: this is doable but
cumbersome. @snailxr could you tell us why you want to disable TLS at the
tenant level?
GitHub link:
GitHub user jak78 added a comment to the discussion: Can I config the pulsar
TLS Encryption at tenant level?
@snailxr welcome to the community! As @yuweisung this is doable but cumbersome.
@snailxr could you tell us why you want to disable TLS at the tenant level?
GitHub link:
GitHub user yuweisung added a comment to the discussion: Can I config the
pulsar TLS Encryption at tenant level?
It is possible to do so but an operational headache.
You can turn on/off tls encryption (pulsar+ssl, or pulsar) and set the
advertisedlistener in individual brokers. Then use
GitHub user visortelle edited a comment on the discussion: Which Pulsar version
do you use in production? ️ Feb 15, 2023
️ March 22.
2.10.x is the leader, and it's a good indicator. I thought that older versions
have a bigger share.
Not sure that 12 votes can be considered a
GitHub user visortelle added a comment to the discussion: Which Pulsar version
do you use in production? ️ Feb 15, 2023
️ March 22.
2.10.x is the leader, and it's a good indicator. I thought that older versions
have much more share.
Not sure that 12 votes can be considered a
GitHub user relief-melone edited a discussion: Should Kafka Source Connector
itsself after unrecoverable error?
This is concerning the pulsar-io/kafka-source. Before I create an issue
regarding this topic I would like to have some insight if the current behaviour
is actually wrong or if
GitHub user yehancha added a comment to the discussion: How to tweak a Pulsar
cluster to have a large number of topics with a reasonable throughput
The issue seems to be with `DispatchRate` limit. In my case, I need 0.5 b/s
throughput on a single topic. I have set the dispatch rate limit to 4
GitHub user abhilashmandaliya added a comment to the discussion: Bookkeeper
startup error: NoNode for /ledgers/LAYOUT
Got some help from the community over slack. They pointed me to the cluster
metadata initialization
GitHub user tianshimoyi added a comment to the discussion: Does the
Cluster-level failover of pulsar have any requirements on the version of
pulsar? Is version 2.10 or higher required? 2.9.4 Can it be used?
Then I restart the producer code directly, and it will not switch.
