Re: [ANNOUNCE] Yubiao Feng as new PMC member in Apache Pulsar

2024-01-09 Thread
Congrats! Yubiao. Thanks, Bo Max Xu 于2023年11月14日周二 11:10写道: > > Congratulations! Yubiao, well deserved > > Best, > Max Xu > > > On Mon, Nov 13, 2023 at 3:37 PM mattison chao > wrote: > > > Dear Community, > > > > We are thrilled to announce that Yubiao Feng > > https://github.com/poorbarcode

Re: [VOTE] PIP-301: Introduce LoadBalanceResources to unify the load-date CRUD

2023-09-19 Thread
+1 (binding) Thanks, Bo

Re: [VOTE] PIP-290 Support WSS E2E encryption and not need to expose the private key to the WebSocket Proxy

2023-08-23 Thread
+1 (binding) The changes are minimal, and the concept is easy for users to understand. I support this PIP. Thanks, Bo Yubiao Feng 于2023年8月23日周三 10:49写道: > > Hi Mattison > > > but anyway. IMO, it's better to split the > > implementation PR into multiple that > > will help the reviewer review

[DISCUSS] PIP-285: Add pulsar_subscription_back_log_duration metric

2023-07-24 Thread
Hi, Pulsar Community I opened a new PIP design PR. https://github.com/apache/pulsar/pull/20859 Thanks, Bo

Re: [VOTE] PIP-275: Introduce topicOrderedExecutorThreadNum to deprecate numWorkerThreadsForNonPersistentTopic in configuration

2023-06-19 Thread
+1(binding) Thanks, Bo houxiaoyu 于2023年6月19日周一 14:04写道: > > Hi, community: > > This thread is to start a vote for PIP-275: Introduce > topicOrderedExecutorThreadNum to deprecate > numWorkerThreadsForNonPersistentTopic in configuration. > > Discussion thread: >

Re: [VOTE] PIP-251 Enhancing Transaction Buffer Stats and Introducing TransactionBufferInternalStats API

2023-05-11 Thread
+1(binding) Thanks, Bo Nicolò Boschi 于2023年5月11日周四 16:38写道: > > +1 binding > > I'm happy that we're going to improve the monitoring tools for > transactions, > which is probably the aspect that is lacking more from a user perspective > > > Nicolò Boschi > > > Il giorno mer 10 mag 2023 alle ore

Re: [Python] Should we make the schema default compatible with Java client?

2023-03-30 Thread
be fixed. > > Thanks, > Yunze > > On Thu, Mar 30, 2023 at 8:42 PM 丛搏 wrote: > > > > Hi, Yunze: > > > > > Regarding the 1st question, yes, that's why I open this thread to > > > discuss. If we change these default values, the behavior of new Py

Re: [Python] Should we make the schema default compatible with Java client?

2023-03-30 Thread
ng, > Node.js clients, they all do not support generating schema definition > from a DTO. > > Thanks, > Yunze > > On Thu, Mar 30, 2023 at 10:14 AM 丛搏 wrote: > > > > Hi, Yunze : > > > > 1. If the changes may cause some compatibility issues. > > H

Re: [Python] Should we make the schema default compatible with Java client?

2023-03-29 Thread
Hi, Yunze : 1. If the changes may cause some compatibility issues. How do we solve the compatibility issues? It may be a breaking change. 2. Another question is if sorting is enabled by default, is the sorting rule the same as java or other clients? Putting aside the above two problems, I think

Re: [DISCUSS] Change PIP template

2023-03-29 Thread
+1 Good discussion! Thanks, Bo Asaf Mesika 于2023年3月29日周三 20:11写道: > > So far only 1 PMC member reviewed it. > Any other PMC member would like to review the new template for PIP? > > On Wed, Mar 22, 2023 at 1:10 PM Asaf Mesika wrote: > > > Any other PMC member can take a look at the new

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-29 Thread
; cases involved with transaction operations. > > Thanks, > Yunze > > On Wed, Mar 29, 2023 at 12:02 PM 丛搏 wrote: > > > > Hi, all : > > > > Thanks to everyone who discussed it. > > > > Our current care points include the following aspects: > > &g

Re: [VOTE] PIP-254: Support configuring client version with a description suffix

2023-03-29 Thread
+1 (binding) Thanks, Bo Lin Lin 于2023年3月27日周一 17:49写道: > > +1 > > Thanks, > Lin Lin > > On 2023/03/15 07:54:20 Yunze Xu wrote: > > Hi all, > > > > This thread is to start the vote for PIP-254. > > > > Discussion thread: > > https://lists.apache.org/thread/65cf7w76tt23sbsjnr8rpfxqf1nt9s9l > > >

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-28 Thread
the configuration, or currently has a startMessageId closed loop solution, I agree to use startMessageId. As for the reset cursor, I think it is another problem, not related to this PIP. Thanks, Bo 丛搏 于2023年3月24日周五 18:53写道: > > Hi, Michael: > > I thought about it carefully, and using 'st

Re: [ANNOUNCE] Qiang Zhao as new PMC member in Apache Pulsar

2023-03-28 Thread
Congrats! Thanks, Bo Baodi Shi 于2023年3月29日周三 11:29写道: > > Congrats! Qiang. > > > Thanks, > Baodi Shi > > > 在 2023年3月29日 11:27:58 上,Horizon <1060026...@qq.com.invalid> 写道: > > > Congrats! > > > > 2023年3月29日 11:24,tison 写道: > > > > > > Congrats! > > > > > >

Re: [DISCUSS] Cherry-pick #15121 into branch-2.10 to solve the issue sasl authentication failure

2023-03-28 Thread
+1 (Solution 2) Thanks, Bo PengHui Li 于2023年3月29日周三 09:47写道: > > Looks good to me to make it optional in branch-2.10 since we don't want to > introduce any break behaviors in the subsequent patch releases. > > Thanks, > Penghui > > On Tue, Mar 28, 2023 at 9:39 PM Dezhi Liu wrote: > > > I agree

Re: [VOTE] Pulsar Release 2.9.5 Candidate 2

2023-03-28 Thread
+1 (binding) os: mac 12.3.1, Intel java: OpenJDK 17.0.1 - Checked the signature - Checked LICENSE - Start standalone - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source package (maven 3.8.6, openJDK 17.0.1) - Run a simple

Re: [VOTE] Pulsar Release 2.11.1 Candidate-1

2023-03-27 Thread
+1 (binding) system: mac os 12.6, Apple M1 maven: 3.8.5 java: OpenJDK 17.0.3 - Checked the signature - Checked LICENSE - Start standalone with zookeeper stream storage - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source

Re: [VOTE] Pulsar Release 2.10.4 Candidate 3

2023-03-27 Thread
- Build from the source package (maven 3.8.6, openJDK 11.0.12) - Run a simple transaction check Thanks, Bo 丛搏 于2023年3月27日周一 18:20写道: > > Hi, Xiangying: > > I found in > https://dist.apache.org/repos/dist/dev/pulsar/pulsar-2.10.4-candidate-3/connectors/ > has two pulsar-io-debeziu

Re: [VOTE] Pulsar Release 2.10.4 Candidate 3

2023-03-27 Thread
Hi, Xiangying: I found in https://dist.apache.org/repos/dist/dev/pulsar/pulsar-2.10.4-candidate-3/connectors/ has two pulsar-io-debezium-mssql-2.10.4.nar Thanks, Bo guo jiwei 于2023年3月23日周四 18:27写道: > > +1 (binding) > > - Checked the signature > - Checked LICENSE > - Publish and consume

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-24 Thread
tal to > > this PIP and should not be ignored. At the very least, I think we need > > to have an idea of what the future solution would be before we defer > > its implementation. > > > > Thanks, > > Michael > > > > > > On Tue, Mar 21, 2023

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-24 Thread
ion. We can't ensure the consumer will not receive > duplicate messages, right? If yes, we should mention it in the proposal. good point! Yes, I will add it to the proposal. Thanks, Bo > > Thanks, > Penghui > > On Wed, Mar 22, 2023 at 3:28 PM 丛搏 wrote: > > > Hi, Michael

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-24 Thread
the consumer, > > but the message processing failed due to some temporary failures. > > So, they want to redeliver all the received messages and try again. > > In this case, we should not filter the messages. > > > > And for a failover subscription. The active consumer m

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-22 Thread
t thinking. You can do what you want, I can do what I want. Thanks, Bo > > Thanks, > Michael > > > On Tue, Mar 21, 2023 at 10:52 PM 丛搏 wrote: > > > > Hi, Michael > > > In this case, the consumer does not have the source of truth for the > > > readPositi

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-21 Thread
implementation that can achieve at least in the java client. Thanks, Bo > > Thanks, > Michael > > On Tue, Mar 21, 2023 at 9:29 PM 丛搏 wrote: > > > > Hi, Michael: > > > > Michael Marshall 于2023年3月21日周二 23:17写道: > > > > > > > > One more point.

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-21 Thread
ic > `MessageId#compareTo` API. If hiding these details in SDK still > requires users to know these details, I think it would not be better > than doing that explicitly in the application. > > Thanks, > Yunze > > On Wed, Mar 22, 2023 at 10:29 AM 丛搏 wrote: > > >

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-21 Thread
0b/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ConsumerImpl.java#L789-L795 > > [3] > > https://github.com/apache/pulsar/blob/af1360fb167c1f9484fda5771df3ea9b21d1440b/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ConsumerImpl.java#L922-L960 > > > > On Tu

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-21 Thread
ed if the subscription type is Exclusive or > > Failover. > > > > Is there any breaking change if we just apply this filter without > > adding a configuration option? > > > > Thanks, > > Yunze > > > > On Tue, Mar 21, 2023 at 2:26 

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-21 Thread
e been reset. As described in Compatibility in PIP. Client consumer doesn't know Pulsar Admin reset cursor. > > Thanks, > Yunze > > On Tue, Mar 21, 2023 at 2:26 PM 丛搏 wrote: > > > > Hi, Michael > > > > Michael Marshall 于2023年3月21日周二 13:03写道: > > > >

Re: [VOTE] PIP-259: Make the config httpMaxRequestHeaderSize of the pulsar web server to configurable

2023-03-21 Thread
+1 (binding) Thanks, Bo Yubiao Feng 于2023年3月20日周一 17:11写道: > > Hi Pulsar Community > > This thread is to start the vote for PIP 259. > > Discussion: https://lists.apache.org/thread/f11cld5cbc8sodhgvs5s28lw8nxsr9dc > Issue: https://github.com/apache/pulsar/issues/19826 > Implementation:

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-21 Thread
messages. It will make this > > > config unclear, and if every redeliver > > > > method changes, it will bring a lot of redundant code, which is > > > > difficult > > > to maintain. If there is a need in the > > > > future, just support it. >

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-20 Thread
> future, just support it. > > > > I suppose you want to say not support `redeliverUnacknowledgedMessages`, > > right? > > > > > > Thanks > > Yubiao Feng > > > > On Mon, Mar 20, 2023 at 10:21 PM 丛搏 wrote: > > > > > Hi, pulsar community: > > > > > > I started a PIP about `Client consumer filter received messages`. > > > > > > PIP: https://github.com/apache/pulsar/issues/19864 > > > > > > Thanks, > > > Bo > > > > >

Re: [DISCUSS] PIP-260: Client consumer filter received messages

2023-03-20 Thread
If there is a need in the > > future, just support it. > > I suppose you want to say not support `redeliverUnacknowledgedMessages`, > right? we only support `redeliverUnacknowledgedMessages` to clear the record in client consumer, any other redeliver method doesn't support > >

[DISCUSS] PIP-260: Client consumer filter received messages

2023-03-20 Thread
Hi, pulsar community: I started a PIP about `Client consumer filter received messages`. PIP: https://github.com/apache/pulsar/issues/19864 Thanks, Bo

Re: [DISCUSS] PIP-259: Make the config httpMaxRequestHeaderSize of the pulsar web server to configurable

2023-03-17 Thread
g > request line, the internal client must also process a long request line. > And this problem can be solved by making configuration > `httpClientRequestBufferSize` configurable. > > > Thanks > Yubiao Feng > > > On Thu, Mar 16, 2023 at 8:12 PM 丛搏 wrote: > > &g

Re: [DISCUSS] PIP-259: Make the config httpMaxRequestHeaderSize of the pulsar web server to configurable

2023-03-16 Thread
hi yubiao : I have a question, why we need `httpClientRequestBufferSize ` in proxy, can you explain in detail? Thanks, Bo Yubiao Feng 于2023年3月16日周四 00:11写道: > > Hi community > > I am starting a DISCUSS for "PIP-259: Make the config > httpMaxRequestHeaderSize of the pulsar web server

Re: [DISCUSS] Retry topic should not create for a retry topic

2023-03-10 Thread
+1, I agree with you. We should prohibit users from creating Retry Topic and DLQ Topic in a loop. It will make uncontrollable behavior. If we allow that, It may cause great trouble to users. Thanks, Bo Asaf Mesika 于2023年2月14日周二 03:02写道: > > Sounds like a bug for sure. > How did you plan on

Re: [VOTE] Pulsar Client Python Release 3.1.0 Candidate 4

2023-03-10 Thread
+1 (binding) python version: 3.7.6 - Checked the signature - Install the python .whl file (pulsar_client-3.1.0-cp37-cp37m-macosx_10_15_universal2.whl) on macOS 12.3.1 - Start the standalone (2.11.0) - Start consumer (python3 ./examples/consumer.py) - Start producer (python3

Re: [VOTE] Pulsar Release 2.10.4 Candidate 1

2023-03-08 Thread
+1 (binding) os: mac 12.3.1, Intel java: OpenJDK 17.0.1 - Checked the signature - Checked LICENSE - Start standalone - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source package (maven 3.6.1, openJDK 11.0.12) - Run a simple

Re: [DISCUSS] PIP-246: Improved PROTOBUF_NATIVE schema compatibility checks without using avro-protobuf

2023-03-08 Thread
opic level? Or perfect it > here? > > Add a call PROTOBUF_NATIVE_ADVANCE schemaType corresponding > ProtobufNativeAdvancedSchemaCompatibilityCheck? (Seems to be more trouble). > > Sorry I can not use the computer and network in the company, I use my > mobile phone to reply to the email,

Re: [DISCUSS] PIP-246: Improved PROTOBUF_NATIVE schema compatibility checks without using avro-protobuf

2023-03-07 Thread
ink it didn't change the logic, it > just allowed him to expand it. > > > I think this PIP should be an enhancement and supplement to the function, > and there is no such thing as unnecessary and meaningless. > > > Thanks, > sinan > > > > > > 丛搏 于2023年3月7日周二 11:5

Re: [DISCUSS] PIP-246: Improved PROTOBUF_NATIVE schema compatibility checks without using avro-protobuf

2023-03-06 Thread
I think we have two ways to do that. First way: We need to advance the improvement of java in protobuf. Ask if they have plans to improve. Second way: the new PROTOBUF_NATIVE `SchemaCompatibilityCheck` should be implemented as a plugin, don't change any existing plugin logic (it's simple and

Re: [Vote] PIP-245: Make subscriptions of non-persistent topic non-durable

2023-03-06 Thread
+1 (binding) Thanks, Bo guo jiwei 于2023年3月6日周一 19:10写道: > > +1 (binding) > > Regards > Jiwei Guo (Tboy) > > On Mon, Mar 6, 2023 at 9:59 AM Yunze Xu wrote: > > > > +1 (binding) > > > > Thanks, > > Yunze > > > > On Fri, Mar 3, 2023 at 11:46 AM PengHui Li wrote: > > > > > > +1 (binding) > > > >

Re: [VOTE][PIP-242] Topic name restriction

2023-02-21 Thread
+1 binding avinash kala 于2023年2月21日周二 15:21写道: > > +1 > > On Tue, Feb 21, 2023, 12:44 PM Haiting Jiang wrote: > > > +1 binding > > > > Haiting > > > > On Tue, Feb 21, 2023 at 3:07 PM guo jiwei wrote: > > > > > > +1 (binding) > > > > > > > > > Regards > > > Jiwei Guo (Tboy) > > > > > > On Mon,

Re: [VOTE] Pulsar Client C++ Release 3.1.2 Candidate 1

2023-02-14 Thread
gt; > [persistent://public/default/partition-testMessageListenerPause-partition-0, > > standalone-0-0] , [batchMessageContainer = { BatchMessageContainer > > [size = 0] [bytes = 0] [maxSize = 1000] [maxBytes = 131072] [topicName > > = > > persistent://public/default/parti

Re: [VOTE][PIP-240] A new API to unload subscriptions

2023-02-12 Thread
+1 (binding) Thanks, Bo 易客 萧 于2023年2月13日周一 09:51写道: > > +1 (non-binding) > > From: Yubiao Feng > Sent: Sunday, February 12, 2023 20:04 > To: dev@pulsar.apache.org > Subject: [VOTE][PIP-240] A new API to unload subscriptions > > Hi Pulsar Community > > I would

Re: [VOTE] Pulsar Client C++ Release 3.1.2 Candidate 1

2023-02-09 Thread
I run ./pulsar-tests block, ``` [ RUN ] BasicEndToEndTest.testMessageListenerPause 2023-02-10 14:53:57.415 INFO [0x101084580] BasicEndToEndTest:922 | res = 204 2023-02-10 14:53:57.415 INFO [0x101084580] ClientConnection:190 | [ -> pulsar://localhost:6650] Create ClientConnection,

Re: [VOTE] Pulsar Client Python Release 3.1.0 Candidate 2

2023-02-02 Thread
+1(binding) os: mac 12.6 python: 3.9.6 python3 ./examples/consumer.py python3 ./examples/producer.py Thanks, Bo Matteo Merli 于2023年2月3日周五 03:26写道: > > +1 > -- > Matteo Merli > > > On Thu, Feb 2, 2023 at 5:57 AM Yunze Xu wrote: > > > > This is the 2nd release candidate for Apache Pulsar

Re: [Vote] PIP-242: Introduce enableStrictTopicName to reject creating topic with -partition- keyword.

2023-01-31 Thread
+1 (binding) Thanks, Bo ZhangJian He 于2023年1月31日周二 16:52写道: > > +1 (non-binding) > > Thanks > ZhangJian He > > > On Tue, 31 Jan 2023 at 16:51, PengHui Li wrote: > > > +1 (binding) > > > > Penghui > > > > On Tue, Jan 31, 2023 at 3:52 PM Nitin Goyal > > wrote: > > > > > +1 (non-binding) > > > >

Re: [DISCUSS] PIP-240 A new API to unload subscriptions

2023-01-12 Thread
> I would invest more time in: > - monitoring tools (tools to detect quickly stuck consumers) > - circuit breakers (fast fail/shut the door to consumers/producers > that don't behave correctly) > - guard rails (limits to clients to prevent them to exhaust the resources on the brokers) I agree

Re: [DISCUSS] Registering Jackson Java 8 support modules by default for all Pulsar components, including client

2023-01-09 Thread
Hi, Lari: Will it affect compatibility? If it is just an improved function, I think it can also be added to the pulsar-common module. it adds the dependency, so it needs PIP to discuss. Thanks, Bo Lari Hotari 于2023年1月9日周一 19:06写道: > > Hi all, > > Jackson has a separate Java 8 support modules

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-05 Thread
the negative schema type in PulsarApi.proto, how could > you explain to users that the "new" schema type is a negative integer? > And for developers, the negative schema types should not have the > schema info, but you create a schema info for it. > > Thanks, >

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-05 Thread
None; > > > > > > > } else { > > > > > > > return Schema.Type.valueOf(type.getValue()); > > > > > > > } > > > > > > > } > > > > > > > ``` > > > > > > > >

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-04 Thread
registry. > > > > Instead, it should be "carrying schema in the request when subscribing > > > > with AUTO_CONSUME schema". > > > > > > > > > > > > > I agree that we should change the naming and we should probably not use a > &g

Re: [VOTE] Pulsar Release 2.11.0 Candidate-5

2023-01-04 Thread
+1 (non-binding) system: mac os 12.6, Apple M1 maven: 3.8.5 java: OpenJDK 17.0.3 - Checked the signature - Checked LICENSE - Start standalone with zookeeper stream storage - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source

[ANNOUNCE] Apache Pulsar 2.9.4 released

2023-01-03 Thread
The Apache Pulsar team is proud to announce Apache Pulsar version 2.9.4. Pulsar is a highly scalable, low latency messaging platform running on commodity hardware. It provides simple pub-sub semantics over topics, guaranteed at-least-once delivery of messages, automatic cursor management for

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread
+1 (non-binding) Thanks, Bo 丛搏 于2023年1月3日周二 16:56写道: > > Hi, Yunze > > What I am concerned about is that if the old clients with other > > schemas (i.e. schema is neither null nor AUTO_CONSUME) subscribe to > > the topic with AUTO_CONSUME schema, what will happen?

Re: [DISCUSS] PIP-236: Upload AUTO_CONSUME SchemaType to Broker

2023-01-03 Thread
Hi, Yunze > What I am concerned about is that if the old clients with other > schemas (i.e. schema is neither null nor AUTO_CONSUME) subscribe to > the topic with AUTO_CONSUME schema, what will happen? AUTO_CONSUME schema will not store in `SchemaRegistryServiceImpl`, it only represents one

Re: [ANNOUNCE] Yunze Xu as a new PMC member in Apache Pulsar

2022-12-29 Thread
Congratulations! Yunze Thanks, Bo Max Xu 于2022年12月29日周四 20:45写道: > > Congratulations! Yunze > > Best, > Max Xu > > > On Thu, Dec 29, 2022 at 8:42 PM Haiting Jiang > wrote: > > > Hi all, > > > > The Apache Pulsar Project Management Committee (PMC) has invited Yunze Xu > >

Re: [DISCUSS] Reject create non-existent persistent partitions.

2022-12-28 Thread
Hi Mattison, > Should we allow the user to create the non-partitioned topic name like > `persistent://tenant/namespace/localname-partition-0`? I think we should disallow creation. This will cause the partition metadata to be incorrect. If the current behavior is to allow the creation,

Re: [VOTE] Pulsar Release 2.9.4 Candidate 3

2022-12-28 Thread
the discussion in the issue, I think we should not add support > > > for Apple M1 in old branches. > > > We don't do major version upgrades of BK in pulsar minor versions. > > > > > > And I will continue to verify this version on the Intel chips based > > >

Re: [DISCUSS] Reject create non-existent persistent partitions.

2022-12-28 Thread
Hi Mattison, I'm not sure if this is the current behavior, I left a comment in the PR Thanks, Bo Enrico Olivelli 于2022年12月28日周三 16:27写道: > > I agree with you. > > Please note that the new test case is about non-persistent topics > > is it expected ? > > Enrico > > Il giorno mer 28 dic 2022

Re: [VOTE] Pulsar Release 2.10.3 Candidate 1

2022-12-27 Thread
+1 (non-binding) system: mac os 12.3.1, Intel maven: 3.6.1 java: OpenJDK 17.0.1 - Checked the signature - Checked LICENSE - Start standalone - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source package - Run a simple

Re: [VOTE] Pulsar Release 2.11.0 Candidate-4

2022-12-27 Thread
+1 (non-binding) system: mac os 12.6, Apple M1 maven: 3.8.5 java: OpenJDK 17.0.3 - Checked the signature - Checked LICENSE - Start standalone with zookeeper stream storage - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source

Re: [VOTE] Pulsar Release 2.9.4 Candidate 3

2022-12-24 Thread
t; +1 (non-binding) > >> > > >> > - Checked the signature > >> > - Build from source > >> > - Start standalone with KoP 2.9.3.20 > >> > - Verified Pulsar client 2.9.4, master (05e6f5e3), and Kafka clients >

Re: [VOTE] Pulsar Release 2.9.4 Candidate 3

2022-12-24 Thread
t; > - Validate Pub/Sub and Java Functions > > > - Validate Cassandra connector > > > - Validate Stateful Functions > > > > > > Thanks, > > > Xiangying > > > > > > On Thu, Dec 15, 2022 at 10:25 AM PengHui Li wrote: > > >

Re: [DISCUSS] The use of consumer redeliverUnacknowledgedMessages method

2022-12-23 Thread
manner, he cannot call the ‘reconumserLater` and > 'negativeAcknowledge' methods? > > > > 2022年12月23日 11:30,丛搏 写道: > > > > Hi, Asaf, Baodi: > > > > I'm very sorry for my late reply. Thanks for your discussion. > > > >> - receive() - get the fol

Re: [DISCUSS] Move GitHub discussion notifications to commits@

2022-12-22 Thread
+1 for pointing to the user list. Thanks, Bo Dave Fisher 于2022年12月23日周五 12:48写道: > > > > Sent from my iPhone > > > On Dec 22, 2022, at 7:00 PM, PengHui Li wrote: > > > > Is it better to point to user@ list? > > I noticed that most discussions are user-facing issues(Requirements, > >

Re: [DISCUSS] The use of consumer redeliverUnacknowledgedMessages method

2022-12-22 Thread
clear. > > > > In those types of subscriptions, it seems that the only actions you are > > > > supposed to do are: > > > > > > 1. receive(): get the next message. > > > > 2. cumulativeAck(msg): acknowledge all messages up to msg have been > >

Re: [VOTE] PIP-229: Add a common interface to get fields of MessageIdData

2022-12-22 Thread
+1 (non-binding) Thanks, Bo Yunze Xu 于2022年12月22日周四 20:34写道: > > Hi all, > > I'm starting the VOTE for PIP-229: Add a common interface to get > fields of MessageIdData: https://github.com/apache/pulsar/issues/18950 > > Discussion thread: >

Re: [DISCUSS] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-22 Thread
inly to express that the semantics of seek will be > modified while the acknowledge semantics keeps not changed. Now I > removed the new APIs and updated this proposal. > > Thanks, > Yunze > > > On Thu, Dec 22, 2022 at 10:55 AM 丛搏 wrote: > > > > > Users ca

Re: [DISCUSS] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-21 Thread
hui > > > > On Thu, Dec 22, 2022 at 12:35 AM Yunze Xu > > wrote: > > > >> > but it needs to cast the `TopicMessageId` from `MessageId`, which is > >> very user-unfriendly. > >> > >> Sorry I think my proposal doesn't express it well. In

Re: [DISCUSS] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-21 Thread
e thinking about using > `consumer.seek(msg.getTopicName(), msg.getMessageId()` for a single > topic consumer. If it's accepted, and you want to unify the use case > of `seek`, the original `seek` API should be deprecated and much > existing code could be affected. If

Re: [VOTE] Pulsar Client Python Release 3.0.0 Candidate 3

2022-12-21 Thread
+1 (non-binding) python version: 3.7.6 - Checked the signature - Install the python .whl file (pip3 install pulsar_client-3.0.0-cp37-cp37m-macosx_10_15_universal2.whl) on macOS 12.3.1 - Start the standalone (2.10.2) - Start consumer (python3 ./examples/consumer.py) - Start producer (python3

Re: [DISCUSS] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-21 Thread
pose > the partition concept, if we introduce the seek API with the topic > name as the argument, we have to explain in detail about what's the > topic name for a partition. It could be a very confusing thing from my > experience when I explained the "partition" concept in communit

Re: [VOTE] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-20 Thread
when I push my PR. > > Thanks, > Yunze > > On Fri, Dec 16, 2022 at 3:03 PM 丛搏 wrote: > > > > if you don't change this in PIP-229 or PIP-224, I will create a new > > PIP to handle the `BatchMessageIdImpl` and `MessageIdImpl` > > `compareTo()` method, now

Re: [DISCUSS] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-20 Thread
Hi Yunze, add `TopicMessageId ` will couple messageID and `topic name` together, which is very unclear for non-partition-topic. ``` void seek(String topicName, MessageId messageId) throws PulsarClientException; List> getLastTopicMessageId() throws PulsarClientException; ``` If the interface is

Re: [DISCUSS] PIP-229: Add a common interface to get fields of MessageIdData

2022-12-20 Thread
ssageId are > very rare and limited. This interface is introduced mainly because we > don't have a String parameter in seek and acknowledge before. It's a > tradeoff between compatibility and complexity. But the use cases of > MessageIdAdv are very common. > > Thanks, > Yu

Re: [DISCUSS] Introduce oshi library to sensory OS resources

2022-12-20 Thread
+1 (non-binding) Thanks, Bo PengHui Li 于2022年12月21日周三 11:48写道: > > +1 > > Thanks, > Penghui > > On Mon, Dec 19, 2022 at 6:19 PM wrote: > > > > > Hi, All > > > > I would like to introduce a new library oshi[1] to help Apache Pulsar > > sensory OS resources. It can help us to get away from the

Re: [DISCUSS] Change the default IO threads and listener threads of Java Client

2022-12-20 Thread
+1 Our default configuration is best for most users. Multiple clients are a few cases. Thanks, Bo houxiaoyu 于2022年12月20日周二 16:02写道: > > +1 > > This change might bring thread number increment in case users create many > clients, but too many pulsar clients run in one machine is not a good use >

Re: [VOTE] PIP-228: Refactor the information architecture of Pulsar client docs

2022-12-20 Thread
+1 (non-binding) Thanks, Bo Yu 于2022年12月21日周三 09:51写道: > > +1 > > On Tue, Dec 20, 2022 at 3:12 PM Yunze Xu > wrote: > > > +1 (non-binding) > > > > Thanks, > > Yunze > > > > On Tue, Dec 20, 2022 at 3:06 PM Zike Yang wrote: > > > > > > +1 (non-binding) > > > > > > Thanks, > > > Zike Yang > > >

Re: [DISCUSS] Proposal required for Admin API/CLI and metrics changes

2022-12-19 Thread
iewers. > And not only a committer can be a reviewer. > > For the review process and review document. It can be a separate > thread if you have any good ideas you want to share. > > Thanks, > Penghui > > > On Sat, Dec 17, 2022 at 9:16 PM 丛搏 wrote: > > > > Is

Re: [DISCUSS] PIP-229: Add a common interface to get fields of MessageIdData

2022-12-19 Thread
you have to add new > logic that sets the topic explicitly when creating the received > message. > > Thanks, > Yunze > > On Sun, Dec 18, 2022 at 3:44 PM 丛搏 wrote: > > > > < For a single-topic consumer, wrapping the topic name is > > < redundant and might

[VOTE] PIP-230: Throw exception when MessageIdImpl and BatchMessageIdImpl compare with each othe

2022-12-19 Thread
Hi, pulsar community: I start a PIP about `Throw exception when MessageIdImpl and BatchMessageIdImpl compare with each other` discussion thread: https://lists.apache.org/thread/oylkh76z1wv8h754c1tvtnspwjojqwmx PIP: https://github.com/apache/pulsar/issues/18957 PR:

Re: [DISCUSS] PIP-230: Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-19 Thread
has the risk of losing messages, because they > > will use a larger messageId to seek, ack etc. > > > > I'm a little curious why the message will lose, could you explain it? > > > > Thanks > > Yubiao > > > > On Fri, Dec 16, 2022 at 5:31 PM 丛搏 wrote:

Re: [DISCUSS] PIP-230: Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-19 Thread
geId, which has the risk of losing messages, because they > will use a larger messageId to seek, ack etc. > > I'm a little curious why the message will lose, could you explain it? > > Thanks > Yubiao > > On Fri, Dec 16, 2022 at 5:31 PM 丛搏 wrote: > > > Hi

Re: [VOTE] Pulsar Release 2.11.0 Candidate-3

2022-12-18 Thread
+1 (non-binding) system: mac os 12.6, Apple M1 maven: 3.8.5 java: OpenJDK 17.0.3 - Checked the signature - Start standalone with zookeeper stream storage - Publish and consume messages - Verified Function and State Function - Verified Cassandra connector - Build from the source package Thanks,

Re: [DISCUSS] PIP-229: Add a common interface to get fields of MessageIdData

2022-12-17 Thread
eId` in `seek` or `acknowledge` on a > multi-topics consumer. PIP-229 is more like a refactoring to allow the > experienced developers access the fields of `MessageIdData` via a > standard interface. > > [1] https://github.com/apache/pulsar/issues/18616#issuecomment-1328609346 > [2] ht

Re: [DISCUSS] Proposal required for Admin API/CLI and metrics changes

2022-12-17 Thread
> Is it time to require a proposal for Admin API/CLI and metrics changes? yes, need a proposal for Admin API/CLI and metrics changes. but It is difficult for us to judge whether a PR is a bug fix or needs PIP or doc/required through automatic detection. We can standardize the committer review

Re: [DISCUSS] PIP-229: Add a common interface to get fields of MessageIdData

2022-12-16 Thread
Abstraction based on MessageIdData is a good solution. I don't have any discussion context. Why don't we put the topic name in it? All I can think of is PulsarApiMessageId extend TopicMessageId(PIP-224[1]) right? Thanks, Bo [1] https://github.com/apache/pulsar/issues/18616 Yunze Xu

Re: [DISCUSS] PIP-230: Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-16 Thread
wrote: > > > > I support this solution. > > > > Unfortunately it is better to not port this to the previous versions > > because it is a behaviour change. > > > > Thanks for driving this effort > > > > Enrico > > > > Il giorno ven 16 dic

Re: [DISCUSS] PIP-230: Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-16 Thread
> Unfortunately it is better to not port this to the previous versions > because it is a behaviour change. > > Thanks for driving this effort > > Enrico > > Il giorno ven 16 dic 2022 alle ore 10:31 丛搏 ha scritto: > > > > Hi, pulsar community:

[DISCUSS] PIP-230: Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-16 Thread
Hi, pulsar community: I start a PIP about modifying MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method original discussion thread: https://lists.apache.org/thread/8n3oyk2hdsskkotnj4lnlvfnndctpqbg PIP: https://github.com/apache/pulsar/issues/18957 Thanks, Bo

Re: [VOTE] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-15 Thread
gt; > > > [1] https://github.com/apache/pulsar/pull/18890/files > > [2] https://lists.apache.org/thread/x52zpwlo8pxzp81oxllh5vw82kyrzgpk > > > > On Fri, Dec 16, 2022 at 11:34 AM 丛搏 wrote: > > > > > > Although unrelated, it adds a lot of confusing code. &g

Re: [DISCUSSIONS] Should we use AUTO_PRODUCE schema?

2022-12-15 Thread
t; validation always succeeds because the schema might change. The > exception is actually thrown in `TypedMessageBuilder#value`. > > But since these APIs are stable, we could only fix it by adding the > documents to describe in which cases could `TypedMessageBuilder#value` > and `Me

Re: [VOTE] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-15 Thread
Although unrelated, it adds a lot of confusing code. Thanks, Bo Yunze Xu 于2022年12月16日周五 08:05写道: > > This proposal is not related to the comparison logic between > BatchMessageIdImpl and MessageIdImpl. > > Thanks, > Yunze > > On Thu, Dec 15, 2022 at 12:58 PM 丛搏 wrote:

Re: [DISCUSS] Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-15 Thread
the topic does not exist we should > > return "not found". > > The "bug" and "breaking change" are not in contrast. What a user > thinks is a bug might be a breaking change. Would you like to open a > PIP for that? From my perspective, both modifying

Re: [VOTE] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-14 Thread
to vote until this issue clearly : Thanks, Bo 丛搏 于2022年12月14日周三 22:56写道: > > +1 (non-binding) > > Thanks, > Bo > > PengHui Li 于2022年12月14日周三 19:12写道: > > > > +1 (binding) > > > > - Penghui > > > > On Sun, Dec 11, 2022 at 6:36 AM Enrico O

Re: [DISCUSSIONS] Should we use AUTO_PRODUCE schema?

2022-12-14 Thread
(schema0.decode(student1)).send(); > ... > ``` > > Thanks, > Yunze > > On Wed, Dec 14, 2022 at 10:37 PM 丛搏 wrote: > > > > Yunze Xu 于2022年12月14日周三 20:37写道: > > > > > > > how do you can create two Student.class in one java process? and use >

Re: [DISCUSS] Modify MessageIdImpl and BatchMessageIdImpl compareTo(MessageId o) method

2022-12-14 Thread
s > compare two message ids. > static int legacyCompare(MessageIdDataInterface lhs, > MessageIdDataInterface rhs) { /* ... */ } > > static int compare(MessageIdDataInterface lhs, MessageIdDataInterface > rhs) { /* ... */ } > ``` > > [1] https://github.com/BewareMyPower/pulsar/pull/11/

Re: [VOTE] PIP-224: Introduce TopicMessageId for consumer's MessageId related APIs

2022-12-14 Thread
+1 (non-binding) Thanks, Bo PengHui Li 于2022年12月14日周三 19:12写道: > > +1 (binding) > > - Penghui > > On Sun, Dec 11, 2022 at 6:36 AM Enrico Olivelli wrote: > > > +1 (binding) > > > > Enrico > > > > Il Ven 9 Dic 2022, 10:41 Jiaqi Shen ha scritto: > > > > > +1(non-binding) > > > > > > Thanks, > >

  1   2   >