[VOTE] PIP-300: Add custom dynamic configuration for plugins

2023-09-25 Thread Zixuan Liu
Hi Pulsar Community, Voting for PIP-300: https://github.com/apache/pulsar/pull/21127 Discussion thread: https://lists.apache.org/thread/ysnsnollgy1b6w1dsvmx1t1y2rz1tyd6 Thanks, Zixuan

Re: [DISCUSS] PIP-300: Add custom dynamic configuration for plugins

2023-09-25 Thread Zixuan Liu
Hi all, Thank you for your feedback. Let's support this feature first! Thanks, Zixuan Xiangying Meng 于2023年9月26日周二 09:39写道: > > Hi Zixuan, > > This is really a great feature. I support it. > > Regarding cherry-pick, as far as I know, we have cherry-picked some > configuration items and

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-25 Thread Xiangying Meng
Hi Dave, Thanks for your support. I also think this should only be for the master branch. Thanks, Xiangying On Tue, Sep 26, 2023 at 9:34 AM Dave Fisher wrote: > > Hi - > > OK. I’ll agree, but I think the PIP ought to include documentation. There > should also be clear communication about this

Re: [DISCUSS] PIP-300: Add custom dynamic configuration for plugins

2023-09-25 Thread Xiangying Meng
Hi Zixuan, This is really a great feature. I support it. Regarding cherry-pick, as far as I know, we have cherry-picked some configuration items and interfaces into branch-2.10. But that should be mentioned in a separate discussion and provide sufficient reasons why we have to do it. Cherry-pick

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-25 Thread Dave Fisher
Hi - OK. I’ll agree, but I think the PIP ought to include documentation. There should also be clear communication about this use case and how to use it. Sent from my iPhone > On Sep 25, 2023, at 6:23 PM, Xiangying Meng wrote: > > Hi Dave, > The uncommitted transactions do not impact actual

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-25 Thread Xiangying Meng
Hi Dave, The uncommitted transactions do not impact actual users' bank accounts. Business Processing System E only reads committed transactional messages and operates users' accounts. It needs Exactly-once semantic. Real-time Monitoring System D reads uncommitted transactional messages. It does

Re: [Vote] PIP-281: Optimize Bundle Unload(Transfer) Protocol for ExtensibleLoadManager

2023-09-25 Thread Heesung Sohn
Hello, I am closing this vote as this PIP received enough +1s for approval. Vote Result: +4 bindings (Matteo, Penghui, Mattison, and Guo) +1 non-bidning (Yubiao) Thank you, Heesung On Tue, Sep 19, 2023 at 6:33 PM Yubiao Feng wrote: > +1 (no binding) > > Thanks > Yubiao Feng > > On Tue, Aug

Re: [DISSCUSS] PIP-298: Consumer supports specifying consumption isolation level

2023-09-25 Thread Dave Fisher
> On Sep 20, 2023, at 12:50 AM, Xiangying Meng wrote: > > Hi, all, > > Let's consider another example: > > **System**: Financial Transaction System > > **Operations**: Large volume of deposit and withdrawal operations, a > small number of transfer operations. > > **Roles**: > > -

Re: [VOTE] PIP-298 Consumer supports specifying consumption isolation level

2023-09-25 Thread Dave Fisher
-1 (binding) I’m not convinced that breaking transaction isolation is the proper course of action. Regards, Dave > On Sep 25, 2023, at 6:46 AM, hzh0425 wrote: > > Hi dev, > This thread is to start a vote for PIP-298 Consumer supports specifying > consumption isolation level > Discuss thread:

[VOTE] PIP-298 Consumer supports specifying consumption isolation level

2023-09-25 Thread hzh0425
Hi dev, This thread is to start a vote for PIP-298 Consumer supports specifying consumption isolation level Discuss thread: https://lists.apache.org/thread/8ny0qtp7m9qcdbvnfjdvpnkc4c5ssyld https://lists.apache.org/thread/2opqjof83425vry6gzszd5glqgryrv11 PIP:

Re: [DISCUSS] Unload Rate Limiting during Graceful Shutdown of Pulsar

2023-09-25 Thread Xiangying Meng
>I think the RateLimiter can handle it: https://github.com/apache/pulsar/blob/a1405ea006f175b1bd0b9d28b9444d592fb4a010/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/BrokerService.java#L965-L968 See here. Do you mean we make `maxConcurrentUnloadPerSec` and

Re: [DISCUSS] PIP-300: Add custom dynamic configuration for plugins

2023-09-25 Thread Zike Yang
Hi, Zixuan Thanks for your proposal. I'm +1 for it. > This is a feature I need. If cherry-pick is not allowed, then it will only be kept in 3.2+. This is a new feature, and I also think that we couldn't cherry-pick it. What about cherry-picking this change to your fork repo and building the

Re: [DISCUSS] Unload Rate Limiting during Graceful Shutdown of Pulsar

2023-09-25 Thread Zike Yang
> If we want the maximum concurrency per second to be 1, and set the maximum concurrency per minute to 60, then the actual maximum concurrency per second could be up to 60, which is 60 times larger than our expected maximum concurrency. I think the RateLimiter can handle it:

Re: [VOTE] PIP-302 Add new API readAllExistingMessages for TableView

2023-09-25 Thread Xiangying Meng
Thank you for your reminder. In our discussion, there were several changes to the specific plan and method names, which resulted in the PR title not being updated promptly. This was my oversight. The email title for the vote was not modified to match the titles of the discussed emails. Regarding

Re: [DISCUSS] Release Pulsar 3.1.1

2023-09-25 Thread Zike Yang
+1 Zike Yang On Mon, Sep 25, 2023 at 2:55 PM Enrico Olivelli wrote: > > +1 > > Enrico > > Il giorno lun 25 set 2023 alle ore 05:08 Yubiao Feng > ha scritto: > > > > +1 > > > > Thanks > > Yubiao Feng > > > > On Mon, Sep 18, 2023 at 1:32 PM guo jiwei wrote: > > > > > Hi all, > > > > > > I would

Re: [VOTE] PIP-302 Add new API readAllExistingMessages for TableView

2023-09-25 Thread Zike Yang
Hi, Xiangying This PIP is a little confusing to me. This mail title states that we are introducing `readAllExistingMessages`. But actually, we only introduced `refreshAsync` in the PIP:

Re: [DISCUSS] Unload Rate Limiting during Graceful Shutdown of Pulsar

2023-09-25 Thread Xiangying Meng
Hi Donglai, Heesung >brokerShutdownMaxNumberOfGracefulBundleUnloadPerMinute=60 is the same as brokerShutdownMaxNumberOfGracefulBundleUnloadPerSec=1 So, the "per-min" config can be more granular. I have some doubts about introducing the `brokerShutdownMaxNumberOfGracefulBundleUnloadPerMinute`

[VOTE] PIP-302 Add new API readAllExistingMessages for TableView

2023-09-25 Thread Xiangying Meng
Hi dev, This thread is to start a vote for PIP-302 Add new API readAllExistingMessages for TableView. Discuss thread: https://lists.apache.org/thread/o085y2314o0fymvx0x8pojmgjwcwn59q PIP: https://github.com/apache/pulsar/pull/21166 BR, Xiangying

Re: [DISCUSS] Release Pulsar 3.1.1

2023-09-25 Thread Enrico Olivelli
+1 Enrico Il giorno lun 25 set 2023 alle ore 05:08 Yubiao Feng ha scritto: > > +1 > > Thanks > Yubiao Feng > > On Mon, Sep 18, 2023 at 1:32 PM guo jiwei wrote: > > > Hi all, > > > > I would like to propose releasing the Pulsar 3.1.1. > > > > It's over one month since the release of 3.1.0 and

Re: [DISCUSS] Release Pulsar 3.0.2

2023-09-25 Thread Enrico Olivelli
+1 Enrico Il giorno lun 25 set 2023 alle ore 05:05 Zike Yang ha scritto: > > +1 > > BR, > Zike Yang > > On Sun, Sep 24, 2023 at 11:58 PM Dave Fisher wrote: > > > > Please use the correct name of the project - Apache Pulsar. > > > > Thanks, > > Dave > > > > Sent from my iPhone > > > > > On Sep