[GitHub] [pulsar] tisonkun closed issue #10958: Remove Kafka related dependencies from core-modules
tisonkun closed issue #10958: Remove Kafka related dependencies from core-modules URL: https://github.com/apache/pulsar/issues/10958 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] tisonkun commented on issue #10958: Remove Kafka related dependencies from core-modules
tisonkun commented on issue #10958: URL: https://github.com/apache/pulsar/issues/10958#issuecomment-1528335344 This can be fixed by https://github.com/apache/pulsar/pull/19468 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] tisonkun closed issue #11064: Nav bar backgroud color
tisonkun closed issue #11064: Nav bar backgroud color URL: https://github.com/apache/pulsar/issues/11064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] tisonkun commented on issue #11064: Nav bar backgroud color
tisonkun commented on issue #11064: URL: https://github.com/apache/pulsar/issues/11064#issuecomment-1528332962 Closing as stale. This website has been redesigned and the source code has been moved to `apache/pulsar-site`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] tisonkun closed issue #10719: k8s: connect to proxy URL return HTTP 502 503 error after broker restarts
tisonkun closed issue #10719: k8s: connect to proxy URL return HTTP 502 503 error after broker restarts URL: https://github.com/apache/pulsar/issues/10719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] tisonkun commented on issue #10719: k8s: connect to proxy URL return HTTP 502 503 error after broker restarts
tisonkun commented on issue #10719: URL: https://github.com/apache/pulsar/issues/10719#issuecomment-1528331670 Closing as stale. If it's still relevant to maintained versions, feel free to open a new issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] nodece merged pull request #20196: [improve][broker] Improve knownBrokers update in ModularLoadManagerImpl
nodece merged PR #20196: URL: https://github.com/apache/pulsar/pull/20196 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[pulsar] branch master updated: [improve][broker] Improve knownBrokers update in ModularLoadManagerImpl (#20196)
This is an automated email from the ASF dual-hosted git repository.
zixuan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new a362eaa8bd8 [improve][broker] Improve knownBrokers update in
ModularLoadManagerImpl (#20196)
a362eaa8bd8 is described below
commit a362eaa8bd8caf13795aba5ddbdf4edd8cec7bd0
Author: houxiaoyu
AuthorDate: Sat Apr 29 01:57:43 2023 +0800
[improve][broker] Improve knownBrokers update in ModularLoadManagerImpl
(#20196)
---
.../broker/loadbalance/impl/ModularLoadManagerImpl.java | 12 +---
1 file changed, 5 insertions(+), 7 deletions(-)
diff --git
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
index 30a2ef5cdf2..73b4f318f3a 100644
---
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
+++
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
@@ -195,7 +195,7 @@ public class ModularLoadManagerImpl implements
ModularLoadManager {
private long unloadBundleCount = 0;
private final Lock lock = new ReentrantLock();
-private Set knownBrokers = ConcurrentHashMap.newKeySet();
+private final Set knownBrokers = new HashSet<>();
private Map bundleBrokerAffinityMap;
/**
@@ -480,13 +480,11 @@ public class ModularLoadManagerImpl implements
ModularLoadManager {
checkNamespaceBundleSplit();
}
-private void cleanupDeadBrokersData() {
+private synchronized void cleanupDeadBrokersData() {
final Set activeBrokers = getAvailableBrokers();
-final Set knownBrokersCopy = new HashSet<>(this.knownBrokers);
-Collection newBrokers =
CollectionUtils.subtract(activeBrokers, knownBrokersCopy);
-this.knownBrokers.addAll(newBrokers);
-Collection deadBrokers =
CollectionUtils.subtract(knownBrokersCopy, activeBrokers);
-this.knownBrokers.removeAll(deadBrokers);
+Collection deadBrokers =
CollectionUtils.subtract(knownBrokers, activeBrokers);
+this.knownBrokers.clear();
+this.knownBrokers.addAll(activeBrokers);
if (pulsar.getLeaderElectionService() != null
&& pulsar.getLeaderElectionService().isLeader()) {
deadBrokers.forEach(this::deleteTimeAverageDataFromMetadataStoreAsync);
[pulsar] branch master updated: [improve][ci] Disable Maven http connection pooling on CI also for newer Maven versions (#20198)
This is an automated email from the ASF dual-hosted git repository. zixuan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 7ccd1ba119b [improve][ci] Disable Maven http connection pooling on CI also for newer Maven versions (#20198) 7ccd1ba119b is described below commit 7ccd1ba119b1349de4f865b0bc0e1065c6769950 Author: Lari Hotari AuthorDate: Fri Apr 28 20:55:19 2023 +0300 [improve][ci] Disable Maven http connection pooling on CI also for newer Maven versions (#20198) --- .github/workflows/ci-go-functions.yaml | 2 +- .github/workflows/ci-maven-cache-update.yaml | 2 +- .github/workflows/ci-owasp-dependency-check.yaml | 2 +- .github/workflows/pulsar-ci-flaky.yaml | 2 +- .github/workflows/pulsar-ci.yaml | 2 +- 5 files changed, 5 insertions(+), 5 deletions(-) diff --git a/.github/workflows/ci-go-functions.yaml b/.github/workflows/ci-go-functions.yaml index a34cb1a9090..f96a6d6586e 100644 --- a/.github/workflows/ci-go-functions.yaml +++ b/.github/workflows/ci-go-functions.yaml @@ -32,7 +32,7 @@ concurrency: cancel-in-progress: true env: - MAVEN_OPTS: -Xss1500k -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 + MAVEN_OPTS: -Xss1500k -Daether.connector.http.reuseConnections=false -Daether.connector.requestTimeout=6 -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 jobs: preconditions: diff --git a/.github/workflows/ci-maven-cache-update.yaml b/.github/workflows/ci-maven-cache-update.yaml index a5a88e2e0b8..0bf1c4148b2 100644 --- a/.github/workflows/ci-maven-cache-update.yaml +++ b/.github/workflows/ci-maven-cache-update.yaml @@ -42,7 +42,7 @@ on: - cron: '30 */12 * * *' env: - MAVEN_OPTS: -Xss1500k -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 + MAVEN_OPTS: -Xss1500k -Daether.connector.http.reuseConnections=false -Daether.connector.requestTimeout=6 -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 jobs: update-maven-dependencies-cache: diff --git a/.github/workflows/ci-owasp-dependency-check.yaml b/.github/workflows/ci-owasp-dependency-check.yaml index 8aec501f8d8..9f1ba2cc996 100644 --- a/.github/workflows/ci-owasp-dependency-check.yaml +++ b/.github/workflows/ci-owasp-dependency-check.yaml @@ -24,7 +24,7 @@ on: workflow_dispatch: env: - MAVEN_OPTS: -Xss1500k -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 + MAVEN_OPTS: -Xss1500k -Daether.connector.http.reuseConnections=false -Daether.connector.requestTimeout=6 -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 jobs: run-owasp-dependency-check: diff --git a/.github/workflows/pulsar-ci-flaky.yaml b/.github/workflows/pulsar-ci-flaky.yaml index ea19bc33078..fdc25ca1d93 100644 --- a/.github/workflows/pulsar-ci-flaky.yaml +++ b/.github/workflows/pulsar-ci-flaky.yaml @@ -36,7 +36,7 @@ concurrency: cancel-in-progress: true env: - MAVEN_OPTS: -Xss1500k -Xmx1024m -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard -Dmaven.wagon.http.retryHandler.count=3 -Dmaven.wagon.http.retryHandler.requestSentEnabled=true -Dmaven.wagon.http.serviceUnavailableRetryStrategy.class=standard -Dmaven.wagon.rto=6 + MAVEN_OPTS: -Xss1500k -Xmx1024m -Daether.connector.http.reuseConnections=false -Daether.connector.requestTimeout=6 -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.http.retryHandler.class=standard
[GitHub] [pulsar] nodece merged pull request #20198: [improve][ci] Disable Maven http connection pooling on CI also for newer Maven versions
nodece merged PR #20198: URL: https://github.com/apache/pulsar/pull/20198 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[pulsar] branch master updated: [improve] [broker] Skip split boundle if only one broker (#20190)
This is an automated email from the ASF dual-hosted git repository.
zixuan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new d135c4a1150 [improve] [broker] Skip split boundle if only one broker
(#20190)
d135c4a1150 is described below
commit d135c4a115038dc61f8fe2d230cb1f0c02239f92
Author: fengyubiao
AuthorDate: Sat Apr 29 01:54:05 2023 +0800
[improve] [broker] Skip split boundle if only one broker (#20190)
Co-authored-by: Zixuan Liu
---
.../loadbalance/impl/ModularLoadManagerImpl.java | 2 +-
.../pulsar/broker/stats/PrometheusMetricsTest.java | 9
.../pulsar/client/api/BrokerServiceLookupTest.java | 58 ++
3 files changed, 68 insertions(+), 1 deletion(-)
diff --git
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
index c6f406a7c8a..30a2ef5cdf2 100644
---
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
+++
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java
@@ -744,7 +744,7 @@ public class ModularLoadManagerImpl implements
ModularLoadManager {
public void checkNamespaceBundleSplit() {
if (!conf.isLoadBalancerAutoBundleSplitEnabled() ||
pulsar.getLeaderElectionService() == null
-|| !pulsar.getLeaderElectionService().isLeader()) {
+|| !pulsar.getLeaderElectionService().isLeader() ||
knownBrokers.size() <= 1) {
return;
}
final boolean unloadSplitBundles =
pulsar.getConfiguration().isLoadBalancerAutoUnloadSplitBundlesEnabled();
diff --git
a/pulsar-broker/src/test/java/org/apache/pulsar/broker/stats/PrometheusMetricsTest.java
b/pulsar-broker/src/test/java/org/apache/pulsar/broker/stats/PrometheusMetricsTest.java
index f5ae8459f18..bf141e10aa1 100644
---
a/pulsar-broker/src/test/java/org/apache/pulsar/broker/stats/PrometheusMetricsTest.java
+++
b/pulsar-broker/src/test/java/org/apache/pulsar/broker/stats/PrometheusMetricsTest.java
@@ -38,6 +38,7 @@ import java.text.NumberFormat;
import java.util.ArrayList;
import java.util.Arrays;
import java.util.Collection;
+import java.util.Collections;
import java.util.Date;
import java.util.HashMap;
import java.util.HashSet;
@@ -80,6 +81,7 @@ import org.apache.pulsar.client.api.PulsarClient;
import org.apache.pulsar.client.api.PulsarClientException;
import org.apache.pulsar.client.api.SubscriptionType;
import org.apache.pulsar.compaction.Compactor;
+import org.apache.zookeeper.CreateMode;
import org.awaitility.Awaitility;
import org.mockito.Mockito;
import org.testng.Assert;
@@ -772,6 +774,10 @@ public class PrometheusMetricsTest extends BrokerTestBase {
c1.acknowledge(c1.receive());
}
+// Mock another broker to make split task work.
+String mockedBroker = "/loadbalance/brokers/127.0.0.1:0";
+mockZooKeeper.create(mockedBroker, new byte[]{0},
Collections.emptyList(), CreateMode.EPHEMERAL);
+
pulsar.getBrokerService().updateRates();
Awaitility.await().untilAsserted(() ->
assertTrue(pulsar.getBrokerService().getBundleStats().size() > 0));
ModularLoadManagerWrapper loadManager =
(ModularLoadManagerWrapper)pulsar.getLoadManager().get();
@@ -796,6 +802,9 @@ public class PrometheusMetricsTest extends BrokerTestBase {
assertTrue(metrics.containsKey("pulsar_lb_bandwidth_out_usage"));
assertTrue(metrics.containsKey("pulsar_lb_bundles_split_total"));
+
+// cleanup.
+mockZooKeeper.delete(mockedBroker, 0);
}
@Test
diff --git
a/pulsar-broker/src/test/java/org/apache/pulsar/client/api/BrokerServiceLookupTest.java
b/pulsar-broker/src/test/java/org/apache/pulsar/client/api/BrokerServiceLookupTest.java
index 2af9f450dd3..8597e0a8799 100644
---
a/pulsar-broker/src/test/java/org/apache/pulsar/client/api/BrokerServiceLookupTest.java
+++
b/pulsar-broker/src/test/java/org/apache/pulsar/client/api/BrokerServiceLookupTest.java
@@ -67,6 +67,7 @@ import javax.net.ssl.KeyManagerFactory;
import javax.net.ssl.SSLContext;
import javax.net.ssl.TrustManager;
import lombok.Cleanup;
+import org.apache.pulsar.broker.BrokerTestUtil;
import org.apache.pulsar.broker.PulsarService;
import org.apache.pulsar.broker.ServiceConfiguration;
import org.apache.pulsar.broker.authentication.AuthenticationDataSource;
@@ -80,6 +81,7 @@ import org.apache.pulsar.broker.namespace.NamespaceService;
import org.apache.pulsar.broker.service.BrokerService;
import org.apache.pulsar.broker.testcontext.PulsarTestContext;
import org.apache.pulsar.common.naming.NamespaceBundle;
+import org.apache.pulsar.common.naming.NamespaceName;
import
[GitHub] [pulsar] nodece merged pull request #20190: [improve] [broker] Skip split boundle if only one broker
nodece merged PR #20190: URL: https://github.com/apache/pulsar/pull/20190 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] nodece merged pull request #16832: [improve][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
nodece merged PR #16832: URL: https://github.com/apache/pulsar/pull/16832 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[pulsar] branch master updated: [improve][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer (#16832)
This is an automated email from the ASF dual-hosted git repository.
zixuan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new b8543ad9797 [improve][broker] Support cgroup v2 by using
`jdk.internal.platform.Metrics` in Pulsar Loadbalancer (#16832)
b8543ad9797 is described below
commit b8543ad979798d89da9f35a9375de7e16b7e5e25
Author: Cong Zhao
AuthorDate: Sat Apr 29 01:52:52 2023 +0800
[improve][broker] Support cgroup v2 by using
`jdk.internal.platform.Metrics` in Pulsar Loadbalancer (#16832)
---
bin/pulsar | 2 +
buildtools/pom.xml | 1 +
pom.xml| 1 +
.../pulsar/broker/loadbalance/LinuxInfoUtils.java | 66 +++---
.../loadbalance/impl/LinuxBrokerHostUsageImpl.java | 2 +-
.../broker/loadbalance/SimpleBrokerStartTest.java | 26 +
.../impl/LinuxBrokerHostUsageImplTest.java | 37 +++-
7 files changed, 122 insertions(+), 13 deletions(-)
diff --git a/bin/pulsar b/bin/pulsar
index a033de947d4..e3b22caced5 100755
--- a/bin/pulsar
+++ b/bin/pulsar
@@ -307,6 +307,8 @@ if [[ -z "$IS_JAVA_8" ]]; then
OPTS="$OPTS --add-opens java.management/sun.management=ALL-UNNAMED"
# MBeanStatsGenerator
OPTS="$OPTS --add-opens
jdk.management/com.sun.management.internal=ALL-UNNAMED"
+ # LinuxInfoUtils
+ OPTS="$OPTS --add-opens java.base/jdk.internal.platform=ALL-UNNAMED"
fi
OPTS="-cp $PULSAR_CLASSPATH $OPTS"
diff --git a/buildtools/pom.xml b/buildtools/pom.xml
index 04b25cced42..a21618004e3 100644
--- a/buildtools/pom.xml
+++ b/buildtools/pom.xml
@@ -58,6 +58,7 @@
--add-opens java.base/jdk.internal.loader=ALL-UNNAMED
--add-opens java.base/java.lang=ALL-UNNAMED
+ --add-opens java.base/jdk.internal.platform=ALL-UNNAMED
diff --git a/pom.xml b/pom.xml
index aef380c5cd0..c5d7092c7b4 100644
--- a/pom.xml
+++ b/pom.xml
@@ -109,6 +109,7 @@ flexible messaging model and an intuitive client
API.
--add-opens java.base/sun.net=ALL-UNNAMED
--add-opens java.management/sun.management=ALL-UNNAMED
--add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED
+ --add-opens java.base/jdk.internal.platform=ALL-UNNAMED
true
4
diff --git
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java
index 42ef264b6db..1405979ae3b 100644
---
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java
+++
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java
@@ -18,7 +18,9 @@
*/
package org.apache.pulsar.broker.loadbalance;
+import com.google.common.annotations.VisibleForTesting;
import java.io.IOException;
+import java.lang.reflect.Method;
import java.nio.charset.StandardCharsets;
import java.nio.file.Files;
import java.nio.file.Path;
@@ -45,6 +47,7 @@ public class LinuxInfoUtils {
private static final String CGROUPS_CPU_USAGE_PATH =
"/sys/fs/cgroup/cpu/cpuacct.usage";
private static final String CGROUPS_CPU_LIMIT_QUOTA_PATH =
"/sys/fs/cgroup/cpu/cpu.cfs_quota_us";
private static final String CGROUPS_CPU_LIMIT_PERIOD_PATH =
"/sys/fs/cgroup/cpu/cpu.cfs_period_us";
+
// proc states
private static final String PROC_STAT_PATH = "/proc/stat";
private static final String NIC_PATH = "/sys/class/net/";
@@ -52,6 +55,30 @@ public class LinuxInfoUtils {
private static final int ARPHRD_ETHER = 1;
private static final String NIC_SPEED_TEMPLATE = "/sys/class/net/%s/speed";
+private static Object /*jdk.internal.platform.Metrics*/ metrics;
+private static Method getMetricsProviderMethod;
+private static Method getCpuQuotaMethod;
+private static Method getCpuPeriodMethod;
+private static Method getCpuUsageMethod;
+
+static {
+try {
+metrics =
Class.forName("jdk.internal.platform.Container").getMethod("metrics")
+.invoke(null);
+if (metrics != null) {
+getMetricsProviderMethod =
metrics.getClass().getMethod("getProvider");
+getMetricsProviderMethod.setAccessible(true);
+getCpuQuotaMethod =
metrics.getClass().getMethod("getCpuQuota");
+getCpuQuotaMethod.setAccessible(true);
+getCpuPeriodMethod =
metrics.getClass().getMethod("getCpuPeriod");
+getCpuPeriodMethod.setAccessible(true);
+getCpuUsageMethod =
metrics.getClass().getMethod("getCpuUsage");
+getCpuUsageMethod.setAccessible(true);
+}
+} catch (Throwable e) {
+log.warn("Failed to get runtime metrics", e);
+}
+}
/**
* Determine whether
[GitHub] [pulsar] heesung-sn commented on a diff in pull request #16832: [improve][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
heesung-sn commented on code in PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#discussion_r1180611101
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean
isCGroupsEnabled) {
* Get CGroup cpu usage.
* @return Cpu usage
*/
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);
Review Comment:
I see. Thanks for the check.
Ref:
https://github.com/openjdk/jdk17/blob/master/src/java.base/share/classes/jdk/internal/platform/Metrics.java
https://github.com/openjdk/jdk17/tree/master/src/java.base/linux/classes/jdk/internal/platform
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] heesung-sn commented on a diff in pull request #16832: [improve][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
heesung-sn commented on code in PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#discussion_r1180611101
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean
isCGroupsEnabled) {
* Get CGroup cpu usage.
* @return Cpu usage
*/
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);
Review Comment:
I see. Thanks for the check.
Ref:
https://github.com/openjdk/jdk17/blob/master/src/java.base/share/classes/jdk/internal/platform/Metrics.java
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] heesung-sn commented on a diff in pull request #16832: [improve][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
heesung-sn commented on code in PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#discussion_r1180577209
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean
isCGroupsEnabled) {
* Get CGroup cpu usage.
* @return Cpu usage
*/
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);
Review Comment:
But your getCpuUsageMethod returns a different unit(rate), bounding [0,1].
Don't we need to convert this rate to the aggregated cpu usage time?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] lifepuzzlefun closed pull request #20200: [improve] [broker] Save isIndividualAckMode to `Consumer` field
lifepuzzlefun closed pull request #20200: [improve] [broker] Save isIndividualAckMode to `Consumer` field URL: https://github.com/apache/pulsar/pull/20200 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] heesung-sn commented on a diff in pull request #16832: [improve][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
heesung-sn commented on code in PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#discussion_r1180577209
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean
isCGroupsEnabled) {
* Get CGroup cpu usage.
* @return Cpu usage
*/
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);
Review Comment:
But your getCpuUsageMethod returns a different unit(rate), bounding [0,1].
Don't we need to convert this rate to the aggregated cpu usage time?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] tisonkun added a comment to the discussion: "cannot be cast to class" in a pulsar function producing un new message
GitHub user tisonkun added a comment to the discussion: "cannot be cast to class" in a pulsar function producing un new message This seems that the platform classloader is different to function classloader but they both load the `SchemaInfoImpl` class. cc @dlg99 @jiangpengcheng do you have ideas how we can configure the class loading strategy or user code to avoid such exception? GitHub link: https://github.com/apache/pulsar/discussions/19962#discussioncomment-5756151 This is an automatically sent email for commits@pulsar.apache.org. To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org
[GitHub] [pulsar] raymondBourges added a comment to the discussion: "cannot be cast to class" in a pulsar function producing un new message
GitHub user raymondBourges added a comment to the discussion: "cannot be cast to class" in a pulsar function producing un new message No one to give me an explanation about the error when the function is called: `Failed to create producer: class org.apache.pulsar.client.impl.schema.SchemaInfoImpl cannot be cast to class org.apache.pulsar.client.impl.schema.SchemaInfoImpl (org.apache.pulsar.client.impl.schema.SchemaInfoImpl is in unnamed module of loader org.apache.pulsar.functions.utils.functioncache.FunctionClassLoaders$ParentFirstClassLoader @2f1ea80d; org.apache.pulsar.client.impl.schema.SchemaInfoImpl is in unnamed module of loader java.net.URLClassLoader @2626b418)` ? Thanks GitHub link: https://github.com/apache/pulsar/discussions/19962#discussioncomment-5755798 This is an automatically sent email for commits@pulsar.apache.org. To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org
[GitHub] [pulsar-client-cpp] BewareMyPower opened a new issue, #261: [Bug] Unexpected error logs when closing client on Windows
BewareMyPower opened a new issue, #261:
URL: https://github.com/apache/pulsar-client-cpp/issues/261
### Search before asking
- [X] I searched in the
[issues](https://github.com/apache/pulsar-client-cpp/issues) and found nothing
similar.
### Version
- Pulsar 2.11.0
- Pulsar Client 3.2.0 candidate 1:
https://dist.apache.org/repos/dist/dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1
### Minimal reproduce step
```c++
#include
using namespace pulsar;
int main(int argc, char *argv[]) {
// The server ran inside WSL2 on Windows
Client client("pulsar://172.22.48.50:6650");
Producer producer;
auto result =
client.createProducer("persistent://public/default/test-topic",
producer);
if (result != ResultOk) {
std::cerr << "Failed to create producer: " << result << std::endl;
return 1;
}
client.close();
return 0;
}
```
The Pulsar standalone ran on the Ubuntu 20.04 WSL2 subsystem whose IP is
`172.22.48.50`.
### What did you expect to see?
No error logs appeared.
### What did you see instead?
There was an error log when closing the client:
```
2023-04-28 22:08:06.875 INFO [12684]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ProducerImpl:755 |
[persistent://public/default/test-topic, standalone-5-42] Closing producer for
topic 01ED65D25180
2023-04-28 22:08:06.877 INFO [11036]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ProducerImpl:719 |
[persistent://public/default/test-topic, standalone-5-42] Closed producer 0
2023-04-28 22:08:06.878 INFO [3112]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ClientConnection:1205 |
[172.22.48.1:5376 -> 172.22.48.50:6650] Connection disconnected
2023-04-28 22:08:06.878 INFO [3112]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ClientConnection:1205 |
[172.22.48.1:5377 -> 172.22.48.50:6650] Connection disconnected
2023-04-28 22:08:06.878 ERROR [11036]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ClientConnection:616 |
[172.22.48.1:5376 -> 172.22.48.50:6650] Read operation failed: 由本地系统中止网络连接。
2023-04-28 22:08:06.878 INFO [11036]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ClientConnection:263 |
[172.22.48.1:5376 -> 172.22.48.50:6650] Destroyed connection
2023-04-28 22:08:06.879 ERROR [11036]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ClientConnection:616 |
[172.22.48.1:5377 -> 172.22.48.50:6650] Read operation failed: 由本地系统中止网络连接。
2023-04-28 22:08:06.880 INFO [11036]
D:\a\pulsar-client-cpp\pulsar-client-cpp\lib\ClientConnection:263 |
[172.22.48.1:5377 -> 172.22.48.50:6650] Destroyed connection
```
The error message is `The network connection was aborted by the local
system` in English.
We can see the following error logs in broker:
```
2023-04-28T22:08:06,877+0800 [pulsar-io-19-1] INFO
org.apache.pulsar.broker.service.ServerCnx -
[PersistentTopic{topic=persistent://public/default/test-topic}][standalone-5-42]
Closing producer on cnx /172.22.48.1:5377. producerId=0
2023-04-28T22:08:06,877+0800 [pulsar-io-19-1] INFO
org.apache.pulsar.broker.service.ServerCnx -
[PersistentTopic{topic=persistent://public/default/test-topic}][standalone-5-42]
Closed producer on cnx /172.22.48.1:5377. producerId=0
2023-04-28T22:08:06,878+0800 [pulsar-io-19-16] WARN
org.apache.pulsar.broker.service.ServerCnx - [/172.22.48.1:5376] Got exception
io.netty.channel.unix.Errors$NativeIoException: recvAddress(..) failed:
Connection reset by peer
2023-04-28T22:08:06,878+0800 [pulsar-io-19-1] WARN
org.apache.pulsar.broker.service.ServerCnx - [/172.22.48.1:5377] Got exception
io.netty.channel.unix.Errors$NativeIoException: recvAddress(..) failed:
Connection reset by peer
2023-04-28T22:08:06,878+0800 [pulsar-io-19-16] INFO
org.apache.pulsar.broker.service.ServerCnx - Closed connection from
/172.22.48.1:5376
2023-04-28T22:08:06,879+0800 [pulsar-io-19-1] INFO
org.apache.pulsar.broker.service.ServerCnx - Closed connection from
/172.22.48.1:5377
```
### Anything else?
When I ran the same code on WSL2 directly, no error logs appeared.
Client side:
```
2023-04-28 22:10:12.454 INFO [140283579778816] ClientConnection:1205 |
[172.22.48.50:53056 -> 172.22.48.50:6650] Connection disconnected
2023-04-28 22:10:12.454 INFO [140283579778816] ClientConnection:263 |
[172.22.48.50:53056 -> 172.22.48.50:6650] Destroyed connection
2023-04-28 22:10:12.455 INFO [140283579778816] ClientConnection:1205 |
[172.22.48.50:53062 -> 172.22.48.50:6650] Connection disconnected
2023-04-28 22:10:12.455 INFO [140283579778816] ClientConnection:263 |
[172.22.48.50:53062 -> 172.22.48.50:6650] Destroyed connection
```
Broker side:
```
2023-04-28T22:10:12,453+0800 [pulsar-io-19-3] INFO
org.apache.pulsar.broker.service.ServerCnx -
[GitHub] [pulsar] poorbarcode commented on a diff in pull request #20190: [improve] [broker] Skip split boundle if only one broker
poorbarcode commented on code in PR #20190:
URL: https://github.com/apache/pulsar/pull/20190#discussion_r1180426689
##
pulsar-broker/src/test/java/org/apache/pulsar/broker/stats/PrometheusMetricsTest.java:
##
@@ -796,6 +802,10 @@ public void testBundlesMetrics() throws Exception {
assertTrue(metrics.containsKey("pulsar_lb_bandwidth_out_usage"));
assertTrue(metrics.containsKey("pulsar_lb_bundles_split_total"));
+
+// cleanup.
+mockZooKeeper.delete(mockedBroker, 0);
+System.out.println(1);
Review Comment:
Thanks @nodece (^_^)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] coderzc commented on pull request #16832: [feature][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
coderzc commented on PR #16832: URL: https://github.com/apache/pulsar/pull/16832#issuecomment-1527583577 > I guess that requires a separate PR. Maybe we can push that PR in but add an issue to refactor (delete it out) the dependency on limit and only use percentage (which should be enough) or refactor to avoid using limit and be more specific like ResourceUsage.CpuUsage, MemoryUsage, NetworkUsage, each providing it's own method, where the CPU would only provide percentage. Yes, we need a separate PR to refactor it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] coderzc commented on a diff in pull request #16832: [feature][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer
coderzc commented on code in PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#discussion_r1180389710
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean
isCGroupsEnabled) {
* Get CGroup cpu usage.
* @return Cpu usage
*/
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);
Review Comment:
The `Metrics.getCpuUsage` will return the aggregate time, so I think we
don't need to multiply the limit.
```
/**
* Returns the aggregate time, in nanoseconds, consumed by all
* tasks in the Isolation Group.
*
* @return Time in nanoseconds, -1 if unknown or
* -2 if the metric is not supported.
*
*/
public long getCpuUsage();
```
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean
isCGroupsEnabled) {
* Get CGroup cpu usage.
* @return Cpu usage
*/
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);
Review Comment:
The `Metrics.getCpuUsage` will return the aggregate time, so I think we
don't need to multiply the limit.
```java
/**
* Returns the aggregate time, in nanoseconds, consumed by all
* tasks in the Isolation Group.
*
* @return Time in nanoseconds, -1 if unknown or
* -2 if the metric is not supported.
*
*/
public long getCpuUsage();
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] jeantil added a comment to the discussion: pulsar admin client in pulsar-client-all logs a ClassNotFoundException at startup
GitHub user jeantil added a comment to the discussion: pulsar admin client in pulsar-client-all logs a ClassNotFoundException at startup Hello, Thanks for your answer, I realize I misunderstood and shading is not the root cause. Thanks for clarifying this. I would however argue that this log gives a bad developer experience to users of the pulsar client: - following the normal usage documentation of the client will result in the user's application throwing a full on warning with a `ClassNotFoundException` and a full stack trace. - the warning provides absolutely no indication on how to resolve the issue, not even an indication of why it would be important to use conscrypt instead of the JDK security provider - the pulsar client documentation doesn't mention conscrypt, doesn't explain why users of the client should deploy it So either it is important to use conscrypt, in which case it would be nice to know why or its not and this warning should be downgraded to an INFO log. In both cases, the full stacktrace and classcast exception message doesn't bring much useful information and could be logged at a lower level (probably DEBUG) would you be open to a pull request in to that effect? GitHub link: https://github.com/apache/pulsar/discussions/20057#discussioncomment-5754271 This is an automatically sent email for commits@pulsar.apache.org. To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org
[GitHub] [pulsar-client-cpp] BewareMyPower commented on issue #259: [Bug] Exception could be thrown when creating producers or consumers with Windows debug library
BewareMyPower commented on issue #259: URL: https://github.com/apache/pulsar-client-cpp/issues/259#issuecomment-1527419332 Could you try the `x64-windows-static` triplet? I've built the debug libraries before and it worked well. Could you try these libraries? [win-debug.zip](https://github.com/apache/pulsar-client-cpp/files/11352991/win-debug.zip) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-client-cpp] BewareMyPower commented on issue #260: [Bug] pulsar::InitialPositionEarliest Not effective
BewareMyPower commented on issue #260: URL: https://github.com/apache/pulsar-client-cpp/issues/260#issuecomment-1527401511 You can use the `Consumer::seek` API to see to a position that is represented by a `MessageId`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] nodece commented on a diff in pull request #20190: [improve] [broker] Skip split boundle if only one broker
nodece commented on code in PR #20190:
URL: https://github.com/apache/pulsar/pull/20190#discussion_r1180256574
##
pulsar-broker/src/test/java/org/apache/pulsar/broker/stats/PrometheusMetricsTest.java:
##
@@ -796,6 +802,10 @@ public void testBundlesMetrics() throws Exception {
assertTrue(metrics.containsKey("pulsar_lb_bandwidth_out_usage"));
assertTrue(metrics.containsKey("pulsar_lb_bundles_split_total"));
+
+// cleanup.
+mockZooKeeper.delete(mockedBroker, 0);
+System.out.println(1);
Review Comment:
```suggestion
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] AnonHxy commented on pull request #20196: [improve][broker] Improve knownBrokers update in ModularLoadManagerImpl
AnonHxy commented on PR #20196: URL: https://github.com/apache/pulsar/pull/20196#issuecomment-1527388524 > @AnonHxy hi i found some previous fix on the ConcurrentModificationException when on `knownBrokers` field. and in my opinion this method will have a chance to execute concurrently. So if thread1 is try to figure out which is newAddBroker and which is deadBroker. thread2 clear the Collection will there an missing update？maybe an synchronized is need WDYT？ Make sense -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun merged pull request #547: [fix][doc]Fix broken links pointing to javadoc
momo-jun merged PR #547: URL: https://github.com/apache/pulsar-site/pull/547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[pulsar-site] branch main updated: [fix][doc]Fix broken links pointing to javadoc (#547)
This is an automated email from the ASF dual-hosted git repository.
junma pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
The following commit(s) were added to refs/heads/main by this push:
new 3ef966ced65 [fix][doc]Fix broken links pointing to javadoc (#547)
3ef966ced65 is described below
commit 3ef966ced652f63bcf70f56ee5b5e01324a6a3a4
Author: Jun Ma <60642177+momo-...@users.noreply.github.com>
AuthorDate: Fri Apr 28 18:57:11 2023 +0800
[fix][doc]Fix broken links pointing to javadoc (#547)
* fix javadoc links
* `/` fix
---
docs/admin-api-tutorial.md | 2 +-
docs/administration-geo.md | 2 +-
docs/client-libraries-consumers.md | 2 +-
docs/client-libraries-java-initialize.md | 2 +-
docs/client-libraries-java-use.md | 8 +++
docs/client-libraries-producers.md | 6 ++---
docs/concepts-messaging.md | 6 ++---
.../version-2.10.x/admin-api-overview.md | 2 +-
versioned_docs/version-2.10.x/admin-api-topics.md | 6 ++---
.../version-2.10.x/administration-geo.md | 2 +-
.../version-2.10.x/client-libraries-java.md| 20 -
.../version-2.10.x/concepts-messaging.md | 6 ++---
versioned_docs/version-2.11.x/admin-get-started.md | 2 +-
.../version-2.11.x/administration-geo.md | 2 +-
.../version-2.11.x/client-libraries-java.md| 26 +++---
.../version-2.11.x/concepts-messaging.md | 6 ++---
versioned_docs/version-2.8.x/admin-api-brokers.md | 2 +-
versioned_docs/version-2.8.x/admin-api-clusters.md | 2 +-
.../version-2.8.x/admin-api-functions.md | 2 +-
.../version-2.8.x/admin-api-namespaces.md | 2 +-
versioned_docs/version-2.8.x/admin-api-overview.md | 2 +-
versioned_docs/version-2.8.x/admin-api-topics.md | 6 ++---
versioned_docs/version-2.8.x/administration-geo.md | 2 +-
.../version-2.8.x/client-libraries-java.md | 20 -
versioned_docs/version-2.8.x/concepts-messaging.md | 6 ++---
versioned_docs/version-2.9.x/admin-api-overview.md | 2 +-
versioned_docs/version-2.9.x/admin-api-topics.md | 6 ++---
versioned_docs/version-2.9.x/administration-geo.md | 2 +-
.../version-2.9.x/client-libraries-java.md | 20 -
versioned_docs/version-2.9.x/concepts-messaging.md | 6 ++---
30 files changed, 89 insertions(+), 91 deletions(-)
diff --git a/docs/admin-api-tutorial.md b/docs/admin-api-tutorial.md
index fd3b5b45c86..6423b699eff 100644
--- a/docs/admin-api-tutorial.md
+++ b/docs/admin-api-tutorial.md
@@ -41,7 +41,7 @@ If you want to test REST APIs in postman, you can use the
REST API JSON files [h
-To use the Java admin API, instantiate a {@inject:
javadoc:PulsarAdmin:/admin/org/apache/pulsar/client/admin/PulsarAdmin} object,
and specify a URL for a Pulsar broker and a {@inject:
javadoc:PulsarAdminBuilder:/admin/org/apache/pulsar/client/admin/PulsarAdminBuilder}.
The following is a minimal example using `localhost`.
+To use the Java admin API, instantiate a
[PulsarAdmin](/api/admin/org/apache/pulsar/client/admin/PulsarAdmin) object,
and specify a URL for a Pulsar broker and a
[PulsarAdminBuilder](/api/admin/org/apache/pulsar/client/admin/PulsarAdminBuilder)
object. The following is a minimal example using `localhost`.
```java
String url = "http://localhost:8080;;
diff --git a/docs/administration-geo.md b/docs/administration-geo.md
index 21df5bc8540..71210062156 100644
--- a/docs/administration-geo.md
+++ b/docs/administration-geo.md
@@ -146,7 +146,7 @@ topicLevelPoliciesEnabled=true
By default, messages are replicated to all clusters configured for the
namespace. You can restrict replication selectively by specifying a replication
list for a message, and then that message is replicated only to the subset in
the replication list.
-The following is an example of the [Java API](client-libraries-java.md). Note
the use of the `setReplicationClusters` method when you construct the {@inject:
javadoc:Message:/client/org/apache/pulsar/client/api/Message} object:
+The following is an example of the [Java API](client-libraries-java.md). Note
the use of the `setReplicationClusters` method when you construct the
[Message](/api/client/org/apache/pulsar/client/api/Message) object:
```java
List restrictReplicationTo = Arrays.asList(
diff --git a/docs/client-libraries-consumers.md
b/docs/client-libraries-consumers.md
index 1c67eed20b1..28cfb4c0d5a 100644
--- a/docs/client-libraries-consumers.md
+++ b/docs/client-libraries-consumers.md
@@ -552,7 +552,7 @@ The following is an example.
CompletableFuture asyncMessage = consumer.receiveAsync();
```
- Async receive operations return a {@inject:
javadoc:Message:/client/org/apache/pulsar/client/api/Message} wrapped inside of
a
[GitHub] [pulsar] codecov-commenter commented on pull request #20190: [improve] [broker] Skip split boundle if only one broker
codecov-commenter commented on PR #20190: URL: https://github.com/apache/pulsar/pull/20190#issuecomment-1527372952 ## [Codecov](https://codecov.io/gh/apache/pulsar/pull/20190?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#20190](https://codecov.io/gh/apache/pulsar/pull/20190?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (dca8d0d) into [master](https://codecov.io/gh/apache/pulsar/commit/7bd9998c9974ff17b1fbd5b3db7cf5bd7d3bc518?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (7bd9998) will **increase** coverage by `0.66%`. > The diff coverage is `100.00%`. [](https://codecov.io/gh/apache/pulsar/pull/20190?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #20190 +/- ## + Coverage 72.25% 72.92% +0.66% - Complexity3195231962 +10 Files 1855 1868 +13 Lines138267 138514 +247 Branches 1522215243 +21 + Hits 99901 101007+1106 + Misses3038629450 -936 - Partials 7980 8057 +77 ``` | Flag | Coverage Δ | | |---|---|---| | inttests | `24.15% <100.00%> (?)` | | | systests | `24.80% <100.00%> (?)` | | | unittests | `72.22% <100.00%> (-0.04%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/pulsar/pull/20190?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...roker/loadbalance/impl/ModularLoadManagerImpl.java](https://codecov.io/gh/apache/pulsar/pull/20190?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9sb2FkYmFsYW5jZS9pbXBsL01vZHVsYXJMb2FkTWFuYWdlckltcGwuamF2YQ==) | `81.52% <100.00%> (-0.34%)` | :arrow_down: | ... and [199 files with indirect coverage changes](https://codecov.io/gh/apache/pulsar/pull/20190/indirect-changes?src=pr=tree-more_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on pull request #20200: save isIndividualAckMode to field
github-actions[bot] commented on PR #20200: URL: https://github.com/apache/pulsar/pull/20200#issuecomment-1527337302 @lifepuzzlefun Please add the following content to your PR description and select a checkbox: ``` - [ ] `doc` - [ ] `doc-required` - [ ] `doc-not-needed` - [ ] `doc-complete` ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] lifepuzzlefun opened a new pull request, #20200: save isIndividualAckMode to field
lifepuzzlefun opened a new pull request, #20200: URL: https://github.com/apache/pulsar/pull/20200 Fixes #xyz Master Issue: #xyz PIP: #xyz ### Motivation ### Modifications ### Verifying this change - [ ] Make sure that the change passes the CI checks. *(Please pick either of the following options)* This change is a trivial rework / code cleanup without any test coverage. *(or)* This change is already covered by existing tests, such as *(please describe tests)*. *(or)* This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end deployment with large payloads (10MB)* - *Extended integration test for recovery after broker failure* ### Does this pull request potentially affect one of the following parts: *If the box was checked, please highlight the changes* - [ ] Dependencies (add or upgrade a dependency) - [ ] The public API - [ ] The schema - [ ] The default values of configurations - [ ] The threading model - [ ] The binary protocol - [ ] The REST endpoints - [ ] The admin CLI options - [ ] The metrics - [ ] Anything that affects deployment ### Documentation - [ ] `doc` - [ ] `doc-required` - [ ] `doc-not-needed` - [ ] `doc-complete` ### Matching PR in forked repository PR in forked repository: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #547: [fix][doc]Fix broken links pointing to javadoc
momo-jun commented on code in PR #547:
URL: https://github.com/apache/pulsar-site/pull/547#discussion_r1180205691
##
versioned_docs/version-2.9.x/concepts-messaging.md:
##
@@ -518,19 +518,19 @@ Partitioned topics need to be explicitly created via the
[admin API](admin-api-o
When publishing to partitioned topics, you must specify a *routing mode*. The
routing mode determines which partition---that is, which internal topic---each
message should be published to.
-There are three {@inject:
javadoc:MessageRoutingMode:/client/org/apache/pulsar/client/api/MessageRoutingMode}
available:
+There are three
[MessageRoutingMode](api/client/org/apache/pulsar/client/api/MessageRoutingMode)
available:
Mode | Description
:|:
`RoundRobinPartition` | If no key is provided, the producer will publish
messages across all partitions in round-robin fashion to achieve maximum
throughput. Please note that round-robin is not done per individual message but
rather it's set to the same boundary of batching delay, to ensure batching is
effective. While if a key is specified on the message, the partitioned producer
will hash the key and assign message to a particular partition. This is the
default mode.
`SinglePartition` | If no key is provided, the producer will randomly pick
one single partition and publish all the messages into that partition. While if
a key is specified on the message, the partitioned producer will hash the key
and assign message to a particular partition.
-`CustomPartition` | Use custom message router implementation that will be
called to determine the partition for a particular message. User can create a
custom routing mode by using the [Java client](client-libraries-java.md) and
implementing the {@inject:
javadoc:MessageRouter:/client/org/apache/pulsar/client/api/MessageRouter}
interface.
+`CustomPartition` | Use custom message router implementation that will be
called to determine the partition for a particular message. User can create a
custom routing mode by using the [Java client](client-libraries-java.md) and
implementing the
[MessageRouter](api/client/org/apache/pulsar/client/api/MessageRouter)
interface.
### Ordering guarantee
The ordering of messages is related to MessageRoutingMode and Message Key.
Usually, user would want an ordering of Per-key-partition guarantee.
-If there is a key attached to message, the messages will be routed to
corresponding partitions based on the hashing scheme specified by
[HashingScheme](/api/client/org/apache/pulsar/client/api/HashingScheme) in
{@inject:
javadoc:ProducerBuilder:/client/org/apache/pulsar/client/api/ProducerBuilder},
when using either `SinglePartition` or `RoundRobinPartition` mode.
+If there is a key attached to message, the messages will be routed to
corresponding partitions based on the hashing scheme specified by
[HashingScheme](/api/client/org/apache/pulsar/client/api/HashingScheme) in
[ProducerBuilder](api/client/org/apache/pulsar/client/api/ProducerBuilder),
when using either `SinglePartition` or `RoundRobinPartition` mode.
Review Comment:
Oops.. Thanks for spotting this. Resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar] lifepuzzlefun commented on pull request #20018: [improve][broker] Recover batch deleted Index when cursor recover from metadataStore.
lifepuzzlefun commented on PR #20018: URL: https://github.com/apache/pulsar/pull/20018#issuecomment-1527283937 ping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] gmiklos-ltg commented on a diff in pull request #20115: [improve][fn] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom Ser
gmiklos-ltg commented on code in PR #20115: URL: https://github.com/apache/pulsar/pull/20115#discussion_r1180181144 ## pulsar-functions/instance/src/test/java/org/apache/pulsar/functions/source/TopicSchemaTest.java: ## Review Comment: I'll see what I can do. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] gmiklos-ltg commented on a diff in pull request #20115: [improve][fn] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom Ser
gmiklos-ltg commented on code in PR #20115:
URL: https://github.com/apache/pulsar/pull/20115#discussion_r1180180833
##
pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/source/TopicSchema.java:
##
@@ -49,8 +53,13 @@ public class TopicSchema {
private final Map> cachedSchemas = new HashMap<>();
private final PulsarClient client;
-public TopicSchema(PulsarClient client) {
+private final ClassLoader functionsClassloader;
+
+public TopicSchema(PulsarClient client, ClassLoader functionsClassloader) {
this.client = client;
+this.functionsClassloader = AccessController.doPrivileged(
Review Comment:
Interestingly IntelliJ IDEA gives me a pretty strong warning that
doPrivileged should be used while creating this URLClassLoader. Shall we omit
this call and just create the URLClassLoader as it is? I saw other parts of
code that made use of doPrivileged (perhaps it also makes static analysis to
fail).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar-site] tisonkun commented on a diff in pull request #547: [fix][doc]Fix broken links pointing to javadoc
tisonkun commented on code in PR #547:
URL: https://github.com/apache/pulsar-site/pull/547#discussion_r1180179893
##
versioned_docs/version-2.9.x/concepts-messaging.md:
##
@@ -518,19 +518,19 @@ Partitioned topics need to be explicitly created via the
[admin API](admin-api-o
When publishing to partitioned topics, you must specify a *routing mode*. The
routing mode determines which partition---that is, which internal topic---each
message should be published to.
-There are three {@inject:
javadoc:MessageRoutingMode:/client/org/apache/pulsar/client/api/MessageRoutingMode}
available:
+There are three
[MessageRoutingMode](api/client/org/apache/pulsar/client/api/MessageRoutingMode)
available:
Mode | Description
:|:
`RoundRobinPartition` | If no key is provided, the producer will publish
messages across all partitions in round-robin fashion to achieve maximum
throughput. Please note that round-robin is not done per individual message but
rather it's set to the same boundary of batching delay, to ensure batching is
effective. While if a key is specified on the message, the partitioned producer
will hash the key and assign message to a particular partition. This is the
default mode.
`SinglePartition` | If no key is provided, the producer will randomly pick
one single partition and publish all the messages into that partition. While if
a key is specified on the message, the partitioned producer will hash the key
and assign message to a particular partition.
-`CustomPartition` | Use custom message router implementation that will be
called to determine the partition for a particular message. User can create a
custom routing mode by using the [Java client](client-libraries-java.md) and
implementing the {@inject:
javadoc:MessageRouter:/client/org/apache/pulsar/client/api/MessageRouter}
interface.
+`CustomPartition` | Use custom message router implementation that will be
called to determine the partition for a particular message. User can create a
custom routing mode by using the [Java client](client-libraries-java.md) and
implementing the
[MessageRouter](api/client/org/apache/pulsar/client/api/MessageRouter)
interface.
### Ordering guarantee
The ordering of messages is related to MessageRoutingMode and Message Key.
Usually, user would want an ordering of Per-key-partition guarantee.
-If there is a key attached to message, the messages will be routed to
corresponding partitions based on the hashing scheme specified by
[HashingScheme](/api/client/org/apache/pulsar/client/api/HashingScheme) in
{@inject:
javadoc:ProducerBuilder:/client/org/apache/pulsar/client/api/ProducerBuilder},
when using either `SinglePartition` or `RoundRobinPartition` mode.
+If there is a key attached to message, the messages will be routed to
corresponding partitions based on the hashing scheme specified by
[HashingScheme](/api/client/org/apache/pulsar/client/api/HashingScheme) in
[ProducerBuilder](api/client/org/apache/pulsar/client/api/ProducerBuilder),
when using either `SinglePartition` or `RoundRobinPartition` mode.
Review Comment:
```suggestion
If there is a key attached to message, the messages will be routed to
corresponding partitions based on the hashing scheme specified by
[HashingScheme](/api/client/org/apache/pulsar/client/api/HashingScheme) in
[ProducerBuilder](/api/client/org/apache/pulsar/client/api/ProducerBuilder),
when using either `SinglePartition` or `RoundRobinPartition` mode.
```
Please check if there are other similar issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #544: [improve][fn] add docs for supporting reading config options from files in Python runner
momo-jun commented on code in PR #544: URL: https://github.com/apache/pulsar-site/pull/544#discussion_r1180173085 ## docs/functions-runtime-process.md: ## @@ -22,3 +22,37 @@ functionRuntimeFactoryConfigs: ``` For more details, see [code](https://github.com/apache/pulsar/blob/master/pulsar-functions/runtime/src/main/java/org/apache/pulsar/functions/runtime/process/ProcessRuntimeFactoryConfig.java). + +### Set runtime parameter with configuration file + +Pulsar Functions now supports setting runtime parameters using a configuration file **in Python**. + +**Example** + +You can start a Python runtime using the configuration file `config.ini` with the following command. + +```shell +pulsar-admin functions localrun \ + --py /path/to/python_instance.py \ + --config-file /path/to/config.ini \ + --classname MyFunction \ + --logging_leve debug \ + --inputs persistent://public/default/my-input-topic \ + --output persistent://public/default/my-output-topic \ + --log-topic persistent://public/default/functions-logs +``` + +` --config-file` is the path to the configuration file. Note that: + +- The ` --config-file` should be written in `.ini` format, with each parameter being configured as `key = value`. + +**Example** + +```ini +[DEFAULT] +logging_level = info +max_pending_async_requests = 1000 +max_concurrent_requests = 50 +``` + +- When starting with the ` --config-file`, all parameters can be set in the ` --config-file`. If you specify parameters on the command line that are also present in the ` --config-file`, the values of the parameters on the command line will **take precedence over** the values in the ` --config-file`. Like in the example above, the `logging_level` is set to `debug`. Review Comment: ```suggestion - When you set a parameter through both the configuration file and the command line, like `logging_level` in the example above, the value set through the command line will **take precedence over** the one set through the configuration file. As a result, the value of `logging_level` is `debug`. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #544: [improve][fn] add docs for supporting reading config options from files in Python runner
momo-jun commented on code in PR #544: URL: https://github.com/apache/pulsar-site/pull/544#discussion_r1180172246 ## docs/functions-runtime-process.md: ## @@ -22,3 +22,37 @@ functionRuntimeFactoryConfigs: ``` For more details, see [code](https://github.com/apache/pulsar/blob/master/pulsar-functions/runtime/src/main/java/org/apache/pulsar/functions/runtime/process/ProcessRuntimeFactoryConfig.java). + +### Set runtime parameter with configuration file + +Pulsar Functions now supports setting runtime parameters using a configuration file **in Python**. + +**Example** + +You can start a Python runtime using the configuration file `config.ini` with the following command. + +```shell +pulsar-admin functions localrun \ + --py /path/to/python_instance.py \ + --config-file /path/to/config.ini \ + --classname MyFunction \ + --logging_leve debug \ Review Comment: ```suggestion --logging_level debug \ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] lhotari opened a new pull request, #20198: [improve][ci] Disable Maven http connection pooling on CI also for newer Maven versions
lhotari opened a new pull request, #20198:
URL: https://github.com/apache/pulsar/pull/20198
### Motivation
- Maven http connection pooling was originally disabled with #8921 to
prevent download issues (TCP connection reset) on GitHub Actions VMs.
- Maven is switching to "Maven Resolver" ("aether") in newer versions
instead of using Wagon.
### Modifications
- Disable Maven http connection pooling also for aether
- Set request timeout to 6ms also for aether
### Documentation
- [ ] `doc`
- [ ] `doc-required`
- [x] `doc-not-needed`
- [ ] `doc-complete`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar-client-cpp] licj520 commented on issue #260: [Bug] pulsar::InitialPositionEarliest Not effective
licj520 commented on issue #260: URL: https://github.com/apache/pulsar-client-cpp/issues/260#issuecomment-1527225896 > Could you add a code example to reproduce this issue? From my experience, mostly it's because you have already acknowledged a message. This configuration only works when the subscription has not been created and acknowledged. ok , been acknowledged. Is there a way to consume again？ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-client-cpp] licj520 commented on issue #259: [Bug] Exception could be thrown when creating producers or consumers with Windows debug library
licj520 commented on issue #259: URL: https://github.com/apache/pulsar-client-cpp/issues/259#issuecomment-1527217359 > Where did you download the debug library? If you built from source, please provide the commands you used. With vcpkg, run that commands cmake \ -B ./build \ -A x64 \ -DBUILD_TESTS=OFF \ -DVCPKG_TRIPLET=x64-windows \ -DCMAKE_BUILD_TYPE=Debug\ -S . cmake --build ./build --config Debug -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[pulsar] branch master updated: [fix][admin] Fix examine messages if total message is zero (#20152)
This is an automated email from the ASF dual-hosted git repository.
houxiaoyu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 8b7aa6312b2 [fix][admin] Fix examine messages if total message is zero
(#20152)
8b7aa6312b2 is described below
commit 8b7aa6312b2af49d0c6edde85c6b0108007a0a96
Author: houxiaoyu
AuthorDate: Fri Apr 28 16:46:51 2023 +0800
[fix][admin] Fix examine messages if total message is zero (#20152)
---
.../org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java | 4
.../java/org/apache/pulsar/broker/admin/PersistentTopicsTest.java | 8
2 files changed, 12 insertions(+)
diff --git
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java
index 6b163ae0446..fcade8270cb 100644
---
a/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java
+++
b/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java
@@ -3061,6 +3061,10 @@ public class PersistentTopicsBase extends AdminResource {
try {
PersistentTopic persistentTopic = (PersistentTopic)
topic;
long totalMessage =
persistentTopic.getNumberOfEntries();
+if (totalMessage <= 0) {
+throw new RestException(Status.PRECONDITION_FAILED,
+"Could not examine messages due to the
total message is zero");
+}
PositionImpl startPosition =
persistentTopic.getFirstPosition();
long messageToSkip =
initialPositionLocal.equals("earliest") ? messagePositionLocal :
diff --git
a/pulsar-broker/src/test/java/org/apache/pulsar/broker/admin/PersistentTopicsTest.java
b/pulsar-broker/src/test/java/org/apache/pulsar/broker/admin/PersistentTopicsTest.java
index f80d9863a26..284e50c8302 100644
---
a/pulsar-broker/src/test/java/org/apache/pulsar/broker/admin/PersistentTopicsTest.java
+++
b/pulsar-broker/src/test/java/org/apache/pulsar/broker/admin/PersistentTopicsTest.java
@@ -1151,6 +1151,14 @@ public class PersistentTopicsTest extends
MockedPulsarServiceBaseTest {
+ "topic partition");
}
+try {
+admin.topics().examineMessage(topicName + "-partition-0",
"earliest", 1);
+Assert.fail();
+} catch (PulsarAdminException e) {
+Assert.assertEquals(e.getMessage(),
+"Could not examine messages due to the total message is
zero");
+}
+
producer.send("message1");
Assert.assertEquals(
new String(admin.topics().examineMessage(topicName +
"-partition-0", "earliest", 1).getData()),
[GitHub] [pulsar] AnonHxy merged pull request #20152: [fix][admin] Fix examine messages if total message is zero
AnonHxy merged PR #20152: URL: https://github.com/apache/pulsar/pull/20152 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] heesung-sn commented on pull request #20168: [fix][broker] log update in class:LeastResourceUsageWithWeight
heesung-sn commented on PR #20168: URL: https://github.com/apache/pulsar/pull/20168#issuecomment-1527198107 We print info logs under the debugMode flag. Whats the intention? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180091081 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180090245 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180088539 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180084488 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180084488 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180082156 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
momo-jun commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180081495 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,463 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + +### PIPs +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters by
[GitHub] [pulsar-client-node] XXXMrG commented on pull request #322: [feat]: Support client.getPartitionsForTopic (#320)
XXXMrG commented on PR #322: URL: https://github.com/apache/pulsar-client-node/pull/322#issuecomment-1527169751 TODO: - [ ] add end-to-end test case later - [ ] update doc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-client-node] XXXMrG opened a new pull request, #322: [feat]: Support client.getPartitionsForTopic (#320)
XXXMrG opened a new pull request, #322: URL: https://github.com/apache/pulsar-client-node/pull/322 Master Issue: #320 ### Motivation Support api: [client.getPartitionsForTopic](https://pulsar.apache.org/api/cpp/3.1.x/classpulsar_1_1_client.html#a208629aff52395ad0072622ae82f5657) ### Modifications Just bind CPP function: `pulsar_client_get_topic_partitions_async` to JS. ### Verifying this change - [ ] Make sure that the change passes the CI checks. This change added tests and can be verified as follows: - [ ] will add end to end test later. ### Documentation - [x] `doc-required` (Your PR needs to update docs and you will update later) - [ ] `doc-not-needed` (Please explain why) - [ ] `doc` (Your PR contains doc changes) - [ ] `doc-complete` (Docs have been already added) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] RobertIndie commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
RobertIndie commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180075761 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker + +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters
[GitHub] [pulsar-client-go] sanketkhotebsft opened a new issue, #1013: Event time not being set when batching is disabled in producer
sanketkhotebsft opened a new issue, #1013:
URL: https://github.com/apache/pulsar-client-go/issues/1013
Expected behavior
The eventTime timestamp should be getting at the consumer side if its set at
the time producing message
Actual behavior
after setting eventTIme in the producer message get event time as 0 in the
consumed message.
Steps to reproduce
Set
p.options.DisableBatching=true
and produce messages with evenTime:
`msg := {
EventTime: time.Now().UTC(),
Payload: []byte(data),
}`
on the consumer side:
`ts := msg.EventTime()`
ts will get as a `1970-01-01 05:30:00 +0530 IST`
System configuration
**Pulsar version**: 0.10.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar-site] Anonymitaet commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
Anonymitaet commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180046832 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker + +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters
[GitHub] [pulsar-site] Anonymitaet commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
Anonymitaet commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180046832 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker + +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters
[GitHub] [pulsar-site] Anonymitaet commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
Anonymitaet commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180046832 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker + +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters
[GitHub] [pulsar-site] Anonymitaet commented on pull request #545: Add release note for Pulsar 3.0.0
Anonymitaet commented on PR #545: URL: https://github.com/apache/pulsar-site/pull/545#issuecomment-1527135767 @tisonkun do we need to show community/website highlights? For example, > - Add instructions for the release note process and policy [#431](https://github.com/apache/pulsar-site/pull/431), [#433](https://github.com/apache/pulsar-site/pull/433) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] Anonymitaet commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
Anonymitaet commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180041688 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771) + +### Broker + +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large clusters
[GitHub] [pulsar-site] momo-jun commented on a diff in pull request #533: [fix][doc] MesssageListener inject link
momo-jun commented on code in PR #533:
URL: https://github.com/apache/pulsar-site/pull/533#discussion_r1180033072
##
docs/concepts-clients.md:
##
@@ -70,7 +70,7 @@ Messages are received from
[brokers](reference-terminology.md#broker) either syn
### Listener
-Client libraries provide listener implementation for consumers. For example,
the [Java client](client-libraries-java.md) provides a {@inject:
javadoc:MesssageListener:/client/org/apache/pulsar/client/api/MessageListener}
interface. In this interface, the `received` method is called whenever a new
message is received.
+Client libraries provide listener implementation for consumers. For example,
the [Java client](client-libraries-java.md) provides a
[MesssageListener](/api/client/org/apache/pulsar/client/api/MessageListener)
interface. In this interface, the `received` method is called whenever a new
message is received.
Review Comment:
Fixed all the broken ones through
https://github.com/apache/pulsar-site/pull/547.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [pulsar-client-cpp] BewareMyPower commented on issue #259: [Bug] Exception could be thrown when creating producers or consumers with Windows debug library
BewareMyPower commented on issue #259: URL: https://github.com/apache/pulsar-client-cpp/issues/259#issuecomment-1527116624 Where did you download the debug library? If you built from source, please provide the commands you used. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] Anonymitaet commented on pull request #544: [improve][fn] add docs for supporting reading config options from files in Python runner
Anonymitaet commented on PR #544: URL: https://github.com/apache/pulsar-site/pull/544#issuecomment-1527115499 @momo-jun @Huanli-Meng could you please help review? Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-client-cpp] BewareMyPower commented on issue #260: [Bug] pulsar::InitialPositionEarliest Not effective
BewareMyPower commented on issue #260: URL: https://github.com/apache/pulsar-client-cpp/issues/260#issuecomment-1527114812 Could you add a code example to reproduce this issue? From my experience, mostly it's because you have already acknowledged a message. This configuration only works when the subscription has not been created and acknowledged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun opened a new pull request, #547: [fix][doc]Fix links to javadoc
momo-jun opened a new pull request, #547: URL: https://github.com/apache/pulsar-site/pull/547 ### Motivation `@inject: javadoc:` has been converted to `/api/client/...`. So to update all the javadoc related links in the docs. ### Documentation - [ ] `doc` - [ ] `doc-required` - [ ] `doc-not-needed` - [ ] `doc-complete` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] RobertIndie commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
RobertIndie commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1180020905 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551]((https://github.com/apache/pulsar/pull/16551)) +- PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) +- PIP-214: Add broker level metrics statistics and expose to prometheus [#18056](https://github.com/apache/pulsar/pull/18056) +- PIP-218: Consumer batchReceive() single partition every receive [#18182](https://github.com/apache/pulsar/pull/18182) +- PIP-229: Add a common interface to get fields of the MessageIdData #18950(https://github.com/apache/pulsar/pull/18950) +- PIP-250: Add proxyVersion to CommandConnect #19623(https://github.com/apache/pulsar/pull/19623) +- PIP-257: Add Open ID Connect Support to Server Components [#19771](https://github.com/apache/pulsar/pull/19771)``` + +### Broker + +- [Broker] incomplete PIP-97: Asynchronous Authentication Provider [#12105](https://github.com/apache/pulsar/pull/12105) + - Implement for ServerCnx by @michaeljmarshall in [#19409](https://github.com/apache/pulsar/pull/19409) + - Implement for ProxyConnection by @michaeljmarshall in [#19292](https://github.com/apache/pulsar/pull/19292) +- [Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#16153](https://github.com/apache/pulsar/pull/16153) + - Add ShadowManagedLedgerImpl by @Jason918 in [#18265](https://github.com/apache/pulsar/pull/18265) + - Support shadow topic creation. by @Jason918 in [#17711](https://github.com/apache/pulsar/pull/17711) + - Add Shadow Replicator by @Jason918 in [#17371](https://github.com/apache/pulsar/pull/17371) +- [Broker] PIP-192: New Pulsar Broker Load Balancer [#16691](https://github.com/apache/pulsar/pull/16691) + - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by @heesung-sn in [#20087](https://github.com/apache/pulsar/pull/20087) + - Improve TransferSheder for overload outlier for large
svn commit: r61525 [1/2] - in /dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1: ./ apk-arm64/ apk-arm64/aarch64/ apk-x86_64/ apk-x86_64/x86_64/ deb-arm64/ deb-x86_64/ rpm-arm64/ rpm-a
Author: xyz Date: Fri Apr 28 07:15:33 2023 New Revision: 61525 Log: Staging artifacts and signature for Pulsar Client C++ release 3.2.0 Candidate 1 Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apache-pulsar-client-cpp-3.2.0.tar.gz (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apache-pulsar-client-cpp-3.2.0.tar.gz.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apache-pulsar-client-cpp-3.2.0.tar.gz.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/APKINDEX.tar.gz (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/APKINDEX.tar.gz.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/APKINDEX.tar.gz.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/apache-pulsar-client-3.2.0-r0.apk (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/apache-pulsar-client-3.2.0-r0.apk.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/apache-pulsar-client-3.2.0-r0.apk.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/apache-pulsar-client-dev-3.2.0-r0.apk (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/apache-pulsar-client-dev-3.2.0-r0.apk.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-arm64/aarch64/apache-pulsar-client-dev-3.2.0-r0.apk.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/APKINDEX.tar.gz (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/APKINDEX.tar.gz.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/APKINDEX.tar.gz.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/apache-pulsar-client-3.2.0-r0.apk (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/apache-pulsar-client-3.2.0-r0.apk.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/apache-pulsar-client-3.2.0-r0.apk.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/apache-pulsar-client-dev-3.2.0-r0.apk (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/apache-pulsar-client-dev-3.2.0-r0.apk.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/apk-x86_64/x86_64/apache-pulsar-client-dev-3.2.0-r0.apk.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/Packages.gz (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/Packages.gz.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/Packages.gz.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/apache-pulsar-client-dev.deb (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/apache-pulsar-client-dev.deb.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/apache-pulsar-client-dev.deb.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/apache-pulsar-client.deb (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/apache-pulsar-client.deb.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-arm64/apache-pulsar-client.deb.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-x86_64/ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-x86_64/Packages.gz (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-x86_64/Packages.gz.asc dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-x86_64/Packages.gz.sha512 dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-x86_64/apache-pulsar-client-dev.deb (with props) dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/deb-x86_64/apache-pulsar-client-dev.deb.asc
svn commit: r61525 [2/2] - in /dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1: ./ apk-arm64/ apk-arm64/aarch64/ apk-x86_64/ apk-x86_64/x86_64/ deb-arm64/ deb-x86_64/ rpm-arm64/ rpm-a
Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/083e8ae40beae98b09f0f2f53df6e2d197f308709fa61a4142968aea073a5749-primary.xml.gz.sha512 == --- dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/083e8ae40beae98b09f0f2f53df6e2d197f308709fa61a4142968aea073a5749-primary.xml.gz.sha512 (added) +++ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/083e8ae40beae98b09f0f2f53df6e2d197f308709fa61a4142968aea073a5749-primary.xml.gz.sha512 Fri Apr 28 07:15:33 2023 @@ -0,0 +1 @@ +642cc04a893ca250d93dee042665502f46f926471c0dff4d8feb500731daacb6dbc507a1c3c4f443583049314dd4df0bce82018396d5d8694ccaf341ec82531f ./rpm-x86_64/x86_64/repodata/083e8ae40beae98b09f0f2f53df6e2d197f308709fa61a4142968aea073a5749-primary.xml.gz Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz == Binary file - no diff available. Propchange: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz -- svn:mime-type = application/octet-stream Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz.asc == --- dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz.asc (added) +++ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz.asc Fri Apr 28 07:15:33 2023 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEn+m0+KLf1EiRy6J0Qrtq+2zSb6YFAmRLcccACgkQQrtq+2zS +b6aSpg//eu1L7r144zErByzFtN/Lb4CNCjNBtFVzA326gynB6MaaABVsIV00yZoZ +gB3DmzHpYgquiqmUJrFlXgiv/0fDyCDOJc0kZxv2PB2Gw1txq8AqDQhBKFiCvKK9 +IXgs4kpqvKfNmL4jUZ03HZxD6tpgwXKoljcN2x5zQuDTIfH7aDnL+kkLzDsi+U3u +udMIJ+i9yfINUeVa+dFtcQE5iG4Anl5ai99uZtGi1Zq3TdZX0iHeIRoV5J82pDSM +bkzHs0FJcXPj3/FvVnLIc9FbyKNg//u7VW/UAnQy2dmjRpysrbLFyTvsfeAQNe+D +fGygg8HmTLhrugbJuN+gMJ9rPnjGCXjcA64nuwA2u6+0GbAutsiAe9r2xyilbnS/ +I5UNxjrMtpDYlRAMYEc0qX7D92NaYuCWLh4g9w/cNp/fYWTX3gF4xNyDSave0Pxf +g5PrTGKLqt7Wr/wWBRWDsC1UKRR2T82RfYLdYmlAa3Jf+/6RxhXj0izd2S0w9vIO +KWno/3RcgaA4gmcQjo6w7GZCt8xA4hFPzY8/hYwA65KzlteBo//HdQfvDvJhfS1d +nusZmMm1DYgLg7spujoo8/V2wofJlHTJtrs3Iowz9TxkLwO4ujA2aT+gHob2ckgx +6MR/R5MpQcx2HkrxsWbk6ObrmzqxwEZY6zyRzNTc7V3U+C7k2r4= +=qhim +-END PGP SIGNATURE- Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz.sha512 == --- dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz.sha512 (added) +++ dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz.sha512 Fri Apr 28 07:15:33 2023 @@ -0,0 +1 @@ +8a33b5606c87b3fcad8b5bf57d4ebd58355a01d4da5e5a53d47134fbc3e0d1646535f905a68155bd5ae5c8adb85868ec3e86a3e5ade14d7919be0e31b75e5fc0 ./rpm-x86_64/x86_64/repodata/2860ec45c99ab884450ed3d2131edee2e0c1120c6f6f7b6a3bfa2696395058ee-filelists.xml.gz Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/34ea2dea8028d9c18261960a1d8e43292a97c4273a4fab5722c0eb3ed4199aea-filelists.sqlite.bz2 == Binary file - no diff available. Propchange: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/34ea2dea8028d9c18261960a1d8e43292a97c4273a4fab5722c0eb3ed4199aea-filelists.sqlite.bz2 -- svn:mime-type = application/octet-stream Added: dev/pulsar/pulsar-client-cpp/pulsar-client-cpp-3.2.0-candidate-1/rpm-x86_64/x86_64/repodata/34ea2dea8028d9c18261960a1d8e43292a97c4273a4fab5722c0eb3ed4199aea-filelists.sqlite.bz2.asc == ---
[GitHub] [pulsar-site] Anonymitaet commented on pull request #544: [improve][fn] add docs for supporting reading config options from files in Python runner
Anonymitaet commented on PR #544: URL: https://github.com/apache/pulsar-site/pull/544#issuecomment-1527081114 > Yes Done, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar] StevenLuMT commented on pull request #20168: [fix][broker] log update in class:LeastResourceUsageWithWeight
StevenLuMT commented on PR #20168: URL: https://github.com/apache/pulsar/pull/20168#issuecomment-1527062802 @heesung-sn help me review it ,thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] nicoloboschi commented on a diff in pull request #545: Add release note for Pulsar 3.0.0
nicoloboschi commented on code in PR #545: URL: https://github.com/apache/pulsar-site/pull/545#discussion_r1179979644 ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +- Omit making a copy of CommandAck when there are no broker interceptors in [#18997](https://github.com/apache/pulsar/pull/18997) +- Use correct file path for tls trust certificates in [#18712](https://github.com/apache/pulsar/pull/18712) +- Enable certificate refresh for Quorum and Netty Servers in [#18097](https://github.com/apache/pulsar/pull/18097) +- Remove timestamp from Prometheus metrics in [#17419](https://github.com/apache/pulsar/pull/17419) +- Revert 5895: fix redeliveryCount in [#17060](https://github.com/apache/pulsar/pull/17060) +- Fix producer/consume permission can’t get v1/schema in [#16018](https://github.com/apache/pulsar/pull/16018) +- Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#15640](https://github.com/apache/pulsar/pull/15640) + + + +### PIPs + +- PIP-160 Metrics stats of Transaction buffered writer [#15370](https://github.com/apache/pulsar/issues/15370) +- PIP-167 Make it Configurable to Require Subscription Permission [#15576](https://github.com/apache/pulsar/pull/15576) +- PIP-169 Support split bundle by flow or qps [#16782](https://github.com/apache/pulsar/pull/16782) +- PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551]((https://github.com/apache/pulsar/pull/16551)) Review Comment: ```suggestion - PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#16551](https://github.com/apache/pulsar/pull/16551) ``` ## release-notes/versioned/pulsar-3.0.0.md: ## @@ -0,0 +1,484 @@ +--- +id: pulsar-3.0.0 +title: Apache Pulsar 3.0.0 +sidebar_label: Apache Pulsar 3.0.0 +--- + + 2023-05-02 + +### Important notice + +- Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#20072](https://github.com/apache/pulsar/pull/20072) +- Introduce consistent hash ring to distribute the load of multiple topics subscription in [#19502](https://github.com/apache/pulsar/pull/19502) +- Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#19486](https://github.com/apache/pulsar/pull/19486) +- Require authRole is proxyRole to set originalPrincipal in [#19455](https://github.com/apache/pulsar/pull/19455) +- Update Elasticsearch sink idle cnx timeout to 30s in [#19377](https://github.com/apache/pulsar/pull/19377) +- Move checked exception into builder when newTransaction. in [#19356](https://github.com/apache/pulsar/pull/19356) +- TokenAuthenticationState: authenticate token only once in [#19314](https://github.com/apache/pulsar/pull/19314) +- OneStageAuth State: move authn out of constructor in [#19295](https://github.com/apache/pulsar/pull/19295) +- Update AuthenticationProvider to simplify HTTP Authn in [#19197](https://github.com/apache/pulsar/pull/19197) +- Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#19182](https://github.com/apache/pulsar/pull/19182) +- Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#19180](https://github.com/apache/pulsar/pull/19180) +- Reject create non existent persistent partitions. in [#19086](https://github.com/apache/pulsar/pull/19086) +-
[GitHub] [pulsar-site] tisonkun closed pull request #299: Add a page about the contents of the Matrix form
tisonkun closed pull request #299: Add a page about the contents of the Matrix form URL: https://github.com/apache/pulsar-site/pull/299 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] tisonkun commented on pull request #299: Add a page about the contents of the Matrix form
tisonkun commented on PR #299: URL: https://github.com/apache/pulsar-site/pull/299#issuecomment-1527045038 This can be superseded by #513. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-site] momo-jun opened a new pull request, #546: Pip 199
momo-jun opened a new pull request, #546: URL: https://github.com/apache/pulsar-site/pull/546 ### Motivation The new client matrix page will be live, so this PR makes the required updates on the doc side. Note that this PR has a dependency on https://github.com/apache/pulsar-site/pull/513, so I put it in draft. ### Modification 1. Update the link for the new client matrix page in client docs. 2. Add the new page to the left navigation. ### Documentation - [ ] `doc` - [ ] `doc-required` - [ ] `doc-not-needed` - [ ] `doc-complete` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [pulsar-client-node] XXXMrG commented on issue #320: [feature request] Any plan to support getPartitionsForTopic ?
XXXMrG commented on issue #320: URL: https://github.com/apache/pulsar-client-node/issues/320#issuecomment-1527039853 maybe i can try to support this api -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
