[GitHub] [pulsar] RobertIndie commented on pull request #20106: [fix][admin] Add javax.xml.bind:jaxb-api to shade

2023-05-02 Thread via GitHub


RobertIndie commented on PR #20106:
URL: https://github.com/apache/pulsar/pull/20106#issuecomment-1532433563

   The release note is collected by filtering the label like `component/admin`. 
This PR is not labeled with `component/admin`. So it's not included in the 
release note. 
   
   It's hard for the release manager to collect and classify all the unlabeled 
PRs. I encourage we should label all the PRs correctly before merging the PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] tisonkun commented on pull request #18646: [improve][misc] Allow custom Netty DnsServerAddressStreamProviders

2023-05-02 Thread via GitHub


tisonkun commented on PR #18646:
URL: https://github.com/apache/pulsar/pull/18646#issuecomment-1532419603

   ditto @RobertIndie 
https://github.com/apache/pulsar/pull/20106#issuecomment-1532419289


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] tisonkun commented on pull request #20106: [fix][admin] Add javax.xml.bind:jaxb-api to shade

2023-05-02 Thread via GitHub


tisonkun commented on PR #20106:
URL: https://github.com/apache/pulsar/pull/20106#issuecomment-1532419289

   cc @RobertIndie perhaps you can investigate why the release note is unsync?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] onobc commented on pull request #20106: [fix][admin] Add javax.xml.bind:jaxb-api to shade

2023-05-02 Thread via GitHub


onobc commented on PR #20106:
URL: https://github.com/apache/pulsar/pull/20106#issuecomment-1532411748

   I don't see this one in the [3.0.0 Release 
notes](https://github.com/apache/pulsar/releases/tag/v3.0.0) but I do see the 
changes in the 
[branch-3.0](https://github.com/apache/pulsar/blob/7636e8989f4d3fc24fce69a356d54e1c550945ed/pulsar-client-all/pom.xml#L185).
 Really I just want to make sure the fix is in 3.0.0 and there is not something 
else I am missing. 
   
   Thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] RobertIndie opened a new pull request, #20216: [cleanup][build] Bumped version to 3.1.0-SNAPSHOT

2023-05-02 Thread via GitHub


RobertIndie opened a new pull request, #20216:
URL: https://github.com/apache/pulsar/pull/20216

   
   
   
   ### Motivation
   
   Bumped version to 3.1.0-SNAPSHOT
   
   ### Does this pull request potentially affect one of the following parts:
   
   
   
   *If the box was checked, please highlight the changes*
   
   - [ ] Dependencies (add or upgrade a dependency)
   - [ ] The public API
   - [ ] The schema
   - [ ] The default values of configurations
   - [ ] The threading model
   - [ ] The binary protocol
   - [ ] The REST endpoints
   - [ ] The admin CLI options
   - [ ] The metrics
   - [ ] Anything that affects deployment
   
   ### Documentation
   
   
   
   - [ ] `doc` 
   - [ ] `doc-required` 
   - [x] `doc-not-needed` 
   - [ ] `doc-complete` 
   
   ### Matching PR in forked repository
   
   PR in forked repository: 
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] onobc commented on pull request #18646: [improve][misc] Allow custom Netty DnsServerAddressStreamProviders

2023-05-02 Thread via GitHub


onobc commented on PR #18646:
URL: https://github.com/apache/pulsar/pull/18646#issuecomment-1532393244

   I don't see this one in the [3.0.0 Release 
notes](https://github.com/apache/pulsar/releases/tag/v3.0.0) but I do see the 
changes in the 
[branch-3.0](https://github.com/apache/pulsar/blob/7636e8989f4d3fc24fce69a356d54e1c550945ed/pulsar-client/pom.xml#L83).
 Really I just want to make sure the fix is in 3.0.0 and there is not something 
else I am missing. 
   
   Thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] github-actions[bot] commented on pull request #19895: [fix][fn] Fix function update error

2023-05-02 Thread via GitHub


github-actions[bot] commented on PR #19895:
URL: https://github.com/apache/pulsar/pull/19895#issuecomment-1532360615

   The pr had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] 03/03: [build] Bump docusaurus version to 2.4.0

2023-05-02 Thread tison
This is an automated email from the ASF dual-hosted git repository.

tison pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git

commit ab312a6b7684131aea1eedaea9949be1ab66
Author: tison 
AuthorDate: Wed May 3 09:41:32 2023 +0800

[build] Bump docusaurus version to 2.4.0

Signed-off-by: tison 
---
 package.json |  12 +-
 yarn.lock| 430 +++
 2 files changed, 235 insertions(+), 207 deletions(-)

diff --git a/package.json b/package.json
index b94b0d98003..7346d156081 100644
--- a/package.json
+++ b/package.json
@@ -16,10 +16,10 @@
 "write-heading-ids": "docusaurus write-heading-ids"
   },
   "dependencies": {
-"@docusaurus/core": "2.2.0",
-"@docusaurus/plugin-client-redirects": "2.2.0",
-"@docusaurus/plugin-google-analytics": "2.2.0",
-"@docusaurus/preset-classic": "2.2.0",
+"@docusaurus/core": "2.4.0",
+"@docusaurus/plugin-client-redirects": "2.4.0",
+"@docusaurus/plugin-google-analytics": "2.4.0",
+"@docusaurus/preset-classic": "2.4.0",
 "@emotion/react": "^11.7.1",
 "@emotion/styled": "^11.6.0",
 "@mdx-js/react": "^1.6.22",
@@ -70,8 +70,8 @@
 ]
   },
   "devDependencies": {
-"@docusaurus/module-type-aliases": "2.2.0",
-"@docusaurus/types": "2.2.0",
+"@docusaurus/module-type-aliases": "2.4.0",
+"@docusaurus/types": "2.4.0",
 "@tsconfig/docusaurus": "^1.0.6",
 "@types/lodash": "^4.14.188",
 "@types/semver": "^7.3.13",
diff --git a/yarn.lock b/yarn.lock
index 8c58edb6671..da91eb0c8ad 100644
--- a/yarn.lock
+++ b/yarn.lock
@@ -1841,9 +1841,9 @@ __metadata:
   languageName: node
   linkType: hard
 
-"@docusaurus/core@npm:2.2.0":
-  version: 2.2.0
-  resolution: "@docusaurus/core@npm:2.2.0"
+"@docusaurus/core@npm:2.4.0":
+  version: 2.4.0
+  resolution: "@docusaurus/core@npm:2.4.0"
   dependencies:
 "@babel/core": ^7.18.6
 "@babel/generator": ^7.18.7
@@ -1855,13 +1855,13 @@ __metadata:
 "@babel/runtime": ^7.18.6
 "@babel/runtime-corejs3": ^7.18.6
 "@babel/traverse": ^7.18.8
-"@docusaurus/cssnano-preset": 2.2.0
-"@docusaurus/logger": 2.2.0
-"@docusaurus/mdx-loader": 2.2.0
+"@docusaurus/cssnano-preset": 2.4.0
+"@docusaurus/logger": 2.4.0
+"@docusaurus/mdx-loader": 2.4.0
 "@docusaurus/react-loadable": 5.5.2
-"@docusaurus/utils": 2.2.0
-"@docusaurus/utils-common": 2.2.0
-"@docusaurus/utils-validation": 2.2.0
+"@docusaurus/utils": 2.4.0
+"@docusaurus/utils-common": 2.4.0
+"@docusaurus/utils-validation": 2.4.0
 "@slorber/static-site-generator-webpack-plugin": ^4.0.7
 "@svgr/webpack": ^6.2.1
 autoprefixer: ^10.4.7
@@ -1882,7 +1882,7 @@ __metadata:
 del: ^6.1.1
 detect-port: ^1.3.0
 escape-html: ^1.0.3
-eta: ^1.12.3
+eta: ^2.0.0
 file-loader: ^6.2.0
 fs-extra: ^10.1.0
 html-minifier-terser: ^6.1.0
@@ -1921,40 +1921,40 @@ __metadata:
 react-dom: ^16.8.4 || ^17.0.0
   bin:
 docusaurus: bin/docusaurus.mjs
-  checksum: 
ff47e6cf85b0f7dc0a9e5b9b0d26e33a6f7385f067566ff4f9b026d044839e4dfb4c3bc9476cfab7a7e95a0065478a534cda403dac3bb7bac9987406f1978a11
+  checksum: 
04d30e31e9c4198ce3f4a47c4f59943f357ef96a5cfa10674fd3049d4cf067c15fa0ae184383ba3e420f59a9b3077ed1cf1f373626399f0e46cea6fcf0897d7b
   languageName: node
   linkType: hard
 
-"@docusaurus/cssnano-preset@npm:2.2.0":
-  version: 2.2.0
-  resolution: "@docusaurus/cssnano-preset@npm:2.2.0"
+"@docusaurus/cssnano-preset@npm:2.4.0":
+  version: 2.4.0
+  resolution: "@docusaurus/cssnano-preset@npm:2.4.0"
   dependencies:
 cssnano-preset-advanced: ^5.3.8
 postcss: ^8.4.14
 postcss-sort-media-queries: ^4.2.1
 tslib: ^2.4.0
-  checksum: 
eff9707414867bf844ef5d84bde1c843593b9b7f542dd1a0a7acc88798b0c5ddb721124229912c234bd88b93cb18d8d69c6115cbf706c2a790497f7d9dd23757
+  checksum: 
b8982230ec014378a5453453df400a328a6ecdeecffb666ead5cfbeb5dc689610f0e62ee818ffcc8adc270c7c47cb818ad730c769eb8fa689dd79d4f9d448b6d
   languageName: node
   linkType: hard
 
-"@docusaurus/logger@npm:2.2.0":
-  version: 2.2.0
-  resolution: "@docusaurus/logger@npm:2.2.0"
+"@docusaurus/logger@npm:2.4.0":
+  version: 2.4.0
+  resolution: "@docusaurus/logger@npm:2.4.0"
   dependencies:
 chalk: ^4.1.2
 tslib: ^2.4.0
-  checksum: 
b3ce6e18721a34793a892221485c941d5f7112ae96d569f7918d12c1f50bde9c99bc4195f4d225e874b2bd5800a35413bfeaf78b63c6fbae5f3015d44d118eee
+  checksum: 
0424b77e2abaa50f20d6042ededf831157852656d1242ae9b0829b897e6f5b1e1e5ea30df599839e0ec51c72e42a5a867b136387dd5359032c735f431eddd078
   languageName: node
   linkType: hard
 
-"@docusaurus/mdx-loader@npm:2.2.0":
-  version: 2.2.0
-  resolution: "@docusaurus/mdx-loader@npm:2.2.0"
+"@docusaurus/mdx-loader@npm:2.4.0":
+  version: 2.4.0
+  resolution: "@docusaurus/mdx-loader@npm:2.4.0"
   dependencies:
 "@babel/parser": ^7.18.8
 "@babel/traverse": ^7.18.8
-"@docusaurus/logger": 2.2.0
-

[pulsar-site] 01/03: [fix] Create parents on references generating

2023-05-02 Thread tison
This is an automated email from the ASF dual-hosted git repository.

tison pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git

commit 4598877e923966c46c9368cd5b3c24b46de0cff8
Author: tison 
AuthorDate: Wed May 3 09:37:43 2023 +0800

[fix] Create parents on references generating

Signed-off-by: tison 
---
 tools/pytools/lib/execute/config_doc_generator.py   | 4 +++-
 tools/pytools/lib/execute/pulsar_admin_clidoc_generator.py  | 4 +++-
 tools/pytools/lib/execute/pulsar_clidoc_generator.py| 4 +++-
 tools/pytools/lib/execute/pulsar_client_clidoc_generator.py | 1 +
 tools/pytools/lib/execute/pulsar_perf_clidoc_generator.py   | 1 +
 5 files changed, 11 insertions(+), 3 deletions(-)

diff --git a/tools/pytools/lib/execute/config_doc_generator.py 
b/tools/pytools/lib/execute/config_doc_generator.py
index b5ad27c1d9e..c0f08d60030 100644
--- a/tools/pytools/lib/execute/config_doc_generator.py
+++ b/tools/pytools/lib/execute/config_doc_generator.py
@@ -94,7 +94,9 @@ def execute(master: Path, version: str):
 ]
 
 for config in configs:
-with (reference / config.type / config.filename).open('w') as f:
+p = (reference / config.type / config.filename)
+p.parent.mkdir(exist_ok=True, parents=True)
+with p.open('w') as f:
 run(java, '-cp', classpath, config.generator, '-c', 
config.classname, stdout=f)
 
 shutil.copy2(
diff --git a/tools/pytools/lib/execute/pulsar_admin_clidoc_generator.py 
b/tools/pytools/lib/execute/pulsar_admin_clidoc_generator.py
index 088312b5319..7f1c8bf3b14 100644
--- a/tools/pytools/lib/execute/pulsar_admin_clidoc_generator.py
+++ b/tools/pytools/lib/execute/pulsar_admin_clidoc_generator.py
@@ -49,5 +49,7 @@ def execute(basedir: Path, version: str):
 ]
 
 for command in commands:
-with (reference / f'{command}.md').open('w') as f:
+p = (reference / f'{command}.md')
+p.parent.mkdir(exist_ok=True, parents=True)
+with p.open('w') as f:
 run(str(admin.absolute()), 'documents', 'generate', command, 
stdout=f)
diff --git a/tools/pytools/lib/execute/pulsar_clidoc_generator.py 
b/tools/pytools/lib/execute/pulsar_clidoc_generator.py
index ffc9f20ae48..e76c4bc9fb6 100644
--- a/tools/pytools/lib/execute/pulsar_clidoc_generator.py
+++ b/tools/pytools/lib/execute/pulsar_clidoc_generator.py
@@ -43,7 +43,9 @@ def execute(basedir: Path, version: str):
 ]
 
 for command in commands:
-with (reference / f'{command[0]}.md').open('w') as f:
+p = (reference / f'{command[0]}.md')
+p.parent.mkdir(exist_ok=True, parents=True)
+with p.open('w') as f:
 run(str(pulsar.absolute()), *command, codes={0, 255}, stdout=f, 
env={
 'PULSAR_BROKER_CONF': 'conf/broker.conf',
 'PULSAR_WORKER_CONF': 'conf/functions_worker.yml',
diff --git a/tools/pytools/lib/execute/pulsar_client_clidoc_generator.py 
b/tools/pytools/lib/execute/pulsar_client_clidoc_generator.py
index c3c1616e0b6..fdba56f1ac5 100644
--- a/tools/pytools/lib/execute/pulsar_client_clidoc_generator.py
+++ b/tools/pytools/lib/execute/pulsar_client_clidoc_generator.py
@@ -25,5 +25,6 @@ def execute(basedir: Path, version: str):
 client = basedir / 'bin' / 'pulsar-client'
 reference = site_path() / 'static' / 'reference' / version / 
'pulsar-client'
 
+reference.mkdir(exist_ok=True, parents=True)
 with (reference / 'pulsar-client.md').open('w') as f:
 run(str(client.absolute()), 'generate_documentation', stdout=f)
diff --git a/tools/pytools/lib/execute/pulsar_perf_clidoc_generator.py 
b/tools/pytools/lib/execute/pulsar_perf_clidoc_generator.py
index e737eed00f0..d6450d3f848 100644
--- a/tools/pytools/lib/execute/pulsar_perf_clidoc_generator.py
+++ b/tools/pytools/lib/execute/pulsar_perf_clidoc_generator.py
@@ -25,5 +25,6 @@ def execute(basedir: Path, version: str):
 perf = basedir / 'bin' / 'pulsar-perf'
 reference = site_path() / 'static' / 'reference' / version / 'pulsar-perf'
 
+reference.mkdir(exist_ok=True, parents=True)
 with (reference / 'pulsar-perf.md').open('w') as f:
 run(str(perf.absolute()), 'gen-doc', stdout=f)



[pulsar-site] branch main updated (553e8e92177 -> ab312a6b768)

2023-05-02 Thread tison
This is an automated email from the ASF dual-hosted git repository.

tison pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from 553e8e92177 [BLOG] Add pulsar 3.0 blog post  (#548)
 new 4598877e923 [fix] Create parents on references generating
 new 557053d6b3c [feat] add version packge script
 new ab312a6b768 [build] Bump docusaurus version to 2.4.0

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 package.json   |  13 +-
 tools/pytools/lib/execute/config_doc_generator.py  |   4 +-
 .../lib/execute/pulsar_admin_clidoc_generator.py   |   4 +-
 .../pytools/lib/execute/pulsar_clidoc_generator.py |   4 +-
 .../lib/execute/pulsar_client_clidoc_generator.py  |   1 +
 .../lib/execute/pulsar_perf_clidoc_generator.py|   1 +
 yarn.lock  | 430 +++--
 7 files changed, 247 insertions(+), 210 deletions(-)



[pulsar-site] 02/03: [feat] add version packge script

2023-05-02 Thread tison
This is an automated email from the ASF dual-hosted git repository.

tison pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git

commit 557053d6b3c4ecca118644c1f53a520133da8182
Author: tison 
AuthorDate: Wed May 3 09:38:41 2023 +0800

[feat] add version packge script

Signed-off-by: tison 
---
 package.json | 1 +
 1 file changed, 1 insertion(+)

diff --git a/package.json b/package.json
index 074867e4b67..b94b0d98003 100644
--- a/package.json
+++ b/package.json
@@ -11,6 +11,7 @@
 "deploy": "docusaurus deploy",
 "clear": "docusaurus clear",
 "serve": "docusaurus serve",
+"version": "docusaurus docs:version",
 "write-translations": "docusaurus write-translations",
 "write-heading-ids": "docusaurus write-heading-ids"
   },



[GitHub] [pulsar] tisonkun closed issue #20214: [Doc] Can't find folder when generating the reference doc

2023-05-02 Thread via GitHub


tisonkun closed issue #20214: [Doc] Can't find folder when generating the 
reference doc
URL: https://github.com/apache/pulsar/issues/20214


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] tisonkun merged pull request #551: [fix] Create parents on references generating

2023-05-02 Thread via GitHub


tisonkun merged PR #551:
URL: https://github.com/apache/pulsar-site/pull/551


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch main updated: [BLOG] Add pulsar 3.0 blog post (#548)

2023-05-02 Thread zike
This is an automated email from the ASF dual-hosted git repository.

zike pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


The following commit(s) were added to refs/heads/main by this push:
 new 553e8e92177 [BLOG] Add pulsar 3.0 blog post  (#548)
553e8e92177 is described below

commit 553e8e921772c29d07edb3c785475caa79640c93
Author: Sherlock Xu <65327072+sherlock...@users.noreply.github.com>
AuthorDate: Wed May 3 09:49:01 2023 +0800

[BLOG] Add pulsar 3.0 blog post  (#548)

* Add pulsar 3.0 blog post

* update the blog post

* Update the blog post
---
 blog/2023-05-02-announcing-apache-pulsar-3-0.md | 139 
 static/img/pulsar-new-release-model.png | Bin 0 -> 52413 bytes
 2 files changed, 139 insertions(+)

diff --git a/blog/2023-05-02-announcing-apache-pulsar-3-0.md 
b/blog/2023-05-02-announcing-apache-pulsar-3-0.md
new file mode 100644
index 000..e426baf4b0b
--- /dev/null
+++ b/blog/2023-05-02-announcing-apache-pulsar-3-0.md
@@ -0,0 +1,139 @@
+---
+title: "Announcing Apache Pulsar 3.0: The First Long-Term Support Release"
+date: 2023-05-02
+author: Apache Pulsar Community
+---
+
+**The Apache Pulsar community today announces the release of Apache Pulsar 
3.0, the first Long-Term Support (LTS) version!** This is a remarkable 
community effort, with over 140 contributors submitting about 1500 commits for 
feature enhancements and bug fixes. We would like to thank all of them for 
their contributions!
+
+
+
+## Introducing Long-Term Support releases
+
+Starting from Pulsar 3.0, the Pulsar community plans to release LTS versions 
to meet the needs of different users for stability and new features, as well as 
to reduce the burden of maintaining historical releases.
+
+The previous release process has short maintenance cycles of approximately 3 
to 4 months, while many users are still using old versions. To keep up with new 
updates and features, they may be forced to perform upgrades within a short 
timeframe, for which they are not prepared in terms of available time and 
required efforts.
+
+Therefore, the Pulsar community introduces LTS versions with feature releases 
between them. The project follows a variant of Semantic Versioning, replacing 
`major.minor.patch` with `LTS.feature.patch`. For example:
+
+- 2.11.0 is a feature release;
+- 3.0.0 is the first LTS release;
+- 3.0.1 is a patch release of the LTS release;
+- 3.1.0 is a feature release;
+- 3.2.0 is a feature release;
+- 3.2.1 is a patch release;
+- 4.0.0 is an LTS release.
+
+This pattern provides version support for users seeking stability and those 
seeking new features. Users who want a more stable release can use versions 
3.0.x, while those seeking new features can use versions 3.x. This new release 
model is a major step for the Pulsar community because it:
+
+- Allows users to choose between different releases based on their needs for 
stability or new features;
+- Clarifies the release cycle for both maintainers and users;
+- Frees maintainers from spending too much time maintaining a long list of old 
releases.
+
+With the new release model, the Pulsar community looks to release LTS versions 
every 18 months, with bug fixes continuing for 24 months and security 
vulnerability patches supported for 36 months. See the image below for details.
+
+![](/img/pulsar-new-release-model.png)
+
+For more information, see 
[PIP-175](https://github.com/apache/pulsar/issues/15966) and the [Release 
policy](pathname:///contribute/release-policy/).
+
+## What’s new in Apache Pulsar 3.0?
+
+Apache Pulsar 3.0 is a major release with a number of important features, 
enhancements, and fixes. Here are some of the highlighted ones.
+
+### New Pulsar broker load balancer
+
+[PIP-192](https://github.com/apache/pulsar/issues/16691) introduces a new load 
manager implementation, aiming to balance cluster utilization as evenly as 
possible while minimizing latency and reducing reliance on ZooKeeper.
+
+Issues with the previous load manager include:
+
+- Load data for all brokers and bundles is replicated to all brokers via ZK 
watchers. This N-replication poses scalability issues when Pulsar clusters grow 
to thousands of brokers and millions of topics.
+- Lookup requires redirection to the leader broker.
+
+In Pulsar 3.0, the broker and bundle load data have been re-evaluated. The new 
load manager stores this load data in non-persistent topics, while topic 
ownership information is saved in system topics and maintained with a state 
machine for eventual consistency. Clients can now connect to any broker for 
lookup without redirection.
+
+### Large-scale delayed message support
+
+Scheduled and delayed message delivery is a common feature in messaging 
systems. [PIP-195](https://github.com/apache/pulsar/issues/16763) aims to 
address limitations in this feature, which has been supported since version 
2.4.0. The issues with the current 

[GitHub] [pulsar-site] RobertIndie merged pull request #548: [BLOG] Add pulsar 3.0 blog post

2023-05-02 Thread via GitHub


RobertIndie merged PR #548:
URL: https://github.com/apache/pulsar-site/pull/548


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] tisonkun opened a new pull request, #551: [fix] Create parents on references generating

2023-05-02 Thread via GitHub


tisonkun opened a new pull request, #551:
URL: https://github.com/apache/pulsar-site/pull/551

   This closes https://github.com/apache/pulsar/issues/20214.
   
   ### Documentation
   
   
   
   - [ ] `doc` 
   - [ ] `doc-required` 
   - [x] `doc-not-needed` 
   - [ ] `doc-complete` 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] tisonkun commented on issue #20214: [Doc] Can't find folder when generating the reference doc

2023-05-02 Thread via GitHub


tisonkun commented on issue #20214:
URL: https://github.com/apache/pulsar/issues/20214#issuecomment-1532350163

   Thanks for reporting this issue! We should protectively create the parent 
folder on missing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] RobertIndie merged pull request #550: Bump Pulsar doc 3.0.0

2023-05-02 Thread via GitHub


RobertIndie merged PR #550:
URL: https://github.com/apache/pulsar-site/pull/550


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] RobertIndie opened a new issue, #20214: [Doc] Can't find folder when generating the reference doc

2023-05-02 Thread via GitHub


RobertIndie opened a new issue, #20214:
URL: https://github.com/apache/pulsar/issues/20214

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) 
and found nothing similar.
   
   
   ### What issue do you find in Pulsar docs?
   
   When generating the reference doc according to 
https://pulsar.apache.org/contribute/release-process/#reference, it raises this 
error:
   ```
   poetry run bin/reference-doc-generator.py 
--master-path=/Users/aaronrobert/codebase/pulsar.branch-3.0 --version=3.0.0
   
   Traceback (most recent call last):
 File 
"/Users/aaronrobert/codebase/pulsar-site/tools/pytools/bin/reference-doc-generator.py",
 line 61, in 
   pulsar_admin_clidoc_generator.execute(master_path, version)
 File 
"/Users/aaronrobert/codebase/pulsar-site/tools/pytools/lib/execute/pulsar_admin_clidoc_generator.py",
 line 52, in execute
   with (reference / f'{command}.md').open('w') as f:
 File 
"/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/pathlib.py", 
line 1119, in open
   return self._accessor.open(self, mode, buffering, encoding, errors,
   FileNotFoundError: [Errno 2] No such file or directory: 
'/Users/aaronrobert/codebase/pulsar-site/static/reference/3.0.x/pulsar-admin/broker-stats.md'
   ```
   
   It is trying to find the folder `pulsar-site/static/reference/3.0.x`, but it 
doesn't exist.
   
   ### What is your suggestion?
   
   My workaround is to create that folder manually: `cp -r next 3.0.x`
   
   ### Any reference?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] github-actions[bot] commented on pull request #550: Bump Pulsar doc 3.0.0

2023-05-02 Thread via GitHub


github-actions[bot] commented on PR #550:
URL: https://github.com/apache/pulsar-site/pull/550#issuecomment-1532343504

   @RobertIndie Please add the following content to your PR description and 
select a checkbox:
   ```
   - [ ] `doc` 
   - [ ] `doc-required` 
   - [ ] `doc-not-needed` 
   - [ ] `doc-complete` 
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] RobertIndie opened a new pull request, #550: Bump Pulsar doc 3.0.0

2023-05-02 Thread via GitHub


RobertIndie opened a new pull request, #550:
URL: https://github.com/apache/pulsar-site/pull/550

   ### Documentation
   
   
   
   - [ ] `doc` 
   - [ ] `doc-required` 
   - [ ] `doc-not-needed` 
   - [ ] `doc-complete` 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] merlimat merged pull request #549: Update document for Pulsar 3.0.0

2023-05-02 Thread via GitHub


merlimat merged PR #549:
URL: https://github.com/apache/pulsar-site/pull/549


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch main updated: Add release note for Pulsar 3.0.0 (#545)

2023-05-02 Thread mmerli
This is an automated email from the ASF dual-hosted git repository.

mmerli pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


The following commit(s) were added to refs/heads/main by this push:
 new 9383130361b Add release note for Pulsar 3.0.0 (#545)
9383130361b is described below

commit 9383130361bb79dc229dcc2813e04d4b2f6cc35d
Author: Zike Yang 
AuthorDate: Wed May 3 07:58:03 2023 +0800

Add release note for Pulsar 3.0.0 (#545)

* Add release note for Pulsar 3.0.0

* Update releaes notes

* Update release-notes/versioned/pulsar-3.0.0.md

Co-authored-by: fengyubiao <9947...@qq.com>

* changes of brokers

* Apply suggestions from code review

Co-authored-by: Nicolò Boschi 

* Remove superseded dependency upgrade

* Remove some empty lines

* Update release-notes/versioned/pulsar-3.0.0.md

Co-authored-by: Anonymitaet <50226895+anonymit...@users.noreply.github.com>

* Remove some empty lines

* Apply suggestions from code review

Co-authored-by: Jun Ma <60642177+momo-...@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Jun Ma <60642177+momo-...@users.noreply.github.com>

* Add special thanks part

* Add release note for Pulsar client

-

Co-authored-by: fengyubiao <9947...@qq.com>
Co-authored-by: fengyubiao 
Co-authored-by: Nicolò Boschi 
Co-authored-by: Anonymitaet <50226895+anonymit...@users.noreply.github.com>
Co-authored-by: Jun Ma <60642177+momo-...@users.noreply.github.com>
---
 release-notes/versioned/client-java-3.0.0.md |  42 +++
 release-notes/versioned/pulsar-3.0.0.md  | 453 +++
 2 files changed, 495 insertions(+)

diff --git a/release-notes/versioned/client-java-3.0.0.md 
b/release-notes/versioned/client-java-3.0.0.md
new file mode 100644
index 000..91f906f65d1
--- /dev/null
+++ b/release-notes/versioned/client-java-3.0.0.md
@@ -0,0 +1,42 @@
+---
+id: client-java-3.0.0
+title: Client Java 3.0.0
+sidebar_label: Client Java 3.0.0
+---
+
+- PIP-224: Add getLastMessageIds API by @BewareMyPower in 
[#20040](https://github.com/apache/pulsar/pull/20040)
+- Refactor client version format by @RobertIndie in 
[#19643](https://github.com/apache/pulsar/pull/19643)
+- Fix authentication not update after changing the serviceUrl by @hangc0276 in 
[#19510](https://github.com/apache/pulsar/pull/19510)
+- Fix load the trust store file by @nodece in 
[#19483](https://github.com/apache/pulsar/pull/19483)
+- PIP-229: Add a common interface to get fields of MessageIdData by 
@BewareMyPower in [#19414](https://github.com/apache/pulsar/pull/19414)
+- Fix async method composition in admin client's NamespacesImpl by @lhotari in 
[#19397](https://github.com/apache/pulsar/pull/19397)
+- Fix async completion in ConsumerImpl#processPossibleToDLQ by @lhotari in 
[#19392](https://github.com/apache/pulsar/pull/19392)
+- Change default threads from 1 to available processors by @codelipenghui in 
[#19059](https://github.com/apache/pulsar/pull/19059)
+- Retry letter producer respect auto schema by @tisonkun in 
[#19051](https://github.com/apache/pulsar/pull/19051)
+- Add unified newTableView method in PulsarClient by @yuruguo in 
[#19048](https://github.com/apache/pulsar/pull/19048)
+- Check topic pattern when creating consumer by @yuruguo in 
[#19029](https://github.com/apache/pulsar/pull/19029)
+- Prevent DNS reverse lookup when physical address is an IP address by 
@lhotari in [#19028](https://github.com/apache/pulsar/pull/19028)
+- ConsumerBuilder.java comments by @mendonk in 
[#18706](https://github.com/apache/pulsar/pull/18706)
+- For exclusive subscriptions, if two consumers are created repeatedly, the 
second consumer will block by @lordcheng10 in 
[#18633](https://github.com/apache/pulsar/pull/18633)
+- Move acknowledge APIs to another interface and improve docs by 
@BewareMyPower in [#18519](https://github.com/apache/pulsar/pull/18519)
+- Avoid allocating unused buffer when receiving chunk message by @RobertIndie 
in [#18511](https://github.com/apache/pulsar/pull/18511)
+- Fix multi-topic consumer stuck after redeliver messages by @poorbarcode in 
[#18491](https://github.com/apache/pulsar/pull/18491)
+- Fix the note of seek in the consumer by @RobertIndie in 
[#18476](https://github.com/apache/pulsar/pull/18476)
+- Fix failover/exclusive consumer with batch cumulate ack issue. by 
@Technoboy- in [#18454](https://github.com/apache/pulsar/pull/18454)
+- Change the get lastMessageId to debug level by @zymap in 
[#18421](https://github.com/apache/pulsar/pull/18421)
+- Fix the Windows absolute path not recognized in auth param string by 
@BewareMyPower in [#18403](https://github.com/apache/pulsar/pull/18403)
+- Fix exception when calling loadConf on a ConsumerBuilder that has a 
KeySharedPolicy by @cbornet in 

[GitHub] [pulsar-site] merlimat merged pull request #545: Add release note for Pulsar 3.0.0

2023-05-02 Thread via GitHub


merlimat merged PR #545:
URL: https://github.com/apache/pulsar-site/pull/545


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] RobertIndie opened a new pull request, #549: Update document for Pulsar 3.0.0

2023-05-02 Thread via GitHub


RobertIndie opened a new pull request, #549:
URL: https://github.com/apache/pulsar-site/pull/549

   ### Documentation
   
   
   
   - [x] `doc` 
   - [ ] `doc-required` 
   - [ ] `doc-not-needed` 
   - [ ] `doc-complete` 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



svn commit: r61616 - /dev/pulsar/pulsar-3.0.0-candidate-4/ /release/pulsar/pulsar-3.0.0/

2023-05-02 Thread mmerli
Author: mmerli
Date: Tue May  2 22:38:45 2023
New Revision: 61616

Log:
Release Apache Pulsar 3.0.0

Added:
release/pulsar/pulsar-3.0.0/
  - copied from r61615, dev/pulsar/pulsar-3.0.0-candidate-4/
Removed:
dev/pulsar/pulsar-3.0.0-candidate-4/



[pulsar] annotated tag v3.0.0 updated (7636e8989f4 -> 6354eebcb8a)

2023-05-02 Thread zike
This is an automated email from the ASF dual-hosted git repository.

zike pushed a change to annotated tag v3.0.0
in repository https://gitbox.apache.org/repos/asf/pulsar.git


*** WARNING: tag v3.0.0 was modified! ***

from 7636e8989f4 (commit)
  to 6354eebcb8a (tag)
 tagging 7636e8989f4d3fc24fce69a356d54e1c550945ed (commit)
 replaces v3.0.0-candidate-3
  by Zike Yang
  on Wed May 3 06:29:19 2023 +0800

- Log -
Release v3.0.0
-BEGIN PGP SIGNATURE-

iQJEBAABCgAuFiEE6ItqSN52cCOQDJEjT0AbyNP5+1UFAmRRjsAQHHppa2VAYXBh
Y2hlLm9yZwAKCRBPQBvI0/n7VXmLD/9TajV8qRZQ65EUMzH8xCqLcbZ5ltsLfGtH
YK6a+Gucs1RjOKzUeQj+htyoy96iQ7FFhegGR0Brdoj0Tt6AyeeLK8oy+lULEGcH
1rUbJoJph+8EjmWU4IIEEIXrELZ8OucMVoisF9b2YxqMBuzfiHUr6PzVEaZtfjje
CM5uogqwk6A7/zPkKvt9D8ChHP3Xm+1fH0cN6ICNfPO7JtHRFlDOn4y6xmBN7oQl
9WXTJwCr059Bbu7uA6twe/SIygn08oEus1cyILp7/C6MdBOCxiaG+ZJKPkqE0wGB
X27lGTxM6ck86AFkBH3T/1ZewGnSfwj3i0BW/U3fkChBjY+spvsX5r2ncxwRSKaG
oUHvee3bka/rE0sKLxrMZIl4Ua94ZD4XrJjiMpGpelDXut/ZsEFTqH8Zd37FkIq4
f4dCFu2CV6/G0NQYJ8nRuJkiCWBABa3UAetgHSYzUO/KKgfwEirdZnOhbgiDx3l8
fHVxTjYMakgEVjhJZFoVB0WoSWO2qTmcqu+MsXCWySKxGzASM4qjzGR1EvKawpEm
+mSFX7StE8JnmiY/HTEpE9rASfPuLsTPPliNEg4FlybooWsYlD2E7wuERmEv2GF/
XAVPcBkF9UuKfLVIvFu21+zP3EApJyqqGLvQNtRtPV1YbW+0HE6FgO5cAAa081m4
WXA8qyC70A==
=LO4A
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:



[GitHub] [pulsar-client-python] tisonkun commented on issue #85: [Investigation] Fully-native Python client

2023-05-02 Thread via GitHub


tisonkun commented on issue #85:
URL: 
https://github.com/apache/pulsar-client-python/issues/85#issuecomment-153174

   https://user-images.githubusercontent.com/18818196/235723965-dd62715c-84c8-4e96-b725-ad2cb6500c85.png;>
   
   I workaround it with comment in 
https://github.com/twisted/pydoctor/issues/658. Although, it may require a 
preinstalled `_pulsar` module. Perhaps we can find a better way in API docs 
automatic generation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-python] tisonkun commented on issue #85: [Investigation] Fully-native Python client

2023-05-02 Thread via GitHub


tisonkun commented on issue #85:
URL: 
https://github.com/apache/pulsar-client-python/issues/85#issuecomment-1531697010

   @BewareMyPower This can be a known issue tracked at 
https://github.com/twisted/pydoctor/issues/658 which I don't have time to 
investigate at that time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-python] BewareMyPower commented on issue #115: Python clients lacks startMessageIdInclusive setting

2023-05-02 Thread via GitHub


BewareMyPower commented on issue #115:
URL: 
https://github.com/apache/pulsar-client-python/issues/115#issuecomment-1531672113

   > I'm unsure how to even set up a development environment to contribute and 
test the issue.
   
   The README provides the guide for how to test the issue. Regarding the 
development environment, you can use IDE like CLion. But for such simple 
changes, I think you can just write code via text editors and run the CLI 
commands referred in the README to test.
   
   I admit the lack of documents for developers. Maybe we can add them later.
   
   BTW, I developed the Python client via Vim with the 
[coc.nvim](https://github.com/neoclide/coc.nvim) plugin. Here is my `.ccls` 
file (in Linux) provided for the `ccls` LSP server:
   
   ```
   g++
   -std=c++11
   -stdlib=libstdc++
   -I
   /home/xyz/software/pulsar-client-cpp/include
   -I
   /usr/include/python3.8
   -I
   ./pybind11/include
   ```
   
   I installed the C++ client to `/home/xyz/software/pulsar-client-cpp` and the 
PyBind11 source code in `./pybind11` by following the guide in REAMDE.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-python] BewareMyPower commented on issue #85: [Investigation] Fully-native Python client

2023-05-02 Thread via GitHub


BewareMyPower commented on issue #85:
URL: 
https://github.com/apache/pulsar-client-python/issues/85#issuecomment-1531652717

   > in the subscribe section simply has a default value of 
_pulsar.ConsumerType.Exclusive but no details on what other ConsumerTypes there 
are.
   
   It's an issue with the Python API docs generation for the `_pulsar` module, 
which is a C++ wrapper written based on the PyBind11. It seems currently the 
Python docs generation tool does not generate the docs for the `_pulsar` 
module. /cc @tisonkun 
   
   On the other hand, PyBind11 support adding the Python API docs via the C++ 
code. Currently the docs were not good. For example, I typed 
`help(_pulsar.ConsumerType)` and see:
   
   ```
|  --
|  Data and other attributes defined here:
|
|  Exclusive = 
|
|  Failover = 
|
|  KeyShared = 
|
|  Shared = 
|
|  --
|  Static methods inherited from pybind11_builtins.pybind11_object:
|
|  __new__(*args, **kwargs) from pybind11_builtins.pybind11_type
|  Create and return a new object.  See help(type) for accurate 
signature.
   ```
   
   We can enhance the API docs later.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] hicolour commented on pull request #16171: [fix][client] Fix duplicate messages caused by seek

2023-05-02 Thread via GitHub


hicolour commented on PR #16171:
URL: https://github.com/apache/pulsar/pull/16171#issuecomment-1531524571

   Hey @nodece, why this PR was closed? Does it it mean that this PR and 
https://github.com/apache/pulsar/pull/15568 will not be  delivered to the 
maistream ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] Abhiramkns commented on issue #16184: pulsar.Client() needs option to supress STDOUT

2023-05-02 Thread via GitHub


Abhiramkns commented on issue #16184:
URL: https://github.com/apache/pulsar/issues/16184#issuecomment-1531516616

   Hello guys, I would like to take up this bug. I'm new to this, so please 
help me out with which part of the code I should make changes to.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] rbarbey opened a new pull request, #262: [feat] Support end-to-end encryption in C Reader API

2023-05-02 Thread via GitHub


rbarbey opened a new pull request, #262:
URL: https://github.com/apache/pulsar-client-cpp/pull/262

   
   
   
   
   Fixes #166 and is a prerequisite for apache/pulsar-client-node#276
   
   ### Motivation
   
   This change allows C and derived clients to use end-to-end encryption for 
Readers.
   
   ### Modifications
   
   Exposed the methods that already in the C++ API in the C interface
   
   ### Verifying this change
   
   - [ ] Make sure that the change passes the CI checks.
   
   This change is a trivial rework / code cleanup without any test coverage.
   
   ### Documentation
   
   
   
   - [ ] `doc-required` 
   (Your PR needs to update docs and you will update later)
   
   - [ ] `doc-not-needed` 
   (Please explain why)
   
   - [ ] `doc` 
   (Your PR contains doc changes)
   
   - [ ] `doc-complete`
   (Docs have been already added)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] Samreay edited a discussion: How to get the latest message (Python client)?

2023-05-02 Thread GitBox


GitHub user Samreay edited a discussion: How to get the latest message (Python 
client)?

Is there a way to get the latest published message in a topic efficiently using 
the python client? Right now in our proof of concept we've spun up  a redis 
instance to cache the latest value, but it seems like we're missing something 
obvious, because I imagine getting the latest published message is a fairly key 
feature in an event-driven system!

I've raised an issue with the Python client over `startMessageInclusive` 
(https://github.com/apache/pulsar-client-python/issues/115), but I'm aware 
there are probably many ways to approach things and there might be something 
simple I've missed.

GitHub link: https://github.com/apache/pulsar/discussions/20213


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org



[GitHub] [pulsar-client-python] Samreay commented on issue #85: [Investigation] Fully-native Python client

2023-05-02 Thread via GitHub


Samreay commented on issue #85:
URL: 
https://github.com/apache/pulsar-client-python/issues/85#issuecomment-1531069608

   To echo the above comment, I just raised 
https://github.com/apache/pulsar-client-python/issues/115 and was going to see 
if I could open a PR for it myself. Without a native python client, the barrier 
to entry on contributing is quite high.
   
   On top of this, there's also the value lost for developers when using the 
library itself. Things like type hints and the internal options are obfuscated.
   
   For a concrete example of this, all the imports from `_pulsar` like 
`ConsumerType` have no autocomplete and no python documentation from the code 
itself. Even the API doc (https://pulsar.apache.org/api/python/2.4.0/) in the 
`subscribe` section simply has a default value of 
`_pulsar.ConsumerType.Exclusive` but no details on what other ConsumerTypes 
there are.
   
   In fact, to figure out what was available, I ended up searching the C++ 
client repo for "ConsumerType" and ending up at 
https://github.com/apache/pulsar-client-cpp/blob/4a864f20530e230ecee7e4ab09430bd65fb9789c/include/pulsar/ConsumerType.h#L28
   
   It has the information I wanted, but in terms of a smooth developer 
experience, having to manually search C++ code to figure out what I can pass in 
to my python signature is less than ideal. Happy to be part of the solution 
here though, and if we migrate to Pulsar I'm very happy to contribute as much 
as possible.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-python] Samreay opened a new issue, #115: Python clients lacks startMessageIdInclusive setting

2023-05-02 Thread via GitHub


Samreay opened a new issue, #115:
URL: https://github.com/apache/pulsar-client-python/issues/115

   Hi all,
   
   As discussed in https://github.com/apache/pulsar/issues/10483 and 
https://github.com/apache/pulsar/issues/10328, it seems like the official way 
to get the latest message is to register a reader using startMessageIdInclusive 
and set the message id to `latest`.
   
   It seems like the functionality was added in the C++ client over at 
https://github.com/apache/pulsar/pull/17209/files, however has yet to come to 
the python client itself.
   
   I believe (and very happy to be proven wrong), that this means python 
clients have no way of actually getting the latest value apart from iterating 
from the start, which is seems... suboptimal.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] gmiklos-ltg commented on a diff in pull request #20115: [improve][fn] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom Ser

2023-05-02 Thread via GitHub


gmiklos-ltg commented on code in PR #20115:
URL: https://github.com/apache/pulsar/pull/20115#discussion_r1182197554


##
pulsar-functions/instance/src/test/java/org/apache/pulsar/functions/source/TopicSchemaTest.java:
##


Review Comment:
   I have expanded upon PulsarFunctionsTest to also include an input SerDe 
class. It should fail on the current master because as it was similarly with 
#5357 it uses the wrong classloader to load the input SerDe class.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] niclash added a comment to the discussion: Pulsar Functions lifecycle and depolyment details.

2023-05-02 Thread GitBox


GitHub user niclash added a comment to the discussion: Pulsar Functions 
lifecycle and depolyment details.

Ok, thanks. That helps a lot.

1. Each function getting its own (times the parallelism) OS process? Or can 
they share OS processes?



GitHub link: 
https://github.com/apache/pulsar/discussions/20195#discussioncomment-5777263


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org