[GitHub] [pulsar-client-cpp] licj520 opened a new issue, #260: [Bug] pulsar::InitialPositionEarliest Not effective

2023-04-26 Thread via GitHub


licj520 opened a new issue, #260:
URL: https://github.com/apache/pulsar-client-cpp/issues/260

   ### Search before asking
   
   - [X] I searched in the 
[issues](https://github.com/apache/pulsar-client-cpp/issues) and found nothing 
similar.
   
   
   ### Version
   
   3.2.0-pre
   
   ### Minimal reproduce step
   
   Consumer consumer;
   ConsumerConfiguration config;
   config.setMessageListener(listener);
   config.setSubscriptionInitialPosition(pulsar::InitialPositionEarliest);
   
   ### What did you expect to see?
   
   After restarting, it can be received from the beginning
   
   ### What did you see instead?
   
   Start spending from the Latest after restarting
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] Anonymitaet commented on a diff in pull request #542: Add doc for available-functions and functions reload

2023-04-26 Thread via GitHub


Anonymitaet commented on code in PR #542:
URL: https://github.com/apache/pulsar-site/pull/542#discussion_r1178633867


##
docs/functions-deploy-cluster-builtin.md:
##
@@ -14,3 +14,15 @@ bin/pulsar-admin functions create \
   --inputs persistent://public/default/input-1 \
   --output persistent://public/default/output-1
 ```
+
+To get the list of available built-in Functions, use the `available-functions` 
command:
+
+```bash
+bin/pulsar-admin functions available-functions
+```
+
+If you add or delete a nar file in a `functions` folder, reload the available 
built-in functions before using it.

Review Comment:
   ```suggestion
   If you add or delete a NAR file in a `functions` folder, reload the 
available built-in functions before using it.
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] Anonymitaet commented on pull request #18951: [improve][fn] support reading config options from file in Function Python Runner

2023-04-26 Thread via GitHub


Anonymitaet commented on PR #18951:
URL: https://github.com/apache/pulsar/pull/18951#issuecomment-1524713954

   @tpiperatgod thanks for your technical input! I've restructured the docs 
based on user learning habits and raised a question in 
https://github.com/apache/pulsar-site/pull/544#issuecomment-1524712753, PTAL.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] Anonymitaet commented on pull request #544: [improve][fn] add docs for supporting reading config options from files in Python runner

2023-04-26 Thread via GitHub


Anonymitaet commented on PR #544:
URL: https://github.com/apache/pulsar-site/pull/544#issuecomment-1524712753

   Hi @tpiperatgod, I submit this PR since it's more convenient to show you my 
thoughts and preview. 
   
   ### Preview
   
   
![image](https://user-images.githubusercontent.com/50226895/234763124-0037aa03-37da-4405-bdca-5c4927b03a0b.png)
   
   ### Doc changes explanations
   
   2️⃣3️⃣ in the image above
   I've restricted the doc structure by "showing the example first" and then 
"explaining the details". 
   
   Reasons:
   
   1) Most developers are likely "learning by doing" rather than "learning by 
reading". Examples always attract them the most. "Hook them up" first and then 
they have more patience to read it through.
   
   2) The doc structure is more clear. The beginning is the example, and the 
latter is the explanation. Splitting them up can increase readability.
   
   1️⃣ 
   
   Consolidate the note into running text to accommodate the new structure.
   
   I've also made other changes like updating all future tense to present tense 
since "[Write in the simple present tense as much as possible if you are 
covering facts that were, are, and forever shall be 
true](https://docs.google.com/document/d/1lc5j4RtuLIzlEYCBo97AC8-U_3Erzs_lxpkDuseU0n4/edit#bookmark=id.e8uqh1awkcnp)"
 in technical writing.
   
   ### Question
   
   4️⃣ 
   
   Seems that the explanations in this box is contradictory.
   
   The above indicates "--config-file" override "command-line", but the below 
says the opposite. Can you clarify a bit and give some examples? Thank you! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] sh-y00 created a discussion: Relationship between Backlog size and Retention size

2023-04-26 Thread GitBox


GitHub user sh-y00 created a discussion: Relationship between Backlog size and 
Retention size

Can someone please tell me the relationship between Backlog size and Retention 
size, because I don't understand it.

●Assumption
Backlog Size:500GB

●Description
When I tried to set the Retention size to 100GB, the following error was output.
_Retention Quota must exceed configured backlog quota for topic. Please 
increase retention quota and retry_
_Reason: Retention Quota must exceed configured backlog quota for topic. 
Please increase retention quota and retry_

●My understanding
Backlog size and Retention size are areas used for different purposes, so there 
was no dependency between them.

●Question
①I would like to know if there is anything wrong about my understanding.
②I would like to know the relationship between Backlog size and Retention size.

GitHub link: https://github.com/apache/pulsar/discussions/20191


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org



[GitHub] [pulsar-site] Anonymitaet opened a new pull request, #544: [improve][fn] add docs for supporting reading config options from files in Python runner

2023-04-26 Thread via GitHub


Anonymitaet opened a new pull request, #544:
URL: https://github.com/apache/pulsar-site/pull/544

   This PR adds docs for https://github.com/apache/pulsar/pull/18951
   
   - [x] `doc` 
   
   https://user-images.githubusercontent.com/50226895/234762563-a5e3c8d7-bca3-4508-9f52-2a302beb0ddd.png;>
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] coderzc commented on pull request #16832: [feature][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer

2023-04-26 Thread via GitHub


coderzc commented on PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#issuecomment-1524693296

   I will update this PR as soon.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] Apurva007 added a comment to the discussion: Bookkeeper Storage recommendations

2023-04-26 Thread GitBox


GitHub user Apurva007 added a comment to the discussion: Bookkeeper Storage 
recommendations

@hangc0276 Great! thanks for helping with the answer!  

GitHub link: 
https://github.com/apache/pulsar/discussions/19606#discussioncomment-5738485


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org



[GitHub] [pulsar-site] coderzc merged pull request #534: Release 2.9.5

2023-04-26 Thread via GitHub


coderzc merged PR #534:
URL: https://github.com/apache/pulsar-site/pull/534


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch main updated: removed 2nd ledgers in topic internal stats (#540)

2023-04-26 Thread liuyu
This is an automated email from the ASF dual-hosted git repository.

liuyu pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


The following commit(s) were added to refs/heads/main by this push:
 new d895c474a39 removed 2nd ledgers in topic internal stats (#540)
d895c474a39 is described below

commit d895c474a39f3f5b5602b7c17b851a7071a4e8da
Author: Yuwei Sung 
AuthorDate: Wed Apr 26 23:05:55 2023 -0500

removed 2nd ledgers in topic internal stats (#540)
---
 docs/administration-stats.md | 1 -
 1 file changed, 1 deletion(-)

diff --git a/docs/administration-stats.md b/docs/administration-stats.md
index 76e3854e71e..073f3be00f9 100644
--- a/docs/administration-stats.md
+++ b/docs/administration-stats.md
@@ -169,7 +169,6 @@ The following table outlines the internal stats inside a 
topic. For more details
 | cursorLedgerLastEntry  | The last `entryid` used to persistently 
store the current `markDeletePosition`. 
|
 | individuallyDeletedMessages| The range of messages acknowledged 
between `markDeletePosition` and the `readPosition` when acknowledges are done 
out of order. |
 | lastLedgerSwitchTimestamp  | The last time when the cursor ledger is 
rolled over.
|
-| ledgers| The ordered list of all ledgers for 
this topic that holds messages. 
|
 | schemaLedgers  | The ordered list of all ledgers for 
this topic schema.  
|
 | compactedLedger| The ledgers holding un-acked messages 
after topic compaction. 
  |
 | ledgerId   | The ID of this ledger.  

|



[GitHub] [pulsar-site] Anonymitaet merged pull request #540: removed 2nd ledgers in topic internal stats

2023-04-26 Thread via GitHub


Anonymitaet merged PR #540:
URL: https://github.com/apache/pulsar-site/pull/540


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] yapxue commented on issue #20186: [Bug] broker cannot connect to bookie suddenly and after restarting this issue persists

2023-04-26 Thread via GitHub


yapxue commented on issue #20186:
URL: https://github.com/apache/pulsar/issues/20186#issuecomment-1524646912

   > I can see several bookie id patterns, Bookie L2032 disappeared, Bookie 
ID-003234 disappeared, Bookie 0x_0x disappeared, log is 
https://gist.github.com/yapxue/febcf0396038bc6ce9638e4ac535b4dc#file-broker_log_2023-04-26-2
   
   v2.10.3 has this problem brought by 
[https://github.com/apache/pulsar/pull/17922](https://github.com/apache/pulsar/pull/17922)
   v2.10.4 fixed this https://github.com/apache/pulsar/pull/18133/files


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] poorbarcode opened a new pull request, #20190: [improve] [broker] Skip split boundle if only one broker

2023-04-26 Thread via GitHub


poorbarcode opened a new pull request, #20190:
URL: https://github.com/apache/pulsar/pull/20190

   ### Motivation
   
   When there is only one broker alive in the cluster, the split bundle makes 
no sense and the `unload bundle` event is triggered, making it even more 
unstable.
   
   ### Modifications
   
   Skip split bundle if only one broker
   
   
   ### Documentation
   
   
   
   - [ ] `doc` 
   - [ ] `doc-required` 
   - [x] `doc-not-needed` 
   - [ ] `doc-complete` 
   
   ### Matching PR in forked repository
   
   PR in forked repository: 
   - 1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-go] Gleiphir2769 commented on a diff in pull request #1003: [Flaky Test]: Fix flaky test TestMaxPendingChunkMessages()

2023-04-26 Thread via GitHub


Gleiphir2769 commented on code in PR #1003:
URL: https://github.com/apache/pulsar-client-go/pull/1003#discussion_r1178584002


##
pulsar/message_chunking_test.go:
##
@@ -576,3 +548,27 @@ func createTestMessagePayload(size int) []byte {
}
return payload
 }
+
+//nolint:all
+func sendSingleChunk(p Producer, uuid string, chunkID int, totalChunks int) {
+   msg := {
+   Payload: []byte(fmt.Sprintf("chunk-%s-%d|", uuid, chunkID)),
+   }
+   producerImpl := p.(*producer).producers[0].(*partitionProducer)
+   mm := producerImpl.genMetadata(msg, len(msg.Payload), time.Now())
+   mm.Uuid = proto.String(uuid)
+   mm.NumChunksFromMsg = proto.Int32(int32(totalChunks))
+   mm.TotalChunkMsgSize = proto.Int32(int32(len(msg.Payload)))
+   mm.ChunkId = proto.Int32(int32(chunkID))
+   producerImpl.updateMetadataSeqID(mm, msg)
+
+   producerImpl.internalSingleSend(
+   mm,
+   msg.Payload,
+   {
+   callback: func(id MessageID, producerMessage 
*ProducerMessage, err error) {},
+   msg:  msg,
+   },
+   uint32(internal.MaxMessageSize),
+   )

Review Comment:
   > We need to flush the producer after sending the message
   
   OK, I will fix it.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch matrix-page updated (cb7cf5486b5 -> c534eec8c9b)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from cb7cf5486b5 Merge branch 'matrix-page' of 
github.com:apache/pulsar-site into matrix-page
 add c534eec8c9b update

No new revisions were added by this update.

Summary of changes:
 package.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)



[pulsar-site] branch matrix-page updated (b6b33865ce0 -> cb7cf5486b5)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from b6b33865ce0 run yarn install
 add 4350c3151c6 update
 add cb7cf5486b5 Merge branch 'matrix-page' of 
github.com:apache/pulsar-site into matrix-page

No new revisions were added by this update.

Summary of changes:
 client-feature-matrix/index.mdx |  8 +---
 package.json|  2 +-
 src/components/Matrix/util.js   | 13 -
 3 files changed, 18 insertions(+), 5 deletions(-)



[GitHub] [pulsar-client-python] yebai1105 commented on issue #113: python client does not retry when get topic partition metadata to create producer fails

2023-04-26 Thread via GitHub


yebai1105 commented on issue #113:
URL: 
https://github.com/apache/pulsar-client-python/issues/113#issuecomment-1524539948

   pulsar-client=3.1.0,I tried this version too, but there is also a problem


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] tisonkun commented on issue #19877: [Doc] Add API doc for the C# client

2023-04-26 Thread via GitHub


tisonkun commented on issue #19877:
URL: https://github.com/apache/pulsar/issues/19877#issuecomment-1524508579

   I'm trying to take a look into this ticket in the following weeks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] coderzc commented on pull request #534: Release 2.9.5

2023-04-26 Thread via GitHub


coderzc commented on PR #534:
URL: https://github.com/apache/pulsar-site/pull/534#issuecomment-1524500034

   /cc @Anonymitaet 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] licj520 opened a new issue, #259: [Bug] Exception could be thrown when creating producers or consumers with Windows debug library

2023-04-26 Thread via GitHub


licj520 opened a new issue, #259:
URL: https://github.com/apache/pulsar-client-cpp/issues/259

   ### Search before asking
   
   - [X] I searched in the 
[issues](https://github.com/apache/pulsar-client-cpp/issues) and found nothing 
similar.
   
   
   ### Version
   
   3.2.0
   
   ### Minimal reproduce step
   
   Client client("pulsar://ip:6650");
   Producer producer;
   Result result = 
client.createProducer("persistent://public/default/my-topic", producer);
   
   ### What did you expect to see?
   
   
![image](https://user-images.githubusercontent.com/105142798/234741103-a005028e-3ed8-48e3-958b-d78f66222a4b.png)
   
   
   ### What did you see instead?
   
   
![image](https://user-images.githubusercontent.com/105142798/234741422-17165bd9-883d-4e09-87b8-e5fc3a7f63a6.png)
   
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] BewareMyPower commented on a diff in pull request #257: Support get the SchemaInfo from a topic and the schema version

2023-04-26 Thread via GitHub


BewareMyPower commented on code in PR #257:
URL: https://github.com/apache/pulsar-client-cpp/pull/257#discussion_r1178552636


##
include/pulsar/Client.h:
##
@@ -404,6 +404,19 @@ class PULSAR_PUBLIC Client {
  */
 uint64_t getNumberOfConsumers();
 
+/**
+ * Asynchronously get the SchemaInfo of a topic and a specific version.
+ *
+ * @topic the topic name
+ * @version the schema version byte array, see 
Message::getLongSchemaVersion.
+ * @callback the callback that is triggered when the SchemaInfo is 
retrieved successfully or not.
+ *
+ * NOTE: If there is no schema registered or the given version does not 
exist, a SchemaInfo whose type is

Review Comment:
   I won't add a new `Result`. The server side returns a `TopicNotFound` error. 
https://github.com/apache/pulsar/blob/f7c0b3c49c9ad8c28d0b00aa30d727850eb8bc04/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ClientCnx.java#L999
   
   So I use `ResultTopicNotFound` here.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] BewareMyPower commented on a diff in pull request #257: Support get the SchemaInfo from a topic and the schema version

2023-04-26 Thread via GitHub


BewareMyPower commented on code in PR #257:
URL: https://github.com/apache/pulsar-client-cpp/pull/257#discussion_r1178548743


##
include/pulsar/Client.h:
##
@@ -404,6 +404,19 @@ class PULSAR_PUBLIC Client {
  */
 uint64_t getNumberOfConsumers();
 
+/**
+ * Asynchronously get the SchemaInfo of a topic and a specific version.
+ *
+ * @topic the topic name
+ * @version the schema version byte array, see 
Message::getLongSchemaVersion.
+ * @callback the callback that is triggered when the SchemaInfo is 
retrieved successfully or not.
+ *
+ * NOTE: If there is no schema registered or the given version does not 
exist, a SchemaInfo whose type is

Review Comment:
   In Java client, the `TopicNotFound` error is ignored and an empty optional 
of `SchemaInfo` is returned. So I thought it should not be treated as an 
exceptional case and users should process this error. I just use a `NONE` 
schema to replace an empty optional.
   
   But I just thought again and IMO an error should be returned if we cannot 
get the schema for the given topic and version. So I will adopt the suggestion 
you made so that users should not handle the schema type.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] github-actions[bot] commented on issue #19770: [Bug] Topics with slashes cannot be queried

2023-04-26 Thread via GitHub


github-actions[bot] commented on issue #19770:
URL: https://github.com/apache/pulsar/issues/19770#issuecomment-1524435264

   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] github-actions[bot] commented on issue #19877: [Doc] Add API doc for the C# client

2023-04-26 Thread via GitHub


github-actions[bot] commented on issue #19877:
URL: https://github.com/apache/pulsar/issues/19877#issuecomment-1524434937

   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] github-actions[bot] commented on issue #19894: [Bug] Pulsar shutdowns Sink connector on exception

2023-04-26 Thread via GitHub


github-actions[bot] commented on issue #19894:
URL: https://github.com/apache/pulsar/issues/19894#issuecomment-1524434788

   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] github-actions[bot] commented on issue #19943: TLS mutual Authentication with PEM configuration fails to establish a successful connection

2023-04-26 Thread via GitHub


github-actions[bot] commented on issue #19943:
URL: https://github.com/apache/pulsar/issues/19943#issuecomment-1524434659

   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] BewareMyPower commented on a diff in pull request #257: Support get the SchemaInfo from a topic and the schema version

2023-04-26 Thread via GitHub


BewareMyPower commented on code in PR #257:
URL: https://github.com/apache/pulsar-client-cpp/pull/257#discussion_r1178544663


##
include/pulsar/Message.h:
##
@@ -177,7 +177,14 @@ class PULSAR_PUBLIC Message {
 bool hasSchemaVersion() const;
 
 /**
- * Get the schema version
+ * Get the schema version.
+ *
+ * @return the the schema version on success or -1 if the message does not 
have the schema version
+ */
+int64_t getLongSchemaVersion() const;

Review Comment:
   Yes. The Java API design is terrible. It really harms the user experience. 
Actually the byte array always represents a big-endian encoded 8 bytes integer, 
unless it's empty, which indicates no schema version. I believe it's a mistake 
made by the author. You can also see `Schemas#getSchemaInfo` in the 
`pulsar-admin` module, you can see the parameter type is long.
   
   ```java
   SchemaInfo getSchemaInfo(String topic, long version) throws 
PulsarAdminException;
   
   CompletableFuture getSchemaInfoAsync(String topic, long 
version);
   ```
   
   However, there is no document that tell users how to get the human-readable 
representation of the byte array. Returning a byte array is definitely a 
mistake. The Python client also wraps this API and returns a string to users. 
And the users can nearly do nothing with it.
   
   I will open a discussion later in the mail list. But for now, I think it's 
good to add such a method.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch main updated: Docs sync done from apache/pulsar (#f7c0b3c)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


The following commit(s) were added to refs/heads/main by this push:
 new 32bc4f32a7e Docs sync done from apache/pulsar (#f7c0b3c)
32bc4f32a7e is described below

commit 32bc4f32a7e6df261b067c6546baed5d8a246cd7
Author: github-actions[bot] 
<41898282+github-actions[bot]@users.noreply.github.com>
AuthorDate: Thu Apr 27 01:37:42 2023 +

Docs sync done from apache/pulsar (#f7c0b3c)
---
 static/swagger/master/swagger.json| 16 ++--
 static/swagger/master/v2/swagger.json | 16 ++--
 2 files changed, 20 insertions(+), 12 deletions(-)

diff --git a/static/swagger/master/swagger.json 
b/static/swagger/master/swagger.json
index 22da404d273..1139682e11a 100644
--- a/static/swagger/master/swagger.json
+++ b/static/swagger/master/swagger.json
@@ -1345,22 +1345,23 @@
 "format": "int64",
 "type": "integer"
 },
+"isOffloaded": {
+"type": "boolean"
+},
 "ledgerId": {
 "format": "int64",
 "type": "integer"
 },
-"metadata": {
+"offloadedContextUuid": {
 "type": "string"
 },
-"offloaded": {
-"type": "boolean"
-},
 "size": {
 "format": "int64",
 "type": "integer"
 },
-"underReplicated": {
-"type": "boolean"
+"timestamp": {
+"format": "int64",
+"type": "integer"
 }
 },
 "type": "object"
@@ -4284,6 +4285,9 @@
 "format": "int32",
 "type": "integer"
 },
+"ignoreUnknownConfigFields": {
+"type": "boolean"
+},
 "includeStandardPrometheusMetrics": {
 "type": "boolean"
 },
diff --git a/static/swagger/master/v2/swagger.json 
b/static/swagger/master/v2/swagger.json
index 22da404d273..1139682e11a 100644
--- a/static/swagger/master/v2/swagger.json
+++ b/static/swagger/master/v2/swagger.json
@@ -1345,22 +1345,23 @@
 "format": "int64",
 "type": "integer"
 },
+"isOffloaded": {
+"type": "boolean"
+},
 "ledgerId": {
 "format": "int64",
 "type": "integer"
 },
-"metadata": {
+"offloadedContextUuid": {
 "type": "string"
 },
-"offloaded": {
-"type": "boolean"
-},
 "size": {
 "format": "int64",
 "type": "integer"
 },
-"underReplicated": {
-"type": "boolean"
+"timestamp": {
+"format": "int64",
+"type": "integer"
 }
 },
 "type": "object"
@@ -4284,6 +4285,9 @@
 "format": "int32",
 "type": "integer"
 },
+"ignoreUnknownConfigFields": {
+"type": "boolean"
+},
 "includeStandardPrometheusMetrics": {
 "type": "boolean"
 },



[GitHub] [pulsar] yapxue closed issue #20186: [Bug] broker cannot connect to bookie suddenly and after restarting this issue persists

2023-04-26 Thread via GitHub


yapxue closed issue #20186: [Bug] broker cannot connect to bookie suddenly and 
after restarting this issue persists
URL: https://github.com/apache/pulsar/issues/20186


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] hangc0276 added a comment to the discussion: Bookkeeper Storage recommendations

2023-04-26 Thread GitBox


GitHub user hangc0276 added a comment to the discussion: Bookkeeper Storage 
recommendations

> What is the recommended storage ratio of journal to the ledger disks? We have 
> 6 ledger SSD SATA disks of 7.5 TB each available. We were wondering how much 
> journal storage(NVMe) would be required?

The journal disk doesn't have the storage size requirement, maybe 100GB is 
enough. You need to ensure the journal throughput can match with your 6 ledger 
SSD throughput. 

> Which file system is recommended for Pulsar? Kafka recommends utilizing xfs 
> filesystem. Was wondering if its the same for pulsar as well?

Both XFS and ext4 can be good options to use with Apache Bookkeeper. If 
performance is a top priority and you have large segments and high-throughput 
workloads, XFS may be the better choice. If reliability and stability are more 
important, then ext4 may be the better choice.

GitHub link: 
https://github.com/apache/pulsar/discussions/19606#discussioncomment-5737468


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org



[GitHub] [pulsar] heesung-sn commented on a diff in pull request #16832: [feature][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer

2023-04-26 Thread via GitHub


heesung-sn commented on code in PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#discussion_r1178536739


##
pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/LinuxInfoUtils.java:
##
@@ -98,11 +138,14 @@ public static double getTotalCpuLimit(boolean 
isCGroupsEnabled) {
  * Get CGroup cpu usage.
  * @return Cpu usage
  */
-public static double getCpuUsageForCGroup() {
+public static long getCpuUsageForCGroup() {
 try {
+if (metrics != null && getCpuUsageMethod != null) {
+return (long) getCpuUsageMethod.invoke(metrics);

Review Comment:
   For backward compatibility, don't we need to multiply the limit in 
calculateBrokerHostUsage?
   ```
   public void calculateBrokerHostUsage() {
   ... 
  double totalCpuLimit = getTotalCpuLimit(isCGroupsEnabled);
   if (isCGroupsEnabled && metrics != null && getCpuUsageMethod != 
null) {
   // cgroup cpuUsage is already scaled, [0.0, 1.0]
   usage.setCpu(new ResourceUsage(cpuUsage * totalCpuLimit, 
totalCpuLimit));
   } else {
   usage.setCpu(new ResourceUsage(cpuUsage, totalCpuLimit));
   }
   
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] hangc0276 edited a comment on the discussion: Bookkeeper Direct Memory Consumption is High

2023-04-26 Thread GitBox


GitHub user hangc0276 edited a comment on the discussion: Bookkeeper Direct 
Memory Consumption is High

Hi @sourabhaggrawal, thank you for raising this issue. I have a few questions.
- Which version are you upgrading from? Before upgrading, does the BookKeeper's 
direct memory issue exist?
- BookKeeper 4.14.7 fixed many direct memory leak bugs, would you please 
upgrade the BookKeeper version to 4.14.7 to see if the direct memory issue 
still exists? You can upgrade the Pulsar to 2.10.4, which uses BookKeeper 4.14.7
- Would you please share your BookKeeper configuration?

GitHub link: 
https://github.com/apache/pulsar/discussions/19663#discussioncomment-5737373


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org



[GitHub] [pulsar] hangc0276 added a comment to the discussion: Bookkeeper Direct Memory Consumption is High

2023-04-26 Thread GitBox


GitHub user hangc0276 added a comment to the discussion: Bookkeeper Direct 
Memory Consumption is High

Hi @sourabhaggrawal, thank you for raising this issue. I have a few questions.
- Which version are you upgrading from? Before upgrading, does the BookKeeper's 
direct memory issue exist?
- BookKeeper 4.14.7 fixed many direct memory leak bugs, would you please 
upgrade the BookKeeper version to 4.14.7 to see if the direct memory issue 
still exists? You can upgrade the Pulsar to 2.10.4, which uses BookKeeper 4.14.7
- Would you please share you BookKeeper configuration?

GitHub link: 
https://github.com/apache/pulsar/discussions/19663#discussioncomment-5737373


This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org



[GitHub] [pulsar] nodece commented on pull request #16832: [feature][broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer

2023-04-26 Thread via GitHub


nodece commented on PR #16832:
URL: https://github.com/apache/pulsar/pull/16832#issuecomment-1523721850

   Any updates? I think this PR makes sense to use the cgroup v2.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] poorbarcode opened a new pull request, #20189: [fix][broker]Fix deadlock of metadata store

2023-04-26 Thread via GitHub


poorbarcode opened a new pull request, #20189:
URL: https://github.com/apache/pulsar/pull/20189

   ### Motivation
   
   In the method `loadOrCreatePersistentTopic,` it does `getBundles` after 
`LockManagerImpl.lambda$acquireLock`. This all runs on the thread 
`main-EventThread.` It will cause deadlock
   
   ```
   "main-EventThread" #21 daemon prio=5 os_prio=0 cpu=1025.43ms 
elapsed=1113.10s tid=0x7fb2b6514bf0 nid=0xd6 waiting on condition  
[0x7fb2785dc000]
  java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@17.0.6/Native Method)
- parking to wait for  <0x000487fda1a8> (a 
java.util.concurrent.CompletableFuture$Signaller)
at 
java.util.concurrent.locks.LockSupport.park(java.base@17.0.6/LockSupport.java:211)
at 
java.util.concurrent.CompletableFuture$Signaller.block(java.base@17.0.6/CompletableFuture.java:1864)
at 
java.util.concurrent.ForkJoinPool.unmanagedBlock(java.base@17.0.6/ForkJoinPool.java:3463)
at 
java.util.concurrent.ForkJoinPool.managedBlock(java.base@17.0.6/ForkJoinPool.java:3434)
at 
java.util.concurrent.CompletableFuture.waitingGet(java.base@17.0.6/CompletableFuture.java:1898)
at 
java.util.concurrent.CompletableFuture.get(java.base@17.0.6/CompletableFuture.java:2072)
at 
com.github.benmanes.caffeine.cache.LocalAsyncCache$AbstractCacheView.resolve(LocalAsyncCache.java:515)
at 
com.github.benmanes.caffeine.cache.LocalAsyncLoadingCache$LoadingCacheView.get(LocalAsyncLoadingCache.java:122)
at 
org.apache.pulsar.common.naming.NamespaceBundleFactory.getBundles(NamespaceBundleFactory.java:260)
at 
org.apache.pulsar.broker.namespace.NamespaceService.getBundle(NamespaceService.java:219)
at 
org.apache.pulsar.broker.namespace.NamespaceService.isServiceUnitActiveAsync(NamespaceService.java:1020)
at 
org.apache.pulsar.broker.service.BrokerService.checkOwnershipAndCreatePersistentTopic(BrokerService.java:1423)
at 
org.apache.pulsar.broker.service.BrokerService.lambda$loadOrCreatePersistentTopic$53(BrokerService.java:1398)
at 
org.apache.pulsar.broker.service.BrokerService$$Lambda$1265/0x00080141f980.run(Unknown
 Source)
at 
java.util.concurrent.CompletableFuture$UniRun.tryFire(java.base@17.0.6/CompletableFuture.java:787)
at 
java.util.concurrent.CompletableFuture.postComplete(java.base@17.0.6/CompletableFuture.java:510)
at 
java.util.concurrent.CompletableFuture.complete(java.base@17.0.6/CompletableFuture.java:2147)
at 
org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.lambda$acquireLock$1(LockManagerImpl.java:105)
at 
org.apache.pulsar.metadata.coordination.impl.LockManagerImpl$$Lambda$604/0x0008012086b8.run(Unknown
 Source)
at 
java.util.concurrent.CompletableFuture$UniRun.tryFire(java.base@17.0.6/CompletableFuture.java:787)
at 
java.util.concurrent.CompletableFuture.postComplete(java.base@17.0.6/CompletableFuture.java:510)
at 
java.util.concurrent.CompletableFuture.complete(java.base@17.0.6/CompletableFuture.java:2147)
at 
org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl.lambda$acquire$2(ResourceLockImpl.java:128)
at 
org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl$$Lambda$602/0x000801208248.run(Unknown
 Source)
at 
java.util.concurrent.CompletableFuture$UniRun.tryFire(java.base@17.0.6/CompletableFuture.java:787)
at 
java.util.concurrent.CompletableFuture.postComplete(java.base@17.0.6/CompletableFuture.java:510)
at 
java.util.concurrent.CompletableFuture.complete(java.base@17.0.6/CompletableFuture.java:2147)
at 
org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl.lambda$acquireWithNoRevalidation$6(ResourceLockImpl.java:167)
at 
org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl$$Lambda$600/0x000801203400.accept(Unknown
 Source)
at 
java.util.concurrent.CompletableFuture$UniAccept.tryFire(java.base@17.0.6/CompletableFuture.java:718)
at 
java.util.concurrent.CompletableFuture.postComplete(java.base@17.0.6/CompletableFuture.java:510)
at 
java.util.concurrent.CompletableFuture.complete(java.base@17.0.6/CompletableFuture.java:2147)
at 
org.apache.pulsar.metadata.impl.ZKMetadataStore.handlePutResult(ZKMetadataStore.java:225)
at 
org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$batchOperation$7(ZKMetadataStore.java:182)
at 
org.apache.pulsar.metadata.impl.ZKMetadataStore$$Lambda$224/0x000800ee9d20.processResult(Unknown
 Source)
at 
org.apache.pulsar.metadata.impl.PulsarZooKeeperClient$3$1.processResult(PulsarZooKeeperClient.java:490)
at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:722)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:563)
   ```
   
   ### Modifications
   
   After the operations of 

[GitHub] [pulsar-client-cpp] shibd commented on a diff in pull request #257: Support get the SchemaInfo from a topic and the schema version

2023-04-26 Thread via GitHub


shibd commented on code in PR #257:
URL: https://github.com/apache/pulsar-client-cpp/pull/257#discussion_r1178056562


##
include/pulsar/Client.h:
##
@@ -404,6 +404,19 @@ class PULSAR_PUBLIC Client {
  */
 uint64_t getNumberOfConsumers();
 
+/**
+ * Asynchronously get the SchemaInfo of a topic and a specific version.
+ *
+ * @topic the topic name
+ * @version the schema version byte array, see 
Message::getLongSchemaVersion.

Review Comment:
   This note does not match the parameter type.



##
include/pulsar/Message.h:
##
@@ -177,7 +177,14 @@ class PULSAR_PUBLIC Message {
 bool hasSchemaVersion() const;
 
 /**
- * Get the schema version
+ * Get the schema version.
+ *
+ * @return the the schema version on success or -1 if the message does not 
have the schema version
+ */
+int64_t getLongSchemaVersion() const;

Review Comment:
   For the Java client, it returns a bytes array. This may be a consensus that 
is already acceptable to users, is it necessary for us to change it to int?



##
include/pulsar/Client.h:
##
@@ -404,6 +404,19 @@ class PULSAR_PUBLIC Client {
  */
 uint64_t getNumberOfConsumers();
 
+/**
+ * Asynchronously get the SchemaInfo of a topic and a specific version.
+ *
+ * @topic the topic name
+ * @version the schema version byte array, see 
Message::getLongSchemaVersion.
+ * @callback the callback that is triggered when the SchemaInfo is 
retrieved successfully or not.
+ *
+ * NOTE: If there is no schema registered or the given version does not 
exist, a SchemaInfo whose type is

Review Comment:
   I think we can add a new `Result` : `TopicSchemaNotFound`
   
   When schema is not found, the Result on the callback is 
`TopicSchemaNotFound`.
   
   What do you think?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] adrian-tarau opened a new issue, #20188: ProducerConfigurationData & ConsumerConfigurationData is not documented with @ApiModelProperty

2023-04-26 Thread via GitHub


adrian-tarau opened a new issue, #20188:
URL: https://github.com/apache/pulsar/issues/20188

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) 
and found nothing similar.
   
   
   ### Motivation
   
   ClientConfigurationData has all its fields annotated with @ApiModelProperty, 
but ProducerConfigurationData & ConsumerConfigurationData do not have that.
   
   It would be very useful to have documentation on these properties, too, 
especially if this documentation generates a list of available properties for 
clients, consumers & producers. Also, the documentation could be a bit more 
detailed. 
   
   ### Solution
   
   Add @ApiModelProperty for each public property with a detailed enough 
description.
   
   Also, expand on the descriptions for ClientConfigurationData :)
   
   ### Alternatives
   
   _No response_
   
   ### Anything else?
   
   I guess I could add those myself and send a PR but I might not have the 
right description for some of those properties.
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] nicoloboschi merged pull request #20116: [improve][fn] Allow unknown fields in connectors config

2023-04-26 Thread via GitHub


nicoloboschi merged PR #20116:
URL: https://github.com/apache/pulsar/pull/20116


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar] branch master updated: [improve][fn] Allow unknown fields in connectors config (#20116)

2023-04-26 Thread nicoloboschi
This is an automated email from the ASF dual-hosted git repository.

nicoloboschi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git


The following commit(s) were added to refs/heads/master by this push:
 new f7c0b3c49c9 [improve][fn] Allow unknown fields in connectors config 
(#20116)
f7c0b3c49c9 is described below

commit f7c0b3c49c9ad8c28d0b00aa30d727850eb8bc04
Author: Nicolò Boschi 
AuthorDate: Wed Apr 26 17:36:56 2023 +0200

[improve][fn] Allow unknown fields in connectors config (#20116)
---
 conf/functions_worker.yml  |   6 ++
 .../pulsar/functions/instance/InstanceConfig.java  |   1 +
 .../functions/instance/JavaInstanceRunnable.java   |  97 +--
 .../instance/JavaInstanceRunnableTest.java | 104 ++---
 .../functions/runtime/JavaInstanceStarter.java |   7 ++
 .../pulsar/functions/runtime/RuntimeUtils.java |   6 +-
 .../pulsar/functions/worker/WorkerConfig.java  |  11 +++
 .../pulsar/functions/worker/FunctionActioner.java  |   1 +
 .../resources/META-INF/services/pulsar-io.yaml |   3 +-
 .../resources/META-INF/services/pulsar-io.yaml |   1 +
 .../resources/META-INF/services/pulsar-io.yaml |   1 +
 .../resources/META-INF/services/pulsar-io.yaml |   1 +
 .../resources/META-INF/services/pulsar-io.yaml |   1 +
 .../resources/META-INF/services/pulsar-io.yaml |   1 +
 14 files changed, 217 insertions(+), 24 deletions(-)

diff --git a/conf/functions_worker.yml b/conf/functions_worker.yml
index bb15e0ca416..4c5b6aab1b7 100644
--- a/conf/functions_worker.yml
+++ b/conf/functions_worker.yml
@@ -407,6 +407,12 @@ validateConnectorConfig: false
 # If it is set to true, you must ensure that it has been initialized by 
"bin/pulsar initialize-cluster-metadata" command.
 initializedDlogMetadata: false
 
+# Whether to ignore unknown properties when deserializing the connector 
configuration.
+# After upgrading a connector to a new version with a new configuration, the 
new configuration may not be compatible with the old connector.
+# In case of rollback, it's required to also rollback the connector 
configuration.
+# Ignoring unknown fields makes possible to keep the new configuration and 
only rollback the connector.
+ignoreUnknownConfigFields: false
+
 ###
 # Arbitrary Configuration
 ###
diff --git 
a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/InstanceConfig.java
 
b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/InstanceConfig.java
index 1a89505d9bb..fcee6d734d6 100644
--- 
a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/InstanceConfig.java
+++ 
b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/InstanceConfig.java
@@ -48,6 +48,7 @@ public class InstanceConfig {
 private boolean exposePulsarAdminClientEnabled = false;
 private int metricsPort;
 private List additionalJavaRuntimeArguments = 
Collections.emptyList();
+private boolean ignoreUnknownConfigFields;
 
 /**
  * Get the string representation of {@link #getInstanceId()}.
diff --git 
a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java
 
b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java
index e2ad9e4c989..c3f36f754da 100644
--- 
a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java
+++ 
b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java
@@ -19,13 +19,20 @@
 package org.apache.pulsar.functions.instance;
 
 import static 
org.apache.pulsar.functions.utils.FunctionCommon.convertFromFunctionDetailsSubscriptionPosition;
+import com.fasterxml.jackson.core.JsonParser;
 import com.fasterxml.jackson.core.type.TypeReference;
+import com.fasterxml.jackson.databind.DeserializationConfig;
+import com.fasterxml.jackson.databind.DeserializationContext;
+import com.fasterxml.jackson.databind.ObjectMapper;
+import com.fasterxml.jackson.databind.deser.BeanDeserializer;
 import com.google.common.annotations.VisibleForTesting;
 import com.scurrilous.circe.checksum.Crc32cIntChecksum;
 import io.netty.buffer.ByteBuf;
 import java.io.IOException;
 import java.nio.ByteBuffer;
+import java.util.ArrayList;
 import java.util.HashMap;
+import java.util.List;
 import java.util.Map;
 import java.util.Objects;
 import java.util.TreeMap;
@@ -34,6 +41,7 @@ import java.util.concurrent.locks.ReadWriteLock;
 import java.util.concurrent.locks.ReentrantReadWriteLock;
 import java.util.function.Consumer;
 import lombok.Getter;
+import lombok.SneakyThrows;
 import lombok.extern.slf4j.Slf4j;
 import net.jodah.typetools.TypeResolver;
 import org.apache.commons.lang3.StringUtils;
@@ -59,6 +67,7 @@ import 

[GitHub] [pulsar] lhotari commented on issue #16601: Add support for cgroup v2 in Pulsar Loadbalancer

2023-04-26 Thread via GitHub


lhotari commented on issue #16601:
URL: https://github.com/apache/pulsar/issues/16601#issuecomment-1523562861

   AWS EKS v1.26 nodes will default to cgroup v2 based on this comment: 
https://github.com/awslabs/amazon-eks-ami/issues/824#issuecomment-1465951128


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] lhotari commented on issue #16601: Add support for cgroup v2 in Pulsar Loadbalancer

2023-04-26 Thread via GitHub


lhotari commented on issue #16601:
URL: https://github.com/apache/pulsar/issues/16601#issuecomment-1523548867

   GKE seems to have a way to select between cgroup v1 & cgroup v2:
   
https://cloud.google.com/kubernetes-engine/docs/how-to/node-system-config#cgroup-mode-options


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] nicoloboschi commented on a diff in pull request #20116: [improve][fn] Allow unknown fields in connectors config

2023-04-26 Thread via GitHub


nicoloboschi commented on code in PR #20116:
URL: https://github.com/apache/pulsar/pull/20116#discussion_r1177964071


##
pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java:
##
@@ -870,6 +872,56 @@ private void setupInput(ContextImpl contextImpl) throws 
Exception {
 
Thread.currentThread().setContextClassLoader(this.instanceClassLoader);
 }
 }
+private Map parseComponentConfig(String connectorConfigs) 
throws IOException {
+return parseComponentConfig(connectorConfigs, instanceConfig, 
componentClassLoader, componentType);
+}
+
+static Map parseComponentConfig(String connectorConfigs,
+InstanceConfig 
instanceConfig,
+ClassLoader 
componentClassLoader,
+
org.apache.pulsar.functions.proto.Function
+
.FunctionDetails.ComponentType componentType)
+throws IOException {
+final Map config = ObjectMapperFactory
+.getMapper()
+.reader()
+.forType(new TypeReference>() {})
+.readValue(connectorConfigs);
+if (instanceConfig.isIgnoreUnknownConfigFields() && 
componentClassLoader instanceof NarClassLoader) {
+final String configClass;
+if (componentType == 
org.apache.pulsar.functions.proto.Function.FunctionDetails.ComponentType.SOURCE)
 {
+configClass = ConnectorUtils
+.getConnectorDefinition((NarClassLoader) 
componentClassLoader).getSourceConfigClass();
+} else if (componentType == 
org.apache.pulsar.functions.proto.Function.FunctionDetails.ComponentType.SINK) {
+configClass =  ConnectorUtils
+.getConnectorDefinition((NarClassLoader) 
componentClassLoader).getSinkConfigClass();
+} else {
+return config;
+}
+if (configClass != null) {
+final Object configInstance = 
Reflections.createInstance(configClass,
+Thread.currentThread().getContextClassLoader());
+final List allFields =

Review Comment:
   I've found a way to use the same deserializer used by jackson mapper, so 
this should cover all the cases when jackson mapper is used by the sink/source



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] nicoloboschi commented on a diff in pull request #20116: [improve][fn] Allow unknown fields in connectors config

2023-04-26 Thread via GitHub


nicoloboschi commented on code in PR #20116:
URL: https://github.com/apache/pulsar/pull/20116#discussion_r1177963377


##
pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java:
##
@@ -870,6 +872,56 @@ private void setupInput(ContextImpl contextImpl) throws 
Exception {
 
Thread.currentThread().setContextClassLoader(this.instanceClassLoader);
 }
 }
+private Map parseComponentConfig(String connectorConfigs) 
throws IOException {
+return parseComponentConfig(connectorConfigs, instanceConfig, 
componentClassLoader, componentType);
+}
+
+static Map parseComponentConfig(String connectorConfigs,
+InstanceConfig 
instanceConfig,
+ClassLoader 
componentClassLoader,
+
org.apache.pulsar.functions.proto.Function
+
.FunctionDetails.ComponentType componentType)
+throws IOException {
+final Map config = ObjectMapperFactory
+.getMapper()
+.reader()
+.forType(new TypeReference>() {})
+.readValue(connectorConfigs);
+if (instanceConfig.isIgnoreUnknownConfigFields() && 
componentClassLoader instanceof NarClassLoader) {
+final String configClass;
+if (componentType == 
org.apache.pulsar.functions.proto.Function.FunctionDetails.ComponentType.SOURCE)
 {
+configClass = ConnectorUtils
+.getConnectorDefinition((NarClassLoader) 
componentClassLoader).getSourceConfigClass();
+} else if (componentType == 
org.apache.pulsar.functions.proto.Function.FunctionDetails.ComponentType.SINK) {
+configClass =  ConnectorUtils
+.getConnectorDefinition((NarClassLoader) 
componentClassLoader).getSinkConfigClass();
+} else {
+return config;
+}
+if (configClass != null) {
+final Object configInstance = 
Reflections.createInstance(configClass,
+Thread.currentThread().getContextClassLoader());
+final List allFields =
+Reflections
+.getAllFields(configInstance.getClass())
+.stream()
+.map(Field::getName)
+.collect(Collectors.toList());
+
+for (String s : config.keySet()) {
+if (!allFields.contains(s)) {
+log.warn("Field '{}' not defined in the {} 
configuration {}, the field will be ignored",

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] Technoboy- merged pull request #20165: [fix][test] Fix flaky test `ConcurrentBitmapSortedLongPairSetTest`

2023-04-26 Thread via GitHub


Technoboy- merged PR #20165:
URL: https://github.com/apache/pulsar/pull/20165


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-reactive] nicoloboschi merged pull request #125: Update README to version 0.3.0

2023-04-26 Thread via GitHub


nicoloboschi merged PR #125:
URL: https://github.com/apache/pulsar-client-reactive/pull/125


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-client-reactive] branch main updated: Update README.adoc (#125)

2023-04-26 Thread nicoloboschi
This is an automated email from the ASF dual-hosted git repository.

nicoloboschi pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-client-reactive.git


The following commit(s) were added to refs/heads/main by this push:
 new 7bee05d  Update README.adoc (#125)
7bee05d is described below

commit 7bee05d794e80e7784a707a55a6ecebad4dd4e01
Author: Christophe Bornet 
AuthorDate: Wed Apr 26 16:17:00 2023 +0200

Update README.adoc (#125)
---
 README.adoc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/README.adoc b/README.adoc
index 92af685..131543b 100644
--- a/README.adoc
+++ b/README.adoc
@@ -19,7 +19,7 @@
 = Reactive client for Apache Pulsar
 
 :github: https://github.com/apache/pulsar-client-reactive
-:latest_version: 0.2.0
+:latest_version: 0.3.0
 
 Reactive client for Apache Pulsar which is compatible with the Reactive 
Streams specification.
 This uses Project Reactor as the Reactive Streams implementation.



[pulsar] branch master updated: [fix][test] Fix flaky test `ConcurrentBitmapSortedLongPairSetTest` (#20165)

2023-04-26 Thread technoboy
This is an automated email from the ASF dual-hosted git repository.

technoboy pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git


The following commit(s) were added to refs/heads/master by this push:
 new 0ec576b25fd [fix][test] Fix flaky test 
`ConcurrentBitmapSortedLongPairSetTest` (#20165)
0ec576b25fd is described below

commit 0ec576b25fdd7e4890799184ac03f66deb4735f6
Author: Jiwei Guo 
AuthorDate: Wed Apr 26 22:16:39 2023 +0800

[fix][test] Fix flaky test `ConcurrentBitmapSortedLongPairSetTest` (#20165)
---
 .../pulsar/utils/ConcurrentBitmapSortedLongPairSetTest.java   | 8 ++--
 1 file changed, 2 insertions(+), 6 deletions(-)

diff --git 
a/pulsar-broker/src/test/java/org/apache/pulsar/utils/ConcurrentBitmapSortedLongPairSetTest.java
 
b/pulsar-broker/src/test/java/org/apache/pulsar/utils/ConcurrentBitmapSortedLongPairSetTest.java
index 47379c3b6f1..5f8f13288cf 100644
--- 
a/pulsar-broker/src/test/java/org/apache/pulsar/utils/ConcurrentBitmapSortedLongPairSetTest.java
+++ 
b/pulsar-broker/src/test/java/org/apache/pulsar/utils/ConcurrentBitmapSortedLongPairSetTest.java
@@ -26,7 +26,6 @@ import 
org.apache.pulsar.common.util.collections.ConcurrentLongPairSet;
 import org.testng.annotations.Test;
 import java.util.ArrayList;
 import java.util.List;
-import java.util.Random;
 import java.util.Set;
 import java.util.concurrent.ExecutorService;
 import java.util.concurrent.Executors;
@@ -188,15 +187,12 @@ public class ConcurrentBitmapSortedLongPairSetTest {
 List> futures = new ArrayList<>();
 for (int i = 0; i < nThreads; i++) {
 final int threadIdx = i;
-
 futures.add(executor.submit(() -> {
-Random random = new Random();
 
+int start = N * (threadIdx + 1);
 for (int j = 0; j < N; j++) {
-int key = random.nextInt();
+int key = start + j;
 // Ensure keys are unique
-key -= key % (threadIdx + 1);
-key = Math.abs(key);
 set.add(key, key);
 }
 }));



[pulsar-client-reactive] 01/01: Update README.adoc

2023-04-26 Thread cbornet
This is an automated email from the ASF dual-hosted git repository.

cbornet pushed a commit to branch readme-0.3.0
in repository https://gitbox.apache.org/repos/asf/pulsar-client-reactive.git

commit d8dd180ebebea9c6e0ed3e64909b9dce741df3ba
Author: Christophe Bornet 
AuthorDate: Wed Apr 26 15:57:51 2023 +0200

Update README.adoc
---
 README.adoc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/README.adoc b/README.adoc
index 92af685..131543b 100644
--- a/README.adoc
+++ b/README.adoc
@@ -19,7 +19,7 @@
 = Reactive client for Apache Pulsar
 
 :github: https://github.com/apache/pulsar-client-reactive
-:latest_version: 0.2.0
+:latest_version: 0.3.0
 
 Reactive client for Apache Pulsar which is compatible with the Reactive 
Streams specification.
 This uses Project Reactor as the Reactive Streams implementation.



[pulsar-client-reactive] branch readme-0.3.0 created (now d8dd180)

2023-04-26 Thread cbornet
This is an automated email from the ASF dual-hosted git repository.

cbornet pushed a change to branch readme-0.3.0
in repository https://gitbox.apache.org/repos/asf/pulsar-client-reactive.git


  at d8dd180  Update README.adoc

This branch includes the following new commits:

 new d8dd180  Update README.adoc

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.




[GitHub] [pulsar] clayburn opened a new pull request, #20187: [improve][ci] Update Gradle Enterprise Maven Extension to 1.17

2023-04-26 Thread via GitHub


clayburn opened a new pull request, #20187:
URL: https://github.com/apache/pulsar/pull/20187

   ### Motivation
   
   This PR publishes a build scan for every CI build on GitHub Actions and for 
every local build from an authenticated Apache committer. The build will not 
fail if publishing fails.
   
   The build scans of the Apache Pulsar project are published to the Gradle 
Enterprise instance at [ge.apache.org](https://ge.apache.org/), hosted by the 
Apache Software Foundation and run in partnership between the ASF and Gradle. 
This Gradle Enterprise instance has all features and extensions enabled and is 
freely available for use by the Apache Pulsar project and all other Apache 
projects.
   
   Currently, the Apache Pulsar build is configured to publish build scans to 
[ge.apache.org](https://ge.apache.org/) for CI only. This pull request enhances 
that functionality by also publishing build scans to 
[ge.apache.org](https://ge.apache.org/) for authenticated Apache committers. On 
this Gradle Enterprise instance, Apache Pulsar will have access not only to all 
of the published build scans but other aggregate data features such as:
   
   - Dashboards to view all historical build scans, along with performance 
trends over time
   - Build failure analytics for enhanced investigation and diagnosis of build 
failures
   - Test failure analytics to better understand trends and causes around slow, 
failing, and flaky tests
   
   ### Modifications
   
   - Update the Gradle Enterprise Maven Extension to 1.17
   - Remove the logic that copies `ge-extensions.xml` in favor of the more 
conventional `extensions.xml` file. Updates to the `publishIfAuthenticated` 
property in Gradle Enterprise Maven Extension 1.17 will cause the build to 
print no output if the user is not authenticated to 
[ge.apache.org](https://ge.apache.org/).
   
   ### Verifying this change
   
   - [ ] Make sure that the change passes the CI checks.
   
   This change is a trivial rework / code cleanup without any test coverage.
   ### Does this pull request potentially affect one of the following parts:
   
   
   
   *If the box was checked, please highlight the changes*
   
   - [ ] Dependencies (add or upgrade a dependency)
   - [ ] The public API
   - [ ] The schema
   - [ ] The default values of configurations
   - [ ] The threading model
   - [ ] The binary protocol
   - [ ] The REST endpoints
   - [ ] The admin CLI options
   - [ ] The metrics
   - [ ] Anything that affects deployment
   
   ### Documentation
   
   
   
   - [ ] `doc` 
   - [ ] `doc-required` 
   - [x] `doc-not-needed` 
   - [ ] `doc-complete` 
   
   ### Matching PR in forked repository
   
   PR in forked repository: 
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



svn commit: r61482 - /dev/pulsar/pulsar-client-reactive-0.3.0-candidate-1/ /release/pulsar/pulsar-client-reactive-0.3.0/

2023-04-26 Thread eolivelli
Author: eolivelli
Date: Wed Apr 26 13:30:31 2023
New Revision: 61482

Log:
Release Reactive client for Apache Pulsar 0.3.0

Added:
release/pulsar/pulsar-client-reactive-0.3.0/
  - copied from r61481, dev/pulsar/pulsar-client-reactive-0.3.0-candidate-1/
Removed:
dev/pulsar/pulsar-client-reactive-0.3.0-candidate-1/



[GitHub] [pulsar] nicoloboschi commented on a diff in pull request #20116: [improve][fn] Allow unknown fields in connectors config

2023-04-26 Thread via GitHub


nicoloboschi commented on code in PR #20116:
URL: https://github.com/apache/pulsar/pull/20116#discussion_r1177841668


##
pulsar-functions/runtime/src/main/java/org/apache/pulsar/functions/worker/WorkerConfig.java:
##
@@ -738,6 +738,17 @@ public String getFunctionAuthProviderClassName() {
 )
 private List additionalJavaRuntimeArguments = new ArrayList<>();
 
+@FieldContext(
+category = CATEGORY_CONNECTORS,
+doc = "Whether to ignore unknown properties when deserializing the 
connector configuration. "
++ "After upgrading a connector to a new version with a new 
configuration, "
++ "the new configuration may not be compatible with the 
old connector. "
++ "In case of rollback, it's required to also rollback the 
connector configuration. "
++ "Ignoring unknown fields makes possible to keep the new 
configuration and "
++ "only rollback the connector."
+)
+private boolean ignoreUnknownConfigFields = false;

Review Comment:
   I thought about that and I agree. But there are other properties that are 
meant to be used by the java runner like 
   maxPendingAsyncRequests, exposeAdminClientEnabled, 
additionalJavaRuntimeArguments  so I'd prefer to stick with this convention



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] tianshimoyi closed issue #20183: [Bug] gc is not working when bookie node is readOnly

2023-04-26 Thread via GitHub


tianshimoyi closed issue #20183: [Bug]  gc is not working when bookie node is 
readOnly
URL: https://github.com/apache/pulsar/issues/20183


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] urfreespace commented on pull request #513: pulsar client matrix page

2023-04-26 Thread via GitHub


urfreespace commented on PR #513:
URL: https://github.com/apache/pulsar-site/pull/513#issuecomment-1523322397

   > @urfreespace fixed. It's because we now check-in yarn.lock to leverage 
yarn 3 pkg manager.
   
   thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] yapxue commented on issue #20186: [Bug] broker cannot connect to bookie suddenly and after restarting this issue persists

2023-04-26 Thread via GitHub


yapxue commented on issue #20186:
URL: https://github.com/apache/pulsar/issues/20186#issuecomment-1523321845

   I can see several bookie id patterns, Bookie L2032 disappeared, Bookie 
ID-003234 disappeared, Bookie 0x_0x disappeared


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] yapxue commented on issue #20186: [Bug] broker cannot connect to bookie suddenly and after restarting this issue persists

2023-04-26 Thread via GitHub


yapxue commented on issue #20186:
URL: https://github.com/apache/pulsar/issues/20186#issuecomment-1523307887

   I can see the log "Bookie urL002422 disappeared"
   In what case can bookie id be deserialized as "urL002422"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] ethqunzhong commented on issue #16955: Failed to start standalone pulsar service with tiered storage due to class not found problem

2023-04-26 Thread via GitHub


ethqunzhong commented on issue #16955:
URL: https://github.com/apache/pulsar/issues/16955#issuecomment-1523307814

   I have also encountered this bug, and I will try to fix the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-client-reactive] annotated tag v0.3.0 updated (277d004 -> ffa1d45)

2023-04-26 Thread cbornet
This is an automated email from the ASF dual-hosted git repository.

cbornet pushed a change to annotated tag v0.3.0
in repository https://gitbox.apache.org/repos/asf/pulsar-client-reactive.git


*** WARNING: tag v0.3.0 was modified! ***

from 277d004  (commit)
  to ffa1d45  (tag)
 tagging 277d004cfb16379ccbfea8da87a933c7670475b7 (commit)
 replaces v0.2.0
  by Christophe Bornet
  on Wed Apr 26 13:59:08 2023 +0200

- Log -
Release v0.3.0
-BEGIN PGP SIGNATURE-

iIkEABYKADEWIQSsJtR8kOYvBGFVou/hzYcUAI4EngUCZEkSDBMcY2Jvcm5ldEBh
cGFjaGUub3JnAAoJEOHNhxQAjgSeiGUA/jUJfecyMvH7iUCXjGGKOwc2HjUsiZFm
PKfMDef2KnjMAPkBwY0rX/IVb4lKyS8lPP4y43GMpCWG4KgWEyJYIm05Ag==
=ZDoz
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:



[GitHub] [pulsar] yapxue closed issue #20186: [Bug] broker cannot connect to bookie suddenly and after restarting this issue persists

2023-04-26 Thread via GitHub


yapxue closed issue #20186: [Bug] broker cannot connect to bookie suddenly and 
after restarting this issue persists
URL: https://github.com/apache/pulsar/issues/20186


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] yapxue opened a new issue, #20186: [Bug] broker cannot connect to bookie suddenly and after restarting this issue persists

2023-04-26 Thread via GitHub


yapxue opened a new issue, #20186:
URL: https://github.com/apache/pulsar/issues/20186

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) 
and found nothing similar.
   
   
   ### Version
   
   pulsar 2.10.X
   
   ### Minimal reproduce step
   
   checkout out to pulsar branch-2.10.X, make a docker image and deploy a 
pulsar cluster by pulsar helm chart.
   Then broker complain cannot connect to bookie. Restart cannot sovle it.
   
   ### What did you expect to see?
   
   broker can connect to bookie.
   
   ### What did you see instead?
   
   ```
   2023-04-26T11:22:59,494+ [pulsar-registration-client-33-1] WARN  
org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to 
resolve network location for 
pulsar-yapxue-bookie-7.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io, 
using default rack for it : /default-rack.
   2023-04-26T11:22:59,494+ [pulsar-registration-client-33-1] INFO  
org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: 
/default-rack/pulsar-yapxue-bookie-7.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io:3181
   2023-04-26T11:22:59,494+ [pulsar-registration-client-33-1] WARN  
org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to 
resolve network location for 
pulsar-yapxue-bookie-3.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io, 
using default rack for it : /default-rack.
   2023-04-26T11:22:59,494+ [pulsar-registration-client-33-1] INFO  
org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: 
/default-rack/pulsar-yapxue-bookie-3.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io:3181
   2023-04-26T11:22:59,494+ [pulsar-registration-client-33-1] WARN  
org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to 
resolve network location for 
pulsar-yapxue-bookie-8.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io, 
using default rack for it : /default-rack.
   2023-04-26T11:22:59,495+ [pulsar-registration-client-33-1] INFO  
org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: 
/default-rack/pulsar-yapxue-bookie-8.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io:3181
   2023-04-26T11:22:59,495+ [pulsar-registration-client-33-1] WARN  
org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to 
resolve network location for 
pulsar-yapxue-bookie-9.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io, 
using default rack for it : /default-rack.
   2023-04-26T11:22:59,495+ [pulsar-registration-client-33-1] INFO  
org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: 
/default-rack/pulsar-yapxue-bookie-9.pulsar-yapxue-bookie.rheos-streaming-pp.svc.137.tess.io:3181
   ```
   
   ### Anything else?
   
   [broker log](https://gist.github.com/yapxue/9b225b78ddcd4bee3426718ac91131f4)
   [bookie log](https://gist.github.com/yapxue/5a2b91856e0e5f530dd1f335bf6575c5)
   I login a broker node and try to connect one bookie, it succeeded.
   https://user-images.githubusercontent.com/20301740/234565267-73d9af0a-920c-4e4e-a5e0-77137f2d714f.png;>
   
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] lifepuzzlefun commented on pull request #20152: [fix][admin] Fix examine messages if total message is zero

2023-04-26 Thread via GitHub


lifepuzzlefun commented on PR #20152:
URL: https://github.com/apache/pulsar/pull/20152#issuecomment-1523226549

   > > @AnonHxy hi, after check the intention of this admin interface. i think 
we can return a meaningful response directly without return exception to the 
caller. like if there is no message here, any check should return equal to 
latest or earliest, WDYT?
   > 
   > Do you mean that we return an empty response, like 
`Response.ok().build()`? Maybe this will confuse the users I think. 
@lifepuzzlefun
   
   I see, i misunderstand the intention. : - )


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-site] tisonkun commented on pull request #513: pulsar client matrix page

2023-04-26 Thread via GitHub


tisonkun commented on PR #513:
URL: https://github.com/apache/pulsar-site/pull/513#issuecomment-1523220118

   @urfreespace fixed. It's because we now check-in yarn.lock to leverage yarn 
3 pkg manager.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch matrix-page updated (7716bf7297a -> b6b33865ce0)

2023-04-26 Thread tison
This is an automated email from the ASF dual-hosted git repository.

tison pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from 7716bf7297a update
 add b6b33865ce0 run yarn install

No new revisions were added by this update.

Summary of changes:
 yarn.lock | 66 ++-
 1 file changed, 65 insertions(+), 1 deletion(-)



[GitHub] [pulsar-site] cbornet opened a new pull request, #543: Add doc for transform functions before sinks

2023-04-26 Thread via GitHub


cbornet opened a new pull request, #543:
URL: https://github.com/apache/pulsar-site/pull/543

   ### Documentation
   
   
   
   - [x] `doc` 
   - [ ] `doc-required` 
   - [ ] `doc-not-needed` 
   - [ ] `doc-complete` 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] BewareMyPower commented on a diff in pull request #257: Support get the SchemaInfo from a topic and the schema version

2023-04-26 Thread via GitHub


BewareMyPower commented on code in PR #257:
URL: https://github.com/apache/pulsar-client-cpp/pull/257#discussion_r1177651271


##
include/pulsar/Message.h:
##
@@ -176,8 +176,16 @@ class PULSAR_PUBLIC Message {
  */
 bool hasSchemaVersion() const;
 
+/**
+ * Get the schema version.
+ *
+ * @return the the schema version on success or -1 if the message does not 
have the schema version
+ */
+int64_t getLongSchemaVersion() const;
+
 /**
  * Get the schema version
+ * @deprecated Use getLongSchemaVersion instead

Review Comment:
   Okay, let's not mark it as deprecated in this PR.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] keyboardbobo opened a new issue, #20185: [Bug] When using the shared consumption mode, if there are many consumers, the pulsar-io thread will be blocked

2023-04-26 Thread via GitHub


keyboardbobo opened a new issue, #20185:
URL: https://github.com/apache/pulsar/issues/20185

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) 
and found nothing similar.
   
   
   ### Version
   
   pulsar 2.9.2
   
   ### Minimal reproduce step
   
   Start three consumer processes with the following commands: 
   `nohup bin/pulsar-perf consume -n 50 --receiver-queue-size 10 -ioThreads 
10 -u pulsar://10.190.70.226:6650,10.190.70.227:6650,10.190.71.35:6650 -ss sub1 
-st Shared persistent://chenjianbo-tenant/chenjianbo-ns/input-test1 &
   `
   
   
   
   The broker stack shows that there are many pulsar-io threads blocked on the 
`ManagedLedgerImpl.asyncOpenCursor` method, The whole process will be stuck and 
cannot be stopped normally, and the service can only be closed through kill:
   ```
   "pulsar-io-69-126" #959 prio=5 os_prio=0 tid=0x7f7c8800a000 nid=0x5bbab 
waiting for monitor entry [0x7f7a4b23d000]
  java.lang.Thread.State: BLOCKED (on object monitor)
   at 
org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl.asyncOpenCursor(ManagedLedgerImpl.java:886)
   - waiting to lock <0x0003cbaad110> (a 
org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl)
   at 
org.apache.pulsar.broker.service.persistent.PersistentTopic.getDurableSubscription(PersistentTopic.java:867)
   at 
org.apache.pulsar.broker.service.persistent.PersistentTopic.lambda$subscribe$19(PersistentTopic.java:753)
   at 
org.apache.pulsar.broker.service.persistent.PersistentTopic$$Lambda$1827/845333798.apply(Unknown
 Source)
   at 
java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:981)
   at 
java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2124)
   at 
org.apache.pulsar.broker.service.persistent.PersistentTopic.subscribe(PersistentTopic.java:680)
   at 
org.apache.pulsar.broker.service.ServerCnx.lambda$null$12(ServerCnx.java:1051)
   at 
org.apache.pulsar.broker.service.ServerCnx$$Lambda$1096/227211373.apply(Unknown 
Source)
   at 
java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:981)
   at 
java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2124)
   at 
org.apache.pulsar.broker.service.ServerCnx.lambda$handleSubscribe$15(ServerCnx.java:1021)
   at 
org.apache.pulsar.broker.service.ServerCnx$$Lambda$1094/1366070297.apply(Unknown
 Source)
   at 
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602)
   at 
java.util.concurrent.CompletableFuture.uniApplyStage(CompletableFuture.java:614)
   at 
java.util.concurrent.CompletableFuture.thenApply(CompletableFuture.java:1983)
   at 
org.apache.pulsar.broker.service.ServerCnx.handleSubscribe(ServerCnx.java:969)
   at 
org.apache.pulsar.common.protocol.PulsarDecoder.channelRead(PulsarDecoder.java:228)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
   at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
   at 
io.netty.handler.flow.FlowControlHandler.dequeue(FlowControlHandler.java:200)
   at 
io.netty.handler.flow.FlowControlHandler.channelRead(FlowControlHandler.java:162)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
   at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
   at 
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:327)
   at 
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:299)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
   at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
   at 
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
   at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
   at 
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
   at 

[GitHub] [pulsar-site] cbornet opened a new pull request, #542: Add doc for available-functions and functions reload

2023-04-26 Thread via GitHub


cbornet opened a new pull request, #542:
URL: https://github.com/apache/pulsar-site/pull/542

   ### Documentation
   
   
   
   - [x] `doc` 
   - [ ] `doc-required` 
   - [ ] `doc-not-needed` 
   - [ ] `doc-complete` 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] RobertIndie commented on a diff in pull request #257: Support get the SchemaInfo from a topic and the schema version

2023-04-26 Thread via GitHub


RobertIndie commented on code in PR #257:
URL: https://github.com/apache/pulsar-client-cpp/pull/257#discussion_r1177607224


##
include/pulsar/Message.h:
##
@@ -176,8 +176,16 @@ class PULSAR_PUBLIC Message {
  */
 bool hasSchemaVersion() const;
 
+/**
+ * Get the schema version.
+ *
+ * @return the the schema version on success or -1 if the message does not 
have the schema version
+ */
+int64_t getLongSchemaVersion() const;
+
 /**
  * Get the schema version
+ * @deprecated Use getLongSchemaVersion instead

Review Comment:
   It seems that we can also do it on the Java client. If we want to replace 
this public API, it's better to propose a PIP and change the Java client side 
first. I think we need to keep the API as consistent as possible with the Java 
client. 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar] equanz commented on pull request #20179: [fix][broker] Fix recentlyJoinedConsumers to address the out-of-order issue

2023-04-26 Thread via GitHub


equanz commented on PR #20179:
URL: https://github.com/apache/pulsar/pull/20179#issuecomment-1523037906

   @poorbarcode
   Thank you for your clarification.
   
   * [1] Yes.
   * [2] Partially yes. However, I think the main point of this PR is the 
change in the timing of getting the position.
 
https://github.com/apache/pulsar/blob/27880e42c03eabd02d3d5f93f97988f6d03a5d90/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/persistent/PersistentStickyKeyDispatcherMultipleConsumers.java#L450-L458


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-client-cpp] branch main updated (e3f6505 -> 1cc88bf)

2023-04-26 Thread tison
This is an automated email from the ASF dual-hosted git repository.

tison pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-client-cpp.git


from e3f6505  [feat] Support dead letter topic for C client. (#237)
 add 1cc88bf  Fix broken debian package build process (#258)

No new revisions were added by this update.

Summary of changes:
 pkg/deb/Dockerfile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)



[GitHub] [pulsar-client-cpp] tisonkun merged pull request #258: Fix broken debian package build process

2023-04-26 Thread via GitHub


tisonkun merged PR #258:
URL: https://github.com/apache/pulsar-client-cpp/pull/258


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [pulsar-client-cpp] tisonkun commented on pull request #258: Fix broken debian package build process

2023-04-26 Thread via GitHub


tisonkun commented on PR #258:
URL: 
https://github.com/apache/pulsar-client-cpp/pull/258#issuecomment-1522999288

   Thank you!
   
   Merging...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch matrix-page updated (e2b795de623 -> 7716bf7297a)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from e2b795de623 update
 add 7716bf7297a update

No new revisions were added by this update.

Summary of changes:
 docusaurus.config.js | 575 +--
 1 file changed, 280 insertions(+), 295 deletions(-)



[GitHub] [pulsar-site] urfreespace commented on pull request #513: pulsar client matrix page

2023-04-26 Thread via GitHub


urfreespace commented on PR #513:
URL: https://github.com/apache/pulsar-site/pull/513#issuecomment-1522982248

   https://user-images.githubusercontent.com/76024046/234513593-2ab79636-5707-4647-98b5-f6951c845dd5.png;>
   
   Hi, @tisonkun would you pls help take a look at this CI problem? thanks very 
much


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch matrix-page updated (385402fee13 -> e2b795de623)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from 385402fee13 Merge branch 'main' into matrix-page
 add e2b795de623 update

No new revisions were added by this update.

Summary of changes:
 src/components/Matrix/util.js | 1 -
 1 file changed, 1 deletion(-)



[pulsar-site] branch matrix-page updated (db16d6d2c1a -> 385402fee13)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from db16d6d2c1a update
 add 2a45801a60b Release 2.10.4 (#518)
 add aef7cbec4be Bump marked from 0.3.19 to 4.0.10 (#520)
 add 710c8ca91dd Add release metadata for 2.10.4 (#524)
 add b153daa7daf fix the release note (#525)
 add 8ec0e0f8cab Update the process to upload the GPG key (#526)
 add bebc6ff75a7 Release 2.11.1 (#527)
 add 07a7cc96507 [improve][doc] Release verify should set ZK env var (#528)
 add 18716683d7b Add the release note for Nodejs client 1.8.2 (#529)
 add a4a7647fa79 Add Node.js API docs (#530)
 add 58f294644b2 Bump webpack from 5.75.0 to 5.79.0 (#522)
 add 4115e5115ca Bump ua-parser-js from 0.7.32 to 0.7.35 (#523)
 add a0b89643ce9 Bump http-cache-semantics from 4.1.0 to 4.1.1 (#521)
 add 10b0f659743 build(deps): Remove redundant dependency node-static (#532)
 add fe502c6d2b4 PIP-250: Document proxy_version protocol update (#531)
 add 3e84239e795 Docs sync done from apache/pulsar (#6036dcc)
 add 081aff6314a [fix][doc] MesssageListener inject link (#533)
 add bd5958b97e0 [improve][doc] Optimize message retention detail 
explanation (#535)
 add 9f64ca06f6e Docs sync done from apache/pulsar (#ab8a8c9)
 add e819fc14fb6 [fix][doc] CPP client advertised listeners examples (#538)
 add c0a708aad65 Add producer access mode examples for Java and C++ client. 
(#537)
 add d667cadbe79 Update io-kafka-sink.md (#539)
 add 385402fee13 Merge branch 'main' into matrix-page

No new revisions were added by this update.

Summary of changes:
 contribute/create-gpg-keys.md  |23 +-
 contribute/validate-release-candidate.md   | 2 +-
 data/release-java.js   | 5 +-
 data/release-node.js   | 3 +-
 data/release-pulsar.js |29 +-
 docs/client-libraries-clients.md   | 7 +-
 docs/client-libraries-producers.md |49 +-
 docs/concepts-clients.md   | 4 +-
 docs/cookbooks-retention-expiry.md | 2 +-
 docs/developing-binary-protocol.md | 1 +
 package.json   | 3 +-
 release-notes/versioned/client-java-2.10.4.md  |16 +
 release-notes/versioned/client-java-2.11.1.md  |30 +
 release-notes/versioned/pulsar-2.10.4.md   |   136 +
 release-notes/versioned/pulsar-2.11.1.md   |   190 +
 .../versioned/pulsar-client-node-1.8.2.md  |18 +
 releases.json  | 2 +
 static/api/js/1.8.x/assets/highlight.css   |92 +
 static/api/js/1.8.x/assets/main.js |58 +
 static/api/js/1.8.x/assets/search.js   | 1 +
 static/api/js/1.8.x/assets/style.css   |  1279 +
 .../api/js/1.8.x/classes/AuthenticationAthenz.html |73 +
 .../api/js/1.8.x/classes/AuthenticationOauth2.html |88 +
 static/api/js/1.8.x/classes/AuthenticationTls.html |78 +
 .../api/js/1.8.x/classes/AuthenticationToken.html  |76 +
 static/api/js/1.8.x/classes/Client.html|   165 +
 static/api/js/1.8.x/classes/Consumer.html  |   236 +
 static/api/js/1.8.x/classes/Message.html   |   154 +
 static/api/js/1.8.x/classes/MessageId.html |   126 +
 static/api/js/1.8.x/classes/Producer.html  |   136 +
 static/api/js/1.8.x/classes/Reader.html|   146 +
 static/api/js/1.8.x/enums/LogLevel.html|82 +
 static/api/js/1.8.x/index.html |   158 +
 static/api/js/1.8.x/interfaces/AthenzConfig.html   |   121 +
 static/api/js/1.8.x/interfaces/ClientConfig.html   |   177 +
 static/api/js/1.8.x/interfaces/ConsumerConfig.html |   204 +
 static/api/js/1.8.x/interfaces/ProducerConfig.html |   189 +
 .../api/js/1.8.x/interfaces/ProducerMessage.html   |   133 +
 static/api/js/1.8.x/interfaces/ReaderConfig.html   |   122 +
 static/api/js/1.8.x/modules.html   |   100 +
 static/api/js/1.8.x/types/CompressionType.html |67 +
 .../1.8.x/types/ConsumerCryptoFailureAction.html   |67 +
 static/api/js/1.8.x/types/HashingScheme.html   |67 +
 static/api/js/1.8.x/types/InitialPosition.html |67 +
 static/api/js/1.8.x/types/MessageRoutingMode.html  |67 +
 .../1.8.x/types/ProducerCryptoFailureAction.html   |67 +
 static/api/js/1.8.x/types/SubscriptionType.html|67 +
 .../next/config/reference-configuration-broker.md  | 4 +-
 .../config/reference-configuration-standalone.md   | 4 +-
 static/reference/next/pulsar-admin/functions.md| 3 +
 static/reference/next/pulsar-admin/schemas.md  |17 +
 static/reference/next/pulsar-admin/sinks.md| 3 +
 

[GitHub] [pulsar-site] urfreespace commented on pull request #513: matrix page

2023-04-26 Thread via GitHub


urfreespace commented on PR #513:
URL: https://github.com/apache/pulsar-site/pull/513#issuecomment-1522960897

   > Thanks Lili. Add a few questions:
   > 
   > 1. How to maintain the status in these tables? We need a user-friendly way 
so that maintainers can update the table on a regular basis.
   > 2. Can we fold each table? Or add hot links on the right side so that 
users can read the whole page at a glance.
   > 3. Can we add a scroll bar horizontally and vertically? Now the consumer 
matrix cannot be displayed in one screen, so we may lose the table header when 
looking at the bottom row.
   > 
   > BTW, We plan to add reader/tableview in the next delivery phase and can 
add them when iterating the matrix.
   
   done, PTAL, thanks @momo-jun 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[pulsar-site] branch matrix-page updated (497389f1b89 -> db16d6d2c1a)

2023-04-26 Thread urfree
This is an automated email from the ASF dual-hosted git repository.

urfree pushed a change to branch matrix-page
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git


from 497389f1b89 Merge branch 'main' into matrix-page
 add db16d6d2c1a update

No new revisions were added by this update.

Summary of changes:
 client-feature-matrix/index.mdx|  27 +
 docusaurus.config.js   | 565 +++--
 src/components/Matrix/matrix.js|  29 ++
 src/{pages/matrix.js => components/Matrix/util.js} |  76 +--
 4 files changed, 365 insertions(+), 332 deletions(-)
 create mode 100644 client-feature-matrix/index.mdx
 create mode 100644 src/components/Matrix/matrix.js
 rename src/{pages/matrix.js => components/Matrix/util.js} (58%)