2019-05-24 09:17:55 UTC - Lewey: Just to add more info we are using the java client. we are using sync ---- 2019-05-24 09:26:54 UTC - Sijie Guo: make sure you have increased ’receiverQueueSize` so that pulsar client can fetch enough messages for you to process.
I think the performance depends on your application, how fast you can call `receive`. so you can estimate the number of threads based on how fast you can call `receive`. ---- 2019-05-24 09:27:20 UTC - David Tinker: httpNumThreads=8 did the trick. Tx. ---- 2019-05-24 09:33:17 UTC - Sijie Guo: :ok_hand: np ---- 2019-05-24 09:39:42 UTC - David Tinker: I created an issue for this. It will hurt people trying out Pulsar on small cloud servers. <https://github.com/apache/pulsar/issues/4359> ---- 2019-05-24 09:44:24 UTC - Sijie Guo: I think the bug was fixed by some pull requests ---- 2019-05-24 10:18:19 UTC - Ulf Lilleengen: I’m investigating the possibility of using source/sink to implement a protocol bridge. In a pulsar sink, is it possible to have it receive messages from all topics? The closest I could find I the docs is maybe specifying “--topics-pattern *”, though I’m not sure it works the way I think it does. ---- 2019-05-24 10:20:05 UTC - Ali Ahmed: @Ulf Lilleengen not sure what kind of bridge you mean , as per doc all topics matched with the regex will be read by the sink, there now no order guarantees when reading multiple topic in sink ---- 2019-05-24 10:22:15 UTC - Ulf Lilleengen: @Ali Ahmed i was thinking about an AMQP 1.0 bridge connecting the brokers to an Apache Qpid Dispatch router. Regarding the ordering, i would not expect any order across multiple topics, but is ordering within a single topic affected? ---- 2019-05-24 10:23:44 UTC - Ali Ahmed: ordering within a topic is guaranteed (within a partition). ---- 2019-05-24 10:24:27 UTC - Ali Ahmed: sink is probably not a place to implement a bridge, you may want to look at the pulsar proxy ---- 2019-05-24 10:25:11 UTC - Ali Ahmed: there a web socket bridge implementation, that might a better point to interject a protocol converter ---- 2019-05-24 10:25:16 UTC - Alexandre DUVAL: FYI: <https://github.com/bbonnin/pulsar-express> +1 : Brian Doran, Yuvaraj Loganathan, Matteo Merli star-struck : Yuvaraj Loganathan, Shivji Kumar Jha ---- 2019-05-24 10:25:26 UTC - Ulf Lilleengen: Ok, yeah I had the proxy in my mind too.. i have not looked at the proxy code yet, so I don’t know how easy task that would be. ---- 2019-05-24 10:26:31 UTC - Ali Ahmed: that depends on the complexity of the protocol and what subset is being translated ---- 2019-05-24 10:26:42 UTC - Ulf Lilleengen: I was thinking to maybe “save” a network hop by using the dispatch router instead, since it enables some other patterns as well ---- 2019-05-24 10:27:03 UTC - Ulf Lilleengen: From what I could see, the pulsar protocol should map nicely to AMQP 1.0 ---- 2019-05-24 10:27:37 UTC - Ali Ahmed: a partial implementation should be relatively straight forward to map to in a proxy extension ---- 2019-05-24 10:27:59 UTC - Ali Ahmed: supporting the entire specification will be difficult. ---- 2019-05-24 10:28:49 UTC - Ulf Lilleengen: Yeah, I’m just playing around with this for now though, I don’t have any particular goal in mind :) ---- 2019-05-24 10:29:31 UTC - Ali Ahmed: generally most applications use a small sub set of AMQP features ---- 2019-05-24 10:33:11 UTC - Ulf Lilleengen: Indeed. Anyway thanks for your help. Just started to read up on pulsar in more depth, I really like what I’ve seen! +1 : Matteo Merli, Karthik Ramasamy ---- 2019-05-24 11:41:36 UTC - Kim Christian Gaarder: How can I force re-run the “Jenkins: C++ / Python Tests” using PR comment? … I know that I can do “run java8 tests” and “run integration tests”, but I don’t know what the magic word for the c++/python tests is. ---- 2019-05-24 12:23:51 UTC - Sijie Guo: run cpp tests ---- 2019-05-24 12:33:36 UTC - Kim Christian Gaarder: ty :slightly_smiling_face: ---- 2019-05-24 17:24:02 UTC - Yuvaraj Loganathan: @Shivji Kumar Jha ---- 2019-05-24 18:33:07 UTC - Matteo Merli: We started by taking ideas from AMQP, MQTT and STOMP, designing for simple interaction that could lead to : * Min overhead per message on wire * Guaranteed receipts for publish & delivery * Flow control mechanism ---- 2019-05-24 18:58:32 UTC - Jerry Peng: @Devin G. Bost <https://github.com/apache/pulsar/pull/4363> ---- 2019-05-24 20:15:42 UTC - flafik: @flafik has joined the channel ---- 2019-05-25 02:55:57 UTC - Devin G. Bost: @Jerry Peng This is awesome! Thanks! FYI @Thor Sigurjonsson @Victor Siu @vinay Parekar ----
