2020-09-07 09:54:05 UTC - Danilo Moreira: @Danilo Moreira has joined the channel ---- 2020-09-07 10:14:15 UTC - Shivam Arora: Hello Rahul, Open source helm chart sizing should be sufficient for your load. However you may want to consider following 1. changing heap size of ZK, Broker and bookie. 2. Node affinity for HA. 3. In Bookie, 100GB of Ledger and 20G of Journal should be a good start. 4. Change below value according to your heap size - ```#dbStorage_writeCacheMaxSizeMb: "32" #dbStorage_readAheadCacheMaxSizeMb: "32" #dbStorage_rocksDB_writeBufferSizeMB: "8" #dbStorage_rocksDB_blockCacheSize: "8388608"``` 5. Three VM minimum to start with. ---- 2020-09-07 14:28:41 UTC - Rahul Vashishth: @Shivam Arora do u suggest a max limit on Ledger and Journal size, for a single bookie pod?
Basis on this we decide how many bookie pod to have in cluster ---- 2020-09-07 22:04:28 UTC - Shivam Arora: There is no specific limit set for a single bookies. However I suggest you to have high performance disk for journal storage. Also, number of bookies with proper ensemble size affect replication factor and HA. Suggest you to read below article for better understanding of how pulsar works -- <https://jack-vanlightly.com/blog/2018/10/2/understanding-how-apache-pulsar-works> ---- 2020-09-08 04:25:50 UTC - Chris Olson: @Chris Olson has joined the channel ---- 2020-09-08 05:02:27 UTC - Chris Olson: Hi Everyone. Im using <https://thingsboard.io> which has just released an integration for Pulsar, so im learning about it as it looks great that it can include worker units in the same broker. I'm also working on a project that will need a job queue for Linear Programming optimisation tasks. The optimisation application is written in python but includes many dependencies from <https://github.com/coin-or> . A question; <http://pulsar.apache.org/docs/en/2.3.2/functions-quickstart/#packaging-python-dependencies> states that dependencies for a python function have to bundled in a particular manner. but in v2.6.1 I couldnt see this in the doc menu although did see this <https://pulsar.apache.org/docs/en/functions-quickstart/> Are Python function dependencies still required to be packaged the same way ? Thanks for any assistance with this btw. Im not a developer, just finding my way :slightly_smiling_face: Chris ----
