sijie opened a new pull request #1387: Build batching-awareness into 
round-robin message router
URL: https://github.com/apache/incubator-pulsar/pull/1387
 
 
   
   ### Motivation
   
   
   The default `SinglePartition` message router works well when you have more 
producers than the number of partitions.
   Howerver partitions will become idle if you have more partitions than 
producers. In the case of `producers` <= `partitions`,
   a round-robin message router works better. However the current round-robin 
messages router doesn't take `batching` into account.
   
   ### Modifications
   
   
   Improve the current round-robin message router to build batching awareness 
into it. The round-robin messages router choose
   partition based on a randomly-chosen start partition id and the current 
milliseconds (round-up at the `maxBatchingDelayMs` boundary).
   This guarantees that at a given `maxBatchingDelayMs`, the message router is 
always choosing a same partition, this improves batching locality.
   
   ### Result
   
   round-robin message router is batching aware.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to