asafm commented on issue #16680: URL: https://github.com/apache/pulsar/issues/16680#issuecomment-1195218495
> > Might generate smaller batches or increase latency? > > Yes. This will generate smaller batches if `batchedFilterProperties ` is not empty. But the advantage is that there is no need to deserialize the entry in the broker or just publish non-batched messages if users want to fliter entries. > > > Why not have list of values for property: region=us,eu ? > > Good idea. Users should know which values they will use. It seems reasonable. What I am suggesting is to turn this idea a bit: Instead of batching per the same values of keys, batch all messages, and for each property save a list of values in the metadata. This way you are not affecting the latency on the client side or batch size, yet you still have the ability to filter batches based on metadata without deserializing it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
