raghavgautam commented on PR #10639:
URL: https://github.com/apache/pinot/pull/10639#issuecomment-1526110888

   > Making it pluggable at KV store level will add extra overhead to the 
default implementation because it will force us to serialize everything. 
Instead, we can make it pluggable at metadata manager level so that there is no 
performance penalty to the default implementation. You may take a look at #9186 
of how we made upsert metadata manager pluggable. This PR should be very 
similar to that
   
   @Jackie-Jiang The serialization that we are using is simple enough to not 
add significant overhead. It will probably cost 100 or so CPU cycles per 
record. Moreover, this overhead happens only during ingestion time and does not 
affect query performance. Keeping the LocalKeyValueStore pluggable will make it 
reusable in other places as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to