xiangfu0 commented on PR #16819: URL: https://github.com/apache/pinot/pull/16819#issuecomment-3298842198
what's the issue observed from your production? Can we reproduce it? In general group commit should be strictly better than single commit. If you have a large table then IdealState commit will take time that will in turn reduce how many updates you can do. E.g. we have a use case that the IdealState is about 200MB uncompressed and each IdealState commit will take about 5 seconds, it means for a minute we could at most do 20 updates. However we have 100+ updates per minute. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
