mcvsubbu commented on issue #6121: URL: https://github.com/apache/incubator-pinot/issues/6121#issuecomment-705799470
Did you run the provisioning helper tool? Can you paste the output here? (See https://docs.pinot.apache.org/operators/operating-pinot/tuning/realtime) That being said, there is always a risk of excessive GC load during segment completion. What we have seen is that all the memory that is accumulated during consumption is released when the segment is completed. Also, segment build takes up cpu, causing queries to get slower. There is a config (on the server) to limit the number of segment builds per server. Default is no limit, but you can try to set it to some limit if you like. Also, 5MB segment sizes seem too small to me, but of course, it depends on what kind of hosts you are provisioning. Running the prov helper and pasting the output here will guide us some. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
