mcvsubbu commented on issue #7994: URL: https://github.com/apache/pinot/issues/7994#issuecomment-1010368708
@lksvenoy-r7 thanks for filing the issue. One question. All realtime completed segments are indeed stored in deepstore. The question is whether there needs to be a copy in memory (on the server) or not. Currently, there is an argument `retentionHours` that can be provided, which says how many hours of data are typically queried. (See https://docs.pinot.apache.org/operators/operating-pinot/tuning/realtime#realtimeprovisioninghelper) If you only query the last N hours most of the time, and do not mind the additional latency of paging for the other queries, you can specify this while invoking the command. Does the help? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
