mcvsubbu commented on issue #6524: URL: https://github.com/apache/incubator-pinot/issues/6524#issuecomment-785295453
@daniellavoie the freshness metric is returned on a per query basis. Users will be issuing query, and on the return, can get metadata about: - Freshness - Partial response If either of these are not in line with what user expects (e.g. freshness should not be less than current time minus 20 minutes), they can contact an SRE to look into the problem. Does this model work for you? Even if we open up some basic table information to users, the users will need to come tp the SREs to make something of the message anyway. What you are looking for is some smart log processing service that analyzes logs, splits them on a per table basis, consolidates logs for the same table across different partitions and servers and reaches some "smart" conclusion about what may be going wrong, and outputs that to the user in one sentence or paragraph, with an action to be taken. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
