kishoreg commented on pull request #6037: URL: https://github.com/apache/incubator-pinot/pull/6037#issuecomment-696321992
> > Aren’t we trying to address the limitations of monitoring systems in Pinot? > > I'm not aware that. Could you elaborate a bit more? what's exactly the plan and what's the timeline for it? > The solution presented here is regarding a large cluster at Linkedin for which table level metrics are disabled for all tables. The current situation is risky as for some high priority tables, we don't get alerted. This PR immediately alleviates the existing issue. Sorry, I was referring to the changes in this PR. Ideally, we should be logging metrics for all tables/resources. It's up to the operators to set alerts on the right tables that are important for the business. By adding this new config, we are adding a workaround in Pinot to overcome the limitation with the metrics system which cannot handle thousands of tables. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
