adam-christian-software commented on issue #50: URL: https://github.com/apache/polaris-tools/issues/50#issuecomment-3627203752
> Is there a standard or tooling around measuring the efficiency of the mcp context? From my understanding, there is nothing around the efficiency or performance yet. https://modelcontextprotocol.io/docs/tools/inspector is great for being able to debug functional problems, but I have yet to find that it helps with efficiency. In terms of efficiency, we could A/B test some of the approaches for: 1. Time taken by the model to respond with an answer 2. The amount of context window used However, these are pretty crude ways to do this from my perspective. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
