mochengqian opened a new issue, #943: URL: https://github.com/apache/dubbo-go-pixiu/issues/943
The LLM proxy cooldown store is bounded, but eviction currently scans entries to find the oldest item. That is acceptable for the small current cap, but it is still O(N) work on the request failure path. Proposed: - Replace oldest-entry eviction with an explicit LRU list, for example `container/list` plus map entries that hold list elements. - Preserve the existing identity key semantics: cluster name, endpoint ID, endpoint address, and credential hash. - Add tests for eviction order, TTL sweep interaction, and endpoint churn. Reference: listed as a known follow-up in PR #932. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
