membphis commented on PR #13632: URL: https://github.com/apache/apisix/pull/13632#issuecomment-4850767499
Thanks, that makes sense if `ai-cache` has not been released yet. One extra question: what is the expected user-facing distinction between L1 and L2 here? My understanding is that the two-layer design is mainly an internal optimization/correctness model: L1 is deterministic and cheap, while L2 is approximate and more expensive because it requires embedding plus vector search. Since an L2 hit already has `X-AI-Cache-Similarity`, do we need to expose `HIT-L1` in `X-AI-Cache-Status`, or could we keep the simpler `HIT` for exact hits and use either `HIT-L2` or a separate layer/similarity header only for semantic hits? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
