janiussyafiq commented on PR #13632: URL: https://github.com/apache/apisix/pull/13632#issuecomment-4850805059
> Thanks, that makes sense if `ai-cache` has not been released yet. > > One extra question: what is the expected user-facing distinction between L1 and L2 here? My understanding is that the two-layer design is mainly an internal optimization/correctness model: L1 is deterministic and cheap, while L2 is approximate and more expensive because it requires embedding plus vector search. Since an L2 hit already has `X-AI-Cache-Similarity`, do we need to expose `HIT-L1` in `X-AI-Cache-Status`, or could we keep the simpler `HIT` for exact hits and use either `HIT-L2` or a separate layer/similarity header only for semantic hits? I believe it is a matter of design, both of your points are legit. I simply reverted back to design choice here in the pic (ref https://github.com/apache/apisix/issues/13290): <img width="903" height="622" alt="image" src="https://github.com/user-attachments/assets/324738f4-2989-4fb3-953d-c2a5ecf7b8d8"; /> I guess we can keep `HIT` for both to remain consistent with previous test cases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
