janiussyafiq opened a new pull request, #13644:
URL: https://github.com/apache/apisix/pull/13644

   ### Description
   
   Extends the `ai-cache` plugin (#13632) to cache streaming responses: SSE 
streams are captured in `body_filter` behind a completeness gate and replayed 
on cache hits with the correct `Content-Type`, with cache entries tagged by 
body format (`json`/`sse`) sourced from the ai-providers streaming framing. 
Also refactors Redis connection management into a shared `with_redis` helper 
with fail-open handling and improves error handling in the L1 backfill path.
   
   #### Which issue(s) this PR fixes:
   Fixes #
   
   ### Checklist
   
   - [x] I have explained the need for this PR and the problem it solves
   - [x] I have explained the changes or the new features added to this PR
   - [x] I have added tests corresponding to this change
   - [x] I have updated the documentation to reflect this change
   - [x] I have verified that this change is backward compatible (If not, 
please discuss on the [APISIX mailing 
list](https://github.com/apache/apisix/tree/master#community) first)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to