This is an automated email from the ASF dual-hosted git repository.
ruihangl pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/tvm.git
from f6a406a64e [Script] Enhance alloc buffer handling in nested frames
(#18088)
add 23bcbc5350 [KVCache] Per Layer Sliding Window (#17928)
No new revisions were added by this update.
Summary of changes:
python/tvm/relax/frontend/nn/llm/kv_cache.py | 49 +++++--
src/runtime/vm/attn_utils.h | 3 +-
src/runtime/vm/paged_kv_cache.cc | 211 +++++++++++++++++++++++----
3 files changed, 216 insertions(+), 47 deletions(-)