This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly
in repository https://gitbox.apache.org/repos/asf/tvm.git
from 71f7af7985 [Runtime] Use preferred host memory (pinned memory) in KV
cache (#17036)
add 291c04770a [TIR] Fix Bug in VectorizeLoop (#17039)
add 08b32a7976 [Runtime][ROCm] Enable ROCm host memory support (#17037)
add f6aab98ace [Bugfix][Support] Fix copy constructor for
support::OrderedSet (#17044)
add 7c2c0d9337 [Disco][QoL] Implement broadcast/scatter methods for
Session (#17035)
add 820f1b617a [Runtime] Compatibility with dmlc::Stream API changes
(#16998)
add 1eac17857f [Runtime] Fix PagedKVCache for PopN and enhance tests
(#17045)
No new revisions were added by this update.
Summary of changes:
3rdparty/dmlc-core | 2 +-
python/tvm/runtime/disco/session.py | 102 +++++++++++++++++++--
src/runtime/disco/process_session.cc | 3 +-
src/runtime/disco/threaded_session.cc | 3 +-
src/runtime/file_utils.h | 8 +-
src/runtime/ndarray.cc | 3 +-
src/runtime/relax_vm/kv_state.cc | 2 +
src/runtime/relax_vm/kv_state.h | 2 +
src/runtime/relax_vm/paged_kv_cache.cc | 49 ++++++----
src/runtime/rocm/rocm_device_api.cc | 40 +++++++-
src/runtime/rpc/rpc_endpoint.cc | 8 +-
src/runtime/rpc/rpc_socket_impl.cc | 7 +-
src/support/base64.h | 5 +-
src/support/ordered_set.h | 31 ++++++-
src/support/pipe.h | 24 +++--
src/tir/transforms/vectorize_loop.cc | 14 ++-
tests/python/disco/test_ccl.py | 70 ++++++++++++--
...runtime_builtin_paged_attention_kv_cache_tir.py | 30 +++++-
.../tir-transform/test_tir_transform_vectorize.py | 27 +++++-
19 files changed, 354 insertions(+), 76 deletions(-)
