This is an automated email from the ASF dual-hosted git repository. vterentev pushed a change to branch fix-vllm-10-08 in repository https://gitbox.apache.org/repos/asf/beam.git
from 7fc6d7d1974 Fix kv-cache-dtype
add 0c5d8bf9ee6 Use float16 dtype, attention backend torch
No new revisions were added by this update.
Summary of changes:
sdks/python/apache_beam/ml/inference/vllm_inference.py | 14 +++-----------
1 file changed, 3 insertions(+), 11 deletions(-)
