Hi Everyone
We have scheduled the October meetup on the 24th of this month. If you are
interested in giving a talk please reply to this thread with Talk Title and
Description or comment the same on the meetup page [1].
I would like to give a talk titled "LLM Optimizations for Local Inference". I
will focus on three specific optimizations: NVFP4, speculative decoding, and
prefix caching. The talk will begin with a brief introduction to how LLMs work,
followed by an explanation of these optimizations, how they work, and how they
help accelerate local inference on machines like the DGX Spark.
Regards,
Vijay
_______________________________________________
Chennaipy mailing list -- [email protected]
To unsubscribe send an email to [email protected]
https://mail.python.org/mailman3//lists/chennaipy.python.org
Member address: [email protected]
