k-krawczyk commented on PR #23614:
URL: https://github.com/apache/camel/pull/23614#issuecomment-4583678121

   Thanks @Croway — all four addressed:
   
   1. Ollama — added the ollama run llama3.2 command and a link to 
https://ollama.com.
   2. LM Studio — added a link to https://lmstudio.ai.
   3. vLLM — added pip install vllm and the vllm serve 
meta-llama/Llama-3.1-8B-Instruct --port 8000
   command plus a link to docs.vllm.ai. Also added a note on the vllm-mlx 
variant for Apple Silicon with
   an example vllm-mlx serve mlx-community/Qwen2.5-7B-Instruct-4bit --port 8000.
   4. OpenRouter — honest answer: I didn't test against the live OpenRouter API 
(no account/key at hand).
     The example follows OpenRouter's documented OpenAI-compatible endpoint, 
and I confirmed in the
   producer code (applyAdditionalBodyProperties / parseJsonOrString) that 
additionalBodyProperty parses
   JSON-string values into a real JSON object on the request body, so the 
nested provider field should
   reach OpenRouter correctly. Happy to revise if @orpiske (or anyone with an 
account) can validate
   end-to-end — or I can sign up and re-test if you'd prefer that before merge.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to