On Fri, 2026-06-26 at 15:08 +0200, Christian Kastner wrote:
> Regarding rpc-server, I agree that this should be called
> 'llama-rpc-server', and requested a rename upstream [1]. 'rpc-server'
> alone is too generic for /usr/bin.

In my own old packages I had actually named it ggml-rpc-server, but
according to the latest discussion on [1], this is also what has been
chosen. So, all looks good.

> @Mathieu: this could be a good candidate for another systemd service, I
> think?

It should certainly be a systemd service! But I don't have much
practice with it.

If I well understand, it will simply load the (full-fledged) ggml
backends which have been installed on the same system, and expose them
so that they can be accessed by remote tools via their RPC backend.

@Christian Do you want me to look at it? Since I am more on whisper.cpp
right now, it may take a few days.

Cheers,

Mathieu

> 
> [1]: https://github.com/ggml-org/llama.cpp/pull/25045

Reply via email to