Hi Gottfried,

  1.
there is a package:

https://packages.guix.gnu.org/packages/llama-cpp/0.0.0-b8445/
but it needs additional stuff.
What would I have to add?
What does your package do? Just the ability to run llama models?

2. What is your experience on AI?
3. Is it safe to install it?
4. Does somebody have experience with it?
5. Somebody from Emacs Mailinglist, uses „llama-cpp“ regularly with Debian Sid.
6. What offers Guix for AI?
I am not entirely sure what you mean; do you mean using packaged agentic 
systems, like openai Codex or openclaw?

I am using both types of systems. Still playing around with everything, but I 
can see myself use it for production stuff. I am very picky though, and I’d 
want to double-check anything produced, review the code, etc.
How safe it is, really depends on how you end up using it. It’s like most 
things, you need to understand your choices fully and predict what can go 
wrong. You can adjust your practice (e.g. not run openclaw on your 
company-provided laptop, or segregating it to a limited user account or a vm) 
and prepare mitigation (e.g. have monitoring jobs/loops, make sure you 
understand security pipelines).

I have working packaged version of ollama and openclaw on my Guix System, 
working continuously; currently working on optimising ollama for using my 
Nvidia GPU properly, because I have had enough of running out of tokens!

Etienne

Reply via email to