So I'm running the llm Debian package locally. I had to package two deps, for which I have filed ITPs as well (1065576: python-ulid, 1065578: python-sqlite-migrate). The former is a solid, globally useful library, but I'm less sure about the latter - it seems more something built just for that project, and that's explicitly not ready for production. But, alas, that is done as well.
The code is on salsa: https://salsa.debian.org/python-team/packages/llm https://salsa.debian.org/python-team/packages/python-ulid https://salsa.debian.org/python-team/packages/sqlite-migrate I'm waiting a bit to see if people kick back on debian-devel before going ahead with new. I'll also test this a little more, possibly trying out llama.cpp if i can find the cycles. So far this works pretty well. It's really nice to not have to use the browser to talk to the engines, and having the ability to just pipe stuff in and out of there is really useful. a. -- Advertisers, not governments, are the primary censors of media content in the United States today. - C. Edwin Baker
