Kirill A. Korinsky [[email protected]] wrote: > > Here a version where I: > 1. added runtime dependency on textproc/ripgrep > 2. patched required current_exe() usage > 3. added README with sample how it can be used against llama.cpp server >
I like this. I had done a similar README. In model_providers you should add:
headers = {}
query_params = {}
They might not break anything today but they are of no use to llama.cpp and
the future is less certain. They are designed for openai's interface.
