As of Solr 9.8 (https://issues.apache.org/jira/browse/SOLR-17525) there's native Solr support for "embedded" LLM models (thank you Alessandro for this work). From the documentation a few specific model types are supported via langchain4j.
We use KServe for serving trained models and am curious to get feedback from the community if support for its interface would be valuable to people. I would be interested in getting started on this work to expand the TextToVectorQParser -Kevin
