benwtrent opened a new issue, #12219:
URL: https://github.com/apache/lucene/issues/12219
### Description
There are two major reasons for adding a custom vector similarity function:
- Adding new nuanced similarity functions (jaccard, hamming, etc.)
- Have external support for unstable JVM APIs (Vector incubator)
I am not 100% sure Lucene itself should go through the work of consistently
adding new similarity functions.
We should make these pluggable in such a way that developers using Lucene
can provide specialized distance functions.
I think the main issue is that the Vector Similarity function is tied to the
FieldType and currently that is not pluggable via any external configuration.
There are two ways I can think of for doing this:
- The functions being provided in indexing and search configurations (not a
fan of this option).
- Using an SPI (seems like a more natural option).
Opening this issue for discussion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]