[
https://issues.apache.org/jira/browse/SOLR-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058470#comment-13058470
]
Dawid Weiss commented on SOLR-2628:
-----------------------------------
Yep, this is a duplicate. Thanks Mike. Like I said -- I won't be able to work
on this for the next two weeks (I also have that FST refactoring opened up in
the background... it's progressing slowly), but it's definitely a low-hanging
fruit to pick because it shouldn't be very difficult and the gains huge.
> use of FST for SynonymsFilterFactory and synonyms.txt
> -----------------------------------------------------
>
> Key: SOLR-2628
> URL: https://issues.apache.org/jira/browse/SOLR-2628
> Project: Solr
> Issue Type: New Feature
> Components: Schema and Analysis
> Affects Versions: 3.4, 4.0
> Environment: Linux
> Reporter: Bernd Fehling
> Assignee: Dawid Weiss
> Priority: Minor
> Labels: suggestion
>
> Currently the SynonymsFilterFactory builds up a memory based SynonymsMap.
> This can generate huge maps because of the permutations for synonyms.
> Now where FST (finite state transducer) is introduced to lucene this could
> also be used for synonyms.
> A tool can compile the synoynms.txt file to a binary automaton file which can
> then be used
> with SynoynmsFilterFactory.
> Advantage:
> - faster start of solr, no need to generate SynonymsMap
> - faster lookup
> - memory saving
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
