This can be dealt with in a lot of differnet ways in Solr -- even if Lucene removes all suppport for the IndexWriter.maxFieldLength, Solr can still support it by wrapping every analyzer with a LimitTokenCountFilter if that config option is used.
we could concievable support having LimitTokenCountFilter added implicitly even if that option isn't used, via some syntax like you suggest -- but honestly i think it's better to just let the user declare it like any other filter -- that way it doesn't have any special semantics, and they can put it at the end (limit tokens) or at the begining (limit tokenz from the tokenizer, but allow more tokens to be added by synonyms, WDF, etc...) : What about an option to override this on a per field-type and/or per : field basis. Then the global setting could still be default: -Hoss -- http://lucenerevolution.org/ ... October 7-8, Boston http://bit.ly/stump-hoss ... Stump The Chump! --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
