On 8/9/07, Lance Norskog <[EMAIL PROTECTED]> wrote: > I'm adding a field to be the source of the spellcheck database. Since that > is its only job, it has raw text lower-cased, de-Latin1'd, and > de-duplicated. > > Since it is only for the spellcheck DB, it does not need to keep duplicates.
Duplicate token values (words) or duplicate field values? Could you give some examples? -Yonik
