MarkovChainTokenFilter
----------------------

                 Key: LUCENE-1024
                 URL: https://issues.apache.org/jira/browse/LUCENE-1024
             Project: Lucene - Java
          Issue Type: New Feature
          Components: Analysis, Term Vectors
            Reporter: Karl Wettin
            Priority: Minor
         Attachments: LUCENE-1024.txt

Merges chains of tokens to a single token, ngrams on a phrase word level rathar 
than on a word character level.

Quite useful for text mining purposes of the vector space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to