Tomoko Uchida created LUCENE-10497:
--------------------------------------

             Summary: Unify "Token" interface in Kuromoji and Nori
                 Key: LUCENE-10497
                 URL: https://issues.apache.org/jira/browse/LUCENE-10497
             Project: Lucene - Core
          Issue Type: Sub-task
            Reporter: Tomoko Uchida


"Token" classes are the output of the viterbi algorithm in kuromoji and nori, 
and its implementation is slightly different between them (Nori's Token class 
looks more expressive or extendable).

To proceed [LUCENE-10493], I think we need the unified "Token" class or at 
least a common interface for it. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to