[
https://issues.apache.org/jira/browse/OPENNLP-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13085876#comment-13085876
]
William Colen commented on OPENNLP-226:
---------------------------------------
As discussed in the dev list I will implement the following:
- We define the MissclassifiedSampleListener interface, with one void
missclassified(T reference, T prediction) method.
Implementations of this interface will be passed to our evaluators (for example
TokenNameFinderEvaluator), that will use it to notify when a prediction fails.
- We will have one default MissclassifiedSampleListener implementation for each
tool, for example NameEvaluationErrorListener. The default implementation will
print errors to System.out. The default implementation will be used by our
command line interface.
- We will move the printErrors methods the util class EvaluationErrorPrinter.
Other things:
we need to know when to notify the listener while executing
Evaluator.evaluateSample(..) method. There we are already using the FMeasure
class, that can easily check if there is an error in the prediction. Maybe we
should simply change the return type of method updateScores from void to
boolean, that would return true if there is an error and we should notify the
listener.
> Evaluators should allow tools to register a misclassified report interface
> --------------------------------------------------------------------------
>
> Key: OPENNLP-226
> URL: https://issues.apache.org/jira/browse/OPENNLP-226
> Project: OpenNLP
> Issue Type: New Feature
> Components: Chunker, Command Line Interface, Name Finder, POS
> Tagger, Sentence Detector, Tokenizer
> Affects Versions: tools-1.5.2-incubating
> Reporter: William Colen
> Assignee: William Colen
> Priority: Minor
> Fix For: tools-1.5.2-incubating
>
>
> OPENNLP-220 introduced the -misclassified argument that enables evaluators to
> print misclassified items while using the command line evaluators. We should
> expand it to allow any other tool that uses evaluators to register an
> interface to get that information.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
