Maciej Grzenda created SAMOA-68:
-----------------------------------

             Summary: Saving true and predicted labels to file
                 Key: SAMOA-68
                 URL: https://issues.apache.org/jira/browse/SAMOA-68
             Project: SAMOA
          Issue Type: New Feature
          Components: SAMOA-API
            Reporter: Maciej Grzenda


Currently PrequentialEvaluation task supports dumpFile option.  With this 
option model performance can be saved to a file. However, in some cases it 
would be good to save also individual predictions made by a model.  This is 
useful for model debugging and method development.
This could be also used to visualize model output, calculate custom performance 
indicators (e.g. model accuracy for instances of a certain class or sharing the 
same feature value).  Such saving of model output (if done) should be made for 
every instance. Hence, a new option making it possible to dump predictions to a 
separate file seems justified.  For classification, it should include votes 
made for individual classes, if available.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to