Pablo Mendes created STANBOL-652: ------------------------------------ Summary: Benchmark should report evaluation summary Key: STANBOL-652 URL: https://issues.apache.org/jira/browse/STANBOL-652 Project: Stanbol Issue Type: Improvement Components: Testing Reporter: Pablo Mendes Priority: Minor
The SBC is a nice way to perform manual inspection of the behavior of the enhancement chain for different examples in the evaluation dataset. However, for evaluations with several hundreds of examples, it would be interesting to have scores that summarize the performance for the entire dataset. For example, precision, recall and F1. An evaluation dataset is available here in BDL: http://spotlight.dbpedia.org/download/stanbol/ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira