Enhancer benchmark tool
-----------------------
Key: STANBOL-138
URL: https://issues.apache.org/jira/browse/STANBOL-138
Project: Stanbol
Issue Type: New Feature
Components: Enhancer, Testing
Reporter: Bertrand Delacretaz
Assignee: Bertrand Delacretaz
Priority: Minor
I'm working on a benchmark tool for the stanbol enhancer, where content is fed
to the enhancer and the output is checked according to a set of expectations.
Here's an example benchmark - the syntax might evolve as we implement this, but
it explains the general idea.
To run the benchmark we'll POST a plain text document containing one or several
such benchmarks, and get an HTML document back with the results.
= INPUT =
Bob Marley was born in Kingston, Jamaica
= EXPECT =
# Comments such as this one are ignored
# EXPECT defines groups of predicate/object matchers that we expect to find in
the output
# Each group applies to one given enhancement: for the expectation to succeed,
at least
# one enhancement must match all lines in the group
http://fise.iks-project.eu/ontology/entity-reference URI
http://dbpedia.org/resource/Kingston%2C_Jamaica
http://purl.org/dc/terms/creator STRING
org.apache..*ReferencedSiteEntityTaggingEnhancementEngine
# Groups are separated by empty lines, here's a new one
http://fise.iks-project.eu/ontology/entity-type URI
http://dbpedia.org/ontology/MusicalArtist
http://fise.iks-project.eu/ontology/entity-reference URI
http://dbpedia.org/resource/Bob_Marley
http://purl.org/dc/terms/creator REGEXP
org.apache.*EntityMentionEnhancementEngine
= COMPLAIN =
# COMPLAIN statements are similar to EXPECT but we expect them *not* to be
fulfilled by
# the enhancer output.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
