Hey alex, I have a repo that queries spotlight running on localhost using
some standard datasets for English https://github.com/tgalery/entivaluator
. It generates a file that one can then use another tool, i.e
https://github.com/diegoceccarelli/dexter-eval for calculating usual stats.
If you have some Dutch data that could be added it would be great! Plus, it
wouldn't be hard to have script that clone and run them.
On Thu, Jan 21, 2016 at 11:43 AM, Alex Olieman <[email protected]> wrote:
> Hi Joachim,
>
> This is wonderful news!
>
> I can probably contribute some Dutch and English evaluation data, and
> would like to do so. I'll try to get this done next month.
>
> Best,
> Alex
>
> On Thu, Jan 21, 2016 at 12:19 PM, Joachim Daiber <[email protected]
> > wrote:
>
>> Dear Spotlight users and developers,
>>
>> we are happy to announce that there will be automatic Spotlight model and
>> data builds, which will be available from [2] once a month.
>>
>> This is possible thanks to the wikistatsextractor tool by diffbot.com,
>> which brings the total training time on a single machine (with SSD and 32GB
>> RAM) down to about 3h for our biggest model (English).
>>
>> Call for Evaluation
>>
>> So far, we have not thoroughly tested the new models. Therefore, we
>> invite you to test and let us know of any problems. Further, we would like
>> to have comparable automatic evaluation for the monthly releases. If you
>> have evaluation scripts/data that you would like to be run as part of the
>> build, please send a pull request at [3]. The script eval.sh [4] is run
>> after all models are built and should write a file eval.txt into each model
>> folder.
>>
>> If your language is missing from the build, please add it here [5].
>>
>> Thanks to Thiago Galery and Diffbot for their help in setting this up.
>>
>> Best,
>> Joachim
>>
>> [1] https://github.com/diffbot/wikistatsextractor
>> [2] http://spotlight.sztaki.hu/downloads/
>> [3] https://github.com/dbpedia-spotlight/model-quickstarter
>> [4]
>> https://github.com/dbpedia-spotlight/model-quickstarter/blob/master/eval.sh
>> [5]
>> https://github.com/dbpedia-spotlight/model-quickstarter/blob/master/run.sh
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Site24x7 APM Insight: Get Deep Visibility into Application Performance
>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
>> Monitor end-to-end web transactions and take corrective actions now
>> Troubleshoot faster and improve end-user experience. Signup Now!
>> http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
>> _______________________________________________
>> Dbp-spotlight-users mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/dbp-spotlight-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> Site24x7 APM Insight: Get Deep Visibility into Application Performance
> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
> Monitor end-to-end web transactions and take corrective actions now
> Troubleshoot faster and improve end-user experience. Signup Now!
> http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
> _______________________________________________
> Dbp-spotlight-users mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/dbp-spotlight-users
>
>
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
Dbp-spotlight-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbp-spotlight-users
