Moving this to the dev list
On Mon, May 12, 2014 at 4:45 PM, Timothy Lebo <[email protected]> wrote:
>
>> At the moment Live is ~1 day back (11/5) but processes ~ 1-1.5K
>> pages/minute so you should see the number increasing gradually after a
>> while.
>>
>>
>> Thanks. Is there anything that conveys the state of the queue?
>> That’d be fun to watch :-)
>> Or, is there a place where I can contribute some development?
>>
>
> Only the statistics page at the moment (
> http://live.dbpedia.org/statistics/)
> But, we have an open issue on this and no one assigned yet :)
> https://github.com/dbpedia/extraction-framework/issues/16
>
>
> I’d be happy to discuss this, first with an eye towards just *showing*
> what’s in the queue.
>
Of course, any contribution is more than welcome :)
The actual queue code lies in here [1]. We also had a statistics package
[2] but didn't work very well and decided to move the stats display
directly in SPARQL.
If you want to work on this there are many ways to code it, the simplest
would be a static cached snapshot that will be updated every e.g. 1 minute
or on access
or a funnier approach for real time preview with something like a
subscriber on the queue additions / deletions.
exampel code to start a server is in the server module [3] [4] which
handles the mappings statistics & more
live at http://mappings.dbpedia.org/server/
Take a look at the links and if you're still interested :) we can work on
this together
Cheers,
Dimitris
[1]
https://github.com/dbpedia/extraction-framework/tree/master/live/src/main/java/org/dbpedia/extraction/live/queue
[2]
https://github.com/dbpedia/extraction-framework/tree/master/live/src/main/java/org/dbpedia/extraction/live/statistics
[3] https://github.com/dbpedia/extraction-framework/tree/master/server
[4]
https://github.com/dbpedia/extraction-framework/blob/master/server/src/main/scala/org/dbpedia/extraction/server/Server.scala#L83
Should we do this off-list (or, take it to the dev list)?
>
>
>
>>
>> Also consider adding more property mappings in the spaceflight infobox
>> http://mappings.dbpedia.org/index.php/Mapping_en:Infobox_spaceflight
>> http://en.wikipedia.org/wiki/Template:Infobox_spaceflight
>>
>>
>> I was going to, but the “properties not yet mapped” link led to a stack
>> dump:
>>
>> http://mappings.dbpedia.org/server/templatestatistics/en/?template=Infobox_spaceflight
>>
>
> You can also do this manually like you did with the osparId but you can
> also wait
> I hope in a couple of weeks we'll have new stats re-deployed
>
>
> Thanks. I’m just trying to stitch a minimal example end-to-end at the
> moment.
> I’ll hold off.
>
> Regards,
> Tim
>
>
--
Kontokostas Dimitris
------------------------------------------------------------------------------
"Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos.
Get unparalleled scalability from the best Selenium testing platform available
Simple to use. Nothing to install. Get started now for free."
http://p.sf.net/sfu/SauceLabs
_______________________________________________
Dbpedia-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-developers
