Hi Marco,

sorry for the exhausting explanation. :-) After I had sent the mail I
thought I should have written half as much...

As for the rendering -

Wow, sweble looks pretty good. I'm envious. :-) Trying to parse a
large article like enwiki/United_States gives quite a few warning
messages though. [1]

I would guess that adding template expansion to DBpedia is a *major*
task. May take several months. It would also be a *huge* benefit. :-)

> http://www.mail-archive.com/[email protected]/msg02767.html

Yes, the AbstractExtractor uses HTTP to call PHP. In 2009 or so, we
tried pretty hard to get MediaWiki to run outside of a web server, but
in the end we gave up. There are too many places in the code that are
tied to server APIs. We also ran a few small benchmarks that strongly
indicated that HTTP is not the problem. IIRC, the HTTP overhead only
took about 10% of the whole rendering time.

But managing to render wikitext in Java/Scala instead of PHP would
probably be a large performance boost.

Cheers,
JC

[1] 
http://sweble.org/crystalball/result?query=United_States&format=html&stage=postpro&expMode=with_expansion

On Thu, May 10, 2012 at 11:56 AM, Pablo Mendes <[email protected]> wrote:
> Hi Marco,
> This smells like another thread:
> http://www.mail-archive.com/[email protected]/msg02767.html
>
>> Would it be possible to emulate Wikipedia renderer engine behavior? It
>> is written in PHP, so it should be a piece of cake to implement it in
>> powerful Scala.
>
>
> So... are you volunteering to try it out?
>
> Cheers,
> Pablo
>
>
> On Thu, May 10, 2012 at 11:31 AM, Marco Fossati <[email protected]>
> wrote:
>>
>> Hi Jona,
>>
>> Thanks for the exhaustive explanation.
>>
>> On 5/8/12 7:14 PM, Jona Christopher Sahnwaldt wrote:
>> > Even worse - there is a link to [[Heavy metal]], but in the infobox
>> > it's spelled "Heavy Metal" (with a capital M), so we don't find that
>> > link. This behavior could be considered a bug. Wikipedia somehow fixes
>> > the uppercase.
>> Would it be possible to emulate Wikipedia renderer engine behavior? It
>> is written in PHP, so it should be a piece of cake to implement it in
>> powerful Scala.
>> Please let us know, as it is quite a critical issue for us.
>> Cheers,
>>
>> Marco
>>
>

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Dbpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion

Reply via email to