Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-08 Thread Daniel Kinzler
First off, TL;DR: (@Tim: did my best to summarize, please correct any misrepresentation.) * Tim: don't re-parse when sitelinks change. * Daniel: can be done, but do we really need to optimize for this case? Denny, can we get better figures on this? * Daniel: how far do we want to limit the

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-07 Thread Daniel Kinzler
On 07.11.2012 00:41, Tim Starling wrote: On 06/11/12 23:16, Daniel Kinzler wrote: On 05.11.2012 05:43, Tim Starling wrote: On 02/11/12 22:35, Denny Vrandečić wrote: * For re-rendering the page, the wiki needs access to the data. We are not sure about how do to this best: have it per cluster,

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-07 Thread Tim Starling
On 07/11/12 22:56, Daniel Kinzler wrote: As far as I can see, we then can get the updated language links before the page has been re-parsed, but we still need to re-parse eventually. Why does it need to be re-parsed eventually? And, when someone actually looks at the page, the page does

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-06 Thread Daniel Kinzler
On 05.11.2012 05:43, Tim Starling wrote: On 02/11/12 22:35, Denny Vrandečić wrote: * For re-rendering the page, the wiki needs access to the data. We are not sure about how do to this best: have it per cluster, or in one place only? Why do you need to re-render a page if only the language

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-06 Thread Denny Vrandečić
Hi Tim, thank you for the input. Wikidata unfortunately will not contain all language links: a wiki can locally overwrite the list (by extending the list, suppressing a link from Wikidata, or replacing a link). This is a requirement as not all language links are necessarily symmetric (although I

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-06 Thread Daniel Kinzler
On 06.11.2012 17:01, Denny Vrandečić wrote: So, we could go without re-rendering at all, if there is consensus that this is the preferred solution and that this is better than the solution we suggested. Anyone having any comments, questions, or insights? I already suggested that changes to

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-06 Thread Tim Starling
On 06/11/12 23:16, Daniel Kinzler wrote: On 05.11.2012 05:43, Tim Starling wrote: On 02/11/12 22:35, Denny Vrandečić wrote: * For re-rendering the page, the wiki needs access to the data. We are not sure about how do to this best: have it per cluster, or in one place only? Why do you need

Re: [Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-04 Thread Tim Starling
On 02/11/12 22:35, Denny Vrandečić wrote: * For re-rendering the page, the wiki needs access to the data. We are not sure about how do to this best: have it per cluster, or in one place only? Why do you need to re-render a page if only the language links are changed? Language links are only in

[Wikitech-l] Data flow from Wikidata to the Wikipedias

2012-11-02 Thread Denny Vrandečić
Hi all, Wikidata aims to centralize structured datas from the Wikipedias in one central wiki, starting with the language links. The main technical challenge that we will face is to implement the data flow on the WMF infrastructure efficiently. We invite peer-review on our design. I am trying to