[Wikitech-l] Can someone take care of branch iwtransclusion?
Hello everybody! I have worked all the summer on interwiki transclusion in branch iwtransclusion. It is nearly finished now: only small improvements have to be made before this is merged to trunk. However, my university work makes me very busy at this time and I think I will have no time to finish the project in the next months. I'm wondering if someone could take care of this, why not during the upcoming hack-a-ton? All my work is described here: [1] The last improvements needed are: * finishing to build-in the GlobalUsage extension * create and use 2 tables globalnamespaces and globalinterwiki (documented in the given link) Of course, if someone is volunteer, I can give them a hand sometimes. Thanks in advance [1] http://www.mediawiki.org/wiki/User:Peter17/Reasonably_efficient_interwiki_transclusion -- Peter Potrowl http://www.mediawiki.org/wiki/User:Peter17 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Separate DB or shared table for GlobalTemplateLinks?
Hi everyone! My Google Summer of Code is finished, but the code I have written for the interwiki transclusion is not yet ready to be merged in trunk. Some optimizations have to be made and some little issues are still to be discussed. The main remaining question is: should I use a separate DB or a shared table to store the GlobalTemplateLinks table? [1] Following the advice of my mentor, Catrope, my code is currently using a separate DB (which name is stored in $wgGlobalDatabase) since it is the mechanism used by CentralAuth and it is very simple for users to set it up. Platonides thinks that I should be using a shared table, since my code is not an extension. However, a disadvantage of shared table is that currently, adding a shared table in $wgSharedTables will force the user to share the users table, which is not always wanted. I have further developments to accomplish on my code concerning database tables (such as creating a GlobalNamespaces table to store the distant namespaces names). I would like to solve this issue first, so that I don't have to rewrite everything later... Can you please provide your opinion about this? Thanks in advance Best regards [1] http://www.mediawiki.org/wiki/User:Peter17/Reasonably_efficient_interwiki_transclusion -- Peter Potrowl http://www.mediawiki.org/wiki/User:Peter17 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] How to find the category information?
2010/6/13 杨杰 xtyang...@gmail.com: Hi, everyone, Hello Yang Jie, I want to do some experiments on classification using web pages of wikipedia. Now that I have got the web page archive, the experiment needs the following category information: 1. what is the category (or categories) of a web page (an article)? eg. once I can get the two tips, the information is enough. a. Web page P1 belongs to category C1; b. Category C1 is under two parent categories CC1 and CC2, while the two categories own their parent category chains seperately. Then I can build a tree, which leaves are the web pages. 2. how do guys in wikipedia deal with the category work upon the huge amount of articles, for example, category method, level or inheritance between categories. Could you give me some adivces or URLs to find them ? The best URL to know how Wikipedia users use the categories is [1] I'm not sure I understand your questions well so, don't hesitate to ask more precise questions once you have read [1] [1] http://en.wikipedia.org/wiki/Wikipedia:Categories Xi’an Jiaotong University Hey! I've been there! once i didn't know software is not free, but found it days later; now i realize that it's indeed free. Yes, it's free! Yours sincerely -- Peter Potrowl http://www.mediawiki.org/wiki/User:Peter17 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Adding fields to the interwiki table
Hello to all! I have posted here [1] a proposal about adding two fields in the interwiki table (API URL and DB name). One of the goals is to simplify interwiki transclusion, but those field might be useful for other interwiki applications. Could you please read it and let me know about your remarks and suggestions, on this list and/or on the talk page? Thanks in advance [1] http://www.mediawiki.org/wiki/User:Peter17/Reasonably_efficient_interwiki_transclusion#Adding_fields_to_the_interwiki_table -- Peter Potrowl http://www.mediawiki.org/wiki/User:Peter17 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Reasonably efficient interwiki transclusion
I have updated my proposal with a fourth version [1] I am still waiting for comments from Tim Starling. I have contacted him on IRC for this. [1] http://www.mediawiki.org/wiki/User:Peter17/Reasonably_efficient_interwiki_transclusion#Fourth_version_.(to_be_discussed) -- Peter Potrowl http://www.mediawiki.org/wiki/User:Peter17 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Reasonably efficient interwiki transclusion
2010/5/25 Platonides platoni...@gmail.com:
Seems it doesn't work so well. It was inadvertedly broken for wikitext
transclusions when the interwiki points to the nice url. See
'wgEnableScaryTranscluding and Templates/Images?' thread at mediawiki-l
Well, in my tests, images are well included because I enabled
$wgUseInstantCommons. As I wrote, the parameters are totally
ignored: they are indeed not substituted.
2010/5/25 Chad innocentkil...@gmail.com:
On Mon, May 24, 2010 at 7:42 PM, church.of.emacs.ml
church.of.emacs...@googlemail.com wrote:
1. You propose a shared database. If I interpret this correctly, it only
works inside a wiki set on the same server farm and doesn't include
external wikis. For example, English Wikipedia could transclude
templates from Meta Wiki, but not from Wikia. In contrast,
$wgForeignFileRepos works for external Wikis (which is much better).
If it's done right, you should be able to put various backends
on it just like the FileRepo code. Bug 20646 is a good start
to something like this I think. Being able to store API urls or
database connection info inside a iw_meta field would be
awesome for this (and has lots of other applications as well).
-Chad
Yes. The shared database would be only for invalidating the cache when
a template is edited. In my 3rd (preferred) solution, the templates
are still fetched through the API. External wikis can transclude them
and cache them for an arbitrary time, as ForeignAPIRepo does.
2010/5/25 church.of.emacs.ml church.of.emacs...@googlemail.com:
2. Parsing the wikitext at the home wiki makes it more difficult to use
site magic words, e.g. {{CONTENTLANGUAGE}}. You'd have to pass one each
and everyone as a template parameter (e.g.
{{homewiki::templatename|lang={{CONTENTLANGUAGE)
Ok, I will keep this in mind. Parsing the template on the home wiki
seems necessary because it can use other templates hosted on that wiki
to render correctly... I think it is the most logical way to do, isn't
it?
2010/5/25 Aryeh Gregor simetrical+wikil...@gmail.com:
On Mon, May 24, 2010 at 8:27 PM, Q overlo...@gmail.com wrote:
I would have to suggest to not go the shared database route unless the
code can be fixed so that shared databases actually work with all of the
DB backends.
I don't see why it shouldn't be easy to get it working with all DB
backends. But in any case, for Wikimedia use, a shared database
backend is pretty much a must. Having the application servers make
HTTP requests to each other to retrieve templates rather than
accessing the database directly is just silly, and is going to perform
badly. Ideally the code should generalize to work with external wikis
too, so that third parties can benefit from our templates as they do
from our images. Maybe someday, a copy-pasted Wikipedia article will
actually work . . . I can dream.
Mmmh sorry, I'm not really sure I understand... My suggestion is
to use a shared database that would store the remote calls, not the
content of the pages... In my mind, fetching the distant pages would
be done through the API, not by accessing directly the distant
database. The external wikis will soon be able to access our images
very easily with wgUseInstantCommons but it is still not an access to
the database...
Thanks for your remarks.
About the question from Alex about transcluding sections: is it
possible to request only a section through the API? I searched about
this but didn't find :(
--
Peter Potrowl
http://www.mediawiki.org/wiki/User:Peter17
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Reasonably efficient interwiki transclusion
2010/5/26 Jim Tittsler j...@onnz.net:
On 2010-05-25 23:41, Peter17 wrote:
2010/5/25 Platonides platoni...@gmail.com:
Seems it doesn't work so well. It was inadvertedly broken for wikitext
transclusions when the interwiki points to the nice url. See
'wgEnableScaryTranscluding and Templates/Images?' thread at mediawiki-l
Well, in my tests, images are well included because I enabled
$wgUseInstantCommons. As I wrote, the parameters are totally
ignored: they are indeed not substituted.
I found it a little surprising that $wgUploadPath needed to be an
absolute path for this to work. I had imagined that as part of the
transclusion the img URLs would have been transformed into the
necessary remote wiki URL.
I didn't set $wgUploadPath. Just $wgUseInstantCommons = true; The
images URLs are actually transformed to remote URLs:
I work on my own local wiki, which address is
http://localhost/mediawiki/ and transcluding
{{mediawikiwiki::User:Peter17}} which contains
[[File:Exquisite-network.png]] produces: a
href=http://www.mediawiki.org/wiki/File:Exquisite-network.png;
class=imageimg alt=Exquisite-network.png
src=http://upload.wikimedia.org/wikipedia/commons/e/e1/Exquisite-network.png;
width=128 height=128 //a, so, it actually points to MediaWiki
image description page and Commons image.
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Reasonably efficient interwiki transclusion
Hello to all! I'm a French student and I am participating the Google Summer of Code this year on Mediawiki! My mentor is Roan Kattouw (Catrope) and my subject is Reasonably efficient interwiki transclusion. You can see my application page here: [1]. I have already discussed with my mentor and we have prepared together a draft about my project: [2]. It sums up the current situation and includes some proposals. It is now open for comments, so, could you please read it and let me know about your remarks and suggestions, on this list and/or on the talk page? Thanks in advance [1] http://www.mediawiki.org/wiki/User:Peter17/GSoc_2010 [2] http://www.mediawiki.org/wiki/User:Peter17/Reasonably_efficient_interwiki_transclusion -- Peter Potrowl http://www.mediawiki.org/wiki/User:Peter17 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
