Re: [Wikitech-l] Data Processing

2009-10-12 Thread Christensen, Courtney
2009/10/11 Roan: On Wikipedia, we use one set of DB servers for the wiki database, and a second set for text; this second set is called the external storage. You don't need to worry about this too much, as small wikis typically don't use external storage, but use the text table instead. The

Re: [Wikitech-l] Data Processing

2009-10-12 Thread Roan Kattouw
2009/10/12 Christensen, Courtney christens...@battelle.org: Is there a size range at which it is accepted to be advantageous to move your text out of the standard text table? It's not so much about size as it is about load. Wikipedia uses ES because it's a heavy-load wiki. More specific

Re: [Wikitech-l] Data Processing

2009-10-12 Thread Domas Mituzas
Hi! Is there a size range at which it is accepted to be advantageous to move your text out of the standard text table? once it doesn't fit into single server anymore? :) Domas ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org

Re: [Wikitech-l] Data Processing

2009-10-11 Thread Roan Kattouw
2009/10/11 李琴 q...@ica.stc.sh.cn: Sorry,I can't  get this sentence's exact meaning. 'External storage stores page text on a separate DB server to the main wiki database.'   What 's separate DB server ?   Or I just want to know where can I get the page content? On Wikipedia, we use one set of

Re: [Wikitech-l] Data Processing

2009-09-28 Thread 李琴
Why one page_title can have different page_id? For example, the page_title 'USA' has two page_id '98937','112696'. Thanks vanessa lee ___ Wikitech-l mailing list

Re: [Wikitech-l] Data Processing

2009-09-28 Thread Max Semenik
On 28.09.2009, 16:54 ?? wrote: Why one page_title can have different page_id? For example, the page_title 'USA' has two page_id '98937','112696'. Because they have different page_namespace ;) ___ Wikitech-l mailing list

Re: [Wikitech-l] Data Processing

2009-09-25 Thread Petr Kadlec
2009/9/25 vanessa lee q...@ica.stc.sh.cn: What form are articles  stored in database? Raw wiki text, plus many tables containing metadata. See http://www.mediawiki.org/wiki/Manual:Database_layout -- [[cs:User:Mormegil | Petr Kadlec]] ___ Wikitech-l

Re: [Wikitech-l] Data Processing

2009-09-25 Thread 李琴
OK, I see. And the other questions? If I edit a page,Whether the page_id change or not? -Original Message- From: Petr Kadlec petr.kad...@gmail.com To: Wikimedia developers wikitech-l@lists.wikimedia.org Date: Fri, 25 Sep 2009 11:30:34 +0200 Subject: Re: [Wikitech-l] Data Processing

Re: [Wikitech-l] Data Processing

2009-09-25 Thread Bryan Tong Minh
On Fri, Sep 25, 2009 at 12:28 PM, 李琴 q...@ica.stc.sh.cn wrote: OK,  I see. And the other questions? If I edit a page,Whether the page_id change or not? page_latest will point to the relevant rev_id. The text will most likely be saved in the text table. Article::doEdit and Revision are the most

Re: [Wikitech-l] Data Processing

2009-09-25 Thread Petr Kadlec
2009/9/25 李琴 q...@ica.stc.sh.cn:       If i just edit a page's section.Then ,What will be saved in the text table,  the entire page's text or  just the edited section's text   ? The entire page text, which is the result of merging the previous page text with the changes you’ve made to the

Re: [Wikitech-l] Data Processing

2009-09-25 Thread 李琴
...@gmail.com To: Wikimedia developers wikitech-l@lists.wikimedia.org Date: Fri, 25 Sep 2009 14:06:41 +0200 Subject: Re: [Wikitech-l] Data Processing 2009/9/25 李琴 q...@ica.stc.sh.cn: If i just edit a page's section.Then ,What will be saved in the text table, the entire page's text or just

Re: [Wikitech-l] Data Processing

2009-09-25 Thread Petr Kadlec
2009/9/25 李琴 q...@ica.stc.sh.cn: The entire page text has been stroed in text table. But the recent change page just shows the edited text. Then,how do these text stroed? It is not stored. It is evaluated during every diff view by comparing (diffing) the two revisions (see

[Wikitech-l] Data Processing

2009-09-24 Thread vanessa lee
Hi Now I have constructed a local wiki.And I want to add the data which download from the internet Wikipedia to the local wiki.I tried to read the source code,but I coudln’t find the exact thing(Interface) that I want. So,I want to ask some questions: when click the save button after edit an