[Bug 25984] Isolate parser from database dependencies

2012-06-13 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #21 from _Vi 2012-06-13 11:09:58 UTC --- > How would you do that? For example, in this way: $ pv pages_talk_templates_dump.xml.xz | wikishelve_create.py shelve 800M 0:NN:NN [100KB/s] [] 100% $ fusecompress -o fc_c:bzip2,

[Bug 25984] Isolate parser from database dependencies

2012-06-12 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 Ángel González changed: What|Removed |Added CC||keis...@gmail.com --- Comment #20 fro

[Bug 25984] Isolate parser from database dependencies

2012-06-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #19 from Sumana Harihareswara 2012-06-11 14:22:51 UTC --- Thanks, _Vi. You should have a temporary password in your email now. Initial login & password change steps: https://labsconsole.wikimedia.org/wiki/Help:Access#Initial_log

[Bug 25984] Isolate parser from database dependencies

2012-06-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #18 from _Vi 2012-06-11 14:04:12 UTC --- > If you get and use dev access, you make it > *easier* for us to review, comment on, Done, https://www.mediawiki.org/wiki/Developer_access#User:Vi2 (Not sure what to do with it yet) -- C

[Bug 25984] Isolate parser from database dependencies

2012-06-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #17 from Sumana Harihareswara 2012-06-11 11:54:44 UTC --- Yes, we do share dev access with anyone, and recommend it for anyone who has ever given us a patch. It's access to suggest patches directly into our git repository, but you

[Bug 25984] Isolate parser from database dependencies

2012-06-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #16 from _Vi 2012-06-11 08:10:59 UTC --- > _Vi is also processing to a different format. :) >I did some tests with your code using eswiki-20081126 dump. The main thing that with HTTP you can experiment with your own storage formats

[Bug 25984] Isolate parser from database dependencies

2012-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 Sumana Harihareswara changed: What|Removed |Added Keywords||patch, patch-need-review

[Bug 25984] Isolate parser from database dependencies

2012-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #14 from _Vi 2012-06-10 18:47:34 UTC --- Created attachment 10721 --> https://bugzilla.wikimedia.org/attachment.cgi?id=10721 Patch to make MediaWiki obtain page sources from alternative locations -- Configure bugmail: https://bu

[Bug 25984] Isolate parser from database dependencies

2012-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #13 from _Vi 2012-06-10 18:46:33 UTC --- Improved the patch: 0001-Make-MediaWiki-1.20-gb7ed02-be-able-to-fetch-from-al.patch . 1. Now applies to master branch (b7ed0276e560389913c629d97a46aaa47f48798b) 2. Separate class "Alternativ

[Bug 25984] Isolate parser from database dependencies

2012-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #12 from Ángel González 2012-06-10 18:13:02 UTC --- Created attachment 10720 --> https://bugzilla.wikimedia.org/attachment.cgi?id=10720 Patch for 0001-Make-MediaWiki-1.19-fetch-content-from-HTTP.patch _Vi is also processing to a

[Bug 25984] Isolate parser from database dependencies

2012-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #11 from Andrew Dunbar 2012-06-10 07:06:23 UTC --- I would dearly love to see a version of this patch go upstream so that others who want to use the real live parser without a DB can see where to start. Obviously having a proper a

[Bug 25984] Isolate parser from database dependencies

2012-06-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #10 from _Vi 2012-06-10 04:20:05 UTC --- Actually it was not intended to merging into upstream, I implemented this primarily just for me to be able to grab online wikis, save them in compressed form and use local MediaWiki to view t

[Bug 25984] Isolate parser from database dependencies

2012-06-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #9 from Platonides 2012-06-09 12:19:02 UTC --- Yes, it is hacky :) Some ideas: - Indent with tabs, not spaces. - If you add a new global, it has to be defined in DefaultSettings - Names like hackTriggered are fine for your code, b

[Bug 25984] Isolate parser from database dependencies

2012-06-08 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 _Vi changed: What|Removed |Added CC||vi0...@gmail.com --- Comment #8 from _Vi 2012-0

[Bug 25984] Isolate parser from database dependencies

2011-11-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 Aaron Schulz changed: What|Removed |Added Priority|Highest |Normal CC|

[Bug 25984] Isolate parser from database dependencies

2011-02-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #7 from Mark A. Hershberger 2011-02-19 02:35:36 UTC --- (In reply to comment #6) > Which problems would that solve? It would make it easier for third parties to use, yes, but that isn't the point. It would be easier to maintain a

[Bug 25984] Isolate parser from database dependencies

2011-02-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #6 from Bawolff 2011-02-11 22:07:53 UTC --- Which problems would that solve? It would make other folks who want to parse wikitext without mediawiki lives easier (which would be very nice, but not exactly a super high priority in my

[Bug 25984] Isolate parser from database dependencies

2011-02-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 Mark A. Hershberger changed: What|Removed |Added Priority|Normal |Highest CC|

[Bug 25984] Isolate parser from database dependencies

2010-11-19 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #4 from Bawolff 2010-11-20 02:07:53 UTC --- >For getting templates and red/blue link info I suggest adding a layer of >abstraction that the parser can call rather than calling directly to the >database. You could make your own cust

[Bug 25984] Isolate parser from database dependencies

2010-11-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #3 from Andrew Dunbar 2010-11-19 02:37:24 UTC --- For getting templates and red/blue link info I suggest adding a layer of abstraction that the parser can call rather than calling directly to the database. Parser users would then

[Bug 25984] Isolate parser from database dependencies

2010-11-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 --- Comment #2 from Max Semenik 2010-11-18 18:51:19 UTC --- (In reply to comment #1) > I don't think that'd be possible, since you need db access the moment you have > wikitext with {{some template}} in it (to retrieve template). Same with > [

[Bug 25984] Isolate parser from database dependencies

2010-11-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=25984 Bawolff changed: What|Removed |Added CC||bawolff...@gmail.com --- Comment #1 from Baw