[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-09-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #47 from nosy marlen.caemme...@wikimedia.de ---
Latest plan is to implement a view called toolserverdb that points to the
original db.
It would regard:

s51892_toolserverdb_p.language
s51892_toolserverdb_p.namespace
s51892_toolserverdb_p.namespacename
s51892_toolserverdb_p.servermapping
s51892_toolserverdb_p.wiki

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-09-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Marc A. Pelletier m...@uberbox.org changed:

   What|Removed |Added

 Status|ASSIGNED|RESOLVED
 Resolution|--- |FIXED

--- Comment #48 from Marc A. Pelletier m...@uberbox.org ---
(The view is named toolserverdb_p to allow all users select right, at it lives
on tools.labsdb).

That has been created.  Please note that (a) the views will not automatically
track schema changes, but that shouldn't be an issue since those are legacy
tables, and (b) the data in those tables is explicitly maintained by the
community and may fall out of sync with reality unless rigorously maintained -
caveat Å«tilisor.

Issues with the data should be reported to the toolserverdb tool maintainers
(https://tools.wmflabs.org/?list#toollist-toolserverdb).

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-09-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #46 from nosy marlen.caemme...@wikimedia.de ---
I'd need a DB called toolserver. :D
It'd be fine if I can only get toolserver_p.
The rest of the DBs of the user can be left untouched.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-08-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #44 from Marc A. Pelletier m...@uberbox.org ---
Wait, if you want an additional DB named toolserver, where do you want me to
put s51073__toolserver?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-08-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #45 from Marc A. Pelletier m...@uberbox.org ---
(Also, if you want everyone to be able to select in a database, it normally
needs to be named ending in _p)

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-08-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #42 from nosy marlen.caemme...@wikimedia.de ---
Word :). Please rename the DB to toolserver.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-08-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #43 from nosy marlen.caemme...@wikimedia.de ---
If its not too complicated I would prefer to have a additional DB called
toolserver so I can migrate and leave the old DB in place until its done.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-08-13 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Marc A. Pelletier m...@uberbox.org changed:

   What|Removed |Added

 Status|REOPENED|ASSIGNED

--- Comment #41 from Marc A. Pelletier m...@uberbox.org ---
Renaming without prefix makes it easy to keep maintaining with the current
tool.  Just say the word, and I'll do the rename.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-08-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Jimmy Xu m...@jimmyxu.org changed:

   What|Removed |Added

 Status|RESOLVED|REOPENED
 CC||m...@jimmyxu.org
 Resolution|FIXED   |---

--- Comment #40 from Jimmy Xu m...@jimmyxu.org ---
Reopening, would this be merged into meta_p or renamed without a s**_ prefix?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-07-08 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Silke Meyer (WMDE) silke.me...@wikimedia.de changed:

   What|Removed |Added

 Status|REOPENED|RESOLVED
 Resolution|--- |FIXED

--- Comment #39 from Silke Meyer (WMDE) silke.me...@wikimedia.de ---
No complaints in almost a month. Closing the ticket.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-07-08 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Dispenser dispen...@toolserver.org changed:

   What|Removed |Added

 CC||dispen...@toolserver.org
 Blocks||66868

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-06-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #38 from Silke Meyer (WMDE) silke.me...@wikimedia.de ---
Dear all, please verify and close if okay. Thanks, nosy!

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #36 from Silke Meyer (WMDE) silke.me...@wikimedia.de ---
Nosy is on it. Long term maintenance of this tool is still an open question
though.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-06-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #37 from nosy marlen.caemme...@wikimedia.de ---
Its done  so far.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-05-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #35 from Silke Meyer (WMDE) silke.me...@wikimedia.de ---
Little status update... According to Nosy, this is not fully done, yet.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-28 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #33 from Silke Meyer (WMDE) silke.me...@wikimedia.de ---
Any comments on Marlen's work so far? Did anyone test it?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-28 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #34 from Alex Monk kren...@wikimedia.org ---
All I can do is get a list of tables in that DB. Everything else is denied.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-25 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #31 from nosy marlen.caemme...@wikimedia.de ---
Did the first steps - most of the scripts already run and the dbs get filled.
I still dont know how to test the data in regard of being valid.
I'd be glad if some of you who need it anyway probably try to use
s51892_toolserverdb on any of the db instances.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-25 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #32 from Marc A. Pelletier m...@uberbox.org ---
Give me a ring once you are satisfied with the result, I can rename the
database to something more mnemonic for you.

(Also, unless your database name ends with _p, you will need to give grants to
it)

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #30 from Silke Meyer (WMDE) silke.me...@wikimedia.de ---
Thanks a lot for the proposal, nosy! Indeed, I would like others to join you
because we (as in WMDE) cannot / will not maintain a tool that that many
other tools depend on in the long run.

Any volunteers? If there aren't any, it might not be such a good idea after
all...

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

nosy marlen.caemme...@wikimedia.de changed:

   What|Removed |Added

 CC||marlen.caemmerer@wikimedia.
   ||de

--- Comment #28 from nosy marlen.caemme...@wikimedia.de ---
I checked with several people.
I can move the Toolserver DB MMP off TS and migrate it into Labs.
When I am done something like toolserverdb_p should be available on all user DB
hosts.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #29 from nosy marlen.caemme...@wikimedia.de ---
If anyone wants to join the project I'd be glad since it is intended to be a
MMP anyway.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

PiRSquared17 pirsquare...@gmail.com changed:

   What|Removed |Added

 CC||pirsquare...@gmail.com

--- Comment #27 from PiRSquared17 pirsquare...@gmail.com ---
(In reply to Merlijn van Deen from comment #18)
 Note that it's impossible to construct a URL without the namespace names
 -- you cannot link to http://en.wikipedia.org/wiki/NS3:valhallasw, for
 example.

You can select page_id and do //en.wikipedia.org/?curid=$pageid

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-04-01 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Tim Landscheidt t...@tim-landscheidt.de changed:

   What|Removed |Added

 Status|RESOLVED|REOPENED
 Resolution|WONTFIX |---

--- Comment #26 from Tim Landscheidt t...@tim-landscheidt.de ---
(In reply to Tim Landscheidt from comment #23)
  It is pointless and expensive, and can be done in a line or two of PHP or
  perl;
  and probably no more in pretty much any other language.  Do you not realize
  that the query above causes an index lookup and row fetch in the database 
  for
  every single page?

 Those are two claims I'd like to see evidence for :-).  I don't like MySQL
 (or MariaDB) very much, but any query planner worth its salt will cache the
 namespacename table heavily.

  Indeed, given that query, you more than triple the resources required to run
  the query, as well as increase the size of the result set by sending
  redundant
  data at every row.
  [...]

 If we are counting bytes, we should close down Tools *now*.

 Most of the queries run on Toolserver/Tools are ineffective, and that fits
 nicely with MediaWiki being written in PHP.

 If it is your professional opinion that with the current setup we need more
 database servers or bigger network cables to implement toolserver.namespace
  Co., that's totally fine, but the solution then isn't WONTFIX, but take it
 up the chain to the one who signs an order for new equipment.

With no response, I ran some tests today on enwiki_p with toolserver.namespace
dumped from the Toolserver to s51073__toolserver.namespace.  I did see an
increase in looking up and returning an additional field (as expected), but
nothing major that would justify buying new equipment.  So reopening this issue
so that it can be solved in software.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2014-01-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

merl bugrepor...@to.mabomuja.de changed:

   What|Removed |Added

 CC||bugrepor...@to.mabomuja.de

--- Comment #25 from merl bugrepor...@to.mabomuja.de ---
I also need to have all namespace names of all wikis in one table on each
cluster.

One aditional use case in my script is replacing full page titles of
languagelinks, iwlinks and wikidata-sitelink table with namespace id and title
without namespace as is needed for further queries in this script on page
table.

Doing this at application layer would be very inefficient any slow, because i
am doing this with about 6,5 million pages (all living people) twice a day.
Currently this part of my tools is done on toolserver with joining
namespacename in less than 5 minutes.

Running api queries to get this namespace info for all 500 wikis (wikipedia +
commons + wikisource + wikiquote) would take longer. And running 6.5 mio.
single update queries on a use table instead of one join would also stress the
database server needless.

So the solution for me is to create this table for my own.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-30 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #24 from MZMcBride b...@mzmcbride.com ---
Two thoughts here:

1. This is clearly a breaking change for the transition from Toolserver to
Labs. Is this appropriately documented somewhere as such?

2. Is the source code that controls/maintains meta[_p] in a Labs project? I
think it should be just another Labs project®, if it isn't already.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-23 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Nemo federicol...@tiscali.it changed:

   What|Removed |Added

URL||http://article.gmane.org/gm
   ||ane.org.wikimedia.labs/1381

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-22 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #23 from Tim Landscheidt t...@tim-landscheidt.de ---
(In reply to comment #22)
 It is pointless and expensive, and can be done in a line or two of PHP or
 perl;
 and probably no more in pretty much any other language.  Do you not realize
 that the query above causes an index lookup and row fetch in the database for
 every single page?

Those are two claims I'd like to see evidence for :-).  I don't like MySQL (or
MariaDB) very much, but any query planner worth its salt will cache the
namespacename table heavily.

 Indeed, given that query, you more than triple the resources required to run
 the query, as well as increase the size of the result set by sending
 redundant
 data at every row.
 [...]

If we are counting bytes, we should close down Tools *now*.

Most of the queries run on Toolserver/Tools are ineffective, and that fits
nicely with MediaWiki being written in PHP.

If it is your professional opinion that with the current setup we need more
database servers or bigger network cables to implement toolserver.namespace 
Co., that's totally fine, but the solution then isn't WONTFIX, but take it up
the chain to the one who signs an order for new equipment.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Merlijn van Deen valhall...@arctus.nl changed:

   What|Removed |Added

 Blocks||57876

--- Comment #18 from Merlijn van Deen valhall...@arctus.nl ---
I suggest re-opening this, as there is are at least two use cases the table
provides:

 1) creating full page titles and URLs on the SQL level; for this at least the
canonical (Talk, User, User Talk, etc) namespaces have to be provided. The
Toolserver wiki shows the following example query:

SELECT
  ns_name,
  page_title
FROM enwiki_p.page
 JOIN toolserver.namespacename 
  ON ns_id = page_namespace AND dbname = 'enwiki_p'
WHERE page_namespace = 6
 AND ns_is_favorite = TRUE
LIMIT 1;

Note that it's impossible to construct a URL without the namespace names --
you cannot link to http://en.wikipedia.org/wiki/NS3:valhallasw, for example.

 2) providing localized page titles for multiple sites (see Comment 2).

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Merlijn van Deen valhall...@arctus.nl changed:

   What|Removed |Added

 Blocks|57876   |58791

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Maarten Dammers maar...@mdammers.nl changed:

   What|Removed |Added

 Status|RESOLVED|REOPENED
 CC||maar...@mdammers.nl
 Resolution|WONTFIX |---
 Ever confirmed|0   |1

--- Comment #19 from Maarten Dammers maar...@mdammers.nl ---
I agree with Merlijn - reopened.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Marc A. Pelletier m...@uberbox.org changed:

   What|Removed |Added

 Status|REOPENED|RESOLVED
 Resolution|--- |WONTFIX

--- Comment #20 from Marc A. Pelletier m...@uberbox.org ---
This belongs in the application, and not the database.  The cost of doubling
index lookups on queries is nontrivial for something that can be done at
near-zero cost at the applicative level.

Comment 18 example 1 is exactly the use case that is to be /avoided/; that join
is pointless and expensive when the application could simply look up the
namespace number in a hash when presenting the result.

Closing again; this will not be supported by tool labs.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Maarten Dammers maar...@mdammers.nl changed:

   What|Removed |Added

 Status|RESOLVED|REOPENED
 Resolution|WONTFIX |---

--- Comment #21 from Maarten Dammers maar...@mdammers.nl ---
Marc, we don't accept no. This is widely used at the Toolserver and so we need
an alternative. It's not near-zero core and is not pointless and expensive. 

Do you think volunteer time is free? What about all the that are currently
using this at the Toolserver and are now forced to move to labs?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Marc A. Pelletier m...@uberbox.org changed:

   What|Removed |Added

 Status|REOPENED|RESOLVED
 Resolution|--- |WONTFIX

--- Comment #22 from Marc A. Pelletier m...@uberbox.org ---
It is pointless and expensive, and can be done in a line or two of PHP or perl;
and probably no more in pretty much any other language.  Do you not realize
that the query above causes an index lookup and row fetch in the database for
every single page?

Indeed, given that query, you more than triple the resources required to run
the query, as well as increase the size of the result set by sending redundant
data at every row.

You /have/ an alternative:  use one line of code at the beginning of your
script to fetch the namespaces info, and look the name up when outputting it.

Does that mean small changes in scripts that used to rely on offloading their
work to the database?  Yes.  It's certainly a much smaller change than was
required when we added edit tokens, for instance.  APIs and interface evolve. 
Obsolete junk is pruned all the time.  This is one of those times.

Reopening this bug will not change those facts, nor will it magically alter how
databases work to make it sane to push what is a trivial hash lookup in the
application into an expensive join at the database.  So please don't; I'd
rather not have to start cracking down on disputes in bugzilla (which isn't the
right venue for this anyways).

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-12-19 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Marc A. Pelletier m...@uberbox.org changed:

   What|Removed |Added

 Status|UNCONFIRMED |RESOLVED
 Resolution|--- |WONTFIX

--- Comment #17 from Marc A. Pelletier m...@uberbox.org ---
Given that this would provide nothing that cannot be obtained faster and more
reliably by an API call, and that its use would add load to the database for no
gain except a minor programming shorthand; closing WONTFIX.

Tool maintainers are perfectly allowed to make such a database available for
general use (and maintain it accordingly).

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-10-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #15 from Marc A. Pelletier m...@uberbox.org ---
Beta16: I'm not sure how to get thousands of API calls; if you are generating
a database report for project X, getting the list of namespaces for that
project is exactly one API call.  OTOH, doing a join while querying some table
on that project's database doubles the number of index lookups, at best, and
potentially multiplies the number of fetched rows and increases the data set
size a lot.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-10-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Liangent liang...@gmail.com changed:

   What|Removed |Added

   See Also||https://bugzilla.wikimedia.
   ||org/show_bug.cgi?id=56301

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-10-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

MZMcBride b...@mzmcbride.com changed:

   What|Removed |Added

 Status|NEW |UNCONFIRMED
 Ever confirmed|1   |0

--- Comment #16 from MZMcBride b...@mzmcbride.com ---
I'm strongly inclined to agree with comment 12 and comment 15. I'm not sure
this is a valid bug. I say this as the original author of [[Wikipedia:Database
reports]], mentioned in comment 14. Scripts and tools should probably query the
MediaWiki Web API themselves.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-10-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #14 from Beta16 l.rabinelli+bugzi...@gmail.com ---
My two cents:
Generate database reports by queries, like [[:en:Wikipedia:Database reports]],
is quite impossible without namespace meta-table.
Get this information via API means making thousands of API calls instead of a
single join.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-10-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #12 from Marc A. Pelletier m...@uberbox.org ---
Querying the API is probably the only way to get fresh data; the actual
configuration is difficult to parse from the configuration and may also be
modified by extensions (which vary from project to project).

If we were to provide metadata tables with namespaces and other
project-specific information, it'd have to be queried from the API anyways; the
only benefit of having it in tables would be to allow joins (don't know how
useful that'd be) at the cost of the information lagging behind reality by 0.5
update period on average.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-10-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #13 from Pietrodn power...@gmail.com ---
I wrote a simple PHP function that queries the MediaWiki API for namespaces.
See the getNamespacesAPI function here:
https://github.com/pietrodn/intersect-contribs/blob/master/pietrodnUtils.php

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-09-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #11 from MZMcBride b...@mzmcbride.com ---
I just hit this issue trying to manually run a database report. The lack of a
namespace table is a bit painful. I imagine this issue is preventing a number
of database reports from being moved to Labs. Hrm. Perhaps everyone should just
query the MediaWiki API themselves. Hmm.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-13 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #10 from MZMcBride b...@mzmcbride.com ---
(In reply to comment #9)
 This should probably be discussed on-wiki so that we can gather actual
 requirements and figure out /how/ before we go ahead and implement something.

Agreed. That's pretty much what I had in mind in comment 8. Feel free to start
that discussion. :-)

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-12 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #9 from Marc A. Pelletier m...@uberbox.org ---
This should probably be discussed on-wiki so that we can gather actual
requirements and figure out /how/ before we go ahead and implement something.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #4 from Tim Landscheidt t...@tim-landscheidt.de ---
(In reply to comment #3)
 I have put most this data in p50380g50577__wmf_wiki_info on tools-db. It was
 generated using the API so some information is missing/wrong for private
 wikis
 which do not allow meta=siteinfo API access.

Thanks!  Could you post the script here as an attachment, please?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Liangent liang...@gmail.com changed:

   What|Removed |Added

 CC||liang...@gmail.com
   See Also||https://bugzilla.wikimedia.
   ||org/show_bug.cgi?id=48626

--- Comment #5 from Liangent liang...@gmail.com ---
(In reply to comment #3)
 I have put most this data in p50380g50577__wmf_wiki_info on tools-db. It was
 generated using the API so some information is missing/wrong for private
 wikis
 which do not allow meta=siteinfo API access.

Maybe you can make it a tool

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #6 from Liangent liang...@gmail.com ---
(In reply to comment #0)
 but an even more interesting approach would of course be to clone
 operations/mediawiki-config and extract the information from there.

I'm doing things in this way currently (in my script it's not only for
namespace names, but also the whole environment so a single table itself
wouldn't help me) but there should be some caveat here: to resolve all
namespace names you need to have all extensions deployed ready, at least those
who create new namespaces, and follow any WMF's deployment of new extensions.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #7 from Alex Monk (Krenair) kren...@gmail.com ---
(In reply to comment #4)
 (In reply to comment #3)
  I have put most this data in p50380g50577__wmf_wiki_info on tools-db. It was
  generated using the API so some information is missing/wrong for private
  wikis
  which do not allow meta=siteinfo API access.
 
 Thanks!  Could you post the script here as an attachment, please?

You can find it in /data/project/wmf-wiki-info/PyMediaWikiClient/script.py
The script wont work alone because you also need some dependencies in certain
locations (MediaWikiClient - a small python class which makes it easy to deal
with MW's API, and WMF's operations/mediawiki-config.git for the s[1-7].dblist
files).
Any feedback/review/etc. is welcome

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #8 from MZMcBride b...@mzmcbride.com ---
I think we should have a discussion about what the current toolserver
database is, what we want in the future, and whether we care about breaking
backward compatibility.

Some of the design decisions in some of the database tables could probably be
re-thought, but only if we're willing to break the current interfaces.

In addition, I think we should only rely on MediaWiki's API for this
information (with user authentication, as necessary). This is the cleanest and
sanest way to accurately get this information, as far as I know.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-06-01 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #3 from Alex Monk (Krenair) kren...@gmail.com ---
I have put most this data in p50380g50577__wmf_wiki_info on tools-db. It was
generated using the API so some information is missing/wrong for private wikis
which do not allow meta=siteinfo API access.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-05-31 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Legoktm legoktm.wikipe...@gmail.com changed:

   What|Removed |Added

 CC||legoktm.wikipe...@gmail.com

--- Comment #2 from Legoktm legoktm.wikipe...@gmail.com ---
(In reply to comment #1)
 On second thought: It would be much more elegant and logical to have a table
 namespace on *each* database (not one per server) that provides only the IDs
 (ns_id) and names (ns_name) of that particular database.

There are use cases to have it all together
(https://www.wikidata.org/wiki/User_talk:Legoktm/namespaces is an example) in
one database, however having it also available on the database would also be
useful.

I think for backwards-compatability reasons we should have one central database
structured like the toolserver one, and then we can have tables on each
individual database.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-05-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

Peter Bena benap...@gmail.com changed:

   What|Removed |Added

 CC||benap...@gmail.com
 Blocks||48930

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace

2013-05-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=48625

--- Comment #1 from Tim Landscheidt t...@tim-landscheidt.de ---
On second thought: It would be much more elegant and logical to have a table
namespace on *each* database (not one per server) that provides only the IDs
(ns_id) and names (ns_name) of that particular database.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l