I recall some point in time (Toolserver maybe?) when all the slices
(overview at https://tools-info.toolforge.org/?listmetap ) were at
different servers, but the Commons slice (s4) was on every server.
At some point new fancy database servers were introduced with all the
slices on all servers. Having 6 servers with each one having a slice +
s4 (Commons) + s8 (Wikidata) might be a good compromise.
On 12-11-2020 00:58, John wrote:
I’ll throw my hat in this too. Moving it to the application layer will
make a number of queries just not feasible any longer. It might make
sense from the administration side, but from the user perspective it
beaks one of the biggest features that toolforge has.
On Wed, Nov 11, 2020 at 6:40 PM Martin Urbanec
<[email protected] <mailto:[email protected]>> wrote:
MusikAnimal is right, however, Wikidata and Commons either have a
sui generis slice, or they share it with a few very large wikis.
Tools that do any kind of crosswiki analysis would instantly
break, as most of them utilise joining by Wikidata items at the
very least.
I second Maarten here. This would mean a lot of things that
currently require a (relatively simple) SQL query would need a
full script, which would do the join at the application level.
I fully understand the reasoning, but there needs to be some
replacement. Intentionally introduce breaking changes while
providing no "new standard" is a bad pattern in a community
environment.
Martin
On Wed, Nov 11, 2020, 10:31 PM MusikAnimal <[email protected]
<mailto:[email protected]>> wrote:
Technically, cross-wiki joins aren't completely disallowed,
you just have to make sure each of the db names are on the
same slice/section, right?
~ MA
On Wed, Nov 11, 2020 at 4:11 PM Maarten Dammers
<[email protected] <mailto:[email protected]>> wrote:
Hi Joaquin,
On 10-11-2020 21:26, Joaquin Oltra Hernandez wrote:
TLDR: Wiki Replicas' architecture is being redesigned for
stability and performance. Cross database JOINs will not
be available and a host connection will only allow
querying its associated DB. See [1]
<https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign>
for more details.
If you only think of Wikipedia, not a lot will break
probably, but if you take into account Commons and
Wikidata a lot will break. A quick grep in my folder with
Commons queries returns 123 lines with cross database
joins. So yes, stuff will break and tools will be
abandoned. This follows the practice that seems to have
become standard for the WMF these days: Decisions are made
with a small group within the WMF without any community
involved. Only after the decision has been made, it's
announced.
Unhappy and disappointed,
Maarten
_______________________________________________
Wikimedia Cloud Services mailing list
[email protected]
<mailto:[email protected]> (formerly
[email protected]
<mailto:[email protected]>)
https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
[email protected] <mailto:[email protected]>
(formerly [email protected]
<mailto:[email protected]>)
https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
[email protected] <mailto:[email protected]>
(formerly [email protected]
<mailto:[email protected]>)
https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
[email protected] (formerly [email protected])
https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
[email protected] (formerly [email protected])
https://lists.wikimedia.org/mailman/listinfo/cloud
