[Cloud] Re: [Cloud-announce] No Friday plans? Spend your weekend replacing Buster VMs!

2024-06-14 Thread AntiCompositeNumber
fairly quickly. If that information doesn't exist then migration by anyone other than the original maintainer will be very difficult. I will say that an OS change is a good time to onboard new maintainers. AntiCompositeNumber (they/him) On Fri, Jun 14, 2024 at 2:50 PM mdsiam O wrote: > > তোর

[Cloud] Re: Changes in schema of pagelinks tables

2024-01-17 Thread AntiCompositeNumber
is single-wiki. AntiCompositeNumber (he/him) On Wed, Jan 17, 2024 at 3:05 PM Amir Sarabadani wrote: > > Hi! > > Am Mi., 17. Jan. 2024 um 19:37 Uhr schrieb Ben Kurtovic > : >> >> Hi Amir & others, >> >> I’m glad we are making changes to improve DB storage/q

[Cloud] Re: VideoWiki direct access questions

2024-01-12 Thread AntiCompositeNumber
Here is the Phab task for the floating IP request: https://phabricator.wikimedia.org/T300750. Declining to grant a floating IP in this case is in line with how WMCS generally handles floating IPs in my experience, and the reasons given are valid. AntiCompositeNumber (he/him) On Fri, Jan 12, 2024

[Cloud] Re: [Cloud-announce] Updated WMCS terms of use

2023-06-05 Thread AntiCompositeNumber
In case it was unclear: I do not intentionally store usernames. The Toolforge infrastructure, in its default configuration, stores usernames. Toolforge also does not provide tools to easily clean up logs. This is not an individual developer problem. AntiCompositeNumber (he/him) On Mon, Jun 5

[Cloud] Re: [Cloud-announce] Updated WMCS terms of use

2023-06-02 Thread AntiCompositeNumber
I'm sorry, but that response is unacceptable. The resources of volunteer developers are also limited. Enacting an unclear policy without recent consultation with the groups affected places an unreasonable burden on the volunteers WMCS exists to serve. AntiCompositeNumber (he/him) On Fri, Jun 2

[Cloud] Re: [Cloud-announce] Updated WMCS terms of use

2023-05-26 Thread AntiCompositeNumber
at <https://ldap.toolforge.org/user/anticomposite>). The overall layout of the Terms is also confusing, with very short sections referring to other very short sections on the other side of the document. AntiCompositeNumber (he/him) On Fri, May 26, 2023 at 9:46 AM Andrew Bogott wrote: > >

[Cloud] Re: Proposing a Tool sweep

2022-12-29 Thread AntiCompositeNumber
> > Cloud mailing list -- cloud@lists.wikimedia.org > > List information: > > https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/ > ___ > Cloud mailing list -- clo

[Cloud] Re: Kubernetes-based jobs engine -- how to use Python virtual environments?

2022-04-06 Thread AntiCompositeNumber
In general, if you are using a Python virtual environment on k8s, you should only modify it from a shell in a matching k8s container. The easiest way to do this is with `webservice --backend=kubernetes python3.9 shell` (or whatever version you are using). If the python version you're using matches

[Cloud] Re: [Cloud-announce] Toolforge: need to stop webservice and start it again following changes to labels

2021-10-14 Thread AntiCompositeNumber
Webservice will try to pull settings from the service.manifest file, but the best practice is to use a webservice template file . This is something all tool operators running a webservice should do, as it prevents you

[Cloud] Re: Python upgrade on the Toolforge

2021-09-26 Thread AntiCompositeNumber
The grid and bastions only support Python 3.5; that won't change until they get an OS upgrade (https://phabricator.wikimedia.org/T275864). As you noted, python 3.7 and 3.9 are available on Kubernetes but writing YAML configuration can be complex. There is a project to build a tool similar to jsub

[Cloud] Re: Validating multiple usernames?

2021-09-09 Thread AntiCompositeNumber
Yes, the canonical form of usernames is with spaces, but the canonical form of page titles is with underscores. No this hasn't ever confused anyone or caused me any problems, why do you ask? ACN On Thu, Sep 9, 2021 at 10:56 AM Roy Smith wrote: > > That can't be right. I think you meant,

Re: [Cloud] [Cloud-announce] Upcoming cloud-vps project deletions

2021-01-26 Thread AntiCompositeNumber
Fastcci is used by a default gadget on Commons, and is being maintained by the recently-returned User:Dschwen. On Tue, Jan 26, 2021 at 2:17 PM Andrew Bogott wrote: > > Hello! > > The 2020 project opt-in process wrapped up at the end of the year, and > we've identified the following projects as

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-17 Thread AntiCompositeNumber
I took a look at converting the query used for GreenC Bot's Job 10, which tracks enwiki files that "shadow" a different file on Commons. It is currently run daily, and the query executes in about 60-90 seconds. I tried three methods to recreate that query without a SQL cross-database join. The

Re: [Cloud] [Cloud-announce] Cloud VPS users, please claim your projects

2020-11-16 Thread AntiCompositeNumber
Kelson already did it a few days ago. On Mon, Nov 16, 2020 at 3:54 PM Travis Briggs wrote: > > Can someone mark mwoffliner as "in use", please? > > I lost my phone and now I can't sign in to mediawiki tech because of 2FA. > > Thanks, > -Travis > > On Mon, Nov 2, 2020 at 9:09 AM Maximilian Doerr

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-10 Thread AntiCompositeNumber
Most cross-db JOINs can be recreated using two queries and an external tool to filter the results. However, there are some queries that would be simply impractical due to the large amount of data involved, and the query for overlapping local and Commons images is one of them. There are basically

Re: [Cloud] Sync 100k most popular articles to local machine?

2020-08-09 Thread AntiCompositeNumber
ould limit your requests to a reasonable rate, typically no more than 60-75 requests/minute (but a slower rate if possible is appreciated). Make sure to also comply with <https://meta.wikimedia.org/wiki/User-Agent_policy> so we can yell at you specifically if there's a problem. AntiCompositeNumber

Re: [Cloud] Logging query with actors and log type (user stats)

2020-04-15 Thread AntiCompositeNumber
://phabricator.wikimedia.org/T246970 and https://phabricator.wikimedia.org/T247978). Using the optimized views brings the all-time query down to about 15 minutes (https://quarry.wmflabs.org/query/43984) and the 2019 query down to about 106 seconds (https://quarry.wmflabs.org/query/43985). AntiCompositeNumber

Re: [Cloud] Logging query with actors and log type (user stats)

2020-04-15 Thread AntiCompositeNumber
You should use the un(der)-documented `logging_logindex` view instead of `logging`. On Wed, Apr 15, 2020 at 17:56 Maciej Jaros wrote: > Not sure if this is an appropriate place to discuss this but I'm not able > to run this query: > https://quarry.wmflabs.org/query/24267 > > Even a minor part

Re: [Cloud] [Cloud-announce] Toolforge: new domain toolforge.org

2020-04-13 Thread AntiCompositeNumber
Continued support for the toolforge: interwiki prefix is being tracked at https://phabricator.wikimedia.org/T247432. On Mon, Apr 13, 2020 at 09:04 Antonin Delpeuch (lists) < li...@antonin.delpeuch.eu> wrote: > Hi Arturo, > > This is great news! The tool urls will be definitely prettier this way.

Re: [Cloud] Can this query be optimized further?

2020-04-12 Thread AntiCompositeNumber
Sometimes a subquery will be faster that the LEFT JOIN: ... WHERE page_id NOT IN (SELECT c2.cl_from FROM categorylinks c2 WHERE c2.cl_to = 'صفحه‌های_گسترده_در_دست_ساخت' ... If that doesn't help, you'll probably have to paginate the query (split it into smaller chunks, then recombine them). On