Re: [Wikitech-l] Deployment-prep (aka 'Beta') services will be unreliable this week

2018-11-20 Thread Bryan Davis
On Tue, Nov 20, 2018 at 4:41 PM Mukunda Modell  wrote:
>
> Despite each of our efforts, there is still a configuration error
> preventing MediaWiki from working in beta. I've been stuck for several
> hours now but I'm hopeful that this is the last major issue and I'm sure
> it's simple for someone who understands MediaWiki internals better than I
> do. Unfortunately I'm completely stumped so I could really use some help
> from someone who understands the configuration of MediaWiki session storage
> and the underlying object cache.
>
> The problem is described in https://phabricator.wikimedia.org/T210030  so I
> won't repeat it here. I'll simply appeal for those of you who know
> something about how "BagOStuff" is configured, please take a look at
> T210030 and point me in the right direction.

The beta cluster wikis are working again. It turns out that there was
some confusion when moving/removing servers because of implementation
drift between our production clusters and the beta cluster.

Before the move to the new region we had both "memc*" and "redis*"
servers in the beta cluster project. The "memc*" servers are the
equivalent of our production "mc*" servers. In production the "mc*"
servers run both memcached and redis services. In the beta cluster our
"memc*" servers were only providing memcached and the configuration
relied on the "redis*" servers for session storage. The "redis*"
servers were removed while migrating virtual machines to the eqiad1-r
region under the assumption that they were legacy servers from the
time when we used redis as storage for the job queue. The fix was to
setup the "memc*" servers with both memcached for arbitrary data
caching and redis for session storage. If you are interested in the
gory details see notes left on
https://phabricator.wikimedia.org/T210030.

Bryan
-- 
Bryan Davis  Wikimedia Foundation
[[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA
irc: bd808v:415.839.6885 x6855

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Discovery Weekly Update for the week starting 2018-11-12

2018-11-20 Thread Kaartic Sivaraam
Hi Chris,

On 20 November 2018 03:39:02 GMT+05:30, Chris Koerner  
wrote:
>
>== Did you know? ==

Thanks for the informative did you know section. It was an interesting read. :-)


>* Letters are encoded internally by computers as numbers—for example,
>“A” is 65 and “a” is 97.[3] Years ago, programs and even websites
>would use different encodings[4] to represent text, often leading to
>unreadable gibberish on screen. Unicode[5] was intended to be a single
>encoding for most of the world’s writing systems. The most-used parts
>of it fit into a 16-bit representation,[6] which can handle about 65
>thousand characters. But that's not enough for the very large number
>of rare and historical Chinese, Japanese, and Korean (CJK) characters,
>which are represented in 16-bit Unicode using “surrogate pairs”.[7]
>1,024 Unicode characters are set aside to be “high surrogates”—the
>first half of a 32-bit character—and 1,024 characters are set aside to
>be “low surrogates”—the second half. By themselves, the surrogates
>aren’t valid and don’t represent anything, but in pairs they can
>represent over a million additional characters. Since these characters
>are usually rare, software can sometimes treat them incorrectly split
>them up, which can result in you seeing the Unicode replacement
>character �,[8] which is used when something has gone wrong processing
>Unicode text. (When the character is fine, but you don’t have a font
>to show it, you sometimes get little squares instead. Since the most
>common source of these squares for English speakers is unrepresented
>CJK characters, a slang term for the squares is “tofu”.[9])
>
>[0] https://phabricator.wikimedia.org/T168427
>[1] https://phabricator.wikimedia.org/T209293
>[2] https://phabricator.wikimedia.org/T209156
>[3] https://en.wikipedia.org/wiki/ASCII#Printable_characters
>[4]
>https://en.wikipedia.org/wiki/Character_encoding#Common_character_encodings
>[5] https://en.wikipedia.org/wiki/Unicode
>[6] https://en.wikipedia.org/wiki/UTF-16
>[7]
>https://en.wikipedia.org/wiki/Universal_Character_Set_characters#Surrogates
>[8]
>https://en.wikipedia.org/wiki/Specials_(Unicode_block)#Replacement_character
>[9] https://en.wiktionary.org/wiki/tofu#Noun
>


-- 
Sivaraam

Sent from my Android device with K-9 Mail. Please excuse my brevity.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Problem importing images

2018-11-20 Thread nad via Wikitech-l
Hi all,

I've installed a new 1.31 and imported content from an xml dump using
importDump.php which included file descriptions, then imported the
images from a directory of files using importImages.php.

About half of the files have imported successfully, but the other half
say the image is not found when I go to the image page in the wiki. i
can see the image in the proper place in the upload directory so it has
imported properly.

If I try and re-upload the image manually I can't because it says an
exact replica already exists, but click on that link to the already
existing one still says "No file by this name exists, but you can upload
it".

I've tried running all the related maintenance scripts such as
rebuildImages.php with no success :-(

Any ideas?

Thanks,
Aran


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Thank you Tuesday

2018-11-20 Thread Mukunda Modell
1. Thanks Kunal for starting this thread.
2. Thanks to Andrew for migrating beta cluster to a new region
3. Thanks to Krenair for a ton of help debugging beta cluster problems the
past couple of days.

On Tue, Nov 20, 2018 at 12:01 PM Kunal Mehta  wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
>
> Hi,
>
> It's been a while since we had a thank you thread, so since it's
> Tuesday, I'm starting one for the alliteration.
>
> If you haven't participated in one of these before, it's simple - just
> reply to the list thanking someone for what they've done recently...or
> send them a private email, it doesn't matter how, as long as you say
> thank you.
>
> I'd like to thank:
>
> RazeSoldier (星耀晨曦) for his great work tracking down and fixing PHP
> 7.3 compatibility issues.
>
> Paladox for being on top of backporting bugfixes to REL1_31 and
> REL1_32 branches.
>
> And all of the GCI admins and mentors who are helping introduce new
> students into the world of free and open source software.
>
>
> Who would you like to thank?
> - -- Legoktm
> -BEGIN PGP SIGNATURE-
>
> iQIzBAEBCgAdFiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlv0S88ACgkQUvyOe+23
> /KKA4w/9Gjj78NAdHJZZySxgCIKv/uZTIGZ96tjj1aULg99ql6KzjPaO7OaC7LJw
> Jlx5hPShD+TJX4dMYC+4/Qy27xWjMKtd17Htty6/drQ6hKAjrTxcQsV+MCoBsIw5
> RNPUmJFDOoKbbghHng5LsFTinp3oP9J767fadxB91AH3VINOeMTfmB8nn85+adRB
> aVpD0mF6uvAdOtMWna1kuGhmzTRW0yvmGF9ri/eIztVNo1C9Xa2RnXH/1hqBg7gg
> gQ+n3ohD5LRGxKH5mzhfTNnGYIs9ZPcrUD1FGuW0POrLVVx2uSVpb6yBzMm6QcoX
> bLxUIqAcsKApCgt+1PSZFwXdqoygfRmq/UN00AWP++G1fGOhNMLGtK0/ok7Ayk6J
> ORicDKB81qODhmqlHfL/wyEyt8RzQSVKVzwtCLs+7fgVXmRpuYL0cSLW3M0HcWve
> EaNdRBEfkyb5S0UpZsia3UvvV21+9/zPgV/yPx1cFS1amvK08zSdJ1rujSrpsoQm
> OpZ52BMqCyoBAKLhvFXKNej5F716cRdXnNKp7/ZAxAuv6tTf51aAFRTRB2j5+RN/
> 7VcA5lAAqFbjf4wyqppE3d2NYTbz0UxztOxxszlwBNFojWdT4qmkGVxwmcKHvDJN
> EYIqZlsD07pRavPrVm+7K97l2uaSNbzWcSRUltFQMNG/PWeaSy4=
> =732/
> -END PGP SIGNATURE-
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Deployment-prep (aka 'Beta') services will be unreliable this week

2018-11-20 Thread Mukunda Modell
So we've made some headway in resolving all of the inevitable issues that
cropped up after migrating a lot of cloud instances to all new
infrastructure and assigning a new IP to each of them. Many Thanks to
Krenair and Andrew for all the great work you've been doing to get things
back to normal.

Despite each of our efforts, there is still a configuration error
preventing MediaWiki from working in beta. I've been stuck for several
hours now but I'm hopeful that this is the last major issue and I'm sure
it's simple for someone who understands MediaWiki internals better than I
do. Unfortunately I'm completely stumped so I could really use some help
from someone who understands the configuration of MediaWiki session storage
and the underlying object cache.

The problem is described in https://phabricator.wikimedia.org/T210030  so I
won't repeat it here. I'll simply appeal for those of you who know
something about how "BagOStuff" is configured, please take a look at
T210030 and point me in the right direction.

Thanks in advance for taking a look. I apologize for the inconvenience
caused by this unfortunately unavoidable interruption of service.

On Mon, Nov 19, 2018 at 12:11 PM Andrew Bogott 
wrote:

> Due to a lucky arrangement of schedules, we are going to move the
> deployment-prep project to the new Cloud region this week, starting in a
> few minutes. *This includes all of the infrastructure behind the
> beta.wmflabs.org site.*
>
> Various people will be standing by to troubleshoot the outages that
> result, but for the most part if you see bad behaviors you should
> disregard or work around them for the time being.
>
> Once everything is moved and semi-stable I will send a followup email,
> at which point the deployment-prep team will once again become
> interested in bug reports :)
>
> Sorry for the short notice!  With a little luck this should be mostly
> painless.
>
> -Andrew
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Thank you Tuesday

2018-11-20 Thread Kunal Mehta
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Hi,

It's been a while since we had a thank you thread, so since it's
Tuesday, I'm starting one for the alliteration.

If you haven't participated in one of these before, it's simple - just
reply to the list thanking someone for what they've done recently...or
send them a private email, it doesn't matter how, as long as you say
thank you.

I'd like to thank:

RazeSoldier (星耀晨曦) for his great work tracking down and fixing PHP
7.3 compatibility issues.

Paladox for being on top of backporting bugfixes to REL1_31 and
REL1_32 branches.

And all of the GCI admins and mentors who are helping introduce new
students into the world of free and open source software.


Who would you like to thank?
- -- Legoktm
-BEGIN PGP SIGNATURE-

iQIzBAEBCgAdFiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlv0S88ACgkQUvyOe+23
/KKA4w/9Gjj78NAdHJZZySxgCIKv/uZTIGZ96tjj1aULg99ql6KzjPaO7OaC7LJw
Jlx5hPShD+TJX4dMYC+4/Qy27xWjMKtd17Htty6/drQ6hKAjrTxcQsV+MCoBsIw5
RNPUmJFDOoKbbghHng5LsFTinp3oP9J767fadxB91AH3VINOeMTfmB8nn85+adRB
aVpD0mF6uvAdOtMWna1kuGhmzTRW0yvmGF9ri/eIztVNo1C9Xa2RnXH/1hqBg7gg
gQ+n3ohD5LRGxKH5mzhfTNnGYIs9ZPcrUD1FGuW0POrLVVx2uSVpb6yBzMm6QcoX
bLxUIqAcsKApCgt+1PSZFwXdqoygfRmq/UN00AWP++G1fGOhNMLGtK0/ok7Ayk6J
ORicDKB81qODhmqlHfL/wyEyt8RzQSVKVzwtCLs+7fgVXmRpuYL0cSLW3M0HcWve
EaNdRBEfkyb5S0UpZsia3UvvV21+9/zPgV/yPx1cFS1amvK08zSdJ1rujSrpsoQm
OpZ52BMqCyoBAKLhvFXKNej5F716cRdXnNKp7/ZAxAuv6tTf51aAFRTRB2j5+RN/
7VcA5lAAqFbjf4wyqppE3d2NYTbz0UxztOxxszlwBNFojWdT4qmkGVxwmcKHvDJN
EYIqZlsD07pRavPrVm+7K97l2uaSNbzWcSRUltFQMNG/PWeaSy4=
=732/
-END PGP SIGNATURE-

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Wednesday: Technical Advice IRC Meeting

2018-11-20 Thread Michael Schönitzer
Reminder: Technical Advice IRC meeting again **Wednesday 4-5 pm UTC** on
#wikimedia-tech.
Question can be asked in English & German.

The Technical Advice IRC Meeting is a weekly support event for volunteer
developers. Every Wednesday, two full-time developers are available to help
you with all your questions about Mediawiki, gadgets, tools and more! This
can be anything from "how to get started" over "who would be the best
contact for X" to specific questions on your project.

If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting

Hope to see you there!

Michi (for the Technical Advice IRC Meeting crew)

-- 
Michael F. Schönitzer



Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de

Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l