[Wikitech-l] grrrit-wm outage (fixed now)

2013-09-23 Thread Yuvi Panda
Hello! There was a grrrit-wm outage for a few hours earlier today. This was caused by the link between our tampa datacenter (where toollabs mostly lives) and our eqiad data center (where gerrit lives) (see preliminary report on

Re: [Wikitech-l] IRC meeting for RFC review

2013-09-23 Thread Daniel Kinzler
I'd love to take part, but this is silly o'clock in europe. -- daniel Am 23.09.2013 05:26, schrieb Tim Starling: I would like to have an open IRC meeting for RFC review, on Tuesday 24 September at 22:00 UTC (S.F. 3pm). We will work through a few old, neglected RFCs, and maybe consider a

[Wikitech-l] Bulk download

2013-09-23 Thread Mihai Chintoanu
Hi everyone, I have a list of about 1.8 million images which I have to download from commons.wikimedia.org. Is there any simple way to do this which doesn't involve an individual HTTP hit for each image? Many thanks in advance. Mihai ___ Wikitech-l

Re: [Wikitech-l] Bulk download

2013-09-23 Thread K. Peachey
On Mon, Sep 23, 2013 at 11:22 PM, Mihai Chintoanu mihai.chinto...@skobbler.com wrote: Hi everyone, I have a list of about 1.8 million images which I have to download from commons.wikimedia.org. Why? ___ Wikitech-l mailing list

Re: [Wikitech-l] Bulk download

2013-09-23 Thread Ariel T. Glenn
We have a somewhat out of date off site mirror of images (I'm working on the out of date part). This includes commons. It's accessible by rsync, http, ftp: http://meta.wikimedia.org/wiki/Mirroring_Wikimedia_project_XML_dumps#Media Thanks again to your.org for hosting that. Are these images

Re: [Wikitech-l] Bulk download

2013-09-23 Thread Jeremy Baron
On Sep 23, 2013 9:25 AM, Mihai Chintoanu mihai.chinto...@skobbler.com wrote: I have a list of about 1.8 million images which I have to download from commons.wikimedia.org. Is there any simple way to do this which doesn't involve an individual HTTP hit for each image? You mean full size

[Wikitech-l] Analyst's Notebook

2013-09-23 Thread Lars Aronsson
Today's top news in Sweden is a revelation of how the police keeps a register or computer file on certain categories of people. Anyway, a side track of this discussion is that they apparently are using a software called Analyst's Notebook, which is useful for tracing connections between

Re: [Wikitech-l] [Wikitech-ambassadors] Fwd: Deployment highlights for the week of Sept 23rd

2013-09-23 Thread Chris McMahon
On Sat, Sep 21, 2013 at 1:21 PM, Nikolas Everett never...@wikimedia.orgwrote: On Sat, Sep 21, 2013 at 10:26 AM, Chad innocentkil...@gmail.com wrote: On Fri, Sep 20, 2013 at 11:47 PM, billinghurst billinghu...@gmail.com wrote: If you can't wait you can read the regression tests here:

[Wikitech-l] Jenkins upgrade Tuesday 9:00UTC

2013-09-23 Thread Antoine Musso
Hello, I will be upgrading Jenkins tomorrow at 9:00UTC for a minor upgrade. I will do it after the weekly i18n team rollout. The upgrade should take roughly one hour, during that time any job launched will be reported as LOST in Gerrit and would need to be retriggered manually (by editing the

Re: [Wikitech-l] [Xmldatadumps-l] Bulk download

2013-09-23 Thread C. Scott Ananian
Federico: providing information on the archive.org mirror (probably on https://meta.wikimedia.org/wiki/Mirroring_Wikimedia_project_XML_dumps#Media) along with any suggestions or ettiquette for using these would probably be useful. --scott ​ ___

Re: [Wikitech-l] [Xmldatadumps-l] Bulk download

2013-09-23 Thread Federico Leva (Nemo)
Jeremy Baron, 23/09/2013 16:11: On Sep 23, 2013 9:25 AM, Mihai Chintoanu mihai.chinto...@skobbler.com mailto:mihai.chinto...@skobbler.com wrote: I have a list of about 1.8 million images which I have to download from commons.wikimedia.org http://commons.wikimedia.org. Is there any simple way

Re: [Wikitech-l] RecentChanges types (RC_* constants)

2013-09-23 Thread Erik Bernhardson
t strings vs integers is not something I'm too worried about. A varchar(16) is essentially 128 bits and with all the things a DB has to do i'm not too worried about comparing a 32bit int vs a 128bit string. I do feel that adding yet another field to compare to is just adding to the complexity

Re: [Wikitech-l] Bulk download

2013-09-23 Thread C. Scott Ananian
I added Jeremy's helpful tips to https://en.wikipedia.org/wiki/Wikipedia:Database_download#Where_are_images_and_uploaded_files-- feel free to improve these/reference them from other appropriate places, etc. --scott ​ ___ Wikitech-l mailing list

[Wikitech-l] summary of my OPW internship

2013-09-23 Thread Rachel Thomas
Today is my last day! I have enjoyed working with you all. See my latest blog for the full summary: http://www.bleededge.blogspot.com/2013/09/wrap-up-of-my-outreach-program-for.html --Rachel *Gnome FOSS Outreach Program for Women Intern Browser Test Automation, Wikimedia Foundation*

Re: [Wikitech-l] Categories without interwiki

2013-09-23 Thread C. Scott Ananian
FWIW, categories can also be very useful for generating offline wiki snapshots. For example, for education I might want to ensure that my wikislice has all the articles related to chemical elements. One reasonable way to do this is to grab all the articles in [[Category:Chemical_elements]]. In

Re: [Wikitech-l] RecentChanges types (RC_* constants)

2013-09-23 Thread Brad Jorsch (Anomie)
On Mon, Sep 23, 2013 at 2:38 PM, Erik Bernhardson ebernhard...@wikimedia.org wrote: I'm not certain if the db servers would like us going back through time and updating all the recentchanges rows on the various wiki's, Although it probably won't be used on WMF wikis, you'll still need to

Re: [Wikitech-l] RfC update: LESS stylesheet support in core

2013-09-23 Thread Brion Vibber
Ok, I have landed: * https://gerrit.wikimedia.org/r/#/c/78669 (core LESS support) * https://gerrit.wikimedia.org/r/#/c/85143/ (.background-image embedding helper function) Any further tweaks needed on the core support should be done as separate patches rather than additional patchsets on those,

Re: [Wikitech-l] [Wikitech-ambassadors] Fwd: Deployment highlights for the week of Sept 23rd

2013-09-23 Thread Nikolas Everett
On Mon, Sep 23, 2013 at 12:40 PM, Chris McMahon cmcma...@wikimedia.org wrote: So nice to see what Nik has done here. Information on running these tests is in the README:

Re: [Wikitech-l] RfC update: LESS stylesheet support in core

2013-09-23 Thread Jon Robson
I cannot describe how significant this change is in the history of MediaWiki. I truly believe this is the dawn of a new age of design in MediaWiki. Big kudos to Ori for getting this kicked off and finally merged and to all the people involved in code review and the RFC process. *takes off his

Re: [Wikitech-l] RfC update: LESS stylesheet support in core

2013-09-23 Thread Ori Livneh
On Mon, Sep 23, 2013 at 1:08 PM, Brion Vibber bvib...@wikimedia.org wrote: Ok, I have landed: * https://gerrit.wikimedia.org/r/#/c/78669 (core LESS support) * https://gerrit.wikimedia.org/r/#/c/85143/ (.background-image embedding helper function) Any further tweaks needed on the core

Re: [Wikitech-l] RfC update: LESS stylesheet support in core

2013-09-23 Thread Antoine Musso
Le 23/09/13 22:08, Brion Vibber a écrit : * https://gerrit.wikimedia.org/r/#/c/84139/ - update for MobileFrontend Whenever that change is merged, it will be deloyed automatically on the beta cluster after a few minutes at: http://en.m.wikipedia.beta.wmflabs.org/ ;) -- Antoine hashar Musso

Re: [Wikitech-l] IRC meeting for RFC review

2013-09-23 Thread Tim Starling
How about we also schedule a meeting for 2 October, 06:00 UTC? So the first week will be US/Australia, and the second will be Europe/Australia. -- Tim Starling On 23/09/13 18:55, Daniel Kinzler wrote: I'd love to take part, but this is silly o'clock in europe. -- daniel Am 23.09.2013

Re: [Wikitech-l] Wikimedia wikis use Ace

2013-09-23 Thread Lennart Kats
Hi MZMcBride, Wow, that's really cool! We'll a reference to the Ace homepage using one of the logos at https://www.wikimedia.org/. Lennart On 9/15/13 20:20 , MZMcBride wrote: Hi. Re: http://ace.c9.io/#nav=production Wikimedia wikis (including Wikipedias, Wiktionaries, Wikidata, etc.) are

Re: [Wikitech-l] summary of my OPW internship

2013-09-23 Thread Ori Livneh
Chris and Zeljko were awesome mentors, and I learned a great deal from them about Quality Assurance and automation. :D I enjoyed reading your posts, Rachel -- I hope you keep writing contributing to open source projects. --- Ori Livneh o...@wikimedia.org On Mon, Sep 23, 2013 at 10:42 AM,

Re: [Wikitech-l] Bulk download

2013-09-23 Thread gnosygnu
Ariel and others have already touched upon this, but just in case you want more details (I'm trying to do something similar): If your images are centered around one wiki (for example, the 1.8 million images are for articles in English Wikipedia), you can use the tarballs at your.org:

Re: [Wikitech-l] AbuseFilter error codes and MobileFrontend

2013-09-23 Thread Andrew Garrett
Apologies, I always forget to hit Reply All. Original Message Subject:Re: AbuseFilter error codes and MobileFrontend Date: Sat, 21 Sep 2013 10:11:28 +1000 From: Andrew Garrett agarr...@wikimedia.org To: Juliusz Gonera jgon...@wikimedia.org Juliusz Gonera

[Wikitech-l] Access from China

2013-09-23 Thread Ryu Cheol
Hello all, last week I had been in Nanjing of China for my business. I tried to access to Wikipedia, my love, of course. Wow, I found I can access on my iPad. It's quite weird. So I tried again on my notebook computer, the firewall reset the session to stop me to access Wikipedia.

Re: [Wikitech-l] AbuseFilter error codes and MobileFrontend

2013-09-23 Thread Juliusz Gonera
On 09/23/2013 06:48 PM, Andrew Garrett wrote: You should know about this change[1], which corrects the error messages to be more in line with the general case, as well as adding some metadata. It's not been approved yet, so I'm nudging a few reviewers. You can also determine which mobile

Re: [Wikitech-l] Access from China

2013-09-23 Thread Ryan Lane
Ryu, As far as we've been told Wikipedia access to China is open, excluding a filter for specific pages, assuming you are using HTTP and not HTTPS. - Ryan On Mon, Sep 23, 2013 at 7:36 PM, Ryu Cheol rch...@gmail.com wrote: Hello all, last week I had been in Nanjing of China for my

Re: [Wikitech-l] Access from China

2013-09-23 Thread Ryu Cheol
Thanks Ryan. On iPad, I could not check it is http or https. You means that on mobile devices such as iPad, it does not redirect to https. I feel a bit, it is not consistent. In the region which https is not allowed, could we keep the http as the default protocol for example China? I thought

Re: [Wikitech-l] Access from China

2013-09-23 Thread Ryan Lane
On Mon, Sep 23, 2013 at 8:07 PM, Ryu Cheol rch...@gmail.com wrote: On iPad, I could not check it is http or https. You means that on mobile devices such as iPad, it does not redirect to https. I feel a bit, it is not consistent. In the region which https is not allowed, could we keep the

Re: [Wikitech-l] [Wikitech-ambassadors] Fwd: Deployment highlights for the week of Sept 23rd

2013-09-23 Thread MZMcBride
Nikolas Everett wrote: I'd like to get those tests running in MediaWiki-Vagrant but I just can't find the time at the moment. In other news, https://www.mediawiki.org/wiki/Search/CirrusSearchFeatures now has a reasonably complete list of CirrusSearch's features. From that page: You should be

Re: [Wikitech-l] Access from China

2013-09-23 Thread Jeremy Baron
On Sep 23, 2013 11:09 PM, Ryu Cheol rch...@gmail.com wrote: On iPad, I could not check it is http or https. You means that on mobile devices such as iPad, it does not redirect to https. I feel a bit, it is not consistent. If it's not consistent then that's a probably bug to be fixed. Can you

Re: [Wikitech-l] IRC meeting for RFC review

2013-09-23 Thread MZMcBride
Tim Starling wrote: I would like to have an open IRC meeting for RFC review, on Tuesday 24 September at 22:00 UTC (S.F. 3pm). We will work through a few old, neglected RFCs, and maybe consider a few new ones, depending on the interests of those present. RFCs are at

Re: [Wikitech-l] Access from China

2013-09-23 Thread Ryu Cheol
Dear Jeremy, you are right. I am back to Korea. Sorry, I cannot give you exact configuration I had in China. At this moment, I can say that I was convinced that on mobile devices I can access to Wikipedia, but I can't on desktop computers. No matter what is behind, http or https. Cheol

Re: [Wikitech-l] Access from China

2013-09-23 Thread Ryu Cheol
Now I am reading Some users live where HTTPS is not an easy option due to explicit blocking by government. At the request of these communities, we made an explicit exclusion for users from those particular countries. Simply, users from China and Iran will not be required to use HTTPS to log