Re: [Wikitech-l] Should MediaWiki CSS prefer non-free fonts?

On Mon, Oct 28, 2013 at 01:32:30PM +1100, Tim Starling wrote: Yes, we should prefer to use free software. We should also strive to ensure that our support for users on non-free platforms is optimal, as long as that doesn't negatively impact on users of free platforms. So I don't think it is a

Re: [Wikitech-l] Should MediaWiki CSS prefer non-free fonts?

On Mon, Oct 28, 2013 at 02:56:42PM -0700, S Page wrote: On Mon, Oct 28, 2013 at 10:20 AM, Erik Moeller e...@wikimedia.org wrote: Prioritizing freely licensed fonts while also explicitly naming the preferred non-free fonts seems like an easy fix. Again, this is already done for us by

Re: [Wikitech-l] Architectural leadership in Wikimedia's technical community

On Tue, Nov 05, 2013 at 05:57:31PM -0800, Erik Moeller wrote: So how should this role evolve going forward? Some possible paths (you know I like to present options ;-): The architect title, besides the job description that you described, is also a seniority level within the WMF's engineering

Re: [Wikitech-l] [Ops] Operations buy in on Architecture of mwlib Replacement

On Wed, Nov 13, 2013 at 03:41:33PM -0800, Matthew Walker wrote: * Node.JS itself should be installable via apt package (we'll have to do a custom package so that we get Node v10) I haven't looked at your document yet, but a quick note on that: I have nodejs 0.10 backported packages ready for

Re: [Wikitech-l] Module storage is coming

On Tue, Dec 03, 2013 at 12:30:00AM -0800, Ori Livneh wrote: We ran a controlled test and found that module storage reduced page load times by 156 ms, on average. Aaron has some data available at https://meta.wikimedia.org/wiki/Research:Module_storage_performance, but we still need to write

Re: [Wikitech-l] ARM servers

On Mon, Jan 13, 2014 at 05:47:12PM +0800, James Salsman wrote: Can someone more familiar with the Foundation's server infrastructure needs than I please create a page somewhere with a checklist of packages, modules, tools, etc., which need to be on arm but aren't yet? Before we do that, we

Re: [Wikitech-l] Jake requests enabling access and edit access to Wikipedia via TOR

On Mon, Jan 13, 2014 at 11:43:53AM -0500, Marc A. Pelletier wrote: If you start with that assumption, then it is unreasonable to assume that the endpoints aren't /also/ compromised or under surveillance. Editing Wikipedia is an inherently public action, if your security or life is in danger

Re: [Wikitech-l] Tor exemption process (was: Re: Jake requests enabling access and edit access to Wikipedia via TOR)

On Fri, Jan 17, 2014 at 01:26:04PM -0800, Erik Moeller wrote: The Board or global community could decide that protecting users' right to anonymity is more important than having abuse prevention tools relying on IP disclosure, but in the absence of such a Board-level decision or community-wide

Re: [Wikitech-l] Drop support for PHP 5.3

On Tue, Feb 18, 2014 at 09:51:25AM -0800, Chad wrote: On Tue, Feb 18, 2014 at 9:48 AM, Trevor Parscal tpars...@wikimedia.orgwrote: PHP 5.4 added a few important features[1], namely traits, shorthand array syntax, and function array dereferencing. I've heard that 5.3 is nearing end of life.

Re: [Wikitech-l] Webfonts

On Thu, Mar 13, 2014 at 07:20:27PM -0400, MZMcBride wrote: I think you're mostly right, though the exact terms of the trade-offs aren't clear here (e.g., some bandwidth). We'll need more explicit measurements in order to reach full agreement on what user benefit vs. site performance trade-offs

Re: [Wikitech-l] [Engineering] Update on HHVM

Thanks for the update, Ori. Exciting stuff :) On Fri, Mar 21, 2014 at 03:42:41AM -0700, Ori Livneh wrote: * We need good packages. The packages provided by Facebook have some deep issues that need to be fixed before they meet our packaging standards. This is a good opportunity to recognize

Re: [Wikitech-l] ogv.js media player update: Flash and GPU acceleration

On Sun, Mar 30, 2014 at 09:51:31AM -0700, Brion Vibber wrote: I spent a little more time the last few weekends on ogv.js (JavaScript-based player for Ogg Theora and Vorbis media in IE and Safari) This is just awesome work, Brion and in amazingly little time. I'm really excited to see this. Keep

Re: [Wikitech-l] GeoData now uses Elasticsearch

On Thu, Apr 10, 2014 at 05:04:38AM +0400, Max Semenik wrote: And finally, appreciation: this was made possible only thanks to awesome help from our search team, Nik Everett and Chad Horohoe. You kick ass guys! Extending appreciation: thanks Max, good work! This is great :) Faidon

Re: [Wikitech-l] Hardening WP/WM against traffic analysis (take two)

Hi Zack, Thanks for bringing this up again, this is a very useful discussion to have. On Thu, Jun 05, 2014 at 12:45:11PM -0400, Zack Weinberg wrote: * what page is the target reading? * what _sequence of pages_ is the target reading? (This is actually easier, assuming the attacker knows the

Re: [Wikitech-l] What's up with upload.wikimedia.org 's crossdomain.xml

On Sat, Jul 05, 2014 at 09:09:07PM -0700, Brion Vibber wrote: That X-Range header was an experiment me and Faidon tried for the ogv.js media player I've been prototyping (Flash fallback version) . We couldn't get the extra header -- or the regular Range header -- to work through the varnish

Re: [Wikitech-l] Limiting storage/generation of thumbnails without loss of functionality

On Wed, Jan 23, 2013 at 01:53:39PM -0800, Aaron Schulz wrote: I'd strongly suggest considering this kind of approach. Ditto. Among other benefits already mentioned, having a predetermined set of sizes would help greatly in the architecture and capacity planning of media storage, as well as in

Re: [Wikitech-l] [Labs-l] Maria DB

On Thu, Feb 14, 2013 at 05:14:31PM +0100, Mark Bergsma wrote: Debug information is *highly useful* in a production setup, and we try to run all our core applications with it so we have a chance to debug issues when they occur. I think the only reason distributions omit debug information is

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

On Thu, Feb 28, 2013 at 11:53:45AM -0800, Mark Holmquist wrote: As absurd as this is for me to be sending out a warning about taking down a labs service, this seems appropriately courteous especially given the amount of use this instance has been getting. I've been in quite important meetings

Re: [Wikitech-l] Proposal: Wikitech contributors

On Tue, Apr 02, 2013 at 05:45:58AM -0700, Quim Gil wrote: * wikitech.wikimedia.org would become the one and only site for our open source software contributors, powered by semantic software and an ontology of categories shared across wiki pages, Bugzilla and hopefully Gerrit. This is

Re: [Wikitech-l] Countdown to SSL for all sessions?

On Tue, Apr 30, 2013 at 11:14:48AM -0700, Daniel Friesen wrote: On Tue, 30 Apr 2013 10:27:21 -0700, Petr Bena benap...@gmail.com wrote: SSL is requiring more CPU, both on server and client and disable all kinds of cache (such as squid or varnish), and some browsers may have problems with it

Re: [Wikitech-l] [WikimediaMobile] Caching Problem with Mobile Main Page?

On Fri, May 03, 2013 at 03:19:13PM -0700, Asher Feldman wrote: 1) Our multicast purge stream is very busy and isn't split up by cache type, so it includes lots of purge requests for images on upload.wikimedia.org. Processing the purges is somewhat cpu intensive, and I saw doing so once per

Re: [Wikitech-l] draft goals for Engineering Community Team for the next 12 months

Hi Sumanah, On Fri, Jun 28, 2013 at 07:39:19PM -0400, Sumana Harihareswara wrote: https://www.mediawiki.org/wiki/Wikimedia_Engineering/2013-14_Goals#Wikimedia_Technical_Community The Engineering Community Team has some draft goals for what we'd like to achieve in the next 12 months. We'll

Re: [Wikitech-l] git.wikimedia.org dead?

Hi, On Sun, Aug 11, 2013 at 12:51:15PM +0200, rupert THURNER wrote: As chad points out, its being served now it's plural (robots.txt) many thanks for getting it up quickly last time! unfortunately https://git.wikimedia.org is unresponsive again. Thanks for the report! I just restarted it

Re: [Wikitech-l] Wikimedia's anti-surveillance plans: site hardening

On Fri, Aug 16, 2013 at 08:04:24PM -0400, Zack Weinberg wrote: Hi, I'm a grad student at CMU studying network security in general and censorship / surveillance resistance in particular. I also used to work for Mozilla, some of you may remember me in that capacity. My friend Sumana

Re: [Wikitech-l] trace gitblit, was: Re: Wikimedia's anti-surveillance plans: site hardening

On Sat, Aug 17, 2013 at 10:19:10PM +0200, rupert THURNER wrote: (2) by when you will adjust your operating guideline, so it is clear to faidon, ariel and others that 10 minutes tracing of an application and getting a holistic view is mandatory _before_ restoring the service, if it goes down for

Re: [Wikitech-l] Wikimedia's anti-surveillance plans: site hardening

On Sat, Aug 17, 2013 at 05:55:36PM -0400, Sumana Harihareswara wrote: I suggest that we also update either https://meta.wikimedia.org/wiki/HTTPS or a hub page on http://wikitech.wikimedia.org/ or https://www.mediawiki.org/wiki/Security_auditing_and_response with up-to-date plans, to make it

Re: [Wikitech-l] Wikimedia's anti-surveillance plans: site hardening

On Fri, Aug 23, 2013 at 06:53:29AM -0700, Bry8 Star wrote: At my first few small-scale implementations, i did not pay attention to rate-limiting techniques, then i realized its importance over time. RRL support for gdnsd is being tracked upstream at: https://github.com/blblack/gdnsd/issues/36

Re: [Wikitech-l] Guidelines for db schema changes

On Tue, Apr 24, 2012 at 05:52:24PM -0700, Rob Lanphier wrote: As we do more frequent deploys, it's going to become critical that we get database schema changes correct, and that we do so in a way that gives us time to prepare for said changes and roll back to old versions of the software

Re: [Wikitech-l] Relations with freenode and wikimedia

On Thu, Jun 21, 2012 at 09:35:56AM +0200, Petr Bena wrote: One developer recently complained about some freenode policies, specifically that wiki projects (wikipedia etc has some kind of exception) are no longer allowed to be hosted on freenode network, which is supposed to host only

Re: [Wikitech-l] Welcoming OpenHatch to organize the pre-Wikimania hackathon

On Thu, Jun 21, 2012 at 05:27:08PM -0400, Asheesh Laroia wrote: Excerpts from Alolita Sharma's message of Mon Jun 18 14:42:08 -0400 2012: Excellent news Sumana! Welcome Asheesh and OpenHatch team :-) Thanks for the warm welcome! Welcome! I wonder how you'll manage to do both

Re: [Wikitech-l] Barkeep code review tool

On Sat, Jun 30, 2012 at 04:06:37PM -0700, Roan Kattouw wrote: On Fri, Jun 29, 2012 at 2:20 PM, Marcin Cieslak sa...@saper.info wrote: As seen on IRC: https://github.com/ooyala/barkeep/wiki/Comparing-Barkeep-to-other-code-review-tools The most prominent feature of Barkeep mentioned on

Re: [Wikitech-l] Serious alternatives to Gerrit

On Thu, Jul 19, 2012 at 06:29:58PM -0700, Roan Kattouw wrote: gitlab might be this, but it's written in Ruby so presumably our developer community would be less able to contribute to it. And I'm pretty sure ops is not just gonna say sure, no problem if/when we ask them to deploy a Ruby web app

Re: [Wikitech-l] Serious alternatives to Gerrit

On Thu, Jul 19, 2012 at 11:58:54AM -0700, Erik Moeller wrote: From what I can tell, we have essentially three choices: * Continue to work with the heavily centralized and clunky Gerrit workflow, and try to beat it into shape to not cause us too much pain, while seeing people increasingly

Re: [Wikitech-l] Serious alternatives to Gerrit

On Fri, Jul 20, 2012 at 02:52:55PM -0700, Ryan Lane wrote: On Thu, Jul 19, 2012 at 11:55 PM, Antoine Musso hashar+...@free.fr wrote: Daniel Friesen wrote: The ops guys hate ruby. I am pretty sure they love it. Puppet itself is a DSL based on top of ruby. The ops argument is we don't

Re: [Wikitech-l] Serious alternatives to Gerrit

On Wed, Jul 25, 2012 at 02:21:03PM -0400, Derric Atzrott wrote: As mentioned before, we can't use github enterprise at all, since it doesn't allow for hosting public repos. Let's ignore that it even exists. I feel like as Wikipedia is one of the top 10 most visited sites on the Internet we

Re: [Wikitech-l] Serious alternatives to Gerrit

On Thu, Jul 26, 2012 at 12:08:39AM -0700, Rob Lanphier wrote: I can get behind the decision to use a currently substandard tool in order to preserve Wikimedia's long term freedom. Even if we accept that Gerrit is substandard (which I don't), preserving freedom is a motivating factor.

Re: [Wikitech-l] Criteria for serious alternative

On Thu, Jul 26, 2012 at 11:27:44AM -0700, Rob Lanphier wrote: Nothing else has been advocated with a degree of seriousness as to warrant consideration at this point. That's not to say we're done with those options; if someone wants to put together a serious proposal, there's still a little

Re: [Wikitech-l] Criteria for serious alternative

On Thu, Jul 26, 2012 at 11:36:50PM -0700, Rob Lanphier wrote: On Thu, Jul 26, 2012 at 12:49 PM, Faidon Liambotis fai...@wikimedia.orgwrote: My understanding of the process was that we would collect a broad set of arguments/ideas/proposals and people would be later assigned to the task

Re: [Wikitech-l] Can we make an acceptable behavior policy? (was: Re: Mailman archives broken?)

On Fri, Aug 17, 2012 at 07:05:24AM -0400, MZMcBride wrote: the mess you made. Right there, in that phrase, you have aggressively indicated the following: a) That you believe someone fucked up; b) That you think they're incompetent; c) That you think they're being lazy about it I

Re: [Wikitech-l] IPv6 usage on Wikimedia?

On Tue, Sep 18, 2012 at 01:30:14PM -0700, S Page wrote: I imagine mobile users on IPv6 might be more aggressively cached by their providers, and they aren't requesting as many resources per page view, so Wikimedia's share of IPv6 users might be higher. I wouldn't count on mobile devices having

Re: [Wikitech-l] IPv6 routing problem?

Hi, Thanks for forwarding the report. I've chatted with the user via IRC on Sunday and subsequently via e-mail, so we're on it. For what it's worth, the underlying issue is still there, although restoring European traffic via the esams (Amsterdam) cluster has significantly reduced the impact.

Re: [Wikitech-l] Let's talk about Solr

On Thu, Oct 18, 2012 at 11:22:05AM -0700, Asher Feldman wrote: I think Solr is the right direction for us to go in. Current efforts can pave the way for a complete refresh of WMF's article full text search as well as how our developers approach information retrieval. We just need to make

Re: [Wikitech-l] SPDY?

On Sat, Oct 27, 2012 at 09:52:34PM +0300, Strainu wrote: Are there any plans for an SPDY [1] test on the Wikimedia servers? I'm currently doing some speed tests on a robot and I found out (not quite to my surprise) that it's much quicker to get whole pages (hundreds at a time) than to ask

[Wikitech-l] secure.wikimedia.org is no more

Hi, Following last year's Native HTTPS efforts¹, I've pushed a change² today that redirects all the old secure.wikimedia.org URLs to the respective native HTTPS ones, e.g. https://secure.wikimedia.org/wikipedia/en/wiki/Main_Page gets redirected to https://en.wikipedia.org/wiki/Main_Page The

Re: [Wikitech-l] secure.wikimedia.org is no more

On Wed, Nov 14, 2012 at 01:48:27PM -0500, Derric Atzrott wrote: Following last year's Native HTTPS efforts¹, I've pushed a change² today that redirects all the old secure.wikimedia.org URLs to the respective native HTTPS ones, e.g. https://secure.wikimedia.org/wikipedia/en/wiki/Main_Page gets

Re: [Wikitech-l] Proposed new WMF browser support framework for MediaWiki

On Tue, Nov 20, 2012 at 05:19:51PM -0800, James Forrester wrote: In WMF Engineering, we've been struggling with what we mean by 'supporting' browsers, and how we can match limited developer time to our natural desire to make everyone happy. snip So, to turn this mass of text into an 'ask', I

Re: [Wikitech-l] Proposed new WMF browser support framework for MediaWiki

On Tue, Nov 20, 2012 at 05:46:22PM -0800, Brion Vibber wrote: Current and immediately-previous releases are also really hard to match up between projects on fast release cycles (like Chrome and Firefox which are pushing out new major versions every couple months) and those where major versions

Re: [Wikitech-l] Proposed new WMF browser support framework for MediaWiki

GOn Wed, Nov 21, 2012 at 09:17:24AM -0800, James Forrester wrote: Those numbers are people using Windows XP, not people using Windows XP with IE. I believe the numbers for (XP IE) are going to be substantially lower - probably half - but still far to high to discount. Doh, my bad.

[Wikitech-l] Tor relay

Hi, This is just a quick update that as of late October, WMF is officially hosting a Tor relay: https://atlas.torproject.org/#details/DB19E709C9EDB903F75F2E6CA95C84D637B62A02 This is not an exit node, and it's just a small contribution to the network. Really - anyone can do it:

Re: [Wikitech-l] Tor relay, and freenode

Hi Pine, On Mon, Nov 10, 2014 at 01:28:54AM -0800, Pine W wrote: Thanks for the note. Would it be within our mission scope to host a Freenode server? We use Freenode a *lot* for public and private communications. There have been previous discussions about WMF support for upstream services,

Re: [Wikitech-l] Tor relay

On Mon, Nov 10, 2014 at 11:35:42PM +0100, Federico Leva (Nemo) wrote: * Advertised Bandwidth 3.3 MB/s, what does it mean and can it be increased? As we do not set any advertised bandwidth in our configuration, the value in Atlas is the bandwidth observed by the network. We are still in a

Re: [Wikitech-l] CORS blocking metrics

On Sat, Aug 15, 2015 at 01:00:38AM -0700, Gergo Tisza wrote: That does not sound like a big deal since we are loading most Javascript files from our own servers, and can fully control what headers are set, but we ran into occasional problems in the past when using CORS (MediaViewer uses

Re: [Wikitech-l] [WikimediaMobile] Wikipedia iOS app moving to GH

Hi Brian, The arguments for/against GitHub etc. were discussed at length across all of our engineering staff community, exactly 3 years ago, which reached consensus: https://www.mediawiki.org/wiki/Git/Gerrit_evaluation#GitHub In my opinion, this is not something that should be addressed on a

Re: [Wikitech-l] Removal of mobile.wikipedia.org and wap.wikipedia.org in support of browser HSTS preload

Hi, If you look at https://phabricator.wikimedia.org/T104942#1436332 (linked from this thread, before Adam posted his own data) an analysis was done on a file called per-domain-count which we previously extracted from sampled 1:1000 logs for approximately 25 days for all kinds of

Re: [Wikitech-l] HTTP/2 switch-on schedule for WMF sites?

On Thu, Sep 10, 2015 at 09:14:27PM +0100, Neil Harris wrote: > Does anyone know if the WMF engineering team has a schedule for > deploying HTTP/2 on its sites, preferably in the near future, and if > so, what the progress is toward that goal? We have no firm schedule yet. It's mostly blocked on

Re: [Wikitech-l] Scope of ArchCom

On Thu, Jan 28, 2016 at 10:53:27AM -0800, Rob Lanphier wrote: > > This is especially true given that ArchComm really has absolutely no say > > in resourcing and a given feature may not have secured funding (people, > > hardware etc.) > > Awwwyou're mail was so great, and then you ended with

Re: [Wikitech-l] Scope of ArchCom

On Fri, Jan 22, 2016 at 02:30:22PM -0800, Rob Lanphier wrote: > On Fri, Jan 22, 2016 at 2:08 PM, Alex Monk wrote: > > > To clarify - are you saying this ([deploying increasingly excellent > > software on the Wikimedia production cluster in a consensus-oriented > > manner]) is

Re: [Wikitech-l] Proposal to invest in Phabricator Calendar

On Sun, May 15, 2016 at 10:59:40PM +0200, Andre Klapper wrote: > On Sat, 2016-05-14 at 20:51 +0200, Ricordisamoa wrote: > > If we're going to be investing money into improving Phabricator  > > upstream, I think we should start with making Differential usable > > (i.e. a suitable replacement for

Re: [Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

project concludes. Best, Faidon -- Faidon Liambotis Principal Operations Engineer Acting Director of Technical Operations Wikimedia Foundation On Fri, Apr 07, 2017 at 04:58:09PM +0300, Faidon Liambotis wrote: > Hi all, > > You may have heard already that, like last year, we are planning to &g

[Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

ations list: o...@lists.wikimedia.org (any time) Thanks, Faidon -- Faidon Liambotis Principal Operations Engineer Acting Director of Technical Operations Wikimedia Foundation ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimed

Re: [Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

, with the ultimate holy-grail goal of an active-active setup for all of our services. We'll keep you all up-to-date on the progress. Best regards, Faidon -- Faidon Liambotis Principal Operations Engineer Acting Director of Technical Operations Wikimedia Foundation On Wed, Apr 19, 2017 at 08:33:49PM

Re: [Wikitech-l] Try out the commit message validator

On Tue, Nov 07, 2017 at 11:19:57AM -0700, Bryan Davis wrote: > We could probably add checks for some common ones if someone compiled a list. > > Running a full spell check would be difficult because of the number of > false positives there would be based on a "normal" dictionary. Commit >

Re: [Wikitech-l] Allow HTML email

On Wed, Sep 23, 2020 at 02:45:37PM +1000, Tim Starling wrote: > We still haven't heard from Faidon who, last I heard, still reads his > emails by piping telnet into less or something. But I think he can > make sense of multipart/alternative as long as it's not base-64 > encoded. You should send