[Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Mark Holmquist
The Etherpad Lite server at http://etherpad.wmflabs.org/pad has been 
surprisingly popular of late, which has revealed an issue in our version. I 
think the issue has been fixed in the latest version of Etherpad Lite, so I'm 
going to hastily schedule a deployment in two hours' time. Please be aware that 
if you're editing a pad at that time, you may lose work.

In all the upgrade should take no longer than an hour, and I'll ping the list 
when it's done with.

As absurd as this is for me to be sending out a warning about taking down a 
labs service, this seems appropriately courteous especially given the amount of 
use this instance has been getting.

Thanks,

-- 
Mark Holmquist
Software Engineer
Wikimedia Foundation
mtrac...@member.fsf.org
https://wikimediafoundation.org/wiki/User:MHolmquist


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Greg Grossmeier
quote name=Mark Holmquist date=2013-02-28 time=11:53:45 -0800
 As absurd as this is for me to be sending out a warning about taking
 down a labs service, this seems appropriately courteous especially
 given the amount of use this instance has been getting.

Thanks, Mark, for the heads up.

Greg

-- 
| Greg GrossmeierGPG: B2FA 27B1 F7EB D327 6B8E |
| identi.ca: @gregA18D 1138 8E47 FAC8 1C7D |

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Antoine Musso
Le 28/02/13 11:53, Mark Holmquist wrote:
 The Etherpad Lite server at http://etherpad.wmflabs.org/pad has been
 surprisingly popular of late,

The version that is on the production box is a bit old and has issue
with SSL connection.  I guess most of us have migrated to the labs one
which does not face those issues.

Thanks for taking care of it :-]

-- 
Antoine hashar Musso


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Mark Holmquist
On Thu, Feb 28, 2013 at 11:53:45AM -0800, Mark Holmquist wrote:
 The Etherpad Lite server at http://etherpad.wmflabs.org/pad has been 
 surprisingly popular of late, which has revealed an issue in our version. I 
 think the issue has been fixed in the latest version of Etherpad Lite, so I'm 
 going to hastily schedule a deployment in two hours' time. Please be aware 
 that if you're editing a pad at that time, you may lose work.
 
 In all the upgrade should take no longer than an hour, and I'll ping the list 
 when it's done with.
 
 As absurd as this is for me to be sending out a warning about taking down a 
 labs service, this seems appropriately courteous especially given the amount 
 of use this instance has been getting.

All right, the server is going down now and should be back up within the hour. 
Stay tuned for more.

Thanks all for your patience.

-- 
Mark Holmquist
Software Engineer
Wikimedia Foundation
mtrac...@member.fsf.org
https://wikimediafoundation.org/wiki/User:MHolmquist


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Mark Holmquist
On Thu, Feb 28, 2013 at 01:53:29PM -0800, Mark Holmquist wrote:
 All right, the server is going down now and should be back up within the 
 hour. Stay tuned for more.
 
 Thanks all for your patience.

The server is back up, and appears to be working well now.

If you see the server down (usually 503'ing or similar) please contact me on 
IRC or via email so I can investigate, and please note the time and date you 
noticed the server going down. This problem sometimes happens when a large 
number of changes are sent to a single client at once.

Cheers,

-- 
Mark Holmquist
Software Engineer
Wikimedia Foundation
mtrac...@member.fsf.org
https://wikimediafoundation.org/wiki/User:MHolmquist


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Faidon Liambotis
On Thu, Feb 28, 2013 at 11:53:45AM -0800, Mark Holmquist wrote:
 As absurd as this is for me to be sending out a warning about taking
 down a labs service, this seems appropriately courteous especially
 given the amount of use this instance has been getting.

I've been in quite important meetings with 15+ attendants where Etherpad
Lite has been used exclusively -- so, clearly not for purposes that are
testing or staging.  So, Labs is the wrong place to have this.  Can you
coordinate with us (operations team) to move the service into a
production environment?

Thanks,
Faidon

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Mark Holmquist
On Thu, Feb 28, 2013 at 02:35:12PM -0800, Faidon Liambotis wrote:
 I've been in quite important meetings with 15+ attendants where Etherpad
 Lite has been used exclusively -- so, clearly not for purposes that are
 testing or staging.  So, Labs is the wrong place to have this.  Can you
 coordinate with us (operations team) to move the service into a
 production environment?

This has been on my list for some time now, but I never found a good point to 
do it. There was some work on Debianizing the package, and maybe some splashing 
around in the Puppet manifests, but I'd be happy to explore the possibility of 
production deployment in the near future, whenever there's a sufficient 
contingent of Ops engineers available to assist.

Thanks, Faidon!

-- 
Mark Holmquist
Software Engineer
Wikimedia Foundation
mtrac...@member.fsf.org
https://wikimediafoundation.org/wiki/User:MHolmquist


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Etherpad Lite labs server going down today at 22:00 UTC (14:00 Pacific) for upgrade

2013-02-28 Thread Matthew Flaschen
On 02/28/2013 05:35 PM, Faidon Liambotis wrote:
 I've been in quite important meetings with 15+ attendants where Etherpad
 Lite has been used exclusively -- so, clearly not for purposes that are
 testing or staging.  So, Labs is the wrong place to have this.  Can you
 coordinate with us (operations team) to move the service into a
 production environment?

Agreed.  We use this to track deploys for instance.

Matt Flaschen

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l