Re: [Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-06 Thread Željko Filipin 
On Thu, May 5, 2016 at 6:27 PM, Jon Robson  wrote:

> Yes. Thanks. I think I've done my bit. Let me know if there is
> anything else you need from me.
>

Thanks Jon. I will add you to a few gerrit patches.

Željko
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-05 Thread Legoktm 
On 05/05/2016 08:24 AM, Grace Gellerman wrote:
> https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
> 
> = 2016-05-04 =
> 
> ==Analytics ==
> *Still trouble with jenkins

Are there any more details about this or a bug filed for it?

-- Legoktm

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-05 Thread Jon Robson 
Yes. Thanks. I think I've done my bit. Let me know if there is
anything else you need from me.

On Thu, May 5, 2016 at 9:58 AM, Željko Filipin  wrote:
> On Thu, May 5, 2016 at 5:52 PM, Jon Robson  wrote:
>
>> Can you clarify what you need help with here? Is it merging
>> patches/updating empty columns on that table/other?
>>
>> Which tests are failing?
>>
>
> Tests fail all the time. See this task for some history:
>
> https://phabricator.wikimedia.org/T94150
>
> Sometimes a job is broken for more than a month. I would like to avoid
> that. I need one or more people to be owners of Selenium tests for each
> repository, so when something is broken, they fix it.
>
> Did I answer your question?
>
> Željko
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l



-- 
Jon Robson
* http://jonrobson.me.uk
* https://www.facebook.com/jonrobson
* @rakugojon

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-05 Thread Željko Filipin 
On Thu, May 5, 2016 at 5:52 PM, Jon Robson  wrote:

> Can you clarify what you need help with here? Is it merging
> patches/updating empty columns on that table/other?
>
> Which tests are failing?
>

Tests fail all the time. See this task for some history:

https://phabricator.wikimedia.org/T94150

Sometimes a job is broken for more than a month. I would like to avoid
that. I need one or more people to be owners of Selenium tests for each
repository, so when something is broken, they fix it.

Did I answer your question?

Željko
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-05 Thread Jon Robson 
On 5 May 2016 9:24 a.m., "Grace Gellerman"  wrote:
>
> https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
>
> = 2016-05-04 =
>
> == Technology ==
>
>
> === Release Engineering ===
>
>
> For all:
>
>
>  * T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs

Hi Zeljko,
Can you clarify what you need help with here? Is it merging
patches/updating empty columns on that table/other?

Which tests are failing?
Jon

>
> ** The migration of browsertests* to selenium* is almost complete,
however,
> Željko needs people to claim their failing browser tests. See the task for
> more information.
>
> *** The task has a table, but it's not clear what you want people to do
> (are you just asking about the rows with missing "contact from
> browsertests.yaml" fields)?
>
>
> For operations:
>
>
> * T126594 - Disable HHVM fcgi server on CI slaves
>
> * Need help from ops to review and merge these two patches (we dont need
> HHVM running as a daemon on CI boxes):
>
> ** https://gerrit.wikimedia.org/r/#/c/269946/
>
> ** https://gerrit.wikimedia.org/r/#/c/269947/
>
>
> * https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool
> instances (contintcloud tenant)
>
> ** More instances needed. Clarified with Chase last week: pending Andrew.
> No urgency.
>
>
> * Two related tasks, each have patches that are needed to streamline the
> scap3 migration:
>
> ** T133211 - Automate the generation deployment keys (keyholder-managed
ssh
> keys)
>
> *** https://gerrit.wikimedia.org/r/#/c/284418/
>
> ** T132747 - scap::target shouldn't allow users to redefine the user's key
>
> *** https://gerrit.wikimedia.org/r/#/c/285519/
>
>
> === Security ===
>
> * Reviews:
>
> ** json-schema done, AuthManger done (no more comments, a few minor things
> before all patches are +1'ed)
>
> ** Starting on T129584 this week
>
> * Starting work on AuthService next week (heads up to Services, we'll
> probably be scheduling a few meetings with you) (Marko: ack && yay!)
>
> * Ops: ping again on T128819
>
>
> === Services ===
>
> (Marko cannot attend today, sorry)
>
> * RESTBase
>
> ** working on storing all auth checks locally (now we are calling the MW
> API every time)
>
> * EventBus / Change propagation
>
> ** started using it in production for the summary endpoint today
>
> ** more dependency updates to follow soon
>
> * Cassandra move to 2.2.6 soon
>
> ** first up: maps cluster
>
> * use Scap3 -
> https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html
>
>
> === Technical Operations
>
> * '''Blocking''':
>
> ** none
>
> * '''Blocked''':
>
> ** none
>
> * '''Updates''':
>
> ** May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully
> deployed till then
>
> ** started using letsencrypt for various small services
>
>
> == Product ==
>
> === Reading ===
>
> * Most of Reading engineering is at an offsite today, I believe.
>
>
>  Reading Infrastructure 
>
> * AuthManager core patches are just waiting for security +1s. Work is
> ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could
> use reviews if anyone is interested.
>
>
> === Editing ===
>
>  Collaboration 
>
> * '''Blocking''':
>
> ** External store work.  External Store deployed everywhere on Beta with
no
> complications.  Work on this continues.  We now need to set up a second
> External Store on Beta for Flow, to test the migration.
>
> * '''Blocked''':
>
> ** Work on Flow dumps continuing on the ops side.
> https://phabricator.wikimedia.org/T119511 and
> https://phabricator.wikimedia.org/T89398 .
>
> * '''Updates''':
>
> ** Continuing notification work on:
>
> *** Cross-wiki notifications coming by default on May 12th!
>
> *** Echo email formatter
>
> *** Work continues on the new Echo MVC architecture
>
>
>  Parsing 
>
> * We got our first visual diff test run comparing Tidy with HTML5depurate.
> Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @
> https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this
> as the basis for figuring out what things might break if we replace Tidy
> today and what needs fixing and where.
>
> * Scott has been working with Ops to get OCG kinks ironed out.
>
>
>  Language 
>
> * '''Blocking''':
>
> ** Apertium->Jessie. Yet to finalize plan and proceed.
>
> * '''Blocked''':
>
> * '''Updates''':
>
> ** cxserver service will be migrated to scap3 deployment soon.
>
> ** Translate (twn, meta,..) now using Apertium MT from cxserver.
>
>
> == Discovery ==
>
> * '''Blocking''': none
>
> * '''Blocked''': none
>
> * Preparing for ElasticSearch 2.0 migration
>
> * Results for A/B test on portal language link location published:
>
https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_Detection_and_Primary_Link_Resorting.pdf
>
> * TextCat A/B test launching soon
>
> * Portal A/B test adding descriptions to project links to start this week
>
> * WDQS redeployed, some performance issues
>
> * Graphs have

Re: [Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-05 Thread Željko Filipin 
On Thu, May 5, 2016 at 5:24 PM, Grace Gellerman 
wrote:

> https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
>
> = 2016-05-04 =
>
> == Technology ==
>
>
> === Release Engineering ===
>
>
> For all:
>
>
>  * T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs
>
> ** The migration of browsertests* to selenium* is almost complete, however,
> Željko needs people to claim their failing browser tests. See the task for
> more information.
>
> *** The task has a table, but it's not clear what you want people to do
> (are you just asking about the rows with missing "contact from
> browsertests.yaml" fields)?


Please see "Ownership of Selenium tests" e-mail sent to this list yesterday
for more information.

In short, I need to populate this table:

https://phabricator.wikimedia.org/T134492

Željko
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] 2016-05-04 Scrum of Scrums meeting notes

2016-05-05 Thread Grace Gellerman 
https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04

= 2016-05-04 =

== Technology ==


=== Release Engineering ===


For all:


 * T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs

** The migration of browsertests* to selenium* is almost complete, however,
Željko needs people to claim their failing browser tests. See the task for
more information.

*** The task has a table, but it's not clear what you want people to do
(are you just asking about the rows with missing "contact from
browsertests.yaml" fields)?


For operations:


* T126594 - Disable HHVM fcgi server on CI slaves

* Need help from ops to review and merge these two patches (we dont need
HHVM running as a daemon on CI boxes):

** https://gerrit.wikimedia.org/r/#/c/269946/

** https://gerrit.wikimedia.org/r/#/c/269947/


* https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool
instances (contintcloud tenant)

** More instances needed. Clarified with Chase last week: pending Andrew.
No urgency.


* Two related tasks, each have patches that are needed to streamline the
scap3 migration:

** T133211 - Automate the generation deployment keys (keyholder-managed ssh
keys)

*** https://gerrit.wikimedia.org/r/#/c/284418/

** T132747 - scap::target shouldn't allow users to redefine the user's key

*** https://gerrit.wikimedia.org/r/#/c/285519/


=== Security ===

* Reviews:

** json-schema done, AuthManger done (no more comments, a few minor things
before all patches are +1'ed)

** Starting on T129584 this week

* Starting work on AuthService next week (heads up to Services, we'll
probably be scheduling a few meetings with you) (Marko: ack && yay!)

* Ops: ping again on T128819


=== Services ===

(Marko cannot attend today, sorry)

* RESTBase

** working on storing all auth checks locally (now we are calling the MW
API every time)

* EventBus / Change propagation

** started using it in production for the summary endpoint today

** more dependency updates to follow soon

* Cassandra move to 2.2.6 soon

** first up: maps cluster

* use Scap3 -
https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html


=== Technical Operations

* '''Blocking''':

** none

* '''Blocked''':

** none

* '''Updates''':

** May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully
deployed till then

** started using letsencrypt for various small services


== Product ==

=== Reading ===

* Most of Reading engineering is at an offsite today, I believe.


 Reading Infrastructure 

* AuthManager core patches are just waiting for security +1s. Work is
ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could
use reviews if anyone is interested.


=== Editing ===

 Collaboration 

* '''Blocking''':

** External store work.  External Store deployed everywhere on Beta with no
complications.  Work on this continues.  We now need to set up a second
External Store on Beta for Flow, to test the migration.

* '''Blocked''':

** Work on Flow dumps continuing on the ops side.
https://phabricator.wikimedia.org/T119511 and
https://phabricator.wikimedia.org/T89398 .

* '''Updates''':

** Continuing notification work on:

*** Cross-wiki notifications coming by default on May 12th!

*** Echo email formatter

*** Work continues on the new Echo MVC architecture


 Parsing 

* We got our first visual diff test run comparing Tidy with HTML5depurate.
Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @
https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this
as the basis for figuring out what things might break if we replace Tidy
today and what needs fixing and where.

* Scott has been working with Ops to get OCG kinks ironed out.


 Language 

* '''Blocking''':

** Apertium->Jessie. Yet to finalize plan and proceed.

* '''Blocked''':

* '''Updates''':

** cxserver service will be migrated to scap3 deployment soon.

** Translate (twn, meta,..) now using Apertium MT from cxserver.


== Discovery ==

* '''Blocking''': none

* '''Blocked''': none

* Preparing for ElasticSearch 2.0 migration

* Results for A/B test on portal language link location published:
https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_Detection_and_Primary_Link_Resorting.pdf

* TextCat A/B test launching soon

* Portal A/B test adding descriptions to project links to start this week

* WDQS redeployed, some performance issues

* Graphs have ability to use WDQS directly now

* Team offsite in 2 weeks (17-21)



==Analytics ==

*Scaling of pageview API , more work than anticipated

*Working new domain analytics.wikimedia.org, wikistats 2.0 migration,
meeting with research to map early states of project

*Still trouble with jenkins

*


== Fundraising Tech ==

* coding new PayPal integration

* pulling in lots of CiviCRM upstream changes

* making CentralNotice fail gracefully in odd cache edge cases

* Casey hanging out with reading offsite

* more work towards replacing