[Wikitech-l] 2017-10-25 Scrum of Scrums meeting notes

2017-10-25 Thread Grace Gellerman
https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-10-25

= 2017-10-25 =

== Callouts ==
* Services are running a new JobQueue test in beta cluster, so if you see
anything strange in beta - please notify
* Mukunda broke scap in beta, will get it fixed soon!

== Audiences ==

=== Readers ===

 Multimedia 
* Blocking: None
* Blocked by: None
* Updates: MediaInfo/Wikibase on Commons work is continuing,
https://phabricator.wikimedia.org/T177022
* UploadWizard changes for 3D legal considerations,
https://phabricator.wikimedia.org/T178513
* and discussions about MP3.
* Heads up: Mark on vacation next week, plus three days in the following
week - will respond but may be AFK

 iOS native app 
* Blocked by:
* Blocking:
* Updates:
** Apps offsite last week
** 5.7.0 will be released this week (
https://phabricator.wikimedia.org/project/view/2899/ ) - Visual updates to
onboarding, iOS 11 support, iPhone X support
** Starting work on 5.7.1 -
https://phabricator.wikimedia.org/project/view/3047/  and 5.8 -
https://phabricator.wikimedia.org/project/view/2913/

 Reading Web 
- currently offsite-ing

 Reading Infrastructure 
* Blocked by:
* Blocking:
* Updates:
** Reading lists available in beta & labs:
https://restbase-reading.wmflabs.org/en.wikipedia.beta.wmflabs.org/v1/ +
http://readinglists.wmflabs.org/api/rest_v1/#/Reading_lists

 Discovery 
* Blocked by:
* Blocking:
* Updates:
* continuing work on portal automation, general clean-ups, adding SVGs

=== Contributors ===

 Parsing 
* Blocked by: Parsoid debian package upload blocked by change needed to the
deb-upload script (Daniel Zahn replied on IRC y'day as he was rushing to
catch a flight that the release server has changed). But, not sure if
anything is needed on our end or will Ops fix this? I can create a phab
ticket if required.
* Blocking:
* Updates:
** Parsing team back from offsite (last week). Nothing significant to
report for purposes of SoS. Focusing on some perf work this week.

 Services 
* Blockers: none
* Updates:
** All jobs in beta cluster are processed via kafka as a test. Please
tell us if you notice anything weird
** Deprecated /titile/ and /title/{title}/ listings in REST API has
been removed

=== Community Tech ===
* Preparing for a  new wishlist survey
* Deploying Unicode sections soon

=== TechOps ===
* Blocked by:
** Flow isAllowed gets actual revision text before it is needed
https://phabricator.wikimedia.org/T172025
* Blocking:
* Updates:
** Procurement for Asia datacenter has started
** We have IP addresses allocated
** Work on unifying production and CI build pipeline ongoing
https://phabricator.wikimedia.org/T177276
** Database shard s5 split into s8 ongoing
https://phabricator.wikimedia.org/T172679
** Work on porting varnish request stats scripts to Prometheus
https://phabricator.wikimedia.org/T177199
** Puppet modernization ongoing https://phabricator.wikimedia.org/T177254

=== Search Platform ===
* Blocked by: none
* Blocking: none
* Updates:
* Finished removal of messaging fallbacks from Elastic indexing (
https://phabricator.wikimedia.org/T177871)
* Relaxing phrase query filter A/B finished, analyzing (
https://phabricator.wikimedia.org/T177956)
* Checked language analyzers to see whether we want to research other
morphological libraries (https://phabricator.wikimedia.org/T171652)
** See the plan in https://phabricator.wikimedia.org/T171652#3707331
* Looking at top abandoned queries (
https://phabricator.wikimedia.org/T176997)
* Extended a set of default search namespaces on several wikis (
https://phabricator.wikimedia.org/T170473)
* Enabled stricter throttling on WDQS to deal with clients that issue tons
of short requests very fast
* Enabling ElasticSearch prefix search on Wikidata today
* Working on porting Selenium tests from Ruby to JS
* Working on upgrade to Elastic 5.5
* Working on indexing Wikidata descriptions and adding them to fulltext
search

=== Release Engineering ===
* Blocked by: None
* Blocking: None
* Updates:
 ** Mukunda broke scap in beta, will get it fixed soon! (
https://phabricator.wikimedia.org/T179013 )
 ** Deployment logspam is mostly quiet, except one non-deployment related
log from the tidy migration (Parsing/MW Platform know)
 ** Zeljko paired with Elena T. to get some Echo notification browser tests
written (nodejs/mocha framework).
 ** Zeljko scheduled a Tech Talk on Oct 31st to discuss/teach the nodejs
browser testing framework.
 ** Scap tech-debt project well underway, merged many improvements last week
 ** new/docker based CI: the phan job is now migrated
 ** Gerrit was upgraded last week (minor version)
 ** Working on git-lfs (large file store, for big binary blobs) support in
Gerrit for ORES and Reading teams
 ** Redesigned (simplified) the Phabricator login screen <
https://phabricator.wikimedia.org/D831>, should be deployed soon.

=== Security ===
* Blocked by: None
* Blocking: whowever is waiting for security reviews
* 

[Wikitech-l] 2017-10-18 Scrum of Scrums meeting notes

2017-10-25 Thread Grace Gellerman
https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-10-18

*= 2017-10-18=*

== Callouts ==
* https://phabricator.wikimedia.org/T177765 Reading Web -> Security

== Audiences ==
=== Readers ===
 iOS native app 
* Blocked by:
* Blocking:
* Updates: Apps offsite this week, 5.7.0 in public beta, will be released
next week ( https://phabricator.wikimedia.org/project/view/2899/ ) - Visual
updates to onboarding, iOS 11 support, iPhone X support

 Android native app 
* Blocked by:
* Blocking:
* Updates:

 Reading Web 
* Blocked by:
https://phabricator.wikimedia.org/T177765 [security]
* Blocking:
* Updates:

   - Investigating ChromeDriver for PDF generation. Security review has
   been requested. OCG is off.


   - Print styles have been deployed to Vector.


 Reading Infrastructure 
* Blocked by:
* Blocking:
* Updates:

 Multimedia 
* Blocked by:
* Blocking:
* Updates: MediaInfo work progressing, ramping up over the next few months.
3D is stalled currently on consideration of changes to the upload pipeline
to handle patent/weapons concerns.

 Discovery 
* Blocked by:
* Blocking:
* Updates:
 - Working on serving SVGs on wikipedia.org portal
 - Making progress on the portal automation tool (to automate portal
builds)

== Maps =
* Blocked by: N/A
* Blocking: N/A
* Updates:
Hanging updates solved
Most of team will be at SOTM (State of The Map) US next week

=== Community Tech ===
* Blocked by:
* Blocking:
* Updates:

=== Contributors ===
 Editing 
* Blocked by:
* Blocking:
* Updates:


 Global Collaboration 
* Blocked by: No one
* Blocking: No one (we think)
* Updates:
** One cause of ORES-on-watchlist slowness fixed (removed STRAIGHT_JOIN at
Bawolff's recommendation) https://phabricator.wikimedia.org/T176456
** Compact Language Links deployed on dewiki
** Continuing work on porting ContentTranslation to VE, and addressing
bugs/feedback from RCFilters release
** Team out at an offsite next week (Oct 23-27), some people traveling on
Friday (Oct 20)

 UI Standardization 
* Blocked: icon feedback appreciated, see below
** OOUI v0.24.0 released,
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.24.0
*** 5 breaking changes,
 Dropped 'MediaWiki' backwards-compatibility theme, replaced by
'WikimediaUI' and moved, deleted different icons
* Ongoing:
** OOUI:
*** icons: Work on icon set to be more harmonious and align to WikimediaUI
Style Guide's guidelines https://phabricator.wikimedia.org/T177432
** Aligning arbitrary, historically grown colors across products to
WikimediaUI color palette https://phabricator.wikimedia.org/T148708

=== Community Tech ===
* Working on GlobalPreferences
* Unicode sections going live very soon

== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:

   - ** Developed new editing- and content-related metrics for AQS together
   with Services team (for Wikistats2 back-end)


   - ** Worked on Wikistats2 front-end: topic selector, views for new AQS
   metrics


   - ** Replacement boxes for eventlogging databases are racked and have
   been reimaged, migration soon


   - ** Assisted Reading team with refinement of EventLogging:Popups data
   into Hive for scalable A/B test


=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:

=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** Reconstructing banner and landing page impression data from Hive
** May have fixed our replication lag (mysql's automatic temp table
drops were being replicated out of order, leaving lots of open temp tables
on replicas. Explicit drops seem to be fine).
** Using contact_id from email links (and adding a verification hash)
to avoid creating duplicate contacts
** Fixing issues caused by Safari's new privacy policies
*** Payment providers that require cookies can't be in an iframe
*** Using a different method to record banner impressions
** Adding more stats to grafana
** Logging client-side errors on donation forms

=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:

=== Performance ===
* Blocked by:
* Blocking:
* Updates:

=== Release Engineering ===
* Blocked by: None
* Blocking: None
* Updates: None

=== Research ===
* Blocked by:
* Blocking:
* Updates:

=== Scoring Platform ===
* Blocked by:
* Blocking:
* Updates:

=== Search Platform ===
* Blocked by: none
* Blocking: none
* Updates:
* Discussing how to improve relevance surveys and A/B tests (
https://phabricator.wikimedia.org/T171215#3677637)
* A/B test for using MLR on 18 wikis finished, analysis next (
https://phabricator.wikimedia.org/T177490)
* Running A/B test with relaxing match requirements on search with multiple
terms (https://phabricator.wikimedia.org/T177502)
* Wikidata configured for indexing P31 and P279, reindexing and working on
integrating them to search
* Working on porting Selenium tests from Ruby to JS
* Working on upgrade to Elastic 

Re: [Wikitech-l] PHPUnit error: Cannot access the database: Unknown database

2017-10-25 Thread Sebastian Berlin
That did it. Thanks a lot.

I added a line about this to the Wiki-page.

Best,

*Sebastian Berlin*
Utvecklare/*Developer*
Wikimedia Sverige (WMSE)

E-post/*E-Mail*: sebastian.ber...@wikimedia.se
Telefon/*Phone*: (+46) 0707 - 92 03 84

On 25 October 2017 at 12:39, Brian Wolff  wrote:

> Try passing
>
> --wiki wiki
>
> As a command line argument to the script. (Assuming wiki is the db name.
> Otherwise pass --wiki dbname_here )
>
> --
> bawolff
>
> On Wednesday, October 25, 2017, Sebastian Berlin <
> sebastian.ber...@wikimedia.se> wrote:
> > I'm having trouble running PHPUnit for the extension I'm developing
> > (Wikispeech), in Vagrant. I followed the instructions on
> >
> https://www.mediawiki.org/wiki/Manual:PHP_unit_testing/
> Writing_unit_tests_for_extensions#Run_your_tests
> ,
> > i.e. `tests/phpunit/phpunit.php extensions/Wikispeech/tests`, and got the
> > error:
> >
> >> Fatal error: Uncaught exception 'Wikimedia\Rdbms\DBConnectionError'
> with
> >> message 'Cannot access the database: Unknown database
> >> 'extensions/Wikispeech/tests/phpunit/ApiWikispeechTest.php'
> (127.0.0.1)'
> in
> >> /vagrant/mediawiki/includes/libs/rdbms/database/Database.php:800
> >>
> > For full log, see https://phabricator.wikimedia.org/P6176.
> >
> > Does anyone know what's causing this?
> >
> > Previously I've run the tests with `phpunit extensions/Wikispeech/tests`
> > which I realize isn't the correct way, after reading the Wiki-page again.
> > However, this didn't work after I reinstalled Vagrant (due to various
> other
> > problems).
> >
> > All the best,
> >
> > *Sebastian Berlin*
> > Utvecklare/*Developer*
> > Wikimedia Sverige (WMSE)
> >
> > E-post/*E-Mail*: sebastian.ber...@wikimedia.se
> > Telefon/*Phone*: (+46) 0707 - 92 03 84
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] PHPUnit error: Cannot access the database: Unknown database

2017-10-25 Thread Brian Wolff
Try passing

--wiki wiki

As a command line argument to the script. (Assuming wiki is the db name.
Otherwise pass --wiki dbname_here )

--
bawolff

On Wednesday, October 25, 2017, Sebastian Berlin <
sebastian.ber...@wikimedia.se> wrote:
> I'm having trouble running PHPUnit for the extension I'm developing
> (Wikispeech), in Vagrant. I followed the instructions on
>
https://www.mediawiki.org/wiki/Manual:PHP_unit_testing/Writing_unit_tests_for_extensions#Run_your_tests
,
> i.e. `tests/phpunit/phpunit.php extensions/Wikispeech/tests`, and got the
> error:
>
>> Fatal error: Uncaught exception 'Wikimedia\Rdbms\DBConnectionError' with
>> message 'Cannot access the database: Unknown database
>> 'extensions/Wikispeech/tests/phpunit/ApiWikispeechTest.php' (127.0.0.1)'
in
>> /vagrant/mediawiki/includes/libs/rdbms/database/Database.php:800
>>
> For full log, see https://phabricator.wikimedia.org/P6176.
>
> Does anyone know what's causing this?
>
> Previously I've run the tests with `phpunit extensions/Wikispeech/tests`
> which I realize isn't the correct way, after reading the Wiki-page again.
> However, this didn't work after I reinstalled Vagrant (due to various
other
> problems).
>
> All the best,
>
> *Sebastian Berlin*
> Utvecklare/*Developer*
> Wikimedia Sverige (WMSE)
>
> E-post/*E-Mail*: sebastian.ber...@wikimedia.se
> Telefon/*Phone*: (+46) 0707 - 92 03 84
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] PHPUnit error: Cannot access the database: Unknown database

2017-10-25 Thread Sebastian Berlin
I'm having trouble running PHPUnit for the extension I'm developing
(Wikispeech), in Vagrant. I followed the instructions on
https://www.mediawiki.org/wiki/Manual:PHP_unit_testing/Writing_unit_tests_for_extensions#Run_your_tests,
i.e. `tests/phpunit/phpunit.php extensions/Wikispeech/tests`, and got the
error:

> Fatal error: Uncaught exception 'Wikimedia\Rdbms\DBConnectionError' with
> message 'Cannot access the database: Unknown database
> 'extensions/Wikispeech/tests/phpunit/ApiWikispeechTest.php' (127.0.0.1)' in
> /vagrant/mediawiki/includes/libs/rdbms/database/Database.php:800
>
For full log, see https://phabricator.wikimedia.org/P6176.

Does anyone know what's causing this?

Previously I've run the tests with `phpunit extensions/Wikispeech/tests`
which I realize isn't the correct way, after reading the Wiki-page again.
However, this didn't work after I reinstalled Vagrant (due to various other
problems).

All the best,

*Sebastian Berlin*
Utvecklare/*Developer*
Wikimedia Sverige (WMSE)

E-post/*E-Mail*: sebastian.ber...@wikimedia.se
Telefon/*Phone*: (+46) 0707 - 92 03 84
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l