[Wikitech-l] Tech Talk: Using Kibana4 to read logs at Wikimedia

[Rachel Farrand]

Please join for the following tech talk:

*Tech Talk**:* Using Kibana4 to read logs at Wikimedia
*Presenter:* Bryan Davis (BD808)
*Date:* November 15, 2016
*Time: *18:00 UTC

Link to live YouTube stream 
*IRC channel for questions/discussion:* #wikimedia-office

*Summary: *Overview of recent changes in the Kibana software used at
logstash.wikimedia.org and logstash-beta.wmflabs.org. You'll never guess
where they hid the short URL links!
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] OOjs UI 0.18.0 release (breaking change)

[Volker E.]

Hello everyone,

we've released OOjs UI 0.18.0 today. It will be in MediaWiki core from
1.29.0-wmf.2,
which will be deployed to Wikimedia production in the regular train, starting on
Tuesday 15 November. As in this release there are six breaking changes, at least
nominally, please carefully look over them to see if they affect your code.


Breaking changes since last release:

* TextInputWidget: remove `isValid()` method, deprecated since v0.12.3
(Ricordisamoa)

  Though named "isValid", this function has always returned a Promise, and not a
  boolean (the Promise was resolved with true/false). Way back over a
year ago in
  v0.12.3 we introduced `getValidity()` instead, with saner semantics
(it returns
  a Promise that is resolved or rejected depending on validitity), with the old
  function left in for backwards compatibility. We're now removing the
old function;
  if you're still using it, you'll need to switch over.


* ComboBoxWidget: Remove this deprecated alias for ComboBoxInputWidget
(James D. Forrester)

  We renamed the `ComboBoxWidget` to `ComboBoxInputWidget` a year ago,
refactoring
  it to inherit from `TextInputWidget`, with the old names left as deprecated
  backwards-compatible options. We're now removing the old name; if you're still
  using it, you'll need to simply switch over the name of the widget you call.


* core: Remove {add|remove}CaptureEventListener (James D. Forrester)

  We provided 'addCaptureEventListener' and its sibling as proxies for
  'node.addEventListener' and its sibling with special code to support Internet
  Explorer 8. However, from version 0.15.0 we dropped support for that
browser (as
  MediaWiki did), so this indirection was no longer necessary. We're
now removing
  the old methods; if you're still using it, you'll need to simply
switch over to
  the native ones.


* icons: Remove deprecated alias 'photoGallery' (Ed Sanders)

  We renamed the 'photoGallery' icon to 'imageGallery' in v0.13.3 in
November 2015,
  and left the old name as a duplicate for a while for backwards
compatibility. We're
  now removing the old name; if you're still using it, you'll need to
simply switch
  over to the new one.


* InputWidget: Remove deprecated #setRTL function (James D. Forrester)

  We renamed the 'setRTL' function to 'setDir' in v0.13.1 to be more standard in
  our naming and not imply that LTR is the normal direction. We left
the old name
  for more than a year, but now it's removed, so you'll switch from passing a
  boolean to one of the strings 'ltr' and 'rtl'.


* MediaWiki theme: Remove deprecated `constructive` variables (Volker E)

  We scrapped the 'constructive' flagged state in the MediaWiki theme some time
  ago. This also removes the Less variables, which we had temporarily set to the
  same values as the 'progressive' flag. This might be a breaking change if you
  were using these downstream, but it is unlikely.



Deprecations since last release:

* Break out parts of TextInputWidget into a new SearchInputWidget
(Prateek Saxena)

  TextInputWidget is being simplified to reduce load, with specialised
assumptions
  around behaviour and what icons to display by default moved down
into a bespoke
  sub-classed widget for that use case. The old parameters will be respected for
  now for backwards-compatibility, but please switch over soon if
you're using the
  widget for search.


* CapsuleMultiSelectWidget: Rename to CapsuleMultiselectWidget
(Bartosz Dziewoński)

  The capital letter on the 'S' is out of keeping with the rest of our
widgets, so
  we renamed it. The old name is left for backwards-compatibility for
at least one
  full release cycle, but please do switch over sooner rather than later.



Additional details are in the full changelog[0]. If you have any further queries
or need help dealing with deprecations, please let me know. As always, a general
set of library documentation is available on mediawiki.org[1], and there is some
comprehensive generated code-level documentation and interactive demos hosted on
doc.wikimedia.org[2].

[0] - https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
[1] - https://www.mediawiki.org/wiki/OOjs_UI
[2] - https://doc.wikimedia.org/oojs-ui/master/


Best,
Volker

--
Senior UX Engineer, Editing
Wikimedia Foundation

volker.e [at] wikimedia
@Volker_E

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] 2016-11-09 Scrum of Scrums meeting notes

[Grace Gellerman]

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-11-09

=2016-11-09=
==Product==
===Reading===
 Mobile Content Service 
* Deployed:
* Added more testing of response formats.
* Removed hard-coded blacklist for most-read. Now using a more dynamic
way to filter out  pages that should not appear in the list of most-read
articles.
* Working on figuring out a short-term and medium-term solution for too
small thumbnails for TFA and POTD in feed. (Once we get a better thumbnail
API then we would be eager to switch to that, of course.)

   - Extra info: The cause of this problem is that now summary data
   (including a thumbnail) for the feed gets hydrated using the details from
   the /page/summary endpoint, and that is currently always capping the
   thumbnail size to 320px. A potential medium-term solution would be to
   increase the thumnails size cap in the  summary endpoint from 320px to
   640px and have the clients change the thumbnail URLs to have the size
   capped to at most 320px for the items the client is showing at a smaller
   size (trending, link previews, ...).
   https://phabricator.wikimedia.org/T149450


Android
* Current sprint (https://phabricator.wikimedia.org/project/view/2331/):
* Continuing Q2 goals for Wikidata descriptions
* Beta coming soon
* Cleaned up lots of little tech debts
* Fix some UI bugs and memory leaks
* Next sprint:
* More Q2 goals for Wikidata descriptions (mostly polish)
Web
* Current sprint: https://phabricator.wikimedia.org/project/board/2336/

   - * Hovercards re-write


   - * Page images API change to return free and non-free images


   - * Bugfixes


   - * Trending service

* Next sprint:
* Similar to current sprint
* Also tech debt
iOS===
https://phabricator.wikimedia.org/project/view/2220/
* Last week:

   - * In the news - bug fixes, UI updates, & tweaks to notification
   scheduling logic


   - * Fixed remaining issues from persistance layer update


   - * Finished first pass of accessibility changes - VoiceOver
   improvements for the explore feed & both widgets

* This week:
* More 5.3.0 beta feedback & fixes
* Add donation announcement card to the news feed
* Set up nightly alpha builds and investigate speedup of automated
tests run on each pull request

 Reading Infrastructure 
* Not blocking/blocked
* finishing up action API error localization and pageview data integration
(T47843, T144865)
* planning to deploy the latter with PageViewInfo extension in first week
of December

=== Discovery: Interactive Team ===
* Launching  on ruwiki today
* Shared multilingual tabular and map data on Commons is on beta cluster,
getting ready for launch, hopefully within 1-2 weeks
** Posted on wikitech-l, FB, T134426
** Demo: https://en.wikipedia.beta.wmflabs.org/wiki/Maplink-page and
https://en.wikipedia.beta.wmflabs.org/wiki/Dimpvis_-_Fertility_vs_Life_Expectancy


=== Community Tech === // Sorry, I won't be able to make it to the meeting
today.
* Started with the wishlist survey this week:
https://meta.wikimedia.org/wiki/2016_Community_Wishlist_Survey
** Urge everyone to take a look and comment on proposals relevant to their
field of expertise
* Starting to work on updating CentralAuth migration scripts to populate
the additional fields added for global watchlist.
https://phabricator.wikimedia.org/T149111
* Work continues, albeit a little slowly, on the ticket for sending a
cookie with each block to prevent abuse:
https://phabricator.wikimedia.org/T5233
** Can use more reviews: https://gerrit.wikimedia.org/r/#/c/48029/
** Eventlogging for the feature: https://phabricator.wikimedia.org/T146230
* French copypatrol version ready to be deployed, waiting for Eranbot to
start getting data (i.e. plagiarized edit records) for frwiki

===Wikidata / WMDE===
* more work on automated sitelinks for Wiktionary (Cognate extension)
* Wikibase Repo federation / foreign repo access (for Wiktionary and
Commons support)
* RevisionSlider - out of beta (feature) for German and Arabic Wikipedia on Nov
22 (per community request)
* ElectronPDF
** extension had security review, we addressed the issues and wait for
review again
** depends on service to be deployed (it's also in security review)

== Technology ==
=== Analytics ===
* Blockers: none
* Blocked: none
Updates:
** Hiring: an offer is about to be made to a candidate, we continue to
review new candidates
** MediaWiki History (edits, users, pages, all projectws except commons
and wikisources) is being vetted, results seem good if not very good.
*** Varnishkafka errors are down to a not-yet-seen level with Varnish4.
Thanks Luca and the traffic team for the thorough work.

=== Architecture / ArchCom ===



=== Release Engineering ===
* Blocking
**
* Blocked
**
* Updates
** 1.28 rc.1 today
** Help squash boogz! https://phabricator.wikimedia.org/project/board/1982/


=== Security ===
* Security Reviews
  * Linter extension
* Continued work 

[Wikitech-l] Localizable data for Graphs and Templates on Commons

[Yuri Astrakhan]

Following the localizable maps example, here is a structured tabular data
example that also supports localization, shared data, and can be used
directly from the graphs or from Lua scripts on any wiki. Note that the
graph itself is in English wiki (labs), but data comes from Commons. Feel
free to add translations.

English:
https://en.wikipedia.beta.wmflabs.org/wiki/Dimpvis_-_Fertility_vs_Life_Expectancy
Russian:
https://en.wikipedia.beta.wmflabs.org/wiki/Dimpvis_-_Fertility_vs_Life_Expectancy?uselang=ru



On Mon, Nov 7, 2016 at 11:46 PM Yuri Astrakhan 
wrote:

> I would like to show one of the projects that Interactive team has been
> hacking on: localizable maps data (GeoJSON), stored on Commons, and usable
> from multiple wikis. I hope we can get it polished and enabled in
> production soon enough - so far, lab's beta cluster only:
>
> https://en.wikipedia.beta.wmflabs.org/wiki/Maplink-page
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Congratulations to {4} Outreachy'13 selects from Wikimedia

[Quim Gil]

Neslihan, Sejal, Anna, Zareen, welcome! I wish you interesting, productive,
and fun internships. I also encourage you to take the opportunity to meet
other technical contributors here, and also other Wikimedians (if there are
any) in your whereabouts.

Thank you Tony, Sumit and all the mentors and other supporters involved in
this Outreachy round.

On Tue, Nov 8, 2016 at 8:20 PM, Neslihan Turan 
wrote:

> Great!
> I can't wait for this project. Congrats to other 3 friends :)
>
> Neslihan
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>



-- 
Quim Gil
Engineering Community Manager @ Wikimedia Foundation
http://www.mediawiki.org/wiki/User:Qgil
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] 2016W45 ArchCom-RFC meeting: official thumb API

[Daniel Kinzler]

Hi all!


Today at the ArchoCom-RFC meeting [E355], we will talk about defining an
official thumbnail API [T66214]. At last week's ArchCom meeting, Gabriel said
that at least the first part of this RFC (without the hashing bit) is good for
an IRC meeting. So let's see how for we can get today.

Gabriel, can you say something regarding the status of the RFC, and the desired
outcome of today's meeting? Thanks!


The meeting will be at the usual time (Wednesday 21 UTC, 14 PDT, 23 CET)
and place (#wikimedia-office). For an overview of ArchCOm activity, see
[ArchComStatus].


-- Daniel


PS: my appologies for initially linking to the wrong RFC in [E355].


[E355]: 
[T66214]: 
[ArchComStatus]: 


-- 
Daniel Kinzler
Senior Software Developer

Wikimedia Deutschland
Gesellschaft zur Förderung Freien Wissens e.V.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Call graph creator applied to MediaWiki and extensions

[Seb35]

Hello,

I wanted to share a recent work I’ve done to better visualise the 
dependencies between classes, with the call graph [1].


For the extension I am currently developping (MediaWikiFarm [2]), I 
wanted to obtain the call graph. First I did it by hand, but then I 
found a program doing the job, phpCallGraph [3], but unfortunately it 
was unmaintained since 2009 (PHP 5.2 era). I did maintenance and it 
partly works [4], I still have issues with the autoloader.


Here are some preliminary results I got: (these are packages without 
much external dependencies due to autoloader issues)

* Extension:MediaWikiFarm

https://www.mediawiki.org/wiki/File:Call_graph_of_extension_MediaWikiFarm.svg
* Extension:Math
https://www.mediawiki.org/wiki/File:Call_graph_of_extension_Math.svg
* Extension:CentralAuth

https://www.mediawiki.org/wiki/File:Call_graph_of_extension_CentralAuth.svg
* directory 'includes' of MediaWiki without subdirectories (too big)

https://www.mediawiki.org/wiki/File:Call_graph_of_MediaWiki%E2%80%99s_directory_includes.svg

I plan to improve this software (see README on GitHub), please say if 
you if you are interested by this type of graph and/or interested in 
contributing.


Thanks,
Seb35

[1] https://en.wikipedia.org/wiki/Call_graph (the overapproximation of 
the static call graph to be precise)

[2] https://www.mediawiki.org/wiki/Extension:MediaWikiFarm
[3] http://phpcallgraph.sourceforge.net
[4] https://github.com/Seb35/phpcallgraph

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l