[Wikitech-l] Phabricator monthly statistics - 2017-07

[communitymetrics]

Hi Community Metrics team,

This is your automatic monthly Phabricator statistics mail.

Accounts created in (2017-07): 432
Active Maniphest users (any activity) in (2017-07): 888
Task authors in (2017-07): 499
Users who have closed tasks in (2017-07): 280

Projects which had at least one task moved from one column to another on
their workboard in (2017-07): 293

Tasks created in (2017-07): 2776
Tasks closed in (2017-07): 2267
Open and stalled tasks in total: 35168

Median age in days of open tasks by priority:

Unbreak now: 25
Needs Triage: 295
High: 532
Normal: 720
Low: 966
Lowest: 946

(How long tasks have been open, not how long they have had that priority)

Active Differential users (any activity) in (2017-07): 24

TODO: Numbers which refer to closed tasks might not be correct, as
described in https://phabricator.wikimedia.org/T1003 .

Yours sincerely,
Fab Rick Aytor

(via community_metrics.sh on iridium at Tue Aug  1 00:00:23 UTC 2017)

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Readers monthly update for July 2017

[Chris Koerner]

Hi everyone,
Here is the monthly update from Readers (previously Reading) department at
the Wikimedia Foundation for July 2017.

As always, feedback and questions are welcome.


==Discussions==

=== Apps===
* Development of ZIM file and offline compilations support continues.
* Continuing to work on improved Reading lists feature, addressing user
reports and preparing for syncing functionality. [0]
* We're working on an initial set of downloadable compilations to be
available in the Android app. [1]
* For iOS we'll be releasing version 5.6 next week, and are just wrapping
up testing.
* Version 5.6 of iOS features sepia and dark reading modes, On this day
timelines and public domain Wikipedia themed stickers for iMessage [2] [3]
[4]

=== Web ===
* We found and reported a quite serious bug in the Firefox browser. [5]
* We're working on some style improvements to the print styles of desktop
pages and PDFs. [6]
* Page previews is coming to all wikis excluding German and English! [7]
* We're working on allowing Page previews to display html previews
* We're considering |adding a namespace filter to Special:ShortPages. Would
this be useful to people? Please let us know! [8]

=== New Readers ===
* New Reader updates can be found at Meta]. [9]

=== Multimedia ===
* We identified must-do 3D tasks in anticipation of a future launch, and
have a few outstanding bugs to resolve before being feature complete. [10]
An additional Wikilegal discussion on 3D has been initiated; depending on
the outcome some interface changes may be required before launch. [11]

=== Discovery ===
The Discovery team provides weekly updates. Here are their updates for the
month.
* 2017-07-03 [12]
* 2017-07-10 [13]
* 2017-07-17 [14]
* 2017-07-24 [15]


[0] https://www.mediawiki.org/wiki/Wikimedia_Apps/Synced_Reading_Lists
[1] https://phabricator.wikimedia.org/T169905
[2] https://phabricator.wikimedia.org/T169142
[3] https://en.wikipedia.org/wiki/Wikipedia:Selected_anniversaries
[4] https://commons.wikimedia.org/wiki/Category:Wikipedia_digital_stickers
[5] https://bugzilla.mozilla.org/show_bug.cgi?id=1379762
[6] https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality
[7] https://phabricator.wikimedia.org/T162672
[8] https://phabricator.wikimedia.org/T170687
[9] https://meta.wikimedia.org/wiki/New_Readers/Updates
[10]
https://phabricator.wikimedia.org/project/board/48/query/GMIMsF0oKK9t/?filter=GMIMsF0oKK9t=priority
[11] https://meta.wikimedia.org/wiki/Wikilegal/3D_files_and_3D_printing
[12] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-07-03
[13] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-07-10
[14] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-07-17
[15] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-07-24

---

The archive of all past updates can be found on MediaWiki.org:

https://www.mediawiki.org/wiki/Reading/Status_updates


Yours,
Chris Koerner
Community Liaison
Wikimedia Foundation
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Discovery Weekly Update for the week starting 2017-07-24

[Chris Koerner]

Greetings,

This is the weekly update for Discovery.

As always, feedback and questions are welcome.

== Discussions ==

=== Search ===
* Erik's bugfixes: T171009 (don't issue a near match query with empty
query), T171155 (match redirects with the ''intitle'' keyword).  [0] [1]
* Stas' Wikidata entity search with Elastic is in testing [2] [3]
* Stas' work on the archive search is in final call, to be enabled next
week. [4]
* David worked on collecting features from the sltr query by using a custom
Accumulator to collect feature names and extracting feature vectors from
the ltr plugin [5]
* Trey's language analysis analysis tools will soon be released in
RelForge. See phab ticket T171516. [6] Comments on the extensive/excessive
documentation copied to MediaWiki are welcome. [7]

=== Analysis  ===
* Chelsy found a bug in the ''renderMenu'' function in ''shinydashboard''
package that was fixed—but we need to wait for latest version to be
uploaded to CRAN before we can patch our instance [8]

=== Interactive ===
* Mapframe was enabled for cswiki by a volunteer contributor. [0]

[0] https://phabricator.wikimedia.org/T171009
[1] https://phabricator.wikimedia.org/T171155
[2]
https://www.wikidata.org/wiki/Wikidata:Project_chat#wbsearchentities_with_ElasticSearch_test
[3] http://elastic-wikidata.wmflabs.org/wb.html
[4] https://phabricator.wikimedia.org/T163235
[5] https://phabricator.wikimedia.org/T168813
[6] https://phabricator.wikimedia.org/T171516
[7]
https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Analysis_Analysis_Tools
[8] https://phabricator.wikimedia.org/T170724
[9] https://phabricator.wikimedia.org/T171588

--

The archive of all past updates can be found on MediaWiki.org:

https://www.mediawiki.org/wiki/Discovery/Status_updates

Interested in getting involved? See tasks marked as "Easy" or "Volunteer
needed" in Phabricator.

[1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R
[2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R

Yours,
Chris Koerner
Community Liaison
Wikimedia Foundation
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Analytics] Wikiscan statistics tool for Wikimedia projects

[Akeron]

Thanks Eric, it looks interesting. Actually I am able to maintain a full
dataset for users but not for pages on big wikis, it may be a good
alternative to display the approximative number of edited pages over a
month or more.

2017-07-31 17:22 GMT+02:00 Erik Bernhardson :

> On Mon, Jul 31, 2017 at 7:18 AM, Akeron  wrote:
>
>> Hi Igal,
>> All suggestions are welcome :)
>> Supporting this feature shouldn't be too difficult in theory because it
>> is already working with this kind of aggregation (month are built from
>> days, years from months...). The main problem is scalability for stats
>> which require uniqueness like number of users or number of edits *per
>> page*. That's why yearly stats can actually be disabled on some big wikis.
>> So it would be feasible but with edits limitations for the range (like 3-5
>> millions) and it would be very slow to load with lots of edits.
>>
>
> One way to handle the scalability problem is to use HyperLogLog counters.
> These are an approximate algorithm for which you can store daily counters,
> and then merge the counters to get weekly/monthly/etc, avoiding the cost of
> doing the calculation over something like an entire year just for the one
> stat.  Of course because these are approximate they may not be exactly what
> you are looking for, just an idea.
>
>
>>
>> Akeron
>>
>> 2017-07-31 14:29 GMT+02:00 יגאל חיטרון :
>>
>>> Hello. It's amazing, thank you very much!
>>> Could I suggest one more feature, please? With it, the tool will be
>>> perfect. I'm talking about aggregation. Any kind of historical statistics
>>> for some day, month or year can be also shown as range of time. For
>>> example, if we have month statistics, we could fill From field to be Jan
>>> 2008 and To field to be May 2011, and get the aggregated numbers for this
>>> range. Is it possible?
>>> Thank you very much again,
>>> Igal (User:IKhitron)
>>>
>>> On Jul 30, 2017 22:18, "Pine W"  wrote:
>>>
>>> > Wikiscan is an interesting tool for statistics fans. I suggest briefly
>>> > reading this IEG page
>>> > , then
>>> > playing with the tool on https://wikiscan.org/
>>> >
>>> > Pine
>>> > ___
>>> > Wikitech-l mailing list
>>> > Wikitech-l@lists.wikimedia.org
>>> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>>> ___
>>> Wikitech-l mailing list
>>> Wikitech-l@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>>
>>
>>
>> ___
>> Analytics mailing list
>> analyt...@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/analytics
>>
>>
>
> ___
> Analytics mailing list
> analyt...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/analytics
>
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Wikiscan statistics tool for Wikimedia projects

[יגאל חיטרון]

I see. Pity.
Igal

On Jul 31, 2017 19:38, "Akeron"  wrote:

> It depends of the size of the dataset, if you already know the pages or
> users you want to compare (limited dataset with reasonable quantity) then
> there is no scalability issue and it should not be too difficult to
> implement. Otherwise it require a lot of resources to merge the numbers for
> every pages or users over the period with a large dataset.
>
>
> 2017-07-31 16:59 GMT+02:00 יגאל חיטרון :
>
> > Thank you. I will not say that I understood your explanation, but I'll
> try:
> > If you have number of viewers of some page for every year, can't you get
> > the sum of them and compare with another page to sort them? And the same
> > for the number of some user's edits?
> > Igal
> >
> > On Jul 31, 2017 17:19, "Akeron"  wrote:
> >
> > > Hi Igal,
> > > All suggestions are welcome :)
> > > Supporting this feature shouldn't be too difficult in theory because it
> > is
> > > already working with this kind of aggregation (month are built from
> days,
> > > years from months...). The main problem is scalability for stats which
> > > require uniqueness like number of users or number of edits *per page*.
> > > That's why yearly stats can actually be disabled on some big wikis. So
> it
> > > would be feasible but with edits limitations for the range (like 3-5
> > > millions) and it would be very slow to load with lots of edits.
> > >
> > > Akeron
> > >
> > > 2017-07-31 14:29 GMT+02:00 יגאל חיטרון :
> > >
> > > > Hello. It's amazing, thank you very much!
> > > > Could I suggest one more feature, please? With it, the tool will be
> > > > perfect. I'm talking about aggregation. Any kind of historical
> > statistics
> > > > for some day, month or year can be also shown as range of time. For
> > > > example, if we have month statistics, we could fill From field to be
> > Jan
> > > > 2008 and To field to be May 2011, and get the aggregated numbers for
> > this
> > > > range. Is it possible?
> > > > Thank you very much again,
> > > > Igal (User:IKhitron)
> > > >
> > > > On Jul 30, 2017 22:18, "Pine W"  wrote:
> > > >
> > > > > Wikiscan is an interesting tool for statistics fans. I suggest
> > briefly
> > > > > reading this IEG page
> > > > > ,
> > then
> > > > > playing with the tool on https://wikiscan.org/
> > > > >
> > > > > Pine
> > > > > ___
> > > > > Wikitech-l mailing list
> > > > > Wikitech-l@lists.wikimedia.org
> > > > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> > > > ___
> > > > Wikitech-l mailing list
> > > > Wikitech-l@lists.wikimedia.org
> > > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> > > ___
> > > Wikitech-l mailing list
> > > Wikitech-l@lists.wikimedia.org
> > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> >
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Wikiscan statistics tool for Wikimedia projects

[Akeron]

It depends of the size of the dataset, if you already know the pages or
users you want to compare (limited dataset with reasonable quantity) then
there is no scalability issue and it should not be too difficult to
implement. Otherwise it require a lot of resources to merge the numbers for
every pages or users over the period with a large dataset.


2017-07-31 16:59 GMT+02:00 יגאל חיטרון :

> Thank you. I will not say that I understood your explanation, but I'll try:
> If you have number of viewers of some page for every year, can't you get
> the sum of them and compare with another page to sort them? And the same
> for the number of some user's edits?
> Igal
>
> On Jul 31, 2017 17:19, "Akeron"  wrote:
>
> > Hi Igal,
> > All suggestions are welcome :)
> > Supporting this feature shouldn't be too difficult in theory because it
> is
> > already working with this kind of aggregation (month are built from days,
> > years from months...). The main problem is scalability for stats which
> > require uniqueness like number of users or number of edits *per page*.
> > That's why yearly stats can actually be disabled on some big wikis. So it
> > would be feasible but with edits limitations for the range (like 3-5
> > millions) and it would be very slow to load with lots of edits.
> >
> > Akeron
> >
> > 2017-07-31 14:29 GMT+02:00 יגאל חיטרון :
> >
> > > Hello. It's amazing, thank you very much!
> > > Could I suggest one more feature, please? With it, the tool will be
> > > perfect. I'm talking about aggregation. Any kind of historical
> statistics
> > > for some day, month or year can be also shown as range of time. For
> > > example, if we have month statistics, we could fill From field to be
> Jan
> > > 2008 and To field to be May 2011, and get the aggregated numbers for
> this
> > > range. Is it possible?
> > > Thank you very much again,
> > > Igal (User:IKhitron)
> > >
> > > On Jul 30, 2017 22:18, "Pine W"  wrote:
> > >
> > > > Wikiscan is an interesting tool for statistics fans. I suggest
> briefly
> > > > reading this IEG page
> > > > ,
> then
> > > > playing with the tool on https://wikiscan.org/
> > > >
> > > > Pine
> > > > ___
> > > > Wikitech-l mailing list
> > > > Wikitech-l@lists.wikimedia.org
> > > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> > > ___
> > > Wikitech-l mailing list
> > > Wikitech-l@lists.wikimedia.org
> > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Analytics] Wikiscan statistics tool for Wikimedia projects

[Erik Bernhardson]

On Mon, Jul 31, 2017 at 7:18 AM, Akeron  wrote:

> Hi Igal,
> All suggestions are welcome :)
> Supporting this feature shouldn't be too difficult in theory because it is
> already working with this kind of aggregation (month are built from days,
> years from months...). The main problem is scalability for stats which
> require uniqueness like number of users or number of edits *per page*.
> That's why yearly stats can actually be disabled on some big wikis. So it
> would be feasible but with edits limitations for the range (like 3-5
> millions) and it would be very slow to load with lots of edits.
>

One way to handle the scalability problem is to use HyperLogLog counters.
These are an approximate algorithm for which you can store daily counters,
and then merge the counters to get weekly/monthly/etc, avoiding the cost of
doing the calculation over something like an entire year just for the one
stat.  Of course because these are approximate they may not be exactly what
you are looking for, just an idea.


>
> Akeron
>
> 2017-07-31 14:29 GMT+02:00 יגאל חיטרון :
>
>> Hello. It's amazing, thank you very much!
>> Could I suggest one more feature, please? With it, the tool will be
>> perfect. I'm talking about aggregation. Any kind of historical statistics
>> for some day, month or year can be also shown as range of time. For
>> example, if we have month statistics, we could fill From field to be Jan
>> 2008 and To field to be May 2011, and get the aggregated numbers for this
>> range. Is it possible?
>> Thank you very much again,
>> Igal (User:IKhitron)
>>
>> On Jul 30, 2017 22:18, "Pine W"  wrote:
>>
>> > Wikiscan is an interesting tool for statistics fans. I suggest briefly
>> > reading this IEG page
>> > , then
>> > playing with the tool on https://wikiscan.org/
>> >
>> > Pine
>> > ___
>> > Wikitech-l mailing list
>> > Wikitech-l@lists.wikimedia.org
>> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>> ___
>> Wikitech-l mailing list
>> Wikitech-l@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
>
>
> ___
> Analytics mailing list
> analyt...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/analytics
>
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Wikiscan statistics tool for Wikimedia projects

[יגאל חיטרון]

Thank you. I will not say that I understood your explanation, but I'll try:
If you have number of viewers of some page for every year, can't you get
the sum of them and compare with another page to sort them? And the same
for the number of some user's edits?
Igal

On Jul 31, 2017 17:19, "Akeron"  wrote:

> Hi Igal,
> All suggestions are welcome :)
> Supporting this feature shouldn't be too difficult in theory because it is
> already working with this kind of aggregation (month are built from days,
> years from months...). The main problem is scalability for stats which
> require uniqueness like number of users or number of edits *per page*.
> That's why yearly stats can actually be disabled on some big wikis. So it
> would be feasible but with edits limitations for the range (like 3-5
> millions) and it would be very slow to load with lots of edits.
>
> Akeron
>
> 2017-07-31 14:29 GMT+02:00 יגאל חיטרון :
>
> > Hello. It's amazing, thank you very much!
> > Could I suggest one more feature, please? With it, the tool will be
> > perfect. I'm talking about aggregation. Any kind of historical statistics
> > for some day, month or year can be also shown as range of time. For
> > example, if we have month statistics, we could fill From field to be Jan
> > 2008 and To field to be May 2011, and get the aggregated numbers for this
> > range. Is it possible?
> > Thank you very much again,
> > Igal (User:IKhitron)
> >
> > On Jul 30, 2017 22:18, "Pine W"  wrote:
> >
> > > Wikiscan is an interesting tool for statistics fans. I suggest briefly
> > > reading this IEG page
> > > , then
> > > playing with the tool on https://wikiscan.org/
> > >
> > > Pine
> > > ___
> > > Wikitech-l mailing list
> > > Wikitech-l@lists.wikimedia.org
> > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Wikiscan statistics tool for Wikimedia projects

[Akeron]

Hi Igal,
All suggestions are welcome :)
Supporting this feature shouldn't be too difficult in theory because it is
already working with this kind of aggregation (month are built from days,
years from months...). The main problem is scalability for stats which
require uniqueness like number of users or number of edits *per page*.
That's why yearly stats can actually be disabled on some big wikis. So it
would be feasible but with edits limitations for the range (like 3-5
millions) and it would be very slow to load with lots of edits.

Akeron

2017-07-31 14:29 GMT+02:00 יגאל חיטרון :

> Hello. It's amazing, thank you very much!
> Could I suggest one more feature, please? With it, the tool will be
> perfect. I'm talking about aggregation. Any kind of historical statistics
> for some day, month or year can be also shown as range of time. For
> example, if we have month statistics, we could fill From field to be Jan
> 2008 and To field to be May 2011, and get the aggregated numbers for this
> range. Is it possible?
> Thank you very much again,
> Igal (User:IKhitron)
>
> On Jul 30, 2017 22:18, "Pine W"  wrote:
>
> > Wikiscan is an interesting tool for statistics fans. I suggest briefly
> > reading this IEG page
> > , then
> > playing with the tool on https://wikiscan.org/
> >
> > Pine
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Wikiscan statistics tool for Wikimedia projects

[יגאל חיטרון]

Hello. It's amazing, thank you very much!
Could I suggest one more feature, please? With it, the tool will be
perfect. I'm talking about aggregation. Any kind of historical statistics
for some day, month or year can be also shown as range of time. For
example, if we have month statistics, we could fill From field to be Jan
2008 and To field to be May 2011, and get the aggregated numbers for this
range. Is it possible?
Thank you very much again,
Igal (User:IKhitron)

On Jul 30, 2017 22:18, "Pine W"  wrote:

> Wikiscan is an interesting tool for statistics fans. I suggest briefly
> reading this IEG page
> , then
> playing with the tool on https://wikiscan.org/
>
> Pine
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l