[Wikitech-l] TechCom meeting 2020-11-18

[Krinkle]

The minutes from TechCom's triage meeting on 18 November 2020.

Present: Tim S, Daniel K, Timo T.
New RFC: Provide mechanism for overriding configuration for browser tests

   - https://phabricator.wikimedia.org/T267928
   - TT: High time we resource this. Some previous research on this when we
   transitioned browser tests from Ruby to Node/WebdriverIO. At the time, we
   wanted to keep the ability to run the same tests against local+CI+beta,
   which made this rather difficult.
   - Moved to P2.

RFC: Discourage use of MySQL's ENUM type

   - https://phabricator.wikimedia.org/T119173
   - DK: yes discourage by default
   - TS: Jaime mentioned that ENUM's sort differently from text, but also
   said we shouldn't ban it outright.
   - TT: as proposed sounds right. generally there are better solutions,
   but as justified optimization specific high-scale uses could be allowed.

RFC: Drop support for database upgrade older than two LTS releases

   - https://phabricator.wikimedia.org/T259771
   - TT: principally seems fine, not aware of concerns. we'd want to make
   sure we cover the failure scenarios, e.g. not just soft documentation, but
   actually programmatically detected and prevent disaster. I'll comment
   on-task.
   - DK: Platform team as stakeholder for ..?
   - TT: I guess potential veto in terms of what the minimum support should
   be, and if okay with trailing/dropping, then how long it has to be.

RFC: Expiring watch list entries

   - https://phabricator.wikimedia.org/T262946
   - Last Call ended. Approved.

RFC: Shellbox microservice for MediaWiki

   - https://phabricator.wikimedia.org/T260330
   - TT: Worth noting that it is an optional service. The current logic
   remains the same as before and Shell-exec call API also remains compatible.
   The library can effectively now be put into a container and MW configured
   to use that rather than calling directly.
   - Put on Last Call until 2 December.

Next week IRC office hoursNo IRC discussion scheduled for next week.


You can also find our meeting minutes at
https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes

If you prefer you can subscribe to our newsletter here
https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar

-- Timo
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] How to get a list of usercontribs for a given date range?

[Bartosz Dziewoński]

On 2020-11-18 12:56, John wrote:
Thats not how those parameters work. You use either or, not both. You 
are either going forward or backwards thru the contribs based on which 
you use. You need to apply some logic on the application layer to filter 
the results to what you need.


This is incorrect, you can use both 'ucstart' and 'ucend' in one query.

--
Bartosz Dziewoński

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] How to get a list of usercontribs for a given date range?

[Bartosz Dziewoński]

The contributions are listed in reverse chronological order (newest 
first), so your 'ucstart' and 'ucend' parameters also need to be 
reversed ('ucstart' is the newer timestamp, 'ucend' is the earlier). 
This works:


https://ta.wikisource.org/wiki/சிறப்பு:ApiSandbox#action=query=json=usercontribs=2020-11-17T19%3A34%3A26.000Z=2020-11-14T19%3A34%3A26.000Z=Fathima%20Shaila

Alternatively, you can choose to list the contributions in chronological 
order (earliest first) using 'ucdir=newer', in which case 'ucstart' and 
'ucend' are opposite, like in your original query:


https://ta.wikisource.org/wiki/சிறப்பு:ApiSandbox#action=query=json=usercontribs=2020-11-14T19%3A34%3A26.000Z=2020-11-17T19%3A34%3A26.000Z=Fathima%20Shaila=newer

--
Bartosz Dziewoński

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Cloud VPS users, please claim your projects -- deadline approaching!

[Andrew Bogott]

There are still 39 unclaimed cloud-vps projects which will be shut down 
at the end of the month.  Please have a look at this list; if there's 
anything on here that you care about, please visit 
https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge and mark 
the project as in use.


asyncwiki
blog
butterfly
centralnotice-staging
cloudstore
collection-alt-renderer
commons-corruption-checker
commonsarchive
discovery-stats
etytree
fastcci
finding-glams
getstarted
grantreview
gratitude
ign2commons
iiab
lizenzhinweisgenerator
lta-tracker
math
meza
ogvjs-integration
openocr
orch
puppet
sccache
security-tools
snuggle
videowiki
wcdo
wdqs-scaling
wikidata-federation
wikidata-history-query-service
wikidata-primary-sources-tool
wikidata-realtime-dumps
wikidumpparse
wikiloop
wikimania-scholarships
wikitextexp



___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Fwd: [Wikimedia-l] Call for insights on ways to better communicate the work of the movement

[Chris Koerner]

Sorry for the cross-posting. Wanting to make sure folks in this community
are involved too!

-- Forwarded message -
From: Elena Lappen 
Date: Wed, Nov 18, 2020 at 6:27 PM
Subject: [Wikimedia-l] Call for insights on ways to better communicate the
work of the movement
To: Wikimedia Mailing List 


Dear all,

The Movement Strategy recommendations published this year made clear the
importance of establishing stronger communications within our movement.

To this end, the Foundation wants to gather insights from communities on
ways we all might more consistently communicate about our collective work,
and better highlight community contributions from across the movement. Over
the coming months, we will be running focus groups and online discussions
to collect these insights. Individual focus groups will include 10-15
volunteers who will be asked to share insights on specific questions as
part of a facilitated discussion.

How can we best communicate with your community on an ongoing basis? In
what ways does the Foundation currently support your work?  We ask you to
share your thoughts on these and other questions by signing up for a focus
group by the end of Wednesday, 2 December, or participating in the
discussion on Meta-Wiki [1].

We would like to collect feedback from across the movement, representing a
wide range of insights and opinions. We will be working to build as many
focus groups as possible, but want to be upfront that we may face
limitations on the number of groups we can convene based on the level of
interest. However, if you would like to discuss your thoughts in detail, we
are also offering the chance to connect with the Communications team in
other ways, including individual and group meetings and office hours [2].

Initial discussions are happening between now and January 2021. We invite
you to join the conversation, and look forward to working together to
explore some important questions.


[1] https://meta.wikimedia.org/wiki/Movement_communications_insights
[2]
https://meta.wikimedia.org/wiki/Movement_communications_insights#Office_hours

--
Elena Lappen (she/her)
Community Relations Specialist
Wikimedia Foundation
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] 2020-11-18 Scrum of Scrums meeting notes

[Grace Gellerman]

https://www.mediawiki.org/wiki/Scrum_of_scrums/2020-11-18

*= 2020-11-18 =*

== Callouts ==
* SRE
** ICU 63 upgrade (has MediaWiki impact) -
https://phabricator.wikimedia.org/T264991
*** enwiki notification up in VP already:

https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Update_to_ICU_Unicode_library
** Sporadic and weird issues with Italian ISPs continue. SRE is aware and
working on them.  contact cdanis@ if you have more debugging data to share
* RelEng
** No Train next week
** No deploys next week Wed-Friday


== SoS Meeting Bookkeeping ==
* Updates:

== TechCom ==
* Blocking:

== Product ==

=== Community Tech ===
* Blocked by: -
* Blocking: -
* Updates: The Community Wishlist Survey is now live and that's gonna be
our main focus for the following 6 weeks

=== Anti-Harassment Tools ===
* Blocked by:
* Blocking:
* Updates:

=== Editing ===
* Blocked by:
* Blocking:
* Updates:

=== Growth ===
* Blocked by:
* Blocking:
* Updates:

=== iOS native app ===
* Blocked by:
* Blocking:
* Updates:

=== Android native app ===
* Blocked by:
* Blocking:
* Updates:

=== Web ===
* Blocked by:
LangEng: Finishing up some changes to make ULS compatible with desktop
improvements (
https://gerrit.wikimedia.org/r/c/mediawiki/extensions/UniversalLanguageSelector/+/635679)
* Blocking:
n/a
* Updates:
Main focus is on finishing the work on the Vue search study. A
VueTaskForce is meeting this week.

=== Product Infrastructure ===
* Blocked by:
* Blocking:
* Updates:

=== Structured Data ===
* Blocked by: -
* Blocking: -
* Updates:
** Commons Media Search: continuing to add features and make UI
improvements, exploring some potential methods for using wikidata to
improve search results (e.g. traversing entity trees, using aliases)
** Media matching: in discussions with other teams to determine how this
project overlaps with others

=== Abstract Wikipedia ===
* Blocked by:
** —
* Blocking:
** —
* Updates:
**The [[m:Abstract_Wikipedia/Wiki_of_functions_naming_contest|community
contest]] for the name of the central wiki of functions has now closed, and
the result is being reviewed with Legal and Comms. Our thanks to all who
voted.
** Continuing work on using ZType data to enforce structure when editing
ZObjects.
** Huge thanks to Daimona and DannyS712 for helping with a Phan issue
blocking us from merging code T268055


=== Parsing ===
* Blocked by:
** This is a followup on a SoS update from a few weeks back. We would like
Parsoid clients ( VisualEditor, ContentTranslation, StructuredDiscussion,
MCS/PCS ) to act onhttps://phabricator.wikimedia.org/T266143 sooner than
later. This should likely be a minor tweak in client code. We need
confirmation that clients can handle this switch before we can make
progress on making that change in Parsoid. Either leave a note on that phab
task once you are done, or create a subtask and resolve it.
* Blocking:
* Updates:
 ** no updates

=== Language ===
* Blocked by:
* Blocking:
** Web. Should be unblocked this week.
* Updates:
** T264756 Working on technical implementation plan for translatable
modules. Will make it public for feedback soon.
** T254481 Doing final tests on "Support sending TechNews using
Special:MassMessage"
** T182433 Developing "Strong synchonization" for translatewiki.net which
is a prerequisite for fully automated translation exports
** We fixed a bunch of production JavaScript errors in ULS. Fixes are
waiting to be deployed.
** Polishing section translation MVP

=== Inuka ===
* Blocked by: -
* Blocking: -
* Updates:
** KaiOS app
*** Submitted to KaiStore
*** Addressing usability study feedback (colours, icons, copy, ...)
*** Production errors
** Wikipedia Preview
*** Oozie job for data analysis
*** Image focus mode
*** Multilines caption

=== UI Standardization ===
* Blocked by:
* Blocking:
* Updates:


=== Library ===
* Blocked by: Waiting to hear back from Cloud Services on question about
IDS/IPS for Cloud infrastructure
* Blocking: -
* Updates: Fixed a bug in Wikipedia Library that denied some users access
to the library bundle when they should've had it. Refactoring of Wikilinks
UI underway to improve performance.

== Technology ==

=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
- Adjustments to allow migration of legacy EventLogging schemas to
Event Platform.
- Fleshed out plan to migrate cluster to Apache BigTop and Hadoop coord
failover.
- Performance improvements of webrequest job, reduce CPU time and data
relocation.
- Fix bug in pageview_complete dumps (replacement of pagecounts).

=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:

=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** SRE deployed a change to stop iOS app launching for
thankyou.wikipedia.org, we need to test
** Quieting down noisy logs in preparation for end of year fundraiser
** Switching dev environment from vagrant to docker

=== Platform ===
* Blocked by:
* Blocking:
** Code review on 

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

[Adam Baso]

Dan Andreescu  wrote:

> Maybe something exists already in Hadoop
>>
>
> The page properties table is already loaded into Hadoop on a monthly basis
> (wmf_raw.mediawiki_page_props).  I haven't played with it much, but Hive
> also has JSON-parsing goodies, so give it a shot and let me know if you get
> stuck.  In general, data from the databases can be sqooped into Hadoop.  We
> do this for large pipelines like edit history
> 
>  and
> it's very easy
> 
> to add a table.  We're looking at just replicating the whole db on a more
> frequent basis, but we have to do some groundwork first to allow
> incremental updates (see Apache Iceberg if you're interested).
>
>
Yes, I like that and all of the other wmf_raw goodies! I'll follow up off
thread on accessing the parser cache DBs (they're in site.pp and
db-eqiad.php, but I don't think those are presently represented by
refinery.util as they're not in .dblist files).
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] How to get a list of usercontribs for a given date range?

[John]

Thats not how those parameters work. You use either or, not both. You are
either going forward or backwards thru the contribs based on which you use.
You need to apply some logic on the application layer to filter the results
to what you need.

On Wed, Nov 18, 2020 at 6:50 AM Shrinivasan T 
wrote:

> Hello all,
>
> I want to get a usercontrib details of a wikisource user in given date
> range.
>
> Trying this
>
>
> https://ta.wikisource.org/wiki/Special:ApiSandbox#action=query=json=usercontribs=2020-11-14T19%3A34%3A26.000Z=2020-11-17T19%3A34%3A26.000Z=Fathima
> Shaila
>
> if I give only ucstart, it works fine.
> adding ucend gives 0 result.
>
> Need help on solving this.
>
> Share your thoughts on how to solve this.
>
> Thanks.
>
> --
> Regards,
> T.Shrinivasan
>
>
> My Life with GNU/Linux : http://goinggnu.wordpress.com
> Free E-Magazine on Free Open Source Software in Tamil : http://kaniyam.com
>
> Get Free Tamil Ebooks for Android, iOS, Kindle, Computer :
> http://FreeTamilEbooks.com
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] How to get a list of usercontribs for a given date range?

[Shrinivasan T]

Hello all,

I want to get a usercontrib details of a wikisource user in given date
range.

Trying this

https://ta.wikisource.org/wiki/Special:ApiSandbox#action=query=json=usercontribs=2020-11-14T19%3A34%3A26.000Z=2020-11-17T19%3A34%3A26.000Z=Fathima
Shaila

if I give only ucstart, it works fine.
adding ucend gives 0 result.

Need help on solving this.

Share your thoughts on how to solve this.

Thanks.

-- 
Regards,
T.Shrinivasan


My Life with GNU/Linux : http://goinggnu.wordpress.com
Free E-Magazine on Free Open Source Software in Tamil : http://kaniyam.com

Get Free Tamil Ebooks for Android, iOS, Kindle, Computer :
http://FreeTamilEbooks.com
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l