Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

Dan Andreescu wrote: > Maybe something exists already in Hadoop >> > > The page properties table is already loaded into Hadoop on a monthly basis > (wmf_raw.mediawiki_page_props). I haven't played with it much, but Hive > also has JSON-parsing goodies, so give it a shot and let me know if you

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

> > Maybe something exists already in Hadoop > The page properties table is already loaded into Hadoop on a monthly basis (wmf_raw.mediawiki_page_props). I haven't played with it much, but Hive also has JSON-parsing goodies, so give it a shot and let me know if you get stuck. In general, data

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

On Tue, Nov 10, 2020 at 5:50 PM Gergo Tisza wrote: > On Tue, Nov 3, 2020 at 1:59 AM Daniel Kinzler > wrote: > >> TemplateData already uses JSON serialization, but then compresses the >> JSON output, to make the data fit into the page_props table. This results >> in binary data in ParserOutput,

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

On Tue, Nov 3, 2020 at 1:59 AM Daniel Kinzler wrote: > TemplateData already uses JSON serialization, but then compresses the JSON > output, to make the data fit into the page_props table. This results in > binary data in ParserOutput, which we can't directly put into JSON. I'm not sure I

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

I saw in the patch for https://phabricator.wikimedia.org/T266200 a strategy was devised to base64-encode page prop values that aren't strictly UTF-8. If I understand correctly, this means TemplateData extension code and page props interfaces require no change while the JSONification of Parser

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

I don't know enough about the parser cache to give Daniel good advice on his question: > That's another issue I wanted to raise: Platform Engineeing is working on > switching ParserCache to JSON. For that, we have to make sure extensions > only put JSON-Serializable data into ParserOutput

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

On Thu, 5 Nov 2020 at 18:35, Dan Andreescu wrote: > On Tue, Nov 3, 2020 at 4:38 AM Daniel Kinzler > wrote: > >> Am 02.11.20 um 19:24 schrieb Daniel Kinzler: >> >> T262946 *"Bump Firefox >> version in basic support to 3.6 or newer"*: last call ending

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

On Wed, Nov 4, 2020 at 12:23 AM Krinkle wrote: > *RFC: Expiring watch list entries* > https://phabricator.wikimedia.org/T124752 > > This just missed the triage window, but it looks like this was implemented > and deployed meanwhile (it was in Phase 3). I'm proposing we put this on > Last Call

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

On Tue, Nov 3, 2020 at 4:38 AM Daniel Kinzler wrote: > Am 02.11.20 um 19:24 schrieb Daniel Kinzler: > > T262946 *"Bump Firefox > version in basic support to 3.6 or newer"*: last call ending on > Wednesday, November 4. Some comments, no objections. > >

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

*RFC: Expiring watch list entries* https://phabricator.wikimedia.org/T124752 This just missed the triage window, but it looks like this was implemented and deployed meanwhile (it was in Phase 3). I'm proposing we put this on Last Call for wider awareness and so that the team can answer any

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

Am 02.11.20 um 19:24 schrieb Daniel Kinzler: > > [Re-posting with fixed links. Thanks for pointing this out Cormac!] > > This is the weekly TechCom board review.  Remember that there is no meeting on > Wednesday, any discussion should happen via email. For individual RFCs, please > keep discussion

Re: [Wikitech-l] TechCom topics 2020-11-04 (fixed)

Am 02.11.20 um 19:24 schrieb Daniel Kinzler: > T262946 *"Bump Firefox version in > basic support to 3.6 or newer"*: last call ending on Wednesday, November 4. > Some comments, no objections. > Since we are not having a meeting on Wednesday, I guess we

[Wikitech-l] TechCom topics 2020-11-04 (fixed)

[Re-posting with fixed links. Thanks for pointing this out Cormac!] This is the weekly TechCom board review.  Remember that there is no meeting on Wednesday, any discussion should happen via email. For individual RFCs, please keep discussion to the Phabricator tickets. Activity since Monday

[Wikitech-l] TechCom topics 2020-11-04

This is the weekly TechCom board review.  Remember that there is no meeting on Wednesday, any discussion should happen via email. For individual RFCs, please keep discussion to the Phabricator tickets. Activity since Monday 2020-10-26 on the following boards: