Re: [Wikitech-l] Wikipedia dumps for Article with Category

[Bináris]

I think all language versions must have the same basic structure. In huwiki
I mostly use pages-articles.xml.bz2 As category is part of page text as
well as redirect target, and namespace can be derived from title, you have
all these information in any dump that has page text. For example,
Pywikibot can work with categories from this dump.

2016-09-26 5:55 GMT+02:00 Abdulfattah Safa :

> Hi,
>
> In Wikipedia dumps for Arabic (arwiki), which dump does contain the article
> categories along with article metadata (namespace, redirects, content,
> etc..)?
>
>
> --
> Regards,
> Abdulfattah Safa
> Senior Software Engineer
> Mobile: (+972)(599)231600
> Skype: fattah.safa
>
> *P **Please consider the environment before printing this email*
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l




-- 
Bináris
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Wikipedia dumps for Article with Category

[Abdulfattah Safa]

Hi,

In Wikipedia dumps for Arabic (arwiki), which dump does contain the article
categories along with article metadata (namespace, redirects, content,
etc..)?


-- 
Regards,
Abdulfattah Safa
Senior Software Engineer
Mobile: (+972)(599)231600
Skype: fattah.safa

*P **Please consider the environment before printing this email*
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Bryan Davis]

On Sun, Sep 25, 2016 at 6:41 AM, Tim Starling  wrote:
> On 25/09/16 21:09, Bináris wrote:
>> Hi,
>>
>> I try to familiarize myself with Gerrit which is not a good example for
>> user-friendly interface.
>> I noticed a letter B in the upper right corner of the screen, and I
>> suspected it could be a portion of my login name. So I looked at it in HTML
>> source, and it was. I pushed my mouse on it and I got another half window
>> as attached.
>>
>> So did somebody perhaps wire the size of a 25" monitor into page rendering?
>> My computer is a Samsung notebook.
>
> In T38471 I complained that the old version was too wide at 1163px
> (for my dashboard on a random day). Now the new version is 1520px. I'm
> not sure if the Gerrit folks are serious or are trolling us. Perhaps
> it is a tactic to encourage UI code contributions?

Sadly I don't think that's the case as the upstream has moved on to
building yet another UI layer to replace the one that we are currently
using [0].

I hacked the heck out of the CSS to make things fit in my ~1024px
preferred browser width [1]. There is a greasemonkey script that will
apply this css [2]. Perhaps some other folks could test this css out
and see if I would be a useful change to add to the stylesheet
overrides already in use by the WMF's deployment.

[0]: https://gerrit.googlesource.com/gerrit/+/master/polygerrit-ui/
[1]: https://github.com/bd808/userscripts/blob/gh-pages/wmfgerrit.user.css
[2]: http://bd808.com/userscripts/wmfgerrit.user.js

Bryan
-- 
Bryan Davis  Wikimedia Foundation
[[m:User:BDavis_(WMF)]]  Sr Software EngineerBoise, ID USA
irc: bd808v:415.839.6885 x6855

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Marcin Cieslak]

Dnia 25.09.2016 Tim Starling  napisał/a:
> On 25/09/16 21:09, Bináris wrote:
>> Hi,
>> 
>> I try to familiarize myself with Gerrit which is not a good example for
>> user-friendly interface.
>> I noticed a letter B in the upper right corner of the screen, and I
>> suspected it could be a portion of my login name. So I looked at it in HTML
>> source, and it was. I pushed my mouse on it and I got another half window
>> as attached.
>> 
>> So did somebody perhaps wire the size of a 25" monitor into page rendering?
>> My computer is a Samsung notebook.
>
> In T38471 I complained that the old version was too wide at 1163px
> (for my dashboard on a random day). Now the new version is 1520px.

This is something strange, on a Windows box with FF 49 I only need 1075px
when not logged in and 1090px when logged into not to have a scroll bar.
(Keep in mind that "saper" is short).

On FreeBSD's oldish Firefox, the username part almost always is hanging off.
With ca. 1400 px it is enough (if only the screen was wide enough).

Something with fonts?

Saper


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Antoine Musso]

On 25/09/16 13:09, Bináris wrote:

Hi,

I try to familiarize myself with Gerrit which is not a good example for
user-friendly interface.
I noticed a letter B in the upper right corner of the screen, and I
suspected it could be a portion of my login name. So I looked at it in HTML
source, and it was. I pushed my mouse on it and I got another half window
as attached.

So did somebody perhaps wire the size of a 25" monitor into page rendering?
My computer is a Samsung notebook.


Hello,

I am pretty sure we can fix it via some CSS. We have a past example to 
move menu to the left next to the icon in order to get the search bar 
visible:

https://gerrit.wikimedia.org/r/#/c/48624/
https://phabricator.wikimedia.org/T46902

The top of a Gerrit page has the logo, then a table that shifted to the 
and next to the logo. That table has a cell for the menu and a cell for 
the search/login.  Since the default menu is "My" which has a lot of 
entries, the search bar and login button are further pushed to the right.


I am sure we can come up some CSS trick to alter it.

Please please fill a task in https://phabricator.wikimedia.org/ with the 
tag #Gerrit :]


--
Antoine Musso




___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Public Event Streams (AKA RCStream replacement) question

[Merlijn van Deen (valhallasw)]

Hi Andrew,

On 23 September 2016 at 23:15, Andrew Otto  wrote:

> We’ve been busy working on building a replacement for RCStream.  This new
> service would expose recentchanges as a stream as usual, but also other
> types of event streams that we can make public.
>

First of all, why does it need to be a replacement, rather than something
that builds on existing infrastructure? Re-using the existing
infrastructure provides a much more convenient path for consumers to
upgrade.


> But we’re having a bit of an existential crisis!  We had originally chosen
> to implement this using an up to date socket.io server, as RCStream also
> uses socket.io.  We’re mostly finished with this, but now we are taking a
> step back and wondering if socket.io/websockets are the best technology to
> use to expose stream data these days.
>

For what it's worth, I'm on the fence about socket.io. My biggest argument
for socket.io is the fact that rcstream already uses it, but my experience
with implementing the pywikibot consumer for rcstream is that the Python
libraries are lacking, especially when it comes to stuff like reconnecting.
In addition, debugging issues requires knowledge of both socket.io and the
underlying websockets layer, which are both very different from regular
http.

From the task description, I understand that the goal is to allow easy
resumation by passing information on the the last received message. You
could consider not implementing streaming /at all/, and just ask clients to
poll an http endpoint, which is much easier to implement client-side than
anything streaming (especially when it comes to handling disconnects).

So: My preference would be extending the existing rcstream framework, but
if that's not possible, my preference would be with not streaming at all.

Merlijn
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Paladox]

This is fixed in polygerrit, polygerrit is the new gerrit ui and is currently 
in testing. To see an example please visit
https://gerrit-new.wmflabs.org/?polygerrit=1to disable it change 1 to 0.
Also see it on gerrit-review.
https://gerrit-review.googlesource.com/?polygerrit=1
and the same change 1 into 0 to disable polygerrit.
Polygerrit is mobile friendly and also desktop friendly I think. It resizes 
depending on screen size.

 

On Sunday, 25 September 2016, 13:43, Bináris  wrote:
 

 In the main view of a task I have at least a horizontal scrollbar. It is
not an elegant solution, too, but I can still live wit that. In diff view
there is no scrollbar.

2016-09-25 13:09 GMT+02:00 Bináris :

> Hi,
>
> I try to familiarize myself with Gerrit which is not a good example for
> user-friendly interface.
> I noticed a letter B in the upper right corner of the screen, and I
> suspected it could be a portion of my login name. So I looked at it in HTML
> source, and it was. I pushed my mouse on it and I got another half window
> as attached.
>
> So did somebody perhaps wire the size of a 25" monitor into page
> rendering? My computer is a Samsung notebook.
>
> --
> Bináris
>



-- 
Bináris
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

   
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Bináris]

2016-09-25 14:41 GMT+02:00 Tim Starling :

> I'm
> not sure if the Gerrit folks are serious or are trolling us. Perhaps
> it is a tactic to encourage UI code contributions?
>

So it is totally out of our scope and all I have to do is to wait for the
Phabricator transfer hopefully? (Which is also not my favourite and I have
never seen it working as code review environment.)


-- 
Bináris
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Bináris]

In the main view of a task I have at least a horizontal scrollbar. It is
not an elegant solution, too, but I can still live wit that. In diff view
there is no scrollbar.

2016-09-25 13:09 GMT+02:00 Bináris :

> Hi,
>
> I try to familiarize myself with Gerrit which is not a good example for
> user-friendly interface.
> I noticed a letter B in the upper right corner of the screen, and I
> suspected it could be a portion of my login name. So I looked at it in HTML
> source, and it was. I pushed my mouse on it and I got another half window
> as attached.
>
> So did somebody perhaps wire the size of a 25" monitor into page
> rendering? My computer is a Samsung notebook.
>
> --
> Bináris
>



-- 
Bináris
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Gerrit screen size

[Tim Starling]

On 25/09/16 21:09, Bináris wrote:
> Hi,
> 
> I try to familiarize myself with Gerrit which is not a good example for
> user-friendly interface.
> I noticed a letter B in the upper right corner of the screen, and I
> suspected it could be a portion of my login name. So I looked at it in HTML
> source, and it was. I pushed my mouse on it and I got another half window
> as attached.
> 
> So did somebody perhaps wire the size of a 25" monitor into page rendering?
> My computer is a Samsung notebook.

In T38471 I complained that the old version was too wide at 1163px
(for my dashboard on a random day). Now the new version is 1520px. I'm
not sure if the Gerrit folks are serious or are trolling us. Perhaps
it is a tactic to encourage UI code contributions?

-- Tim Starling



___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Gerrit screen size

[Bináris]

Hi,

I try to familiarize myself with Gerrit which is not a good example for
user-friendly interface.
I noticed a letter B in the upper right corner of the screen, and I
suspected it could be a portion of my login name. So I looked at it in HTML
source, and it was. I pushed my mouse on it and I got another half window
as attached.

So did somebody perhaps wire the size of a 25" monitor into page rendering?
My computer is a Samsung notebook.

-- 
Bináris
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Public Event Streams (AKA RCStream replacement) question

[Antoine Musso]

Le 23/09/2016 à 23:15, Andrew Otto a écrit :
> Hi all,
> 
> We’ve been busy working on building a replacement for RCStream.  This new
> service would expose recentchanges as a stream as usual, but also other
> types of event streams that we can make public.
> 
> But we’re having a bit of an existential crisis!  We had originally chosen
> to implement this using an up to date socket.io server, as RCStream also
> uses socket.io.  We’re mostly finished with this, but now we are taking a
> step back and wondering if socket.io/websockets are the best technology to
> use to expose stream data these days.
> 
> The alternative is to just use ‘streaming’ HTTP chunked transfer encoding.


Hello,

As I understand it we have a legacy system we want to replace. It uses
an old socket.io with a set of events A.

Since you "are mostly finished with" a replacement that has the latest
socket.io I would ship that now and drop/replace the legacy system. With
no new events.

From there survey people about changing the transport layer. Which leads
me to a few questions:

- is RCStream actually used?
- how many clients?
- typology of clients (big corp like Yahoo, Google, volunteers, WMF
internal use) ...

Then survey about the change of transport.  The red hearing is that if
you get mostly volunteers, it is going to be long and tedious to have
them change to the new system.  AFAIK WMF still maintains an IRC server
to stream events which was supposed to be dropped by RCStream.  There
are still tools and bot relying on IRC protocol with no developers able
to do the migration.

You will face the exact same problem by changing to HTTP chunks, and we
would end up with:
- IRC (legacy)
- socket.io (on a legacy / outdated infra)
- HTTP chunk


My recommendations are:
- to upgrade the current socket.io since it is apparently already done.
- Find out who are the consumers of the IRC feed and RCStream, run a
survey and figure out what would fit their need best.
- Come with a plan to DROP the old systems

And hopefully we end up with a single system from which people can build
upon and on which we can introduce new type of events.


My 0.02 €

-- 
Antoine "hashar" Musso


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Public Event Streams (AKA RCStream replacement) question

[Antoine Musso]

Le 24/09/2016 à 22:51, Brad Jorsch (Anomie) a écrit :
> On Sat, Sep 24, 2016 at 11:41 AM, Andrew Otto  wrote:
> 
>> ​So, since most of the dev work for a socket.io implementation is already
>> done, you can see what the protocol would look like here:
>> https://github.com/wikimedia/kasocki#socketio-client-set-up
>>
>> Kasocki is just a library, the actual WMF deployment and documentation
>> would be more specific about MediaWiki type events, but the interface would
>> be the same.  (Likely there would be client libraries to abstract the
>> actual socket.io interaction.)
>>
> 
> See, that's the sort of thing I was complaining about. If I'm not using
> whatever language happens to have a library already written, there's no
> spec so I have to reverse-engineer it from an implementation. And in this
> case that seems like socket.io on top of engine.io on top of who knows what
> else.

socket.io has libraries in several languages. The RCStream shows example
for JavaScript and Python:
https://wikitech.wikimedia.org/wiki/RCStream#Client

It is true though that a lib has to be written on top of that to be
aware of MediaWiki events dialect.

-- 
Antoine "hashar" Musso


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l