Re: [Wikitech-l] I love Parsoid but it doesn't want me

On 09/17/2015 07:44 PM, Ricordisamoa wrote: Stephen Niedzielski: "it seems like, as soon as you get the HTML the first thing you want to do, perhaps a little bit ironically because it's called Parsoid, it's parse the output a little bit more" https://www.youtube.com/watch?v=3WJID_WC7BQ&t=35m14s

Re: [Wikitech-l] I love Parsoid but it doesn't want me

And as I responded there, if I gave you a JSON string instead, the first thing you'd need to do is parse the JSON to turn it into something you can use. The difference is that JSON and html5 parsers are standard components in every programming language. Html5 even has a standard object representa

Re: [Wikitech-l] A couple videos: Parsoid with Reading Engineering; Reading Showcase 20150824

Done. On Thu, Sep 17, 2015 at 2:05 PM, C. Scott Ananian wrote: > Adam: could you add a link to > > https://commons.wikimedia.org/wiki/File:Doing_Cool_Things_with_Wiki_Content_(Parsoid_Power!).pdf > to the youtube description for that talk? > > Thanks! > --scott > > On Thu, Sep 17, 2015 at 1:58

Re: [Wikitech-l] I love Parsoid but it doesn't want me

Stephen Niedzielski: "it seems like, as soon as you get the HTML the first thing you want to do, perhaps a little bit ironically because it's called Parsoid, it's parse the output a little bit more" https://www.youtube.com/watch?v=3WJID_WC7BQ&t=35m14s Il 23/07/2015 22:02, C. Scott Ananian ha sc

Re: [Wikitech-l] Announcing the launch of Maps

On 09/17/2015 03:26 PM, Tomasz Finc wrote: The Discovery Department has launched an experimental tile and static maps service available at https://maps.wikimedia.org. Congratulations to the whole team. This is a huge deal, and will open up our projects to whole new kinds of media, editing, an

Re: [Wikitech-l] Saving MediaWiki:common.js

On Thu, Sep 17, 2015 at 3:03 PM, Legault, Phillip [ITSUS] wrote: > Sorry it took me a while to get back to this. > [Thu Sep 17 14:42:22 2015] [error] [client 10.22.165.73] File does not exist: > /app/mediawiki/mw/skins/chameleon/kai_stars-dev.png, referer: > server/index.php?title=MediaWiki:Comm

Re: [Wikitech-l] Announcing the launch of Maps

The bracketing was introduced to reduce the DDOS attack surface and increase the cache hit ratio. This means that we could in theory do all the magic of bracketing in the varnish (to keep the cache rate high), or we could force the clients to do the logic. The problem with Varnish approach is that

Re: [Wikitech-l] A couple videos: Parsoid with Reading Engineering; Reading Showcase 20150824

Adam: could you add a link to https://commons.wikimedia.org/wiki/File:Doing_Cool_Things_with_Wiki_Content_(Parsoid_Power!).pdf to the youtube description for that talk? Thanks! --scott On Thu, Sep 17, 2015 at 1:58 PM, Adam Baso wrote: > Hi all, > > Just wanted to share a couple recent videos. E

Re: [Wikitech-l] Announcing the launch of Maps

Awesome sauce! Congrats to everyone who's been working on this. On Thu, Sep 17, 2015 at 12:26 PM, Tomasz Finc wrote: > == In Depth == > > Tiles are served from https://maps.wikimedia.org, but can only be accessed > from any subdomains of *.wmflabs .org and *.wikivoyage.org. Kartotherian > can

Re: [Wikitech-l] Announcing the launch of Maps

The STYLE of the map is in https://github.com/kartotherian/osm-bright.tm2 which is a fork from https://github.com/mapbox/mapbox-studio-osm-bright.tm2 -- released by Mapbox under a 3 clause BSD license (IANAL). On Thu,

Re: [Wikitech-l] Announcing the launch of Maps

The underlying data is ODbL which is properly attributed per OSM guidelines. The license for tiles themselves is a different issue, OSM decided to CC them, we're not claiming any additional copyright so far, until legal tells us in https://phabricator.wikimedia.org/T111224 On Thu, Sep 17, 2015 at

Re: [Wikitech-l] Announcing the launch of Maps

ODbL (which is the license for the data) doesn't require any particular license for maps produced from ODbL data. (And in the U.S. data isn't copyrightable anyway.) There is a copyright on the style and presentation of the tiles which is separate from any copyright on the data. This copyright belon

Re: [Wikitech-l] Announcing the launch of Maps

While the presentation of data can be copyrighted within the United States, and database rights permit the pseudo-copyrighting of data within the European Union, our core servers are hosted within the United States - a jurisdiction where data /itself/ cannot be copyrighted. Our license does not hav

Re: [Wikitech-l] Announcing the launch of Maps

I feel like there's an argument to be made that the images are a derived work from the data itself, so it may be best to just stick with OSM's license rather than run into any possible issues. (Also, of course, I am biased and prefer copyleft licenses since they support free information.) *-- * *

Re: [Wikitech-l] Announcing the launch of Maps

And in case that isn't decided, I would suggest CC0 so that we don't have to link to a big explanation from each tile rendering :) On Thu, Sep 17, 2015 at 12:40 PM, Ryan Kaldari wrote: > What is the license for the map tiles, i.e. the cartography rather than > the data? Open Street Maps uses CC-

Re: [Wikitech-l] Announcing the launch of Maps

What is the license for the map tiles, i.e. the cartography rather than the data? Open Street Maps uses CC-BY-SA, although they don't really make it clear who is supposed to be attributed. It looks like our tiles are different though. On Thu, Sep 17, 2015 at 12:26 PM, Tomasz Finc wrote: > The Di

[Wikitech-l] Announcing the launch of Maps

The Discovery Department has launched an experimental tile and static maps service available at https://maps.wikimedia.org. Using this service you can browse and embed map tiles into your own tools using OpenStreetMap data. Currently, we handle traffic from *.wmflabs .org and *.wikivoyage .org (re

Re: [Wikitech-l] Saving MediaWiki:common.js

Sorry it took me a while to get back to this. [Thu Sep 17 14:42:22 2015] [error] [client 10.22.165.73] File does not exist: /app/mediawiki/mw/skins/chameleon/kai_stars-dev.png, referer: server/index.php?title=MediaWiki:Common.js&action=edit I rebuilt the database from my production system that i

[Wikitech-l] A couple videos: Parsoid with Reading Engineering; Reading Showcase 20150824

Hi all, Just wanted to share a couple recent videos. Enjoy! == Parsoid with Reading == https://youtu.be/3WJID_WC7BQ?t=14 C. Scott Ananian and Subbu Sastry from the Wikimedia Foundation provide an overview of Parsoid, a Wikimedia technology that supports HTML to wikitext (and vice versa) transla

Re: [Wikitech-l] thumb generation

On Wed, Sep 16, 2015 at 12:51 AM, Federico Leva (Nemo) wrote: > Have you looked into what mwoffliner does? > https://sourceforge.net/p/kiwix/other/ci/master/tree/mwoffliner/mwoffliner.js +1 for mwoffliner. It should be *very* close to what you are looking for, and avoids the need to parse wikit

Re: [Wikitech-l] Fwd: [Tools] Kubernetes picked to provide alternative to GridEngine

Congrats on moving forward with a big decision! I'm very optimistic about containers, so it's exciting to see movement in this area. Is there a larger arc of using this for our own services (Mediawiki, RESTBase, etc.), potentially in production? On Wed, Sep 16, 2015 at 9:28 PM, Yuvi Panda wrot