Re: [Wikitech-l] Parsoid/PHP replaces Parsoid/JS on the Wikimedia cluster

2019-12-19 Thread Subramanya Sastry
We haven't updated the setup instructions yet because we are going to be making some more changes to how Parsoid/PHP integrates with MediaWiki. We hope to be able to get it all squared away in time for the next MW release. That will make the installation as simple as upgrading to the latest

Re: [Wikitech-l] Parsoid/PHP replaces Parsoid/JS on the Wikimedia cluster

2019-12-19 Thread Hogan (US), Michael C
The Extension:VisualEditor page on Mediawiki.org still guides people to use Parsoid/JS. Where is the best place to find instructions for migrating a wiki installation from Parsoid/JS to Parsoid/PHP? If documentation doesn't exist, I can help create it once I understand the steps. I've also

Re: [Wikitech-l] Parsoid/PHP replaces Parsoid/JS on the Wikimedia cluster

2019-12-19 Thread Amir Sarabadani
Great job! It's such a big improvement while users might not notice, I greatly appreciate this improvement as it helps with the development and running third party installations of mediawiki. Best and thanks again! On Thu, Dec 19, 2019, 18:26 Subramanya Sastry wrote: > Summary > --- >

Re: [Wikitech-l] Parsoid: node 0.1x deprecated now; node 0.1x support will end March 31st, 2017

2017-04-07 Thread Subramanya Sastry
To followup on the earlier announcement from November 2016, Parsoid no longer supports node v0.1x. The master branch of Parsoid now requires node v4 or higher. It has been tested with node v4 and node v6. Last week, we release a new debian and npm version of Parsoid, v0.7.1 [1]. This

Re: [Wikitech-l] Parsoid Exception HTTP 500 [Solved]

2016-09-03 Thread Julian Loferer
The fact that you got this log line, [warning/api/econnrefused][localhost/v3/page/html/Main_Page/3] Failed API request, {"error":{"code":"ECONNREFUSED","errno":"ECONNREFUSED","syscall":"connect"},"retries-remaining":0} means that your VE is probably setup correctly. It is at least

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-08-03 Thread Arlo Breault
>> Can you think of anything specific in your setup that >> might be preventing that? > In that case I think there could be something. I cannot start the parsoid > server with "service parsoid start", What happens when you try to do that? > so I must do it manuelly with nodejs and maybe thats

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-30 Thread Julian Loferer
Am 29.07.2016 um 22:54 schrieb Arlo Breault: On Jul 29, 2016, at 12:24 PM, Julian Loferer wrote: Yeah here is my localsettings.js file: https://phabricator.wikimedia.org/P3603 Thanks! And i have installed it as an ubuntu package so with apt-get install parsoid . I'm

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-29 Thread Arlo Breault
> On Jul 29, 2016, at 12:24 PM, Julian Loferer wrote: > > Yeah here is my localsettings.js file: > > https://phabricator.wikimedia.org/P3603 Thanks! > And i have installed it as an ubuntu package so with apt-get install parsoid . I'm assuming you have v0.5.1 then.

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-29 Thread Julian Loferer
Yeah here is my localsettings.js file: https://phabricator.wikimedia.org/P3603 And i have installed it as an ubuntu package so with apt-get install parsoid . Am 29.07.2016 um 19:12 schrieb Arlo Breault: On Jul 29, 2016, at 10:07 AM, Julian Loferer wrote: Yeah it looks

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-29 Thread Arlo Breault
> On Jul 29, 2016, at 10:07 AM, Julian Loferer wrote: > > Yeah it looks similar. The link direct me to the right page. Can you paste your localsettings.js file somewhere for us to take a look? https://phabricator.wikimedia.org/paste/edit/form/14/ Also, in case I missed

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-29 Thread Julian Loferer
Yeah it looks similar. The link direct me to the right page. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-28 Thread Arlo Breault
> On Jul 28, 2016, at 9:03 AM, Julian Loferer wrote: > > I looked into my localsettings.js and didnt found a line called setInterwiki > I only found setMwApi? Is it the same or should i add setInterwiki for my own? setMwApi is the newer name for that function and should

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-28 Thread Julian Loferer
I looked into my localsettings.js and didnt found a line called setInterwiki I only found setMwApi? Is it the same or should i add setInterwiki for my own? Am 28.07.2016 um 17:14 schrieb Alex Monk: I would check your parsoid localsettings.js config file... There should be a setInterwiki call

Re: [Wikitech-l] Parsoid Exception HTTP 500

2016-07-28 Thread Alex Monk
I would check your parsoid localsettings.js config file... There should be a setInterwiki call in there pointing to your MediaWiki api.php. The parsoid server needs to be able to fetch that URL. On 28 July 2016 at 12:42, Julian Loferer wrote: > Hello, > > i have a problem.

Re: [Wikitech-l] Parsoid entrypoint http://parsoid-lb.eqiad.wikimedia.org being decommissioned

2016-02-01 Thread Gabriel Wicke
Multi-line input for transform end points is now live: https://en.wikipedia.org/api/rest_v1/?doc#!/Transforms/post_transform_wikitext_to_html_title_revision On Sat, Jan 30, 2016 at 10:46 AM, Gabriel Wicke wrote: > Basic multi-line input support for wikitext / html

Re: [Wikitech-l] Parsoid entrypoint http://parsoid-lb.eqiad.wikimedia.org being decommissioned

2016-01-30 Thread Bartosz Dziewoński
So what is the replacement for http://parsoid-lb.eqiad.wikimedia.org/_wikitext/ if I just want to see how Parsoid renders a piece of wikitext? It seems the fancy forms at https://en.wikipedia.org/api/rest_v1/?doc don't actually allow me to do the same simple thing. I figured out I must use

Re: [Wikitech-l] Parsoid entrypoint http://parsoid-lb.eqiad.wikimedia.org being decommissioned

2016-01-30 Thread Subramanya Sastry
On 01/30/2016 09:50 AM, Bartosz Dziewoński wrote: So what is the replacement for http://parsoid-lb.eqiad.wikimedia.org/_wikitext/ if I just want to see how Parsoid renders a piece of wikitext? It seems the fancy forms at https://en.wikipedia.org/api/rest_v1/?doc don't actually allow me to do

Re: [Wikitech-l] Parsoid entrypoint http://parsoid-lb.eqiad.wikimedia.org being decommissioned

2016-01-30 Thread Gabriel Wicke
Basic multi-line input support for wikitext / html transforms turned out to be quite straightforward to implement: https://phabricator.wikimedia.org/T110712#1984226 Production should have multi-line inputs some time next week. On Sat, Jan 30, 2016 at 9:11 AM, Subramanya Sastry

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-09 Thread Brad Jorsch (Anomie)
On Fri, Nov 6, 2015 at 3:29 PM, Ricordisamoa wrote: > What if I need to get all revisions (~2000) of a page in Parsoid HTML5? > The prop=revisions API (in batches of 50) with mwparserfromhell is much > quicker. > That's a tradeoff you get with a highly-cacheable

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-09 Thread Subramanya Sastry
On 11/09/2015 12:37 PM, Petr Bena wrote: Do you really want to say that reading from disk is faster than processing the text using CPU? I don't know how complex syntax of mw actually is, but C++ compilers are probably much faster than parsoid, if that's true. And these are very slow. What takes

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-09 Thread C. Scott Ananian
On Mon, Nov 9, 2015 at 1:37 PM, Petr Bena wrote: > Do you really want to say that reading from disk is faster than > processing the text using CPU? I don't know how complex syntax of mw > actually is, but C++ compilers are probably much faster than parsoid, > if that's true.

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-09 Thread Ricordisamoa
Il 09/11/2015 15:52, Brad Jorsch (Anomie) ha scritto: On Fri, Nov 6, 2015 at 3:29 PM, Ricordisamoa wrote: What if I need to get all revisions (~2000) of a page in Parsoid HTML5? The prop=revisions API (in batches of 50) with mwparserfromhell is much quicker.

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-09 Thread Petr Bena
Do you really want to say that reading from disk is faster than processing the text using CPU? I don't know how complex syntax of mw actually is, but C++ compilers are probably much faster than parsoid, if that's true. And these are very slow. What takes so much CPU time in turning wikitext into

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-06 Thread Gabriel Wicke
We don't currently store the full history of each page in RESTBase, so your first access will trigger an on-demand parse of older revisions not yet in storage, which is relatively slow. Repeat accesses will load those revisions from disk (SSD), which will be a lot faster. With a majority of

Re: [Wikitech-l] Parsoid convert arbitrary HTML?

2015-11-06 Thread Eric Evans
On Fri, Nov 6, 2015 at 10:18 AM, James Montalvo wrote: > Can Parsoid be used to convert arbitrary HTML to wikitext? It's not clear > to me whether it will only work with Parsoid's HTML+RDFa. I'm wondering if > I could take snippets of HTML from non-MediaWiki webpages

Re: [Wikitech-l] Parsoid convert arbitrary HTML?

2015-11-06 Thread James Montalvo
Thanks for the quick response. Is there a simple way to do this without RESTBase? On Nov 6, 2015 10:32 AM, "Eric Evans" wrote: > On Fri, Nov 6, 2015 at 10:18 AM, James Montalvo > wrote: > > > Can Parsoid be used to convert arbitrary HTML to

Re: [Wikitech-l] Parsoid convert arbitrary HTML?

2015-11-06 Thread Subramanya Sastry
On 11/06/2015 10:18 AM, James Montalvo wrote: Can Parsoid be used to convert arbitrary HTML to wikitext? It's not clear to me whether it will only work with Parsoid's HTML+RDFa. I'm wondering if I could take snippets of HTML from non-MediaWiki webpages and convert them into wikitext. The right

Re: [Wikitech-l] Parsoid convert arbitrary HTML?

2015-11-06 Thread Gabriel Wicke
To add to what Eric & Subbu have said, here is a link to the API documentation for this end point: https://en.wikipedia.org/api/rest_v1/?doc#!/Transforms/post_transform_html_to_wikitext_title_revision On Fri, Nov 6, 2015 at 8:47 AM, Subramanya Sastry wrote: > On

Re: [Wikitech-l] Parsoid convert arbitrary HTML?

2015-11-06 Thread James Montalvo
Thanks for the responses. I do want to convert HTML that cannot be assumed to be clean, so it sounds like Parsoid will not solve the problem for now. --James On Fri, Nov 6, 2015 at 11:06 AM, Gabriel Wicke wrote: > To add to what Eric & Subbu have said, here is a link to

Re: [Wikitech-l] Parsoid convert arbitrary HTML?

2015-11-06 Thread Subramanya Sastry
On 11/06/2015 11:15 AM, James Montalvo wrote: Thanks for the responses. I do want to convert HTML that cannot be assumed to be clean, so it sounds like Parsoid will not solve the problem for now. If you give us a sample of the kind of HTML you are looking at, we can see what kind of wikitext

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-06 Thread Subramanya Sastry
Parsoid is simply a wikitext -> html and a html -> wikitext conversion service. Everything else would be tools and libs built on top of it. Subbu. On 11/06/2015 02:29 PM, Ricordisamoa wrote: What if I need to get all revisions (~2000) of a page in Parsoid HTML5? The prop=revisions API (in

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-06 Thread Ricordisamoa
I mean RESTBase can't access more than 1 revision at once? Il 06/11/2015 21:39, Subramanya Sastry ha scritto: Parsoid is simply a wikitext -> html and a html -> wikitext conversion service. Everything else would be tools and libs built on top of it. Subbu. On 11/06/2015 02:29 PM,

Re: [Wikitech-l] Parsoid still doesn't love me

2015-11-06 Thread C. Scott Ananian
I think your subject line should have been "RESTBase doesn't love me"? --scott ​ ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Parsoid announcement: Main roundtrip quality target achieved

2015-06-29 Thread Brad Jorsch (Anomie)
On Fri, Jun 26, 2015 at 11:52 AM, Subramanya Sastry ssas...@wikimedia.org wrote: On 06/25/2015 06:29 PM, David Gerard wrote: On 25 June 2015 at 23:22, Subramanya Sastry ssas...@wikimedia.org wrote: On behalf of the parsing team, here is an update about Parsoid, the bidirectional wikitext

Re: [Wikitech-l] Parsoid announcement: Main roundtrip quality target achieved

2015-06-29 Thread Subramanya Sastry
On 06/29/2015 09:20 AM, Brad Jorsch (Anomie) wrote: On Fri, Jun 26, 2015 at 11:52 AM, Subramanya Sastry ssas...@wikimedia.org wrote: The PHP parser used in production has 3 components: the preprocessor, the core parser, Tidy. Parsoid relies on the PHP preprocessor (access via the mediawiki

Re: [Wikitech-l] Parsoid announcement: Main roundtrip quality target achieved

2015-06-26 Thread Subramanya Sastry
On 06/25/2015 06:29 PM, David Gerard wrote: On 25 June 2015 at 23:22, Subramanya Sastry ssas...@wikimedia.org wrote: On behalf of the parsing team, here is an update about Parsoid, the bidirectional wikitext - HTML parser that supports Visual Editor, Flow, and Content Translation.

Re: [Wikitech-l] Parsoid announcement: Main roundtrip quality target achieved

2015-06-26 Thread David Gerard
I didn't have anything in mind, evidently I was just vague on what the stuff in there is and does :-) On 26 June 2015 at 16:52, Subramanya Sastry ssas...@wikimedia.org wrote: On 06/25/2015 06:29 PM, David Gerard wrote: On 25 June 2015 at 23:22, Subramanya Sastry ssas...@wikimedia.org wrote:

Re: [Wikitech-l] Parsoid announcement: Main roundtrip quality target achieved

2015-06-25 Thread David Gerard
On 25 June 2015 at 23:22, Subramanya Sastry ssas...@wikimedia.org wrote: On behalf of the parsing team, here is an update about Parsoid, the bidirectional wikitext - HTML parser that supports Visual Editor, Flow, and Content Translation. xcellent. How close are we to binning the PHP

Re: [Wikitech-l] Parsoid performance metrics

2015-03-31 Thread Gabriel Wicke
Christy, thank you for making this happen! Having continuously-tracked metrics for the key performance characteristics will help us keep tabs on regressions clearly highlight performance improvements as they happen. Both are great motivators. Thank you for your work best of luck with your next

Re: [Wikitech-l] Parsoid performance metrics

2015-03-31 Thread Subramanya Sastry
Thanks Christy for your work on the project. Your work in instrumenting Parsoid and providing us with the dashboards is quite useful and will help us keep on top of perf regressions, and identifying things to improve. Subbu. On 03/31/2015 01:04 PM, E.C Okpo wrote: Hello, Parsoid now has

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Brad Jorsch (Anomie)
On Thu, Aug 28, 2014 at 11:25 AM, Aran a...@organicdesign.co.nz wrote: I'm trying to install parsoid on Ubuntu 12. I installed nodejs from source, but when I try and install parsoid via apt-get it fails saying that it depends on nodejs (= 0.8.0) even though node --version returns v0.10.31!

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Gabriel Wicke
On 08/28/2014 08:46 AM, Brad Jorsch (Anomie) wrote: On Thu, Aug 28, 2014 at 11:25 AM, Aran a...@organicdesign.co.nz wrote: I'm trying to install parsoid on Ubuntu 12. I installed nodejs from source, but when I try and install parsoid via apt-get it fails saying that it depends on nodejs (=

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Aran
Yeah I tried installing from apt-get first, but it installed 0.6.x, Ubuntu 12 is quite old now. On 28/08/14 13:23, Gabriel Wicke wrote: On 08/28/2014 08:46 AM, Brad Jorsch (Anomie) wrote: On Thu, Aug 28, 2014 at 11:25 AM, Aran a...@organicdesign.co.nz wrote: I'm trying to install parsoid

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Brad Jorsch (Anomie)
On Thu, Aug 28, 2014 at 12:23 PM, Gabriel Wicke gwi...@wikimedia.org wrote: What happens when you just do a 'apt-get install nodejs' ? Presumably it installs nodejs version 0.6.12~dfsg1-1ubuntu1, since that's the version available in Ubuntu precise (which I assume is what was meant by Ubuntu

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Aran
Yeah that's what it installed, so then I uninstalled and did it from source instead. On 28/08/14 13:40, Brad Jorsch (Anomie) wrote: On Thu, Aug 28, 2014 at 12:23 PM, Gabriel Wicke gwi...@wikimedia.org wrote: What happens when you just do a 'apt-get install nodejs' ? Presumably it installs

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Aran
Thanks I was able to use the equivs package to get parsoid to run properly - I also then found the following link in some fine print on MW Parsoid/Setup page which works too: https://github.com/joyent/node/wiki/Installing-Node.js-via-package-manager On 28/08/14 12:46, Brad Jorsch (Anomie) wrote:

Re: [Wikitech-l] Parsoid

2014-08-28 Thread Gabriel Wicke
On 08/28/2014 02:29 PM, Aran wrote: Thanks I was able to use the equivs package to get parsoid to run properly - I also then found the following link in some fine print on MW Parsoid/Setup page which works too: https://github.com/joyent/node/wiki/Installing-Node.js-via-package-manager Glad to