[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 Marc Ordinas i Llopis marc...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #18 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 102011 merged by jenkins-bot: Bug 56590: Use the Parsoid HTTP API in round-trip testing https://gerrit.wikimedia.org/r/102011 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #17 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 99348 abandoned by GWicke: Bug 56590: Use the Parsoid HTTP API in round-trip testing Reason: Moved to https://gerrit.wikimedia.org/r/#/c/102011/ https://gerrit.wikimedia.org/r/99348 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #16 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 102011 had a related patch set uploaded by GWicke: Bug 56590: Use the Parsoid HTTP API in round-trip testing https://gerrit.wikimedia.org/r/102011 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #13 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 99348 had a related patch set uploaded by Marcoil: Bug 56590: Use the Parsoid HTTP API in round-trip testing https://gerrit.wikimedia.org/r/99348 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|ASSIGNED|PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #14 from Antoine hashar Musso has...@free.fr --- (In reply to comment #12) snip Thanks for the info, Antoine. Even though we'll be running an independent Parsoid API server when running roundtrip-test.js, that will need internet access to fetch wikitext from the MediaWiki API. I'll open that bug when the code is ready. Shouldn't you mock the API access? I mean Parsoid could be injected fixtures with known articles content and use those flat files instead of relying on the remote wiki. That would save the internet HTTP get and make sure you are testing known value. Of course, I don't think Parsoid support that kind of injection (yet?). -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #15 from ssas...@wikimedia.org --- So far, we've been doing some basic integration testing on a single page (en:Barack_Obama) in a Jenkins job after each commit. While we could fully mock up all API accesses, for large pages like en:Barack_Obama, this would require us to effectively do a capture and replay of all API accesses for those pages (since it is not just wikitext, but also templates, extensions, images, etc. -- some 100s to 1000s of API calls). Scott does have some basic code for capturing these accesses and dumping them to a file and using that to do a replay (without relying on internet). But, that seems like extra complexity instead of relying on internet access if we really want to do full-page integration testing on a set of N (for small values of N, say 5) pages after each commit. So, I think the real question is whether we should be doing full page testing in a Jenkins/CI job after each commit or not. If yes, it seems simpler to rely on HTTP. All that said, we do have a mock MW API server for testing PHP extensions (bug 45440). See parsoid/js/tests/mockAPI.js. Currently, we use this for running parserTests only. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 Marc Ordinas i Llopis marc...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |ASSIGNED --- Comment #12 from Marc Ordinas i Llopis marc...@wikimedia.org --- (In reply to comment #11) (snip) That build has been run on lanthanum.eqiad.wmnet which does not have direct access to internet. We can tie the job to a Jenkins slave that has internet access though. 11pm right now so I will forget about it, but a bug against Wikimedia Continuous integration would make sure it get solved. Thanks for the info, Antoine. Even though we'll be running an independent Parsoid API server when running roundtrip-test.js, that will need internet access to fetch wikitext from the MediaWiki API. I'll open that bug when the code is ready. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #8 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 97733 had a related patch set uploaded by Marcoil: Bug 56590: Use the HTTP API in round-trip testing https://gerrit.wikimedia.org/r/97733 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|ASSIGNED|PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #9 from Marc Ordinas i Llopis marc...@wikimedia.org --- Problems when testing this patch: - When testing with a local Parsoid instance, it compares the two wikitext versions and gives a correct number of syntactic and semantic diffs, although the number is sometimes different to the one given by direct (no HTTP API) testing. Most of the times the differences are due to a final '\n' difference when testing through HTTP. Could be due to different selser and editMode settings? - When testing from my local machine, but using httpL//parsoid.wmflabs.org/ as the HTTP API URL, html2wt always gives out the same wikitext as was gotten with TemplateRequest::one, which results in 0 diffs. Caching? - node roundtrip-test.js --parsoidURL http://parsoid.wmflabs.org/ --prefix enwiki Barack_Obama gives this error: ERROR: Error: request entity too large at IncomingMessage.onData (/data/project/parsoid/js/node_modules/express/node_modules/connect/node_modules/raw-body/index.js:40:17) at IncomingMessage.EventEmitter.emit (events.js:88:17) at IncomingMessage._emitData (http.js:359:10) at HTTPParser.parserOnBody [as onBody] (http.js:123:21) at Socket.socket.ondata (http.js:1682:22) at TCP.onread (net.js:404:27) - It doesn't pass Jenkins, see https://integration.wikimedia.org/ci/job/parsoid-roundtrip-test-check/1789/console It seems that the roundtrip-test.js script can't connect to the parsoid HTTP API from the jenkins machine. We'll need to get a parsoid instance running on the jenkins test machine, using a random port. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #10 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 97733 abandoned by Marcoil: Bug 56590: Use the HTTP API in round-trip testing Reason: This needs more work to work anywhere besides my local setup, a new patch will come soon. https://gerrit.wikimedia.org/r/97733 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 --- Comment #11 from Antoine hashar Musso has...@free.fr --- (In reply to comment #9) snip - It doesn't pass Jenkins, see https://integration.wikimedia.org/ci/job/parsoid-roundtrip-test-check/1789/ console It seems that the roundtrip-test.js script can't connect to the parsoid HTTP API from the jenkins machine. We'll need to get a parsoid instance running on the jenkins test machine, using a random port. That build has been run on lanthanum.eqiad.wmnet which does not have direct access to internet. We can tie the job to a Jenkins slave that has internet access though. 11pm right now so I will forget about it, but a bug against Wikimedia Continuous integration would make sure it get solved. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56590] Use the HTTP API in round-trip testing
https://bugzilla.wikimedia.org/show_bug.cgi?id=56590 Marc Ordinas i Llopis marc...@wikimedia.org changed: What|Removed |Added Summary|Test HTTP API endpoints |Use the HTTP API in |exposed by Parsoid |round-trip testing --- Comment #7 from Marc Ordinas i Llopis marc...@wikimedia.org --- Divided into two tasks: * This bug will track changing the round-trip test client to use the HTTP API so that they test a more similar code to the actual one used by clients. * Bug #56730 tracks the (future) development of unit tests of Parsoid's HTTP API. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
