Mvolz has uploaded a new change for review.
https://gerrit.wikimedia.org/r/179435
Change subject: Stop using Mozilla user agent header
......................................................................
Stop using Mozilla user agent header
Mozilla user agent header was initally used
because some sites required that a valid
browser be used to load; however, for other
sites this resulted in connection errors.
This a temporary solution; in the future,
we may try multiple request types on upon
failure.
Bug: T1174
Bug: T1173
Change-Id: I9e0cc7e1bb359cd4610048b85a7c62a77d2d2127
---
M lib/scrape.js
1 file changed, 0 insertions(+), 1 deletion(-)
git pull ssh://gerrit.wikimedia.org:29418/mediawiki/services/citoid
refs/changes/35/179435/1
diff --git a/lib/scrape.js b/lib/scrape.js
index 8482571..cd7be26 100644
--- a/lib/scrape.js
+++ b/lib/scrape.js
@@ -38,7 +38,6 @@
request(
{
url: url,
- headers: {'user-agent': 'Mozilla/5.0'},
followAllRedirects: true
}, function(error, response, html){
--
To view, visit https://gerrit.wikimedia.org/r/179435
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I9e0cc7e1bb359cd4610048b85a7c62a77d2d2127
Gerrit-PatchSet: 1
Gerrit-Project: mediawiki/services/citoid
Gerrit-Branch: master
Gerrit-Owner: Mvolz <mv...@wikimedia.org>
_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
