Edit report at https://bugs.php.net/bug.php?id=74181&edit=1
ID: 74181 Comment by: [email protected] Reported by: james at jameswestby dot net Summary: Different configurations for serving www.php.net? Status: Open Type: Bug Package: Website problem Operating System: Linux PHP Version: Irrelevant Block user comment: N Private report: N New Comment: Additionally, it sounds like you're scripts are getting tripped up my PHP.net's mirroring system. You might find the information here helpful: http://php.net/mirrors.php https://wiki.php.net/web/mirror https://wiki.php.net/ideas/phpnetmirroring Some of the mirrors likely have slightly different configurations. Previous Comments: ------------------------------------------------------------------------ [2017-02-28 15:21:37] [email protected] This doesn't address the problem you're having, but maybe you could modify the bot to use this to get the new versions, rather than scraping the site? http://php.net/releases/index.php?json Check out the notes in the right-hand sidebar here for details on other query-string options to provide: http://php.net/releases/ ------------------------------------------------------------------------ [2017-02-28 14:47:29] james at jameswestby dot net Description: ------------ Hi, We have a bot that watches for new versions of php by scraping the website occaisionally. It sometimes reported that it couldn't find the latest release in the page. After debugging for a while I found that sometimes it was being redirected to `/search.php` by `http://www.php.net`. Testing lots of queries against `www.php.net` shows different behaviours, indicating perhaps a mix of servers for it, with different configurations? Test script: --------------- $ curl -I http://www.php.net/ Expected result: ---------------- Same behaviour whichever backend server is reached. Actual result: -------------- Here are two consecutive responses I received with curl -I: HTTP/1.1 200 OK Date: Tue, 28 Feb 2017 14:43:00 GMT Server: Apache Last-Modified: Tue, 28 Feb 2017 13:30:11 GMT Content-language: en X-Frame-Options: SAMEORIGIN Set-Cookie: COUNTRY=NA%2C86.31.132.166; expires=Tue, 07-Mar-2017 14:43:00 GMT; path=/; domain=.php.net Set-Cookie: LAST_NEWS=1488292980; expires=Wed, 28-Feb-2018 14:43:00 GMT; path=/; domain=.php.net Link: <http://php.net/index>; rel=shorturl Connection: close Content-Type: text/html; charset=utf-8 HTTP/1.1 301 Moved Permanently Server: nginx/1.6.2 Date: Tue, 28 Feb 2017 14:43:01 GMT Content-Type: text/html Content-Length: 184 Connection: keep-alive Location: http://php.net/ You can see that the nginx is behaving differently to the apache. The bot was seeing a redirect to `/search.php` sometimes, but I haven't seen that with curl yet. ------------------------------------------------------------------------ -- Edit this bug report at https://bugs.php.net/bug.php?id=74181&edit=1 -- PHP Webmaster List Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
