Re: [Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-22 Thread David Niklas
On Tue, 21 Aug 2018 06:39:38 -0400 (EDT)
lynx-dev@nongnu.org wrote:
> > Normally 504 gateway errors have nothing to do with your personal
> > setup.  Instead they reflect a communications error between the
> > site's own servers, timing out communications wise.  
> 
> With lynx, I see an immediate (on human timescales) HTTP/1.1 504
> GATEWAY_TIMEOUT response.  With my own manual fetcher script, I see a
> redirect to HTTPS.  I infer they are playing silly User-Agent: games.
> Maybe telling lynx to lie in its User-Agent: header would work around
> whatever is broken?
> 
> Gateway Timeout _is_ the standard meaning of 504: "The 504 (Gateway
> Timeout) status code indicates that the server, while acting as a
> gateway or proxy, did not receive a timely response from an upstream
> server it needed to access in order to complete the request.".  I
> suppose it's possible that lynx requests get redirected to a backend
> that's timing out.  But the short time before I get the 504 argues
> against that.  Without transparency into the server setup behind it,
> it's difficult to say more.


My lynx:

Lynx Version 2.8.9dev.11 (15 Nov 2016)
libwww-FM 2.14, SSL-MM 1.4.1, GNUTLS 3.5.6, ncurses 6.0.20161126(wide)

On:

Linux Phenom-II-x6 4.17.8dav1 #5 SMP PREEMPT Thu Aug 9 03:50:23 UTC 2018
x86_64 GNU/Linux

has the same problem. Using curl or changing the user agent header fixes
this.
Your experience goes to show how broken the web site is, not even
returning the correct response code for the web server's refusing to
allow your user agent access.

Sincerely,
David

___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev


Re: [Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-21 Thread Mouse
> Normally 504 gateway errors have nothing to do with your personal
> setup.  Instead they reflect a communications error between the
> site's own servers, timing out communications wise.

With lynx, I see an immediate (on human timescales) HTTP/1.1 504
GATEWAY_TIMEOUT response.  With my own manual fetcher script, I see a
redirect to HTTPS.  I infer they are playing silly User-Agent: games.
Maybe telling lynx to lie in its User-Agent: header would work around
whatever is broken?

Gateway Timeout _is_ the standard meaning of 504: "The 504 (Gateway
Timeout) status code indicates that the server, while acting as a
gateway or proxy, did not receive a timely response from an upstream
server it needed to access in order to complete the request.".  I
suppose it's possible that lynx requests get redirected to a backend
that's timing out.  But the short time before I get the 504 argues
against that.  Without transparency into the server setup behind it,
it's difficult to say more.

Possibly relevant tidbit: www.crisisgroup.org is hosted by
amazonaws.com; it resolves to 34.204.104.28 and 34.195.245.170 for me,
ec2-34-204-104-28.compute-1.amazonaws.com and
ec2-34-195-245-170.compute-1.amazonaws.com.

/~\ The ASCII Mouse
\ / Ribbon Campaign
 X  Against HTMLmo...@rodents-montreal.org
/ \ Email!   7D C8 61 52 5D E7 2D 39  4E F1 31 3E E8 B3 27 4B

___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev


Re: [Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-20 Thread Karen Lewellen

Actually, no it does not.
The profile at the top of this page, the one which appears in lynx, when 
you  remove the user header   indicates the servers are rather  simple, 
its dated 1999.

if you go to the site with lynx and get the 504 gateway error,
change the send user agent header  and the site displays, oddly but  it 
displays.

links uses a different approach to user agent headers.
 when I researched the error, all information indicates it is a site thing 
not a you thing.

Kare



On Mon, 20 Aug 2018, Chime Hart wrote:

OK Karen, thanks for your explainer, but the fact that it works in e l i n k 
s but not L Y N X would mean something else. In looking in my files, as late 
as October 2014 or maybe some of 2015 I could reach this site. Thanks so much 
in advance

Chime





___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev


Re: [Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-20 Thread Chime Hart
OK Karen, thanks for your explainer, but the fact that it works in e l i n k s 
but not L Y N X would mean something else. In looking in my files, as late as 
October 2014 or maybe some of 2015 I could reach this site. Thanks so much in 
advance

Chime


___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev


Re: [Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-20 Thread Karen Lewellen

hi Chime,
Normally 504 gateway errors have nothing to do with your personal setup. 
Instead they reflect a communications error  between the site's own 
servers, timing out communications wise.

have you been able to reach the site before using lynx?
kare



On Mon, 20 Aug 2018, Chime Hart wrote:

Well Russell, thanks for looking, however, whether I try here on Shellworld 
or on my hard-drive in Debian, I receive a 504 error.

Running Lynx Version 2.8.9rel.1
Thanks so much in advance
Chime

___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev




___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev


Re: [Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-20 Thread Chime Hart
Well Russell, thanks for looking, however, whether I try here on Shellworld or 
on my hard-drive in Debian, I receive a 504 error.

Running Lynx Version 2.8.9rel.1
Thanks so much in advance
Chime

___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev


[Lynx-dev] Why Do I Receive a Gateway Timeout on www.crisisgroup.org

2018-08-20 Thread russellbell
Quoth Chime Hart:  'in trying to visit www.crisisgroup.org
l i n k s does reach this site, but when going to specific articles, I think it 
just loops around. But worse, L Y N X gives me a 504 gateway timeout. Can some1 
please examine, incase there are work-arounds.'
I have no trouble connecting.  The pages are > 100K, if size
matters.  Every page begins with > 300 lines of header information
before the information on the topic.  If you're being read to you have
a lot of the same being read before you get to the information you
want.

russell bell

___
Lynx-dev mailing list
Lynx-dev@nongnu.org
https://lists.nongnu.org/mailman/listinfo/lynx-dev