Hi Karen, They are probably not blocking by IP or they would have blocked access from links (the chain) as well.
Thinking they might be blocking by a combination of both IP and User agent trigger, I changed the user agent for lynx (the cat) with another UA string I got from the online UA database. Now I called realclearpolitics.com with: /usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; XH; rv:8.578.498) fr, Gecko/20121021 Camino/8.723+ (Firefox compatible)" $* No joy. Still blocked with lynx (the cat.) Links (the chain) still works. I don't suppose you could try sending me shellworld's lynx config file, could you? On Wed, Nov 10, 2021 at 02:06:45PM -0500, Karen Lewellen wrote: > Hi Rudy, > Have you tried this site today? > Granted I am using the Lynx configuration at shellworld, but I just typed > the address you provided, and reached the page perfectly. > something to consider about cloudflare is that it tracks sometimes by IP > address. > Would love to learn how the fanfiction.net site works with your user agent > though, smiles. > Karen > > > > On Wed, 10 Nov 2021, Rudy Vener wrote: > > > Hi all, > > > > Yesterday realclearpolitics.com started returning the following page > > when I tried to access it with lynx. > > > > Please enable JS and disable any ad blocker > > > > I invoke lynx as follows: > > /usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; Intel > > Mac OS X 10_8_0) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.79 > > Safari/537.1 lynx" $* > > > > The above user agent spoof normally lets me slip the Cloud Flare > > gatekeepers, but this seems to be something new. > > > > For what it's worth, the same problem now occurs with w3m, however, > > links (the chain) can access the site just fine. > > If there is a simple configuration fix for this, I'd really like to know. > > > > Thank you. > > > > -- > > Rudy Vener > > Website: http://www.rudyvener.com > > Twitter: https://twitter.com/RudySalt > > > > -- Rudy Vener Website: http://www.rudyvener.com Twitter: https://twitter.com/RudySalt
