C:\Scoop>perl sitescooper.pl http://politiken.dk/VisArtikel.iasp?PageID=1
[...snip...]
Reading: http://politiken.dk/VisArtikel.iasp?PageID=1
SITE WARNING: "VisArtikel.iasp?PageID=1" line 0: HTTP GET failed: 404 Object
Not Found (http://politiken.dk/VisArtikel.iasp?PageID=1)
---
The site recently changed to a more hostile format (using javascript to
scramble links) so I'm guessing that they've narrowed access down to a limited
number of useragents as well. A quick test using wget posing as the sitescooper
useragent resolved in a 404, while it grabbed the page just fine faking it's
identity as Mozilla.
Any way to make sitescooper pretend it's something else? =)
Cheers,
/Jan
_______________________________________________
Sitescooper-talk mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/sitescooper-talk
