When I look at the headers I'm getting back from the BusinessWeek server, they look like as follows. Is there a special way I need to use to deal with CGI authentication, since HTTP authentication via the LWP credentials method doesn't work?
Connection: close Date: Mon, 14 Mar 2005 20:27:59 GMT Server: Netscape-Enterprise/3.6 SP3 Content-Type: text/html; charset=ISO-8859-1 Client-Date: Mon, 14 Mar 2005 20:27:55 GMT Client-Peer: 164.109.22.105:80 Client-Response-Num: 1 Link: <https://www-secure.businessweek.com/tms-ts/style/external.css>; rel="stylesheet"; type="text/css" Set-Cookie: Transact=Ha786ec07e744c6efd8cdd1df37580a9c:session_id=8f51eaf294c711d98900e4 d5b08dcaef&kid=310001.100170&ss=env; Path=/ Title: BusinessWeek Online XXX-Authenticate: CGIPassword ( Andrew Johnson ) ) Marketing Writer ( ( Elias/Savion Advertising ) ( Phone: 412.642.7700 Fax 412.642.2277 ) ) www.elias-savion.com ( ( [EMAIL PROTECTED] ) -----Original Message----- From: John J Lee [mailto:[EMAIL PROTECTED] Sent: Monday, March 14, 2005 4:15 AM To: libwww@perl.org Subject: Re: Authentication problem? On Sat, 12 Mar 2005, Andrew Johnson wrote: > I've been wrestling with a script to scrape some information off of [...] > What else could I try? [...] Hi Andrew Read some past messages on this list from me. I think I've made the same guesses about fifty times now ;-/ and most of the debugging hints are always taken from the same fairly small set. Feel free to come back if you've tried those and are still stuck, of course! IIRC this list is on gmane now, so it should be easy to search. Does this list have a FAQ, anybody? My own FAQs (Python, not Perl, but that's not really all *that* relevant): http://wwwsearch.sourceforge.net/bits/GeneralFAQ.html http://wwwsearch.sourceforge.net/ClientCookie/doc.html#debugging Other standard responses: 1. use WWW::Mechanize 2. perdoc lwpcook John
