Hello, I recently upgraded to htDig 3.2.0b5 in order to take advantage of cookie support, however I'm having trouble getting htDig to index the site.
If I execute lynx http://customersupport/login.php, I'm immediately prompted to accept a cookie. When I run htdig, it appears to stop on login.php, which is what is first called when entering the site. Below are the results of executing htdig -vvvs. Can anyone make any assumptions based on this output? Could htdig be hanging on the cookie prompt as well? Thanks! ========================================================================== [EMAIL PROTECTED] root]# /usr/local/htdig/bin/htdig -vvvs ht://dig Start Time: Tue Jun 1 13:19:47 2004 0:1:http://customersupport/ New server: customersupport, 80 - Persistent connections: enabled - HEAD before GET: enabled - Timeout: 30 - Connection space: 0 - Max Documents: -1 - TCP retries: 1 - TCP wait time: 5 - Accept-Language: Trying to retrieve robots.txt file Making HTTP request on http://customersupport/robots.txt Header line: HTTP/1.1 404 Not Found Header line: Date: Tue, 01 Jun 2004 17:19:47 GMT Header line: Server: Apache/1.3.27 (Unix) PHP/4.3.1 Header line: Content-Type: text/html; charset=iso-8859-1 Request time: 0 secs pushed 1:1:http://customersupport/ skipped pick: customersupport, # servers = 1 > customersupport supports HTTP persistent connections (infinite) 0:7:0:http://customersupport/: Making HTTP request on http://customersupport/ Header line: HTTP/1.1 200 OK Header line: Date: Tue, 01 Jun 2004 17:19:47 GMT Header line: Server: Apache/1.3.27 (Unix) PHP/4.3.1 Header line: X-Powered-By: PHP/4.3.1 Header line: Set-Cookie: PHPSESSID=65a7a05c77e9b6b69c4f27fe1db0b728; path=/ Header line: Expires: Thu, 19 Nov 1981 08:52:00 GMT Header line: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Header line: Pragma: no-cache Header line: Content-Type: text/html Request time: 0 secs Header line: HTTP/1.1 200 OK Header line: Date: Tue, 01 Jun 2004 17:19:47 GMT Header line: Server: Apache/1.3.27 (Unix) PHP/4.3.1 Header line: X-Powered-By: PHP/4.3.1 Header line: Set-Cookie: PHPSESSID=6f06a4a85a34d7f51da76c4baf692a5f; path=/ Header line: Expires: Thu, 19 Nov 1981 08:52:00 GMT Header line: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Header line: Pragma: no-cache Header line: Transfer-Encoding: chunked Header line: Content-Type: text/html Request time: 0 secs (changed) title: log - Sign In href: http://customersupport/log/favicon.ico () Rejected: item in exclude list url rejected: (level 1)http://customersupport/log/favicon.ico size = 2965 pick: customersupport, # servers = 1 > customersupport supports HTTP persistent connections (infinite) htdig: Run complete htdig: 1 server seen: htdig: customersupport:80 1 document HTTP statistics =============== Persistent connections : Yes HEAD call before GET : Yes Connections opened : 2 Connections closed : 1 Changes of server : 0 HTTP Requests : 3 HTTP KBytes requested : 0.824219 HTTP Average request time : 0 secs HTTP Average speed : inf KBytes/secs ht://dig End Time: Tue Jun 1 13:19:47 2004 [EMAIL PROTECTED] root]# ------------------------------------------------------- This SF.Net email is sponsored by: Oracle 10g Get certified on the hottest thing ever to hit the market... Oracle 10g. Take an Oracle 10g class now, and we'll give you the exam FREE. http://ads.osdn.com/?ad_id=3149&alloc_id=8166&op=click _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
