i dont think nutch can,

just a thought, maybe add "googlebot" to the user-agent, im not saying do that, im just saying its a possibility that would allow you to access password protected pages for indexing purposes, search google for the password protected page to see if it gets the contents are index by google

_gk

----- Original Message ----- From: "Andy Morris" <[EMAIL PROTECTED]>
To: <[email protected]>
Sent: Friday, January 13, 2006 7:15 PM
Subject: Access pasword protected sites?


Can nutch access password protected sites?
If so how?
Thanks,
Andy



-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general

Reply via email to