How can I assign a useragent if I am using RobotUA. It appears that some sites cannot be crawled unless a valid useragent is assigned.
Read the docs on LWP::UserAgent for "useragent". RobotUA is a subclass of UserAgent, so anything you can do to UserAgent, you can do to RobotUA.
--
Andy Lester => [EMAIL PROTECTED] => www.petdance.com => AIM:petdance
