On Fri, Aug 09, 2002 at 03:01:54PM +0500, Ken Munro wrote: > Hi. > > I am trying to write a simple robot that reads urls from a text file. > The source is listed below. I am getting an error that says: > > LWP::RobotUA=HASH(0x83d7994) GET 1 ...Can't locate object method "host" > via package > "URI::_generic" (perhaps you forgot to load "URI::_generic"?) at > /usr/lib/perl5/site_perl/5.6.1/WWW/RobotRules.pm line 187, <IN> line 2. > > I have search Google far and wide, and have found other people with this > problem, but no solution.
This is from memory and refers to old code, but ... I think I saw that problem when I was using WWW::Robot over a year ago. I remember fixing a problem with LWP::RobotUA crashing on unusual URLs. I also removed some hardcoded limits on the kinds of URLs WWW::Robot traverses. If you're interested in trying the modified modules, they are available at http://www.win.tue.nl/~rp/perl/lib/LWP/RobotUA.pm http://www.win.tue.nl/~rp/perl/lib/WWW/Robot.pm -- Reinier
