Hello,
I have a little problem with libwww-perl-5.48. If I try to use
RobotUA, RobotUA does not realize that access is denied by
robots.txt. Maybe this has to do someting with the fresh-until
Timeout.
My Code:
========
use strict;
use diagnostics;
use LWP::Debug qw(+ +conns);
use LWP::RobotUA;
use HTTP::Request;
use HTTP::Response;
my $ua = new LWP::RobotUA ('134.108.35.20', '[EMAIL PROTECTED]');
$ua->delay([0]);
my $request = HTTP::Request->new ("GET" => "http://134.108.35.20");
my $response = $ua->request($request);
my $result = $response->is_success()." ".$response->content()." Error
".$response->code()." ".$response->message()."\n";
print $result;
Any Ideas what is wrong in the code ?
Many thanks
Bye
Matthias Jaekle