-Original Message-
From: Yun MO [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, January 28, 2003 2:28 AM
To: Max Bowsher
Cc: [EMAIL PROTECTED]
Subject: Re: Recursive download Problem.
Dear Max Bowsher,
Thank you for the answer. Yes, it works for some sites. I
encountered a
new
Yun MO wrote:
Dear Ma'am/sir,
I could not get all files with "wget -r" command for following
address. Would you help me?
Thank you in advance.
M.Y.
---
meta NAME="robots" CONTENT="noindex,nofollow"
Wget is obeying the robots instruction.
wget -e robots=off ...
Dear Ma'am/sir,
I could not get all files with "wget -r" command for following address.
Would you help me?
Thank you in advance.
M.Y.
---
wget -r http://www.venus.dti.ne.jp/~hok/html/document/index.html
wget -r http://www.venus.dti.ne.jp/~hok/html/document/index.html
