If there is a robots file , how could I retrieve file from that site? I 've used the -e robots=off instruction , but it still can not mirror a web site.
- [Bug-wget] -e robots=off problem david chou
- Re: [Bug-wget] -e robots=off problem Micah Cowan
If there is a robots file , how could I retrieve file from that site? I 've used the -e robots=off instruction , but it still can not mirror a web site.