On 06/12/2011 06:34 AM, david chou wrote: > If there is a robots file , > how could I retrieve file from > that site? I 've used the -e robots=off instruction , > but it still can not mirror a web site.
Use the --debug flag to diagnose, and compare the output with http://wget.addictivecode.org/FrequentlyAskedQuestions#Why_isn.27t_Wget_downloading_all_the_links.3F_I_have_recursive_mode_set -- Micah J. Cowan http://micah.cowan.name/
