On Sunday, July 10, 2016 11:50:07 AM CEST chika tambun wrote: > Dear List, > > I've used to mirror the website using the command > # wget -np --mirror -p --convert-links --reject > msi,asc,gz,bz2,zip,bin,rpm,deb -P /var/www/html $url > > But i've got failed when launch this command for > http://supervisord.org/index.html > # wget -np --mirror -p --convert-links --reject > asc,bin,bz2,deb,doc,exe,gif,gz,java,jpg,msi,pdf,png,rpm,txt,zip -P > /var/www/html http://supervisord.org/index.html > > Any reference, would be appreciated.
They don't want you to mirror their site :-( You have to change the request User-Agent (option -U) to work around. You should consider to be polite and also add --wait=1 to wait 1s between requests . Regards, Tim
signature.asc
Description: This is a digitally signed message part.
