Dear list, It is nice to be polite. Yes it works Thankyou
*Best regards,* *chika.tambun* *"Winning loves preparation"* On Mon, Jul 11, 2016 at 2:42 PM, Tim Ruehsen <[email protected]> wrote: > On Sunday, July 10, 2016 11:50:07 AM CEST chika tambun wrote: > > Dear List, > > > > I've used to mirror the website using the command > > # wget -np --mirror -p --convert-links --reject > > msi,asc,gz,bz2,zip,bin,rpm,deb -P /var/www/html $url > > > > But i've got failed when launch this command for > > http://supervisord.org/index.html > > # wget -np --mirror -p --convert-links --reject > > asc,bin,bz2,deb,doc,exe,gif,gz,java,jpg,msi,pdf,png,rpm,txt,zip -P > > /var/www/html http://supervisord.org/index.html > > > > Any reference, would be appreciated. > > They don't want you to mirror their site :-( > > You have to change the request User-Agent (option -U) to work around. > You should consider to be polite and also add --wait=1 to wait 1s between > requests . > > Regards, Tim >
