I ran wget again over the site using the latest debian testing package.. the problem seems to have been fixed with the -nd parameter
regards - Niel On Thu, 2005-09-15 at 16:17 +0200, Mauro Tortonesi wrote: > Alle 16:21, giovedì 1 settembre 2005, Niel Drummond ha scritto: > > hiya, sorry to bother... I've been consistenly recompiling the newest > > wget with slight change in the file "url.c", mainly because of the > > default "non-clobber" behaviour. I'm sure there's been lots of > > controversial discussion already on this, so I'll be quick. > > > > the site I am trying to mirror is a shopping cart "template" based > > system, which has re-occuring filenames for different pages. I use the > > following command: > > > > ./wget -r -p -k -nH -nd -w0.8 -P/home/www/static/aug-05/mirror/ -linf -K > > -U"Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.0)" > > -I/images2,/cgi-bin/lf.storefront -X/cgi-bin/lf.storefront/*/Offer/* > > -oaug-spider.log -b http://dev.lookfantastic.com/cgi-bin/lf.storefront/ > > > > because of the re-occuring endings in the URI's, this command will fail > > to save some pages, due to the way non-clobber works and that all files > > are saved in the same folder. > > > > My recompiled wget ignores the --recursive non-clobber suppression, and > > saves files appended with a number, though it would be nice to have some > > extra combination of commands to re-anable it. > > > > Is there a useful way around this 'default' behaviour, without > > replicating the directory tree locally? > > not that i know of. the one you implemented seems to be an interesting > feature > to be added as an option in the next wget release. can you send us the patch > please? >
