I found that wget 1.10.2 often re-downloads the same files even though the local one is up to date. It reports "sizes do not much" and starts the download even though the remote size reported is exactly the same like the local one. It does not do it for all files of the remote site but only for certain ones. Seems, that is is doing so only when the size calculation is "unauthoritative". Please find below an excerpt of a real log file:
"..... Remote file no newer than local file `/db/src/unigene/Aedes_aegypti/Aae.profiles.gz' -- not retrieving. Remote file no newer than local file `/db/src/unigene/Aedes_aegypti/Aae.retired.lst.gz' -- not retrieving. The sizes do not match (local 43740801) -- retrieving. --21:09:06-- ftp://ftp.ncbi.nih.gov/repository/UniGene/Aedes_aegypti/Aae.seq.all.gz => `/db/src/unigene/Aedes_aegypti/Aae.seq.all.gz' ==> CWD /repository/UniGene/Aedes_aegypti ... done. ==> PASV ... done. ==> RETR Aae.seq.all.gz ... done. Length: 43,740,801 (42M) (unauthoritative) 0K .......... .......... .......... .......... .......... 0% 88.35 KB/s 50K .......... .......... .......... .......... .......... 0% 62.33 KB/s 100K .......... .......... .......... .......... .......... 0% 52.26 KB/s 150K .......... .......... .......... .......... .......... 0% 52.99 KB/s ....." Thank you very much for dealing with this issue. Gyorgy Simon
