Hi Darshit Shah ,
Darshit Shah wrote:
Hi Taras,
Thanks for your interest in Wget.
On 10/31, [email protected] wrote:
Hi all,
I use wget, I think such features will be useful.Are there objections
against the below, or something is already implemented and I did not
find?
1) Maximal size of downloaded file (not all the batch) : do not
download if value in header present and stop and delete otherwise if
it is too big. I implemented it in my internal version. This prevents
downloading huge files when downloading from list and the process is
not controlled manually.
This might be an interesting option to consider. I'm not aware of any
option to limit downloads based on a single file's size. However, you
must remember that not all servers send a Content-Length header. In
such scenarios, Wget *must* download the file before it realizes its
actual size. In such a case, what would be the expected outcome?
Should Wget delete the larger file? Or retain it?
It should delete partial file.The full file must not be downloaded ,
the download will stop when downloaded stuff reaches limit.For example
,/maxsize 100000 while downloading 100 Mb file without size in header -
stops at 10 Mb and deletes the downloaded chunk.
2) Rename output to file001...bin if the URL produces junk name (now
unable to download).Additional option - for any non-7bit chars.
Could you please explain this issue further? What kind of junk name
causes Wget to refuse downloading? A test case would be the best way
to demonstrate this.
HTTP download with compilcated URLs like
http://someurl/foo.php?x=1?y=2jsdjdjdd. ,the wget produces file name
that cannot be created.I amnot sure,using not the last wget, encountered
such issues sometimes.In other cases it produces valid,but not readable
name like foo&fdjfdklfdfdfdl;&fkfkfdfkfkfkfk&bad.bin
3) -N should work with - O ,also for bad output names without -O.
Look at the manual page for Wget, under the --output-document section.
It explains why -N and -O do not fit well together.
This is also related to bad names. With -N -O the wget can look at
timestamp of file named as written in "-O". Please explain why this is
not OK.
