Re: --timestamping and big files?

2005-05-28 Thread Dan Bolser
On Sat, 28 May 2005, Hrvoje Niksic wrote:

>Dan Bolser <[EMAIL PROTECTED]> writes:
>
>> I think --timestamping fails for files > 2Gb
>
>Thanks for the report.  Wget 1.9.x doesn't support 2+GB files, not
>only for timestamping.  You can try Wget 1.10-beta from
>ftp://ftp.deepspace6.net/pub/ds6/sources/wget/wget-1.10-beta1.tar.bz2
>

Sorry for the lack of details, I sent the email before I realized I didn't
even give you the version...

Thanks for the reply,
Dan.



Re: --timestamping and big files?

2005-05-28 Thread Hrvoje Niksic
Dan Bolser <[EMAIL PROTECTED]> writes:

> I think --timestamping fails for files > 2Gb

Thanks for the report.  Wget 1.9.x doesn't support 2+GB files, not
only for timestamping.  You can try Wget 1.10-beta from
ftp://ftp.deepspace6.net/pub/ds6/sources/wget/wget-1.10-beta1.tar.bz2


RE: Is it just that the -m (mirror) option an impossible task [Was: wget 1.91 skips most files]

2005-05-28 Thread Tony Lewis
Maurice Volaski wrote:

> wget's -m option seems to be able to ignore most of the files it should
> download from a site. Is this simply because wget can download only the
> files it can see? That is, if the web server's directory indexing option
> is off and a page on the site is present on the server, but it isn't
> referenced by any publicly viewable page, wget simply can't see it. 

I've been thinking about coding a --extra-sensory-perception option that
would cause wget to read the mind of the server so that it can download
files that it cannot see. As soon as I get the algorithm worked out, I'll be
submitting the patch. So far I've figured out how to download index.html
without being able to see it, but I'm sure that if I keep working at it that
wget will be able to detect the rest of the files it cannot see. Of course,
I could just be taking the wrong approach; it may work better if I try to
implement the --psychic option instead.

Tony




--timestamping and big files?

2005-05-28 Thread Dan Bolser

I think --timestamping fails for files > 2Gb

wget tries to download the file again with the .1 extension (as if you
were not using --timestamping).

This only happens to a big file in a list of files I am wgetting.