Continued download (wget -c) is not done in the current svn version with default
options (where no HEAD is used). The download starts instead at byte 0 again.
When other options require a HEAD, it works ok again. Perhaps the correction is
as easy as adding the '-c' case to those options that need a HEAD request.  ;-)

Regards, J.Roderburg

Log outputs for various versions:

Version 1.10.2 does no HEAD, but immediately a GET with Range

wget.1102 --debug -c http://ftp.uni-koeln.de/files.lst.gz

Setting --continue (continue) to 1
DEBUG output created by Wget 1.10.2 on linux-gnu.

--22:48:58--  http://ftp.uni-koeln.de/files.lst.gz
           => iles.lst.gz'
Resolving ftp.uni-koeln.de... 134.95.19.35
Caching ftp.uni-koeln.de => 134.95.19.35
Connecting to ftp.uni-koeln.de|134.95.19.35|:80... connected.
Created socket 3.
Releasing 0x08084a00 (new refcount 1).

---request begin---
GET /files.lst.gz HTTP/1.0
Range: bytes=6033568-
User-Agent: Wget/1.10.2
Accept: */*
Host: ftp.uni-koeln.de
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 206 Partial Content
Date: Thu, 13 Sep 2007 20:48:59 GMT
Server: Apache/2.0.46 (Red Hat)
Last-Modified: Wed, 12 Sep 2007 04:08:33 GMT
ETag: "1b7500ba-1524e9d-60055240"
Accept-Ranges: bytes
Content-Length: 16137725
Content-Range: bytes 6033568-22171292/22171293
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: application/x-gzip
Content-Encoding: x-gzip

---response end---
206 Partial Content
Registered socket 3 for persistent reuse.
Length: 22,171,293 (21M), 16,137,725 (15M) remaining [application/x-gzip]

59% [+++++++++++++++=================>                        ] 13,095,904    
1.61M/s    ETA 00:05


SVN version from a month ago does a HEAD and a GET with Range

wget.111-svn-0708 --debug -c http://ftp.uni-koeln.de/files.lst.gz

Setting --continue (continue) to 1
DEBUG output created by Wget 1.10+devel on linux-gnu.

--22:52:40--  http://ftp.uni-koeln.de/files.lst.gz
Resolving ftp.uni-koeln.de... 134.95.19.35
Caching ftp.uni-koeln.de => 134.95.19.35
Connecting to ftp.uni-koeln.de|134.95.19.35|:80... connected.
Created socket 3.
Releasing 0x080884c8 (new refcount 1).

---request begin---
HEAD /files.lst.gz HTTP/1.0
User-Agent: Wget/1.10+devel
Accept: */*
Host: ftp.uni-koeln.de
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Thu, 13 Sep 2007 20:52:40 GMT
Server: Apache/2.0.46 (Red Hat)
Last-Modified: Wed, 12 Sep 2007 04:08:33 GMT
ETag: "1b7500ba-1524e9d-60055240"
Accept-Ranges: bytes
Content-Length: 22171293
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: application/x-gzip
Content-Encoding: x-gzip

---response end---
200 OK
Registered socket 3 for persistent reuse.
Length: 22171293 (21M) [application/x-gzip]
--22:52:40--  http://ftp.uni-koeln.de/files.lst.gz
Reusing existing connection to ftp.uni-koeln.de:80.
Reusing fd 3.

---request begin---
GET /files.lst.gz HTTP/1.0
Range: bytes=6033568-
User-Agent: Wget/1.10+devel
Accept: */*
Host: ftp.uni-koeln.de
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 206 Partial Content
Date: Thu, 13 Sep 2007 20:52:40 GMT
Server: Apache/2.0.46 (Red Hat)
Last-Modified: Wed, 12 Sep 2007 04:08:33 GMT
ETag: "1b7500ba-1524e9d-60055240"
Accept-Ranges: bytes
Content-Length: 16137725
Content-Range: bytes 6033568-22171292/22171293
Keep-Alive: timeout=15, max=99
Connection: Keep-Alive
Content-Type: application/x-gzip
Content-Encoding: x-gzip

---response end---
206 Partial Content
Length: 22171293 (21M), 16137725 (15M) remaining [application/x-gzip]
Saving to: iles.lst.gz'
58% [++++++++++++++++==================>                         ] 13,030,816 
1.50M/s  eta 6s


Current SVN version does no HEAD and a GET for the whole file again

wget.111-svn-0709 --debug -c http://ftp.uni-koeln.de/files.lst.gz
Setting --continue (continue) to 1
DEBUG output created by Wget 1.10+devel on linux-gnu.

--22:56:39--  http://ftp.uni-koeln.de/files.lst.gz
Resolving ftp.uni-koeln.de... 134.95.19.35
Caching ftp.uni-koeln.de => 134.95.19.35
Connecting to ftp.uni-koeln.de|134.95.19.35|:80... connected.
Created socket 3.
Releasing 0x080884c8 (new refcount 1).

---request begin---
GET /files.lst.gz HTTP/1.0
User-Agent: Wget/1.10+devel
Accept: */*
Host: ftp.uni-koeln.de
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Thu, 13 Sep 2007 20:56:39 GMT
Server: Apache/2.0.46 (Red Hat)
Last-Modified: Wed, 12 Sep 2007 04:08:33 GMT
ETag: "1b7500ba-1524e9d-60055240"
Accept-Ranges: bytes
Content-Length: 22171293
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: application/x-gzip
Content-Encoding: x-gzip

---response end---
200 OK
Registered socket 3 for persistent reuse.
Length: 22171293 (21M) [application/x-gzip]
Saving to: iles.lst.gz'

26% [==============>                                             ] 5,811,360  
1.55M/s  eta 11s

Reply via email to