Bug#908478: wget -r doesn't recurse if index.html hasn't been updated

2019-01-20 Thread Tim Rühsen
On Mon, 10 Sep 2018 11:24:05 +0200 Tor Arntsen  wrote:
> Package: wget
> Version: 1.19.5-1
> Severity: important
> 
> Dear Maintainer,
> 
> wget used for maintaining a local mirror of a web site
> 
> Did: wget -r -N -np --no-host-directories $url/
> Outcome: Got 'index.html not mofified on server. Omitting dowload', followed 
> by exit
> Expected: Recursive check of $url/, download of 'modified on server' pages

Clearly a bug. Try with --no-if-modified-since. If that works for you,
put it into the .wgetrc file to make it permanent.

Regards, Tim



signature.asc
Description: OpenPGP digital signature


Bug#908478: wget -r doesn't recurse if index.html hasn't been updated

2018-09-10 Thread Tor Arntsen
Package: wget
Version: 1.19.5-1
Severity: important

Dear Maintainer,

wget used for maintaining a local mirror of a web site

Did: wget -r -N -np --no-host-directories $url/
Outcome: Got 'index.html not mofified on server. Omitting dowload', followed by 
exit
Expected: Recursive check of $url/, download of 'modified on server' pages

The only way to get wget 1.19.5 to actually look for updated pages
is to either remove the local copy of index.html or 'touch' it with
an older timestamp, so that wget (re-)downloads it. Then, and only
then, will wget parse it and follow links recursively.

This used to work with older versions of wget. The current version will
not recursively look for updated pages unless index.html[*] is modified,
and updates of other pages will not be detected.
It is not known in which version this behavior changed.

[*] or any start page

-- System Information:
Debian Release: buster/sid
  APT prefers unstable
  APT policy: (500, 'unstable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 4.11.0-1-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US:e
n (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: unable to detect

Versions of packages wget depends on:
ii  libc62.27-5
ii  libgnutls30  3.5.19-1
ii  libidn2-02.0.4-2.2
ii  libnettle6   3.4-1
ii  libpcre3 2:8.39-11
ii  libpsl5  0.20.2-1
ii  libuuid1 2.32.1-0.1
ii  zlib1g   1:1.2.11.dfsg-1

Versions of packages wget recommends:
ii  ca-certificates  20180409

wget suggests no packages.

-- no debconf information

--
(please ignore auto-added disclaimer)
-- 

CONFIDENTIALITY This e-mail and any attachment contain KONGSBERG information 
which may be proprietary, confidential or subject to export regulations, and is 
only meant or the intended recipient(s). Any disclosure, copying, distribution 
or use is prohibited, if not otherwise explicitly agreed with KONGSBERG. If 
received in error, please delete it immediately from your system and notify the 
sender properly.