Re: [Bug-wget] [bug #51666] Please hash the hostname in ~/.wget-hsts files

On Freitag, 18. August 2017 14:51:12 CEST Ander Juaristi wrote: > Follow-up Comment #2, bug #51666 (project wget): > > I'm not generally against these kind of small tweaks that don't harm and > slightly improve user's privacy. > > If Firefox doesn't do it, we don't care: it's their business and t

Re: [Bug-wget] Compiling against libwget built with ubsan

On 08/29/2017 05:03 PM, Avinash Sonawane wrote: > Hello! > > $ cat foo.c > #include > #include > > int main(int argc, char **argv) > { > char foo[] = "FOO"; > printf("%s\n", wget_strtolower(foo)); > > return 0; > } > > $ gcc -lwget foo.c -o foo > //usr/local/lib/libwget.so: undefi

Re: [Bug-wget] Signature verification support in wget?

Hi Ludo, thanks for heads up :-) Darshit just opened an issue at https://gitlab.com/gnuwget/wget2/issues/266. If you don't mind, I would add your suggestions there. With Best Regards, Tim On 08/30/2017 02:52 PM, Ludovic Courtès wrote: > Hello! > > Following the GNU Hackers Meeting there w

Re: [Bug-wget] Signature verification support in wget?

On 08/30/2017 05:14 PM, Darshit Shah wrote: > * Unknown PGP keys are always an interesting problem due to the > various differences in how people would like to deal with it. By > default, I would suggest that Wget reports a warning about a missing > key and continues. There would be

Re: [Bug-wget] Not downloading srcset assets with -p --page-requisites option

On Dienstag, 12. September 2017 16:31:26 CEST Lorenz Reichelt wrote: > Hi, > > I tried downloading a single html page using the -p --page-requisites > option with GNU Wget 1.17.1 built on linux-gnu. The assets in an srcset > attribute of an img tag were not downloaded. Is this a bug? Hi, your ve

Re: [Bug-wget] http server responding with 416 but file was not transferred completely

On 09/14/2017 09:53 AM, Josef Moellers wrote: > Hi, > > We have seen (at least) one server who has > Accept-Ranges: bytes > in his header but, upon receiving a request with > Range: bytes=23068672- > responds with > HTTP/1.1 416 Requested Range Not Satisfiable > although the file was not transferr

Re: [Bug-wget] http server responding with 416 but file was not transferred completely

On 09/14/2017 12:11 PM, Josef Moellers wrote: > On 14.09.2017 10:12, Tim Rühsen wrote: >> On 09/14/2017 09:53 AM, Josef Moellers wrote: >>> Hi, >>> >>> We have seen (at least) one server who has >>> Accept-Ranges: bytes >>> in his header but, u

Re: [Bug-wget] http server responding with 416 but file was not transferred completely

:06, Tim Rühsen wrote: >> On 09/14/2017 12:11 PM, Josef Moellers wrote: >>> On 14.09.2017 10:12, Tim Rühsen wrote: >>>> On 09/14/2017 09:53 AM, Josef Moellers wrote: >>>>> Hi, >>>>> >>>>> We have seen (at least) one server who has &

Re: [Bug-wget] Problems building wget2

Hi Josef, please see README.md on how to build wget2. If you installed from git repo (https://gitlab.com/gnuwget/wget2.git) then ./bootstrap ./configure make make check With Best Regards, Tim On 09/27/2017 02:41 PM, Josef Moellers wrote: > I was trying to see if a bug I fixed in wget als

Re: [Bug-wget] lex compile problem on AIX 7.1

On 10/02/2017 10:00 AM, l...@langs.se wrote: > Hi! > > I get the following error when compiling wget 1.19.1 on AIX 7.1: > > make all-am > CC connect.o > CC convert.o > CC cookies.o > CC ftp.o > lex -ocss.c > 0: Warning: 1285-300 The o flag is not valid. > 0: Warning: 1285-300 The s flag is not va

Re: [Bug-wget] lex compile problem on AIX 7.1

On Dienstag, 3. Oktober 2017 18:31:45 CEST Avinash Sonawane wrote: > On Mon, Oct 2, 2017 at 8:56 PM, Tim Rühsen wrote: > > On 10/02/2017 10:00 AM, l...@langs.se wrote: > >> Hi! > >> > >> I get the following error when compiling wget 1.19.1 on AIX 7.1: >

Re: [Bug-wget] Wget cannot validate https://ftp.gnu.org?

Hi Jeffrey, I can't reproduce your issue on the first try (Debian unstable here). That means the issuers cert (DST Root CA X3,O=Digital Signature Trust Co.) is part of the systems's CA cert store. $ ls -la /etc/ssl/certs/*X3* lrwxrwxrwx 1 root root 53 27-10-11 09:39:52 /etc/ssl/certs/DST_Root_

Re: [Bug-wget] cipher_list string when using OpenSSL

Hi Jeffrey, thanks for heads up ! Does OpenSSL meanwhile have a PFS for their cipher list ? Currently it looks like that each and every client has to amend their cipher list from time to time. Instead, this should be done in the library. So that new versions automatically make the client code mo

Re: [Bug-wget] cipher_list string when using OpenSSL

On 10/19/2017 11:49 AM, Jeffrey Walton wrote: > On Thu, Oct 19, 2017 at 5:35 AM, Tim Rühsen wrote: >> Hi Jeffrey, >> >> thanks for heads up ! >> >> Does OpenSSL meanwhile have a PFS for their cipher list ? >> >> Currently it looks like that each and e

Re: [Bug-wget] one strlen on loop

Hi Rodgger, thanks for your contribution ! Could you please amend a few things !? Not compilable here: > if (tok_len < 12) && (strchr( tok, '-') != NULL)) If you are about to touch the code, please also add a space where it is missing (between tok and +): > *(tok+ (tok_len - 4)) = '\0'; /* Di

Re: [Bug-wget] one strlen on loop

On 10/25/2017 01:10 AM, Rodgger Bruno wrote: > right? Not quite >> And there seems to be two buffer underflow issues in the old code. >> Please consider fixing it as well: >> >>> if (!c_strncasecmp((tok + (tok_len - 4)), ".DIR", 4)) >> >>> else if (!c_strncasecmp ((tok + (tok_len - 6)),

Re: [Bug-wget] Patch: Avoid unnecessary UTF-8 encoded fallback

Thanks, applied. With Best Regards, Tim On 10/25/2017 12:56 PM, YX Hao wrote: > Dear there, > > Things are clear as the patch shows. ☺ > > == > diff --git a/src/retr.c b/src/retr.c > index a27d58af..c1bc600e 100644 > --- a/src/retr.c > +++ b/sr

Re: [Bug-wget] Fedora 26 server - wget - p11-kit/OpenSC - pcsc-lite/pcscd - polkit

Hi, > Whenever a user is using wget to fetch a webpage via https, I'll get p11-kit and dependencies are not directly used by wget, but your wget is likely build with GnuTLS (check it !). I know that GnuTLS is using p11-kit, especially Redhat/Fedora are the driving force behind it. So the next

Re: [Bug-wget] wget 1.19.2 fails on Test-metalink-http.py and Test-metalink-http-quoted.py

On Sonntag, 29. Oktober 2017 13:45:53 CET Arkadiusz Miśkiewicz wrote: > Hi. > > Test suite for wget fails here on Test-metalink-http.py and Test-metalink- > http-quoted.py > > test-suite.log attached. Could you please also send us the file 'config.log' ? That shows your configuration - I would

Re: [Bug-wget] wget 1.19.2 fails on Test-metalink-http.py and Test-metalink-http-quoted.py

On Sonntag, 29. Oktober 2017 21:00:35 CET Arkadiusz Miśkiewicz wrote: > On Sunday 29 of October 2017, Tim Rühsen wrote: > > On Sonntag, 29. Oktober 2017 13:45:53 CET Arkadiusz Miśkiewicz wrote: > > > Hi. > > > > > > Test suite for wget fails here on Test-meta

Re: [Bug-wget] wget 1.19.2 fails on Test-metalink-http.py and Test-metalink-http-quoted.py

On 10/29/2017 09:39 PM, Arkadiusz Miśkiewicz wrote: > On Sunday 29 of October 2017, Tim Rühsen wrote: >> On Sonntag, 29. Oktober 2017 21:00:35 CET Arkadiusz Miśkiewicz wrote: >>> On Sunday 29 of October 2017, Tim Rühsen wrote: >>>> On Sonntag, 29. Oktober 2017 13:

Re: [Bug-wget] wget 1.19.2 fails on Test-metalink-http.py and Test-metalink-http-quoted.py

On 10/30/2017 12:49 PM, Arkadiusz Miśkiewicz wrote: > On Monday 30 of October 2017, Tim Rühsen wrote: >> On 10/29/2017 09:39 PM, Arkadiusz Miśkiewicz wrote: >>> On Sunday 29 of October 2017, Tim Rühsen wrote: >>>> On Sonntag, 29. Oktober 2017 21:00:35 CET Arkadi

Re: [Bug-wget] Self test results on OS X 10.9

On Montag, 30. Oktober 2017 12:28:23 CET Jeffrey Walton wrote: > Hi Everyone, > > I'm building 1.19.2 from sources. Does anyone have an idea about the > "Use of uninitialized value $addr in concatenation ..."? Looks like a copy&paste misuse of an uninitialized value :-) E.g. in Test-https-pfs.px

Re: [Bug-wget] New wget (1.19.2): Unexpected download behaviour for gzip-compressed tarballs (HTTP-header dependent)

Hi Jens, On Mittwoch, 1. November 2017 17:27:58 CET Jens Schleusener wrote: > Hi, > > the new "wget" release 1.19.2 has got a new feature: > > "gzip Content-Encoding decompression" > > But that feature - at least for my self-conmpiled binary - leads to a > problem if one downloads gzip-compre

Re: [Bug-wget] New wget (1.19.2): Unexpected download behaviour for gzip-compressed tarballs (HTTP-header dependent)

On Mittwoch, 1. November 2017 22:21:38 CET Daniel Stenberg wrote: > On Wed, 1 Nov 2017, Tim Rühsen wrote: > > Content-Encoding: gzip means that the data has been compressed for > > transportation purposes only. > > That's actually not what it means. There's trans

Re: [Bug-wget] New wget (1.19.2): Unexpected download behaviour for gzip-compressed tarballs (HTTP-header dependent)

On 11/03/2017 06:37 AM, James Cloos wrote: >>>>>> "TR" == Tim Rühsen writes: > > TR> I downloaded/tested thousands of web pages and they behave as if 'Content- > TR> Encoding: gzip' is a compression for the transport. Uncompressing it > &

Re: [Bug-wget] New wget (1.19.2): Unexpected download behaviour for gzip-compressed tarballs (HTTP-header dependent)

On 11/03/2017 09:30 AM, Daniel Stenberg wrote: > On Thu, 2 Nov 2017, Tim Rühsen wrote: > >> How would you (or curl) handle >>  Content-Type: application/x-tar >>  Content-Encoding: gzip > >> when downloading 'x.tar.gz' or 'x.tgz' ? Save the

Re: [Bug-wget] Support for HTTP 308 (Permanent Redirect)

On Sonntag, 29. Oktober 2017 00:35:54 CET Vasya Pupkin wrote: > Hello, > > Some websites started using HTTP 308 redirects > (https://tools.ietf.org/html/rfc7538) and Wget fails to follow such > redirects currently. I'm not sure if this can be considered a bug, though. > Anyway, would be nice if Wg

Re: [Bug-wget] wget -mk behavior changed from 16 to 18 for JavaScript files

On Mittwoch, 8. November 2017 10:38:47 CET Angelo Fuchs wrote: > Hi, > Hi Angelo, > I'm using wget to make a static mirror of a wordpress instance. When I > updated to version 18 the process broke because now strings in > javascript files that look like html links are converted by -k. Can't rem

Re: [Bug-wget] Patch: Make url_file_name also convert remote path to local encoded

On Donnerstag, 2. November 2017 21:09:46 CET YX Hao wrote: > Dear Tim, > > > > The 2nd patch is attached. Please take a review :) Hmmm, is this a stand-alone patch and working without your patch #1 (Fix printing...) ? Please give at least one example (better more) to show what your patch fixe

Re: [Bug-wget] Patch: Make url_file_name also convert remote path to local encoded

On 11/12/2017 07:46 PM, Eli Zaretskii wrote: >> From: Tim Rühsen >> Date: Sun, 12 Nov 2017 14:50:47 +0100 >> Cc: YX Hao >> >> As I understand, the second patch is still in discussion with Eli. Since I >> do >> not have Windows, I can't help you

Re: [Bug-wget] Patch: Make url_file_name also convert remote path to local encoded

On Montag, 13. November 2017 19:41:32 CET Yuxi Hao wrote: > Hi Tim, > > > From: Tim Rühsen [mailto:tim.rueh...@gmx.de] > > Sent: 2017年11月12日 21:51 > > Hmmm, is this a stand-alone patch and working without your patch #1 (Fix > > printing...) ? > > Yes. They

Re: [Bug-wget] Patch: Make url_file_name also convert remote path to local encoded

On Montag, 13. November 2017 18:32:46 CET Eli Zaretskii wrote: > > Cc: bug-wget@gnu.org, lifenjoi...@163.com > > From: Tim Rühsen > > Date: Mon, 13 Nov 2017 16:36:39 +0100 > > > > > I don't think it's a Gnulib issue. The problem is that on Windows,

Re: [Bug-wget] nettle-3.4.tar.gz isn't actually compressed

There already has been a discussion about that (starting here: http://lists.gnu.org/archive/html/bug-wget/2017-11/msg0.html). Looks like we didn't fix it correctly. Currently, to disable gzip compression at all: add compression = none to ~/.wgetrc and/or /etc/wgetrc. We'll fix it the next

Re: [Bug-wget] Failing to compile without depricated features from openssl

On 12/04/2017 01:13 AM, Matthew Thode wrote: > Yep, confirmed that this fixed a possible issue, also tested it with > openssl-1.1. > > We are currently using the attached patch. Thanks, I already pushed your patch (with my small changes) to master yesterday. If there is any issue with it, let me

Re: [Bug-wget] nettle-3.4.tar.gz isn't actually compressed

to our Fedora package. I can't reproduce that issue > > Thank you. > > Regards, > Tomas > > On 20.11.2017 17:07, Tim Rühsen wrote: >> There already has been a discussion about that (starting here: >> http://lists.gnu.org/archive/html/bug-wget/2017-11/msg0.

Re: [Bug-wget] Unexpected result with -H and -D

Hi, this is not a PSL matching, so no libpsl is needed. Just sufmatch() has to be fixed to do (sub)domain matching. Attached is a fix. With Best Regards, Tim On 01/17/2018 03:01 PM, Darshit Shah wrote: > Hi, > > This is a bug in Wget, apparently a really old one! Seems like the bug has >

Re: [Bug-wget] nettle-3.4.tar.gz isn't actually compressed

On 01/19/2018 02:23 AM, Thomas Deutschmann wrote: > Hi, > >> sorry, I lost focus on this issue while waiting for >> more examples. > > In Gentoo we hit this several times: > > https://bugs.gentoo.org/640930 > https://bugs.gentoo.org/639752 > https://bugs.gentoo.org/636238 > https://bugs.gentoo.o

Re: [Bug-wget] Testsuite summary for wget 1.19.4: # FAIL: 8

Thanks for the report. This happens because we try to print a numeric IP address: warn "Failed to resolve $$addr, using $srcdir/certs/wgethosts\n"; But then this is printed only if 'localhost' can't be resolved to 127.0.0.1. What is it in your case ? Could you apply this patch and see what tha

Re: [Bug-wget] wget 1.19.2 fails on Test-metalink-http.py and Test-metalink-http-quoted.py

Thanks, slightly amended and pushed. With Best Regards, Tim On 01/30/2018 09:42 AM, Arkadiusz Miśkiewicz wrote: > On Monday 30 of October 2017, Tim Rühsen wrote: >> On 10/30/2017 12:49 PM, Arkadiusz Miśkiewicz wrote: >>> On Monday 30 of October 2017, Tim Rühsen wrote: >

Re: [Bug-wget] no data downloaded

On 02/05/2018 12:03 PM, jos vaessen wrote: > Hello, > > I am downloading the home-webpage from my solar-power-converter using > WIFI and its IP adress 160.190.0.1 with WGET. No problem beside that the > page is zipped as 7ZIP. After unzipping it shows the content of > index.html like a copy/pas

Re: [Bug-wget] no data downloaded

.js  (and  > layout.css for the colors?). > > Always something new to learn when I think I have seen it all, Jos > > > Op 05-Feb-18 om 17:32 schreef Tim Rühsen: >> Either it's missing credentials (do you have to login with Firefox ?) or >> cookies. >> S

Re: [Bug-wget] How to remove a header?

Hi, On 02/09/2018 12:40 AM, Peng Yu wrote: > Hi, > > wget sets some headers. Is there a way to remove some headers, e.g., > Accept-Encoding? Thanks. No, you can change headers and add headers. But it looks like nobody ever needed/asked for an option to remove headers. With Best Regards, Tim

Re: [Bug-wget] "make check" fails in "Test-iri-disabled" on Mac OS X, after "./configure" and "make" of wget-1.19.4 complete

The charset conversion has an issue on OSX since a while (OSX changed something). And we have no OSX developer, so there is nothing to do for us. In the past I had several contacts with charset issues on OSX, who found configuration/installation issues after a while and then silenced (problem solv

Re: [Bug-wget] segment fault while downloading .tar.gz file

Hi Jay, it seems related to https://gitlab.com/gnuwget/wget2/merge_requests/353. Maybe you like to drop in there... In short: the server ignores 'Accept-Encoding: identity' and gives us a 'Content-Type: gzip'. If you build wget2 with libz (just install zlib1-dev and ./configure again), the prob

Re: [Bug-wget] wget 1.19.4 - possible double free in url.c

On 03/01/2018 03:01 PM, Volkmar Klatt wrote: > Dear wget maintainer, > > 1) in wget 1.19.4 (and probably earlier) > please check carefully > > static char * convert_fname (char *fname) > in > src/url.c > > I run a OpenBSD machine, x86, ABI=32 > and I guess there's a double free when using iconv,

Re: [Bug-wget] Add `--retry-on-http-error` to help message

Thanks, applied. With Best Regards, Tim On 03/06/2018 10:00 PM, Giovanni Tirloni wrote: > +N_("\ > + --retry-on-http-error=ERRORScomma-separated list of HTTP errors > to retry\n"), signature.asc Description: OpenPGP digital signature

Re: [Bug-wget] About GSoC project: Support QUIC Protocol

On 03/09/2018 08:43 AM, Daniel Stenberg wrote: > On Fri, 9 Mar 2018, Gisle Vanem wrote: > >> I agree on ngtcp2. Foremost because it seems to have good support for >> MSVC/Windows. My next contender would be MozQuic. Written in C++, but >> with C interface. A bit of a bummer for Wget2 or libcurl? >

Re: [Bug-wget] 8 Failing testes for wget 1.19.4

Hi David, thos bugs in the error messages have been fixed in master: commit 98ec26cc6da0892b6ca7c0f02b10191d8c73f607 Author: Tim Rühsen Date: Fri Feb 9 10:33:01 2018 +0100 Fix warning to not print binary IP address * tests/Test-https-badcerts.px: Likewise * tests/Test-https

Re: [Bug-wget] GSoC'18: DNS over HTTPS.

On 03/21/2018 07:11 PM, Aniketh Gireesh wrote: > Hello everyone, > > I'm Aniketh Girish, a computer science undergraduate from India. Just > giving a small introduction about myself, I am quite convenient with open > source contribution and I have done GSoC last year with KDE under Krita, a > grap

Re: [Bug-wget] GSoC'18: DNS over HTTPS.

On 03/22/2018 02:01 PM, Aniketh Gireesh wrote: > Further, In my opinion, I think it would be better as a different > library/directory. I think that would be a better refactoring method as > well as it would be easier to work on the codebase at a later point in > time. Further, as far as my underst

Re: [Bug-wget] GSOC Project Availability

Hi Eric, IMO the deadline for GSOC student applications is today 18:00 CEST, so you have to hurry. During 27th March and 23rd April the organizations review and decide for/against proposals. Both, http/2 test suite and WARC library hasn't been addressed by an application so far (but that may chan

Re: [Bug-wget] wget2 hanging, possible I/O issue

Hi Jeffrey, basically wget2 should work on WSL, I just tested it scarcely two weeks ago without issues. I suspect it might have to do with your dependencies (e.g. did you install libnghttp2-dev ?). To find out, please send your config.log. That allows me to see your compiler, CFLAGS and the de

Re: [Bug-wget] wget2 hanging, possible I/O issue

-dev libpcre3-dev libpsl-dev libunistring-dev zlib1g-dev > $ sudo update-alternatives --install /usr/bin/python python > /usr/bin/python3.5 1 > > then the commands outlined as per the documentation. config.log attached. > > On Mon, Apr 2, 2018 at 11:53 AM, Tim Rühsen <mailto:ti

Re: [Bug-wget] wget2 hanging, possible I/O issue

me11-dev >> libiconv-hook-dev libidn2-0-dev liblzma-dev libnghttp2-dev >> libmicrohttpd-dev libpcre3-dev libpsl-dev libunistring-dev zlib1g-dev >> $ sudo update-alternatives --install /usr/bin/python python >> /usr/bin/python3.5 1 >> >> then the commands outlined a

Re: [Bug-wget] wget2 hanging, possible I/O issue

Hi Jeffrey, possibly I can get my hands on a fast Win10 desktop the coming weekend... no promise but I'll try. With Best Regards, Tim On 04/04/2018 09:54 AM, Tim Rühsen wrote: > Hi Jeffrey, > > I can't tell you. Basically because the only WSL I can get my hands on >

Re: [Bug-wget] make.exe warnings

On 04/06/2018 04:30 AM, Jeffrey Fetterman wrote: > I've successfully built wget2 through msys2 as a Windows binary, and it > appears to be working (granted I've not used it much yet), but I'm > concerned about some of the warnings that occurred during compilation. > > Unsurprisingly they seem to b

Re: [Bug-wget] wget2 hanging, possible I/O issue

ran) I made some tests yesterday without success. --no-tcp-fastopen makes a small difference, write() sets errno to 32 (broken pipe). Removing the gnulib wrapper code didn't make a difference, neither did removal of SO_REUSEADDR. Regards, Tim > > On Wed, Apr 4, 2018 at 3:22 AM, Tim

Re: [Bug-wget] Miscellaneous thoughts & concerns

Hi Jeffrey, thanks for your feedback ! On 06.04.2018 23:30, Jeffrey Fetterman wrote: > Thanks to the fix that Tim posted on gitlab, I've got wget2 running just > fine in WSL. Unfortunately it means I don't have TCP Fast Open, but given > how fast it's downloading a ton of files at once, it seem

Re: [Bug-wget] Miscellaneous thoughts & concerns

bar) is WSL related or not. TFO reduces RTT by one (on 'hot' connections only). So only under certain conditions,e.g. when closing and opening connections to the same IP often. It combines with TLS False Start, so that you can drop connection latency from 3RTT to 1RTT. 0RTT is pos

Re: [Bug-wget] Miscellaneous thoughts & concerns

L a little less painful, haha. I'd run > this in a VM in an instant but I feel like that would be a bottleneck > on what's supposed to be a high performance program. Speaking of high > performance, just how much am I missing out on by not being able to > take advantage of t

Re: [Bug-wget] Miscellaneous thoughts & concerns

r between resumes that might overwrite .wget-session, >>>> plus you've got to remember I'm on WSL and I'd rather have relevant >>> files >>>> kept within my normal folders rather than my WSL filesystem. >>>> >>> I'm not sure if

Re: [Bug-wget] --http2=off causes Segmentation fault but ./configure --without-libnghttp2 does not

On 04/09/2018 01:04 PM, Jeffrey Fetterman wrote: > So I wanted to see how scraping a large site compared with multiplexing > off. I used the -http2=off parameter, but I got a segfault. Not reproducible here. Could you give me the whole command line ? > So I decided I'd configure wget2 without the

Re: [Bug-wget] --http2=off causes Segmentation fault but ./configure --without-libnghttp2 does not

On 04/09/2018 01:18 PM, Jeffrey Fetterman wrote: > God damnit, I just got it to happen with ./configure --without-libnghttp2 > > Now I'm not sure what is triggering it. If you can trigger it in a Linux VM: Install valgrind, build the code with -g and use wget2_noinstall instead of wget2. e.g. va

Re: [Bug-wget] retry_connrefused?

On 04/10/2018 03:12 AM, Jeffrey Fetterman wrote: > --retry_connrefused is mentioned in the documentation but it doesn't seem > to be an option anymore. I can't find a replacement for it, either. My VPN > is being a bit fussy today and I keep having to restart my script because > of 111 errors. >

Re: [Bug-wget] retry_connrefused?

On 10.04.2018 20:37, Jeffrey Fetterman wrote: > with --tries=5 set, Failed to connect (111) will still instantly abort the > operation. As I wrote, not reproducible here (see my debug output). Please append your debug output. Regards, Tim > On Tue, Apr 10, 2018 at 2:45 AM, Tim Rühs

Re: [Bug-wget] retry_connrefused?

ou can tail -f your log in a second console and grep the output (e.g. tail -f log|egrep 'Connection refused|host_increase_failure') and stop wget2 when the problem occurred. Without a trace / reproducer I can't help you. Regards, Tim > > On Tue, Apr 10, 2018 at 3:27 PM, Tim

Re: [Bug-wget] wget2: exclude-directories, in documentation but not functional

On 22.04.2018 08:00, Jeffrey Fetterman wrote: > So there's a directory in a site I've been using wget2 on that has a bunch > of files I don't need, but I can't figure out how to filter it out. > > --exclude-directories is in the documentation but it says it's an unknown > option. > > Was it repla

[Bug-wget] Announcement: Released GNU Wget2 1.99.1 (second alpha)

GNU Wget2 is the successor of GNU Wget, a file and recursive website downloader. Designed and written from scratch it wraps around libwget, that provides the basic functions needed by a web client. Wget2 works multi-threaded and uses many features to allow fast operation. In many cases Wget2 dow

Re: [Bug-wget] Newbie help

On 02.05.2018 19:25, Sameeran Joshi wrote: > Hi,I am a newbie to wget,i have tried some interesting stuffs using wget by > reading documentation,and I am curious about how the internal working of > wget [url] works,what may be the logic used.So I downloaded the source code > but I am confused where

Re: [Bug-wget] Add support to bind to a local port

On 03.05.2018 19:16, Darshit Shah wrote: > + { "bindport", &opt.bind_port, > cmd_number }, >{ "bodydata", &opt.body_data, cmd_string }, There are more tabs here. I think that port binding does work with address 'ANY'. So wouldn't it be po

Re: [Bug-wget] Removing commented function

On 05.05.2018 15:00, Sameeran Joshi wrote: > 1.i have a doubt regarding the > static void _urls_to_absolute(WGET_VECTOR *urls, WGET_IRI *base) > > function in > wget2/libwget/html_url.c > file .As its commented why are we keeping it there,can't we re

[Bug-wget] [ANNOUNCEMENT] New release 1.19.5 of GNU Wget

report any problem you may experience to the bug-wget@gnu.org mailing list. For the maintainers of Wget, Tim Rühsen signature.asc Description: OpenPGP digital signature

Re: [Bug-wget] Wget not ignoring the return value of a void function in 1.19.5

On 05/08/2018 09:16 AM, Josef Moellers wrote: > Hi, > > While trying to upgrade to 1.19.5, we found a bug in wget (src/host.c) > where the (non-existing) return value of a void function is assigned to > a variable. > > A patch is appended. Thanks, setting timer to NULL is not needed here. I'll

Re: [Bug-wget] Need help

Hi Sameeran, people only answer questions if the know the answer. Your original email was quite confusing. At least I didn't understand your problem and thus didn't answer. Try to be precise and if possible add an example or your error output (the relevant parts). With Best Regards, Tim On 0

Re: [Bug-wget] Bug-wget mailing list

On 15.05.2018 13:32, Graeme wrote: > I opened the mailing list archives. > http://lists.gnu.org/archive/html/bug-wget/ > > I searched for Windows, looking for information on the latest Wget for > windows version. > > I get 1091 documents but they are in order of score.  I change the > sort to by da

Re: [Bug-wget] Wget for WIndows download

On 15.05.2018 13:48, Graeme wrote: > I am trying to find the up to date version of Wget for Windows. > > On https://www.gnu.org/software/wget/faq.html#download there are 4 links. > > Sourceforge and Bart Puype links seem to be dead links. > > Christopher Lewis' link times out. > > Jernej Simoncic's

Re: [Bug-wget] gcc: error: unrecognized command line option '-R'

Hi Jeff, could you 'cd fuzz', then 'make -j1 V=1' and send us the ouput ? It should include the full gcc command line. Please attach your config.log. Regards, Tim On 19.05.2018 17:28, Jeffrey Walton wrote: > Hi Everyone, > > This looks like a new issue with Wget 1.19.5: > > make > .

Re: [Bug-wget] gcc: error: unrecognized command line option '-R'

On 19.05.2018 20:53, Jeffrey Walton wrote: > On Sat, May 19, 2018 at 12:27 PM, Tim Rühsen wrote: >> Hi Jeff, >> >> could you 'cd fuzz', then 'make -j1 V=1' and send us the ouput ? >> >> It should include the full gcc command line. >>

Re: [Bug-wget] gcc: error: unrecognized command line option '-R'

On 19.05.2018 23:44, Jeffrey Walton wrote: > On Sat, May 19, 2018 at 5:21 PM, Tim Rühsen wrote: >> On 19.05.2018 20:53, Jeffrey Walton wrote: >>> On Sat, May 19, 2018 at 12:27 PM, Tim Rühsen wrote: >>> ... >>> make[4]: Entering directory '/home/Build-Scri

Re: [Bug-wget] [unit-test] Crash on test_hsts_new_entry()

Thanks for your report. I just merged another branch into master, this issue seemed to be fixed in there. Please try again latest master. Regards, Tim On 05/22/2018 05:06 PM, Gisle Vanem wrote: > I've built unit-test on Windows (clang-cl). But when running > it, it crashes after the message: >  

Re: [Bug-wget] [unit-test] Crash on test_hsts_new_entry()

On 05/29/2018 05:47 PM, Gisle Vanem wrote: > Tim Rühsen wrote: > >> I just merged another branch into master, this issue seemed to be fixed >> in there. Please try again latest master. > > Thanks, unit-test.exe works fine now. > > BTW. Why 2 versions of the

Re: [Bug-wget] Error when compiling wget 1.19.5 with c-ares 1.14.0

On 06/04/2018 01:14 PM, Krzysztof Malinowski wrote: > Hello, > > I am trying to build wget 1.19.5 with c-ares 1.14.0 and the > compilation fails with error: > > make[3]: Entering directory '/dev/shm/akm022/wget-1.19.5/src' > CC host.o > host.c: In function 'wait_ares': > host.c:735:11: er

Re: [Bug-wget] Wget follows "button" links

On 06/05/2018 11:53 AM, CryHard wrote: > Hey there, > > I've used the following: > > wget --user-agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) > AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Safari/537.36" > --user=myuser --ask-password --no-check-certificate --recursive

Re: [Bug-wget] Wget follows "button" links

estamps) doesn't work, as the server on which the wiki is hosted > doesn't seem to support this, hence wget keeps redownloading the same files. > > Thanks a lot! > ‐‐‐ Original Message ‐‐‐ > > On June 5, 2018 1:57 PM, Tim Rühsen wrote: > >>

Re: [Bug-wget] Wget follows "button" links

example? or .*/xpage=watch.* ? > > Thanks! > > > ​Sent with ProtonMail Secure Email.​ > > ‐‐‐ Original Message ‐‐‐ > > On June 5, 2018 2:40 PM, Tim Rühsen wrote: > >> Hi, >> >> in this case you could try it with -X / --exclude-directories. >> >

Re: [Bug-wget] query

Hi, On 06/11/2018 07:30 AM, Md. Qudratullah Phd2011, MGL wrote: > Hi, > I started downloading with wget but it stopped after some time (25% > completion) and I restarted with -c option but it does not show that it > resume download. Every time I restart with -c option, it starts from 0%. > I have

Re: [Bug-wget] Retry on host error

Hi Elliot, thanks for your contribution. I'll care for the integration / merge tomorrow. We maintainers decided to accept your work without the FSF Copyright Assignment from you (will be tagged as Copyright-paperwork-exempt). Let us know if you plan to work on more and we'll send you the FSF As

Re: [Bug-wget] Retry on host error

Congrats your patch has been pushed, though I detected a small issue right after that (fixed now). And don't you think --tries should be considered ? Regards, Tim On 12.06.2018 20:53, Tim Rühsen wrote: > Hi Elliot, > > thanks for your contribution. > > I'll care fo

Re: [Bug-wget] Deprecate TLS 1.0 and TLS 1.1

On 06/19/2018 12:44 PM, Loganaden Velvindron wrote: > Hi All, > > As per: > https://tools.ietf.org/html/draft-moriarty-tls-oldversions-diediedie-00 > > Attached is a tentative patch to disable TLS 1.0 and TLS 1.1 by > default. No doubt that this will cause some discussions, I'm open to > hearing

Re: [Bug-wget] Why does -A not work?

Hi Nils, On 06/20/2018 06:16 AM, Nils Gerlach wrote: > Hi there, > > in #wget on freenode I was suggested to write this to you: > I tried using wget to get some images: > wget -nd -rH -Dcomicstriplibrary.org -A > "little-nemo*s.jpeg","*html*","*.html.*","*.tmp","*page*","*display*" -p -e > robots

Re: [Bug-wget] Why does -A not work?

m > trying to use wget ;) > > Thanks for the information on the filename and path, though. > > Greetings > > 2018-06-20 16:13 GMT+02:00 Tim Rühsen : > >> Hi Nils, >> >> On 06/20/2018 06:16 AM, Nils Gerlach wrote: >>> Hi there, >>> >

Re: [Bug-wget] Why does -A not work?

get2 are finding + downloading those files. From a first glimpse: those files are linked from an RSS / Atom file. Those aren't supported by wget, but wget2 does parse them for URLs. Want to give it a try ? https://gitlab.com/gnuwget/wget2 Regards, Tim > > 2018-06-20 16:58 GMT+02:00 Tim

Re: [Bug-wget] Why does -A not work?

little-nemo-19060204-s.jpeg little-nemo-19060211-s.jpeg little-nemo-19060218-s.jpeg little-nemo-19060225-s.jpeg Regards, Tim On 06/20/2018 09:59 PM, Tim Rühsen wrote: > On 20.06.2018 18:20, Nils Gerlach wrote: >> It does not delete any html-file or anything else. Either it is accepted >&

Re: [Bug-wget] Retry on host error

Hi Elliot, On 06/25/2018 11:17 PM, Elliot Chandler wrote: > Hello again, > > Thank you for integrating the patch! Thanks for contributing :-) > Regarding licensing, I don't have immediate plans to contribute more > patches to GNU (kind of swamped with things going on), but it's always a > possi

Re: [Bug-wget] Feature request: option to not download rejected files

On 06/29/2018 03:20 PM, Zoe Blade wrote: > For anyone else who needs to do this, I adapted Sergey Svishchev's 1.8-era > patch for 19.1 (one of the few versions I managed to get to compile in OS X; > I'm on a Mac, and not the best programmer): > > recur.c:578 > - if (blacklist_contains (blacklis

Re: [Bug-wget] Feature request: option to not download rejected files

On 07/03/2018 12:48 PM, Zoe Blade wrote: >> In Wget2 there is an extra option for this, --filter-urls. > > Thank you Tim, this sounds like exactly what I was after! (It's especially > important when you have wget logged in as a user, to be able to tell it not > to go to the logout page.) Thoug

Re: [Bug-wget] wget2 Feature Suggestion - Triston Line

Hi, On 07/12/2018 08:12 PM, Triston Line wrote: > Hi Wget team, > > I am but a lowly user and linux sysadmin, however, after noticing the wget2 > project I have wondered about a feature that could be added to the new > version. > > I approve of all the excellent new features already being added

Re: [Bug-wget] wget2 Feature Suggestion - Triston Line

On 07/12/2018 08:12 PM, Triston Line wrote: > If that's possible that would help immensely. I "review" sites for my > friends at UBC and we look at geographic performance on their apache and > nginx servers, the only problem is they encounter minor errors from time to > time while recursively downl

Re: [Bug-wget] request to change retry default

On 07/08/2018 02:59 AM, John Roman wrote: > Greetings, > I wish to discuss a formal change of the default retry for wget from 20 > to something more pragmatic such as two or three. > > While I believe 20 retries may have been the correct default many years > ago, it seems overkill for the modern "

<    1   2   3   4   5   6   7   8   9   10   >