Re: [Bug-wget] Unexpected result with -H and -D

2018-01-17 Thread Tim Rühsen
Hi, this is not a PSL matching, so no libpsl is needed. Just sufmatch() has to be fixed to do (sub)domain matching. Attached is a fix. With Best Regards, Tim On 01/17/2018 03:01 PM, Darshit Shah wrote: > Hi, > > This is a bug in Wget, apparently a really old one! Seems like the bug has >

Re: [Bug-wget] Unexpected result with -H and -D

2018-01-17 Thread Darshit Shah
Hi, This is a bug in Wget, apparently a really old one! Seems like the bug has been around since atleast 1997. Looking at the source, the issue is that Wget does a very simple suffix matching on the actual domain and accepted domains list. This is obviously wrong as you have just found out. I'm

[Bug-wget] Unexpected result with -H and -D

2018-01-17 Thread Friso van Vollenhoven
Hello all, I am trying to do a recursive download of a webpage and span multiple hosts within the same domain, but not cross to other domains. The issue is that the crawl does extend to other domains. My full command is this: wget \ --recursive \ --no-clobber \ --page-requisites \ --adjust-extens

[Bug-wget] [bug #52349] Seg fault with wget -O - smxi.org/sm/sm-versions

2018-01-17 Thread Darshit Shah
Follow-up Comment #4, bug #52349 (project wget): Hi, You can simply apply the patch from master to your working directory. I haven't tested it, but it should work just fine. There aren't many changes to that part of the codebase. Very soon we'll have a new version released with these fixes.

[Bug-wget] [bug #44817] http/gzip compression

2018-01-17 Thread Darshit Shah
Update of bug #44817 (project wget): Status:None => Fixed Open/Closed:Open => Closed Release: 1.16.3 => 1.19.1