Re: not working with ssl/ipv6?

2024-03-27 Thread Tim Rühsen
On 3/27/24 17:32, Brian Vargo wrote: I've not been able to use wget on ssl with github and debian. I ^C'ed out of the gitusercontent one (it would have timed out) and the second one is just a random example: ``` $ wget

Re: Integer overflows in parse_content_range() and gethttp()

2024-03-03 Thread Tim Rühsen
Thanks vulnerabilityspotter, are there any insights why this specific integer overflow is a vulnerability? ("potential" is not enough) TL;DR for the audience: An AI generated vulnerability report. I mostly agree with what has been written for curl at https://github.com/curl/curl/issues/12983

Re: Is it possible to get wget --content-disposition to overwrite an existing file.

2024-03-03 Thread Tim Rühsen
On 2/25/24 03:40, Mark Sapiro wrote: As far as I can tell, the only way to get wget to overwrite an existing file is with the `-O` option, but I want to use `--content-disposition` to write the output to the filename in the Content-Disposition: header. This works, but if the filename already

Re: Wget fails to download some URLs from www.investing.com

2024-02-18 Thread Tim Rühsen
On 2/14/24 11:21, Chris Smith via Primary discussion list for GNU Wget wrote: Hi guys, This is not so much a bug as requests being blocked by the cloudflare server. Checkout: https://www.investing.com/crypto/bitcoin/btc-usd-historical-data The server just gives a 403 Forbidden. The

Re: [PATCH] * src/html-url.c: Parse attributes

2024-01-28 Thread Tim Rühsen
On 1/1/24 13:56, blankie via Primary discussion list for GNU Wget wrote: Hello, Attached is a patch to fix https://savannah.gnu.org/bugs/?55087. This patch is slightly hacky ( in a media element is allowed), but the code as-is also allows for in a and outside of a or media element.

Re: read error

2024-01-27 Thread Tim Rühsen
On 1/11/24 05:40, 王强 via Primary discussion list for GNU Wget wrote: Wget is consistently encountering a byte read error, increasing the number of attempts and the waiting time does not solve the problem. (2024-01-11 12:37:20 (17.3 KB/s) - Read error at byte 2122610 (Success).Retrying.)

Re: wget refuses to use legitimate self signed CAs provided with the --ca-certificate flag

2023-12-09 Thread Tim Rühsen
Hi, yeah, I'd expect --ca-certificate should work. It would be interesting to see whether --ca-directory works for you. Which TLS library is your wget binary linked with? (use "wget --version" and there is either openssl or gnutls listed) Regards, Tim On 12/9/23 08:11, David Hadas wrote:

Re: fail to download big files correctly

2023-11-17 Thread Tim Rühsen
On 11/17/23 20:34, grafgrim...@gmx.de wrote: > I use Linux and so not exe files. I use Gentoo Linux. > > Command line example: > One line (wget and the url): > > wget > http://releases.mozilla.org/pub/firefox/releases/119.0.1/source/firefox-119.0.1.source.tar.xz > > result: a file with a wrong

Re: [bug #64808] When I use wget to download some files from a web server, files with russian names do not get proper names

2023-11-17 Thread Tim Rühsen
On 11/17/23 20:39, Eli Zaretskii wrote: Date: Fri, 17 Nov 2023 20:34:37 +0100 From: grafgrim...@gmx.de I use Linux and so not exe files. I use Gentoo Linux. Command line example: One line (wget and the url): wget

Re: fail to download big files correctly

2023-11-17 Thread Tim Rühsen
On 11/16/23 13:45, grafgrim...@gmx.de wrote: Dear wget developers, I use "GNU Wget 1.21.4" and I have problems to download big files with wget. Unsure, what "big" exactly means. For example I download firefox-source, noto-font, linux-firmware and get checksum failures when using wget. These

Re: How?

2023-11-04 Thread Tim Rühsen
Thanks to the feedback from Michael I could create and upload a wget2.exe (x86, 64-bit, v2.1.0, stripped). Find it at https://gitlab.com/gnuwget/wget2/-/releases/v2.1.0 Regards, Tim On 10/25/23 14:23, Michael D. Setzer II via Primary discussion list for GNU Wget wrote: On 25 Oct 2023 at

Re: [Feature Request] Add a short option for --content-disposition

2023-11-04 Thread Tim Rühsen
On 10/29/23 21:08, No-Reply-Wolfietech via Primary discussion list for GNU Wget wrote: Nowadays it seems increasingly common to find a file that is not being hosted where its actually stored, for access control presumably, and it seems to make no sense in having to type content-disposition

Re: wget claims "Success" when it failed to write to local directory

2023-10-29 Thread Tim Rühsen
On 10/27/23 11:16, Christian Rosentreter wrote: Thanks Tim! Seems to work well for me. You are welcome, Christian :) Took me a while to get to the "commit". wget's primary homepage under https://www.gnu.org/software/wget/ doesn't make it very easy to find any information about the

Re: wget claims "Success" when it failed to write to local directory

2023-10-22 Thread Tim Rühsen
s me of some earlier discussion, see https://lists.gnu.org/archive/html/bug-wget/2021-05/msg00012.html I rechecked wget 1.21.4, and it still gives Cannot write to ‘’ (Success). I suppose the same analysis still applies. Andries On Sat, Oct 21, 2023 at 07:22:25PM +0200, Tim Rühsen wrote: Hi,

Re: wget claims "Success" when it failed to write to local directory

2023-10-21 Thread Tim Rühsen
Hi, do you run the latest wget (1.21.4)? With that version, you get a Cannot write to 'index.html' (Permission denied). Regards, Tim On 10/21/23 17:16, Christian Rosentreter wrote: Hi there, There's a minor cosmetic bug in wget 1.x where it claims "Success" when it in fact entirely

Re: wget -p shall honor -H (isn´t used unless -r is given)

2023-10-08 Thread Tim Rühsen
Hey Elmar, did you try the following? wget2 -p -r -l 1 -N -D static.esquire.de https://www.esquire.de/life/reisen/schoenste-wasserfaelle-welt-natur It downloads 94 files, 44 are .jpg files in static.esquire.de/. TBH, I am not 100% sure what you are trying to do, so excuse me if I am off

Re: Not sure if this list for wget2?? Have an issue after recent updates.

2023-10-08 Thread Tim Rühsen
Hey Michael, Sorry that the Windows version of Wget2 doesn't support multi-threading. This is a known issue when cross-building wget2.exe on Linux. As far as I know, you need a native Windows build, but I can't help you much with that. There is actually no obvious reason why you experience a

Re: Semicolon not allowed in userinfo

2023-10-05 Thread Tim Rühsen
Tue, Oct 3, 2023 at 1:45 PM Daniel Stenberg wrote: On Tue, 3 Oct 2023, Tim Rühsen wrote: My version of curl (8.3.0) doesn't accept it: curl -vvv 'http://a ;b:c@xyz' * URL rejected: Malformed input to a URL function That's in no way a legal URL (accortding to RFC 3

Re: Semicolon not allowed in userinfo

2023-10-03 Thread Tim Rühsen
Hi, On 10/2/23 10:55, Bachir Bendrissou wrote: Hi, The following url example contains a semicolon in the userinfo segment: *http://a ;b:c@xyz* Wget rejects this url with the following error message: *http://a ;b:c@xyz: Bad port number.* It seems that Wget sees "c" as a port number. When

wget2-2.1.0 released

2023-08-31 Thread Tim Rühsen
://gitlab.com/gnuwget/wget2.git **Source Code Test Coverage** https://gnuwget.gitlab.io/wget2/coverage/ **Fuzz Code Coverage** https://gnuwget.gitlab.io/wget2/fuzz-coverage/ The authors list is auto-generated from the git history; sorted by number of commits Tim Rühsen Mitch Capper Ander Juaristi

Re: build bug

2023-08-25 Thread Tim Rühsen
I have seen this with WolfSSL, setting a single certificate does in fact *add* the certificate to whatever the system environment provides. So instead of seeing the expected error, the executed wget2 command succeeds. Is there a chance that you built with WolfSSL. Maybe provide the

Re: Trying to mirror some blogs before destruction this month's 21

2023-08-20 Thread Tim Rühsen
Hi, which version of Wget are you using ? (wget --version) On 8/19/23 05:37, Stephane Ascoet wrote: Hi, I launch 'd0="/media/demo/PartitionNTFS/" && cd $d0 && d1="speakerinertl" && echo "On va supprimer "$d1" dans "`pwd` ; sleep 9 ; rm -rvf $d1 ; mkdir $d1 ; cd $d1 && wget -c

Re: Wget crash in printf - bugfix

2023-08-12 Thread Tim Rühsen
Hey Mark, On 8/8/23 23:38, Mark Esler wrote: Hi Tim, Will this issue receive a CVE? Would you like help assigning a CVE? We, the maintainers, are understaffed and not even able to fix all incoming bugs. So while we appreciate when you request a CVE for the issue, please understand that we

Re: Wget crash in printf - bugfix

2023-08-03 Thread Tim Rühsen
Thanks, your patch is correct. I also added a unit test for retr_rate() to reproduce the issue. Regards, Tim On 8/2/23 15:31, Wiebe Cazemier wrote: Hi, We're getting the following segfault. We haven't been able to reproduce it with debug builds or builds from 'apt-get source wget', so

Re: tests: portability fix

2023-08-03 Thread Tim Rühsen
Thanks, pushed. On 8/2/23 11:35, Christian Weisgerber wrote: There is a portability problem in wget's tests/Makefile, which variously refers to "unit-tests" and "./unit-tests". GNU make recognizes "foo" and "./foo" as the same target. Other make(1) implementations may not; OpenBSD's doesn't.

Re: Bug in Termux

2023-07-08 Thread Tim Rühsen
You likely chose the wrong URL. Search the web for nethunter installation on termux and try again. Regards, Tim On 7/6/23 15:07, Antreas Zaxo wrote: Hello, I wanted to say about one problem that i have in termux, i put the code "wget -O install-nethunder-termux https://offs.ec/2MecZWr; and

Re: Wget recursive option not working correctly with scheme relative URLs

2023-07-01 Thread Tim Rühsen
Hey Jan, On 7/1/23 15:16, Jan Bidler via Primary discussion list for GNU Wget wrote: Hello, I have part of a website (`example.com/index.html`) I want to mirror which contains scheme relative URLs (`//otherexample.com/image.png`). Trying to download these with the -r flag, results in wget

Re: unit tests fail due to extra output file wget-log

2023-07-01 Thread Tim Rühsen
Hey Nam, I see that wget unexpectedly writes a log file (from test-suite.log): Redirecting output to ‘wget-log’. In log.c, L973 (function check_redirect()), writing the log is caused by pid_t foreground_pgrp = tcgetpgrp (STDIN_FILENO); if (foreground_pgrp != -1 &&

Re: wget refuses IPv6 link local addresses as invalid

2023-07-01 Thread Tim Rühsen
Hey Moritz, On 6/28/23 15:40, Moritz Wilhelmy wrote: Dear wget maintainers, I tried to connect to IPv6 link local address using both wget 1.20 as well as 1.21.3. I've replaced the address by ... for privacy reasons but since IPv6LL addresses are automatically assigned on modern operating

Re: wget-1.21.4 released [stable]

2023-05-14 Thread Tim Rühsen
again on i686 systems. There have been 29 commits by 3 people in the 62 weeks since 1.21.3. See the NEWS below for a brief summary. Thanks to everyone who has contributed! The following people contributed changes to this release: Darshit Shah (6) Tim Rühsen (22) jinfuchiang (1) Darshit

Re: Termux error

2023-05-07 Thread Tim Rühsen
On 5/1/23 13:04, Abdullah Basharat wrote: wget -0 install- nethunter-termux https://offs.ec/2MceZWr please correct this error for upgrade turmux Correct command line: wget -O install-nethunter-termux https://offs.ec/2MceZWr OpenPGP_signature Description: OpenPGP digital signature

DANE support for Wget2

2023-04-23 Thread Tim Rühsen
For the interested people, DANE support has been merged today (with GnuTLS build only). DANE allows to verify the server certificates for HTTPS connections via DNS. This allows to connect to servers without having a CA certificate pool installed - well, *if* the the site admin prepared the

Re: Recursive downloading of pages through the "action" attributes of the following "form" tags

2023-04-22 Thread Tim Rühsen
On 17.04.23 21:22, BERBAR Florian wrote: Hi folk, I have question about recursive downloading of webpages. Trying to download all pages from a website using recursing option (--recursive) on wget 1.21, the webpages processing seems to don't follow form "action" attributs of "form" tags. -

Re: Test failures on i686-linux

2023-04-16 Thread Tim Rühsen
Hi, On 16.04.23 15:58, Andreas Enge wrote: Hello, when trying to build wget for i686-linux in Guix, we are getting test failures (x86_64 works well): FAIL: Test-hsts Error: Expected file hw not found.. FAIL: Test--https Error: Expected file File1 not found.. FAIL: Test-pinnedpubkey-der-https

Re: [PATCH] Update deprecated option in Wget documentation

2023-04-09 Thread Tim Rühsen
On 09.04.23 09:38, chiang jinfu wrote: Hello Wget maintainers, Since Wget 1.12 renames '--html-extension' to '--adjust-extension', it is better to update the usage in the documentation. I've attached a patch to update the deprecated option '--html-extension' to its new name

Re: wget core dump on ubuntu 22.04

2023-03-19 Thread Tim Rühsen
On 28.02.23 18:19, Art Mellor wrote: *% wget -v --tries=1 --secure-protocol=SSLv3 -T 3 --no-check-certificate https://localhost:1234 * --2023-02-28 12:15:09-- https://localhost:1234/ OpenSSL: unimplemented 'secure-protocol' option value 2 Please report this issue to

Re: Mention multiple -O OK

2023-03-19 Thread Tim Rühsen
On 21.02.23 04:12, Dan Jacobson wrote: "TR" == Tim Rühsen writes: TR> I'd consider adding a paragraph to the OPTIONS/"Option Syntax" TR> sections in the man/info page. TR> Would you like to come up with a suggestion ? All I know is the flustered -O user won't

Re: Slower download with wget2 compared to original wget?

2023-03-10 Thread Tim Rühsen
Hi, On 04.03.23 23:40, Ant wrote: Hello, I noticed wget2 is slower than original wget: $ wget2 -v https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp_macos_legacy[0] Downloading 'https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp_macos_legacy' ... HTTP response

Re: Mention multiple -O OK

2023-02-19 Thread Tim Rühsen
On 19.02.23 02:23, Darshit Shah wrote: On Fri, Feb 17, 2023, at 18:03, Tim Rühsen wrote: It is not possible to control the stored file names with multiple -O options (missing feature) Sorry, but no. This is not a missing feature. Its a long standing annoyance of mine but the manual

Re: Mention multiple -O OK

2023-02-18 Thread Tim Rühsen
On 18.02.23 03:56, Dan Jacobson wrote: "TR" == Tim Rühsen writes: TR> It is not possible to control the stored file names with multiple -O TR> options (missing feature). Yes, so the man page should warn that multiple -O's is in fact NOT OK, i.e., will not do what the user

Re: Wget2 can't mirror a website

2023-02-17 Thread Tim Rühsen
On 17.02.23 01:48, retro mouse via Primary discussion list for GNU Wget wrote: Dear devs, I was trying to use wget2 to archive webs since wget1 doesn't support resourcesets. I can't get it work as expected bug or simple user ignorance I can't tell so I would appreciate some support. The

Re: Mention multiple -O OK

2023-02-17 Thread Tim Rühsen
On 14.02.23 02:54, Dan Jacobson wrote: On (info "(wget) Download Options") and the man page too, mention that one can use multiple -O's in the same command: $ wget -O c emample.com -O n example.net ... thus saving tons of DNS queries! If you want to download several files/pages in one command

Re: Please use gzip/gunzip when fetching webpages

2023-02-03 Thread Tim Rühsen
On 01.02.23 18:05, itstheworm--- via Primary discussion list for GNU Wget wrote: More often than not I try recursively downloading a webpage using wget, only to have it download a single `index.html.gz` then stop. Obviously wget can't read gzipped files so it fails to find any links for

Re: Query on downloading a script with windows 10

2023-01-28 Thread Tim Rühsen
On 27.01.23 07:33, Doug Lawrence via Primary discussion list for GNU Wget wrote: Hi there, Sorry to bother you, but how do I run a wget script (.sh extension) in windows 10?  Can't figure out the correct command. Kind regards, Doug Lawrence Hi, AFAICS, *nix shell script won't be interpreted

Re: Wget2 downloaded GIMP v2.10's DMG twice when original wget didn't.

2023-01-22 Thread Tim Rühsen
A fix has been pushed. Regards, Tim On 22.01.23 11:37, Tim Rühsen wrote: On 20.01.23 21:58, Ant wrote: Hello, I reproduced it in both updated 64-bit Debian bullseye and Fedora v37 PCs: Here's an example from my 14 yrs. old Debian PC: $ wget2 https://download.gimp.org/gimp/v2.10/macos

Re: Wget2 downloaded GIMP v2.10's DMG twice when original wget didn't.

2023-01-22 Thread Tim Rühsen
On 20.01.23 21:58, Ant wrote: Hello, I reproduced it in both updated 64-bit Debian bullseye and Fedora v37 PCs: Here's an example from my 14 yrs. old Debian PC: $ wget2 https://download.gimp.org/gimp/v2.10/macos/gimp-2.10.32-1-x86_64.dmg [0] Downloading

Re: missing something to download mp3 files from host

2022-12-26 Thread Tim Rühsen
On 17.12.22 20:32, Paolo Dista via Primary discussion list for GNU Wget wrote: Hello, I am trying to download all the radio programmes from this page: https://www.radiofrance.fr/personnes/gilles-deleuze with: wget -r -l 1 -H -nd -np -A '*.mp3' -D media.radiofrance-podcast.net

Re: [bug #63431] --disable-ntlm ignored if nettle is present

2022-12-11 Thread Tim Rühsen
Hey Hannu, thanks for explaining your needs. It indeed slipped through my attention that nettle is only needed for NTLM. I just pushed a fix. Regarding keeping wget a small as possible, let me suggest adding --with-gpgme-prefix=/ --disable-pcre --without-metalink --disable-opie to your

Re: iframe srcdoc resources recursive mode

2022-09-04 Thread Tim Rühsen
Thanks for reporting. I opened an Wget2 issue at https://gitlab.com/gnuwget/wget2/-/issues/613. Regards, Tim On 03.09.22 01:52, wget--- via Primary discussion list for GNU Wget wrote: I tried searching the mailing list, bug tracker and source code for srcdoc support, seems it is missing. If

Re: Problem downloading image with wget

2022-08-13 Thread Tim Rühsen
Please try again with wget 1.21.3 (the current release). Regards, Tim On 10.08.22 11:42, Edgar Mobile wrote: I unsuccessfully try to download an image using wget from discogs using the following command: wget

Re: wget and WebKit?

2022-06-25 Thread Tim Rühsen
On 20.06.22 09:15, Josef Moellers wrote: On 18.06.22 16:11, Tim Rühsen wrote: Moin Josef, Mooi'n Tim, is it possible that 'wget' is linked to something else or is a different binary than expected ? Or maybe 'wget' is a script or alias ? I had asked for straces and they show that "/us

Re: wget 1.21.3 "make check" fails on M1 Mac "Out Of The Box"

2022-06-18 Thread Tim Rühsen
Hey, a while ago, a nice person gave me a login to an M1 in order to build and test wget and wget2. I had no issues running make check. aarch64 and arm64 is two different names for the same thing, like e.g. x86_64 and amd64. The FAILs in tests/ (make -C tests) may be due to some Perl

Re: wget and WebKit?

2022-06-18 Thread Tim Rühsen
Moin Josef, is it possible that 'wget' is linked to something else or is a different binary than expected ? Or maybe 'wget' is a script or alias ? Because a) webkit and wget have nothing in common b) That message you got seems not be originated in GNU Wget Regards, Tim On 14.06.22 14:37,

Re: wget crashes on a recursive download of my city's website

2022-06-12 Thread Tim Rühsen
On 06.06.22 23:07, Eric Gallager wrote: It took several hours before the crash happened, so I don't really want to run the command again just to get a backtrace... If you can get your hands on wget2: drop --preserve-permissions (FTP only) and add --max-thread=50 to your command line.

Re: wget crashes on a recursive download of my city's website

2022-06-12 Thread Tim Rühsen
, Tim Rühsen wrote: Nvm, just reproduced the crash (or another one), took no longer than 10 mins. I have no time right now to dig into it. Just in case someone else wants to chime in: This was on branch `origin/dynamic-buf-size`, where origin is https://gitlab.com/gnuwget/wget.git. Built

Re: wget crashes on a recursive download of my city's website

2022-06-11 Thread Tim Rühsen
On 06.06.22 23:07, Eric Gallager wrote: I was trying to use wget to download all of the calendar files on my city website: http://concordnh.gov/iCalendar.aspx Admittedly I'm kind of inexperienced at wget, so I probably didn't use the right command-line, but anyways it was: $ wget -r --tries=3 -c

Re: wget crashes on a recursive download of my city's website

2022-06-11 Thread Tim Rühsen
Nvm, just reproduced the crash (or another one), took no longer than 10 mins. I have no time right now to dig into it. Just in case someone else wants to chime in: This was on branch `origin/dynamic-buf-size`, where origin is https://gitlab.com/gnuwget/wget.git. Built with ./configure

Re: wget-1.21.3-win32/64

2022-05-31 Thread Tim Rühsen
On 30.05.22 14:57, WQ wrote: Hi, Thank you for having replied anyway ! The testing I did was always with the same server and file. So I'm 100% sure about the results (different behaviour on the Netgear) When I wrote "path/file" then I did mean something like F:\Download\thefile.txt I know

GNU Wget2 2.0.1 released

2022-05-27 Thread Tim Rühsen
://gnuwget.gitlab.io/wget2/fuzz-coverage/ With Best Regards, Tim Rühsen OpenPGP_signature Description: OpenPGP digital signature

Re: Working with index.html

2022-05-23 Thread Tim Rühsen
Not sure what to do here. Regards, Tim On 21 May 2022, at 12:10, Tim Rühsen wrote: Hi, I can not reproduce this issue with wget 1.21.3 nor with current wget2. Please make sure you use the latest version of wget. Regards, Tim On 16.05.22 18:39, Great Zverre wrote: Hello guys! I’m u

Re: R: wget fails with this url

2022-05-21 Thread Tim Rühsen
On 21.05.22 12:20, i...@mbsoft.biz wrote: I have found the solution Adding option --no-iri works as expected. Problem closed. Thanks. If anyone is interested in the details, see also https://gitlab.com/gnuwget/wget/-/issues/10. Regards, Tim OpenPGP_signature Description: OpenPGP

Re: wget fails with this url

2022-05-21 Thread Tim Rühsen
On 20.05.22 19:39, Gisle Vanem wrote: ge...@mweb.co.za wrote: I tried this from South Africa and I am getting the exact behaviour as the OP. Okay. Now I tested with various other older Wgets:   the one bundled with Ruby (a msys2 built version) -> 403 Forbidden   the one bundled with GNU

Re: Working with index.html

2022-05-21 Thread Tim Rühsen
Hi, I can not reproduce this issue with wget 1.21.3 nor with current wget2. Please make sure you use the latest version of wget. Regards, Tim On 16.05.22 18:39, Great Zverre wrote: Hello guys! I’m using wget to make a mirror of https://releases.hashicorp.com but I don’t want to make a full

Re: is this a wget bug or something else?

2022-04-30 Thread Tim Rühsen
On 29.04.22 19:13, George R Goffe wrote: Hi, I'm pretty sure this is not a wget bug but I'm seeing a LOT of 'ERROR 421: Misdirected Request.' messages from wget. Could you comment on this please? Can you give a command line example where this happens ? Seems to be a server configuration

Re: wget-1.21.3-win32/64

2022-04-22 Thread Tim Rühsen
On 15.04.22 23:54, gc394625 wrote: Hi, Actually I'm using wget-1.21.3-win32/64 and I have (since long) a weird problem : I have an "old" Thecus N2100 NAS and a "less old" Netgear RN102 (newest Firmware). They are used in Windows with their UNC (\\NAS\Folder\). *Netgear RN102:* When

Re: wget pause when using --input-file

2022-04-03 Thread Tim Rühsen
Hi, On 02.04.22 06:08, BruceLam wrote: Dear GNU heros: When I use ./rssGet.sh to download mp3 files, wget pause and the terminal only shows the following text, but no actions: --2022-04-02 11:56:11--

Re: --convert-links should not convert # hrefs

2022-03-26 Thread Tim Rühsen
On 26.03.22 11:20, Christopher Gait-Smith wrote: When using the --convert-links in wGET, sites will often become broken if they contain: Will get converted to: I believe that hrefs that just have a #whatever should not get converted to file.html#whatever I can see how this breaks.

Re: wget timeout does not work

2022-03-11 Thread Tim Rühsen
-to-tackle-urgent-needs I am using version 1.19.4 with the following switches: wget -E -k -p -q -N --timeout=3 --tries=1 --server-response "URL" Any other help would be appreciated! Thanks, Dave On 2/25/22 9:33 AM, Tim Rühsen wrote: On 16.02.22 00:32, Dave Henderson wrote: Good aft

Re: wget ignoring no-parent, creating entire parent directory

2022-03-01 Thread Tim Rühsen
Hi Stephane, On 28.02.22 18:12, Stephane Ascoet wrote: Date: Sun, 27 Feb 2022 14:26:59 +0100 From: Tim Rühsen Did you already check the man page for --cut-dirs ? Hi, Tim answer is a little rude. Clearer and more complete explanation: you don't understand what "noparent" is for

Re: wget ignoring no-parent, creating entire parent directory structure

2022-02-27 Thread Tim Rühsen
On 25.02.22 18:51, Jibun no Kage . wrote: wget -r -np -R index.* http://infrastructure.dd.org/repository/infrastructure/usr/local/bin/rpitx/signals/ Did you already check the man page for --cut-dirs ? Regards, Tim OpenPGP_signature Description: OpenPGP digital signature

Re: wget timeout does not work

2022-02-25 Thread Tim Rühsen
On 16.02.22 00:32, Dave Henderson wrote: Good afternoon. I am trying to use wget to crawl some sites and one of the sites that it gets to makes it get stuck. I've tried using all the timeout parameters, even each individually. None of them work. It just stays stuck. Here's the link it is

Re: wget: unable to resolve host address

2022-02-18 Thread Tim Rühsen
On 16.02.22 21:04, Seymour J Metz wrote: Given that RFCs 3490-3492 came out in 2003 and 5890-5895 came out in 2010, I would have expected IDNA support by now. Does anybody know for sure? This issue has nothing to do with IDN support. It is about the fact that the input file uses a charset

Re: [PATCH] netrc: only remove backslash when we have quotes

2022-02-13 Thread Tim Rühsen
do escape the next character and that double quotes are needed for tokens with spaces. But I am not sure where exactly the best place is. Regards, Tim On 13.02.22 14:33, Tim Rühsen wrote: One thing is that different programs/parsers handle this differently, because there is no standardization

Re: [PATCH] netrc: only remove backslash when we have quotes

2022-02-13 Thread Tim Rühsen
One thing is that different programs/parsers handle this differently, because there is no standardization for the .netrc file. Some support spaces inside tokens, some not. The quotation mark is a wget extension to allow spaces and tabs inside a token. That means quotation marks inside the

Re: problems building wget2, both 2-0.0 AND from the repository

2022-01-26 Thread Tim Rühsen
ib-ada-1.4-0.29.20120830CVS.fc35.x86_64 zlib-ada-devel-1.4-0.29.20120830CVS.fc35.x86_64 zlib-devel-1.2.11-30.fc35.x86_64 zlib-ng-2.0.5-1.20210625gitc69f78bc5.fc35.x86_64 zlib-ng-devel-2.0.5-1.20210625gitc69f78bc5.fc35.x86_64 zlib-static-1.2.11-30.fc35.x86_64 On Wednesday, January 19, 2022, 05:22:47 A

Re: Wget

2022-01-23 Thread Tim Rühsen
Hi Gerd, On 23.01.22 09:52, ge...@mweb.co.za wrote: Hi, I see. Fascinating story. But it probably then is too late to fix that issue now (old wget, old servers, old antivirus on old router - they are all possible sources of errors.) Also, as was pointed out here by others (was it Tim?) as

Re: Wget

2022-01-21 Thread Tim Rühsen
Hi, I guess nobody even tries to reproduce the issue as nobody uses XP or the old wget 1.11.4. For example, I don't even have a Windows license and thus no Windows installed. To get better feedback from other users, I would suggest - update to the latest wget (hundreds of bugs have been

Re: problems building wget2, both 2-0.0 AND from the repository

2022-01-19 Thread Tim Rühsen
Hi, On 18.01.22 22:29, George R Goffe wrote: Hi, Thanks for your earlier reply. Somehow my /usr/lsd tool chain acquired a libz.a but NO libz.so. I renamed them to off.* and the wget2 build succeeded. You can also use ./confgure --without-zlib. No need to change something on the system

Re: problems building wget2, both 2-0.0 AND from the repository

2022-01-15 Thread Tim Rühsen
Hi, On 15.01.22 01:46, George R Goffe wrote: Hi, I'm trying to build wget2 from both the gnu ftp site and from the repository and am having trouble with "make install". I'm enclosing the build log. Could I get you to take a look at the end of the log and let me know what I'm doing wrong

Re: Automated nightly build using wget is reporting a security check issue and will not allow the download

2022-01-06 Thread Tim Rühsen
Hi, On 04.01.22 17:45, Laura Hebert wrote: Hello, I use Linux Ubuntu 18.04 to build an embedded linux (Yocto Sumo) - it builds nightly. Just before the holidays it stopped building because of a fetch php Temporarily Unavailable error. So I left it hoping it would fix itself over the holidays

Re: Bug report on ParrotSec on wget and SSLv3

2021-12-27 Thread Tim Rühsen
It looks like the underlying TLS/SSL library doesn't support SSLv3. You possibly need to build the TLS/SSL library with SSLv3 enabled. Regards, Tim On 27.12.21 16:38, keda...@outlook.com wrote: XUser:~/Desktop$ wget parrotsec.org --secure-protocol=SSLv3 --2021-12-27 10:29:27--

Re: Statify website problem

2021-12-03 Thread Tim Rühsen
On 02.12.21 22:48, Johan wrote: I have a hard time making a site static with wget, it keeps saving CSS files with versioning like main.css?v=12345 into main.css@v=12345.css, this is not at all what I want. I would prefer it would just save it to main.css without the query params, is this

Re: Problems downloading files on Windows with wget2 2.0.0

2021-10-17 Thread Tim Rühsen
do not own a Windows license and thus can not test/build on a Windows OS. Regards, Tim On 04.10.21 17:26, Jernej Simončič wrote: On Sunday, October 3, 2021, 11:21:58, Tim Rühsen wrote: while I try to reproduce here (have to build all the deps first), could you possibly do some more tests

Re: Problems downloading files on Windows with wget2 2.0.0

2021-10-17 Thread Tim Rühsen
not before the next weekend) Regards, Tim On 04.10.21 17:26, Jernej Simončič wrote: On Sunday, October 3, 2021, 11:21:58, Tim Rühsen wrote: while I try to reproduce here (have to build all the deps first), could you possibly do some more tests to narrow down the issue !? a) test with --max

Re: Bug? --reject download first, and THEN delete the file

2021-10-17 Thread Tim Rühsen
On 12.10.21 16:55, Gabriele Zaverio wrote: Hi there, Writing about wget --reject. When using it, wget actually download(!!!) the file, and THEN delete it. I think this is wrong. It must not download it at all. Can this be a bug / be corrected? Thank you Are you using wget in recursive

Re: Problems downloading files on Windows with wget2 2.0.0

2021-10-03 Thread Tim Rühsen
Hi Jernej, while I try to reproduce here (have to build all the deps first), could you possibly do some more tests to narrow down the issue !? a) test with --max-threads=1 --no-http2 b) test with --max-threads=1 using a plain text (http://) URL I think the message "failed to receive: 0" (the

GNU Wget2 2.0.0 released

2021-09-26 Thread Tim Rühsen
Hi, we are happy to announce the release 2.0.0 of GNU Wget2. Wget2 is the successor of GNU Wget, a file and recursive website downloader. Designed and written from scratch it wraps around libwget, that provides the basic functions needed by a web client. Wget2 works multi-threaded and uses

Re: Relative links for wget2

2021-09-04 Thread Tim Rühsen
On 23.08.21 06:10, Matt Huszagh wrote: Tim Rühsen writes: this works as expected with wget2 built from latest git master. Which reminds me that we urgently need a new release. If you want to build wget2 from tarball (which is more hassle-free than building from git master), follow

Re: Relative links for wget2

2021-08-21 Thread Tim Rühsen
Hi Matt, this works as expected with wget2 built from latest git master. Which reminds me that we urgently need a new release. If you want to build wget2 from tarball (which is more hassle-free than building from git master), follow the instruction from

Re: BUG in recent versions of WGET with POSTing more than 8 KiO data

2021-08-15 Thread Tim Rühsen
On 09.08.21 15:41, Taylor wrote: Hello Sorry, I can't reproduce this on Linux with wget 1.21 nor with wget from latest master. Thanks. I got the binaries from https://eternallybored.org/misc/wget/ Provided by Jernej Simončič jernej|s-webs...@eternallybored.org Shall I try to report it to

Re: BUG in recent versions of WGET with POSTing more than 8 KiO data

2021-08-07 Thread Tim Rühsen
Sorry, I can't reproduce this on Linux with wget 1.21 nor with wget from latest master. Did you report the issue to where you got the wget.exe from ? Regards, Tim On 02.08.21 15:19, Taylor wrote: To : bug-wget@gnu.org Subj : BUG in recent versions of WGET with POSTing more than 8 KiO data

Re: Warn that --compression=gzip is not enforced

2021-08-01 Thread Tim Rühsen
On 31.07.21 13:39, 積丹尼 Dan Jacobson wrote: "TR" == Tim Rühsen writes: TR> If you know that the server sends uncompressed content, you can TR> compress it yourself on-the-fly to avoid excessive disk space usage. TR> At least it works for single files: TR> wget -O-

Re: Warn that --compression=gzip is not enforced

2021-07-31 Thread Tim Rühsen
On 30.07.21 03:30, 積丹尼 Dan Jacobson wrote: The man page should mention for --compression=gzip, the website can still ignore it and send the whole file uncompressed. And wget is not picky, and still will accept it. So better have extra disk space ready. Tested with

Re: Exclusion failures

2021-07-08 Thread Tim Rühsen
[@\?].*" (the fourth and last term in the regex). Once again, https://regex101.com/ confirms that "event-4193082@CalendarViewType=1=6%2F27%2F2021.html" matches this term. Thanks for your support. -Original Message- From: Tim Rühsen Sent: Monday, July 5, 2021 4:09 PM To: R

Discussion: FTP in Wget2

2021-07-05 Thread Tim Rühsen
There has been some discussion if and how we should implement FTP(S) in Wget2. I'd like to get more feedback / suggestions / ideas on https://gitlab.com/gnuwget/wget2/-/issues/3#note_618746514. In case you don't have and don't want a Gitlab.com account, feel free to reply via email to this

Re: Exclusion failures

2021-07-05 Thread Tim Rühsen
On 28.06.21 19:36, Roger Brooks wrote: I am trying to use wget 1.19.1 to back up a club website. Here is a reduced version of my wget command, which only accesses the public parts of the website: cd /volume1/Backup/ wget -EkKrNpH \ --output-file=wget.log \

Re: Problème du caractère "+" dans la chaine de caractère de "--post-data"

2021-07-05 Thread Tim Rühsen
On 30.06.21 17:51, Mourad Amani wrote: Bonjour, Je travaille comme ingénieur en informatique dans une entreprise en France, j'ai un bug sur votre commande wget que je n'arrive pas à résoudre. Je suis actuellement en train de travailler sur un projet ou je dois lancer des données sur une url

Re: Solved: I can't download a Website with linked archive file exactly like I want

2021-06-25 Thread Tim Rühsen
On 18.06.21 18:22, Stephane Ascoet wrote: I've solved it: the directory is forbidden by robots.txt Wget should mention this on standard input when finished, something like "some elements couldn't be downloaded because of robots.txt rules" Good suggestion ! Maybe even with the exact number of

Re: Nohup and wget

2021-06-04 Thread Tim Rühsen
Hi Lionel, this seems to be an nohup / ssh issue. It looks like wget (or better: your script) receives another signal than SIGHUP. It might be SIGPIPE, which is typical when you try to write to a stream that has been closed or has no reader any more. This may be the reason why it works with

Re: Re:

2021-05-03 Thread Tim Rühsen
On 02.05.21 14:08, Tim Rühsen wrote: On 01.05.21 07:30, Rm Beer wrote: SO: Archlinux32 (Linux 5.11.10-arch1-1.0 #1 SMP PREEMPT Sat, 27 Mar 2021 20:56:37 + i686 GNU/Linux) packages: wget 1.21.1-1.0 gnutls 3.7.1-1.0 No matter what you do, modifying user-agent, cookies, or headers, it returns

  1   2   3   4   5   6   7   8   9   >