On 16 Nov 2023 at 13:45, grafgrim...@gmx.de wrote: Date sent: Thu, 16 Nov 2023 13:45:42 +0100 From: grafgrim...@gmx.de To: bug-wget@gnu.org Subject: fail to download big files correctly
> Dear wget developers, > > I use "GNU Wget 1.21.4" and I have problems to download big files with > wget. Unsure, what "big" exactly means. > > For example I download firefox-source, noto-font, linux-firmware and > get checksum failures when using wget. These files are 340 MB to 1 GB. > > size in bytes: > 356057052 linux-firmware-20231111.tar.xz > 524717896 firefox-119.0.1.source.tar.xz > 1062488324 noto-20231031.tar.gz > > Download is okay when using a web browser or curl. > > So my weak guess is that wget can not handle big file downloads. > When I use wget several times to get the file, i always get another > checksum after download finished with wget. > > No problems when downloading small files. Unsure, what "small" exactly > means. Not sure on windows version, but tested downloading a 2099451904 Fedora-Workstation-Live-x86_64-38-1.6.iso using linux wget and wget2 programs. Both downloaded files on my local 1G network and both times files matched 100% with a binary compare. Downloaded Compared deleted fie and repeated. Got about 90MB download speed. Do know the wget2 had an issue with multi-threading with the 2.0 version, but the 2.1 version seems to handle up to 10 threads without issues. Only time I've used it with large files, and only locally with my local machines. Only have a 50Mb download and 3Mb upload, so not wanting to test. There is a windows build with the 2.1 version https://gitlab.com/gnuwget/wget2/-/releases Has 64 bit version for windows. > > Greetings > Graf Grimm > +------------------------------------------------------------+ Michael D. Setzer II - Computer Science Instructor (Retired) mailto:mi...@guam.net mailto:msetze...@gmail.com Guam - Where America's Day Begins G4L Disk Imaging Project maintainer http://sourceforge.net/projects/g4l/ +------------------------------------------------------------+
