Error 403 when using wget
Hi there, I have a rather puzzling problem with only some sites. Short version: For some sites, I can not retrieve html files if these files already exist on my harddisk. Long version: I try go mirror www.grc.com with the command wget http://www.grc.com --mirror and get ERROR 403: Forbidden. for the file www.grc.com/index.html Well, this has worked before, I have the file www.grc.com\index.html on my disk. If I delete this file, things work alright and processing continues up to the next html-file. This again fails if I already have it on my disk. Browsing this site with Netscape (same proxy) is not a problem. First I thought the site was blocking wget, but I tried changing the user agent in wget - no improvement. I get the Error 403 in wget only for html files, never for other files. So far I have found two sites with this problem, www.grc.com and www.sysinternals.com. Other sites - no problem. Can someone tell me please what is going on? Can I solve this problem here locally, or do I need to contact the webmasters of these sites, asking for a change? If so, which change? Thanks for all advice Ulrich PS: In case it matters, I am using 'GNU Wget 1.7.1-pre1', running on WinNT 4.0, SP6. -- Unix gives you just enough rope to hang yourself -- and then a couple of more feet, just to be sure. (Eric Allman)
Size bug in wget-1.7
Not sure if this is wget's fault or a broken server, but it happens on a lot of servers so maybe it should be handled better. The bug seems to manifest itself when resuming an FTP transfter and the length is unauthoritative. The reported total length is in fact the remaining length (i.e. the total length minus the length downloaded); the reported remaining length is the total length minus twice the length downloaded, which goes negative once you've downloaded 50% of the file! For example, the actual size of kdebase-2.2.tar.bz2 is 10917131 bytes, and this is what my log says when the transfer was resumed at 56%: --11:38:44-- ftp://ftp.sourceforge.net/pub/mirrors/kde/stable/2.2/src/kdebase-2.2.tar.bz2 = `kdebase-2.2.tar.bz2' Connecting to ftp.sourceforge.net:21... connected! Logging in as anonymous ... Logged in! == SYST ... done.== PWD ... done. == TYPE I ... done. == CWD /pub/mirrors/kde/stable/2.2/src ... done. == PORT ... done.== REST 6131968 ... done. == RETR kdebase-2.2.tar.bz2 ... done. Length: 4,785,163 [-1,346,805 to go] (unauthoritative) [ skipping 5760K ] 5760K 131% @ 2.07 KB/s As an artefact of this bug, the percentage downloaded is also incorrect (also shown here) Yours, Dave Turner [EMAIL PROTECTED]
help on configuration
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi all, I have installed a copy of the wget package version 1.5. I have tried (and failed) to run the program with the following command line args, but I get strange replies. wget -m -L -l2 -A 105181* http://sunsolve.sun.co.uk/autopatch I have my proxy host, user, passwd. my sunsolve user name password set up in .wgetrc file and it connects ok, but when I look at the results in the sunsolve.sun.o.uk directory all I see is a file as below: ~/sunsolve.sun.co.uk/private-cgi/show.pl?target=raw-patchdisplay=plai n in this file is href entries with the patches listed (all of them), but I am not receiving the patch 105181 at all. what am I doing wrong. Confused Kevin - - Lie, n.: A very poor substitute for the truth, but the only one discovered to date. - - -BEGIN PGP SIGNATURE- Version: PGPfreeware 7.0.3 for non-commercial use http://www.pgp.com iQA/AwUBO3qF/wxuP44/+NFmEQJTbQCeLb21eji8yKjY91aJFhsJInMNoicAoOKJ ETcxus1TnhZuJia/9uxT849j =Nybc -END PGP SIGNATURE- PLEASE READ: The information contained in this e-mail is confidential and intended for the named recipient(s) only. If you are not an intended recipient of this email you must not copy, distribute or take any further action in reliance on it and you should delete it and notify the sender immediately. Email is not a secure method of communication and Nomura International plc cannot accept responsibility for the accuracy or completeness of this message or any attachment(s). Please examine this e-mail for virus infection, for which Nomura International plc accepts no responsibility. If verification of this email is sought then please request a hard copy. Unless otherwise stated any views or opinions presented are solely those of the author and do not represent those of Nomura International plc. This email is intended for informational purposes only and is not a solicitation or offer to buy or sell securities or related financial instruments. Nomura International plc is regulated by the Securities and Futures Authority Limited and is a member of the London Stock Exchange. PGPexch.rtf.asc
Incorrect calculating
Hi, I've found a bug in wget 1.7 running on Debian Unstable. I downloaded the 640 MB ISO of the Freebsd 4.3 Install CD. Download was from linuxiso.org which redirected wget to a ftp mirror in Canada. I downloaded the first 77% (~500MB) from there. Then my ISDN Line (YES I download a 640 MB file with 7.5 kb/s ;-) was disconnected (this happens every 24 hours). So I continued the Download with wget -c but linuxiso redirected me to another Server. The complete URL is: ftp://ftp.fsn.hu/pub/CDROM-Images/freebsd/i386/ISO-IMAGES/4.3-install.iso And here is the bug: after continuing the download from another ftp Server wget says that it has downloaded 337% of the file instead of 77%. It counts up to 430% when the file is finished. The file's md5sum is correct so it is just a calculating problem. I hope this helps to fix this bug. Thanks for coding wget. It's the best download manager out there. The view of the current download speed which came with version 1.7 is the last feature I missed. Keep up the good work Andreas -- Wiesenstr. 5 * 74831 Gundelsheim * Germany Tel.: +49 06269/8997 * Mobil: 0179/5335280 Mailto: [EMAIL PROTECTED] http://www.pro-linux.de/ http://www.ahe-net.f2s.com/
