RE: wget hangs or downloads end up incomplete in Windows 2000 X P.
I tried --passive-ftp parameter on the Windows 2000 machine, and it hung during a file download with 3 seconds left. Never timed out. :( -- Ants. There's a size for every picnic, a colour for every occasion, and a bite to let you know that they are there. Apart from the bite, that could describe a Basenji pretty well. --Len Reddie /\___/\ / /\ /\ \ Phillip Pi (Ant) @ The Ant Farm: http://antfarm.ma.cx | |o o| | E-mail: [EMAIL PROTECTED] or [EMAIL PROTECTED] \ _ /Be sure you removed ANT from e-mail address if you get ( ) a returned e-mail. On Thu, 20 May 2004, Phillip Pi wrote: Not really. I know XP has its ICF enabled but 2000 doesn't have one. I can try it and see what happens. I added --passive-ftp parameter after wget.exe part. I doubt it will makes any differences. On Thu, 20 May 2004, Post, Mark K wrote: Are you behind a firewall or proxy of some kind? If so, you might want to try using passive FTP mode. Mark Post -Original Message- From: Phillip Pi [mailto:[EMAIL PROTECTED] Sent: Thursday, May 20, 2004 3:08 PM To: [EMAIL PROTECTED] Subject: RE: wget hangs or downloads end up incomplete in Windows 2000 X P. FYI. I noticed if I ctrl-c to get out of the hanging part and try to resume, my FTP seems to be broken and hangs. I tried manually with ftp.exe command in command line and it froze with dir command: Microsoft Windows XP [Version 5.1.2600] (C) Copyright 1985-2001 Microsoft Corp. C:\Documents and Settings\phillip_piftp 192.168.14.18 Connected to 192.168.14.18. 220 USSM-CPD Microsoft FTP Service (Version 5.0). User (192.168.14.18:(none)): domain\username 331 Password required for domain\username. Password: 230 User domain\username logged in. ftp dir 200 PORT command successful. 150 Opening ASCII mode data connection for /bin/ls. [stuck forever until I ctrl-c to break out of it] I either have to reboot the computer OR wait maybe ten minutes to try again with the FTP connection. On Wed, 12 May 2004, Phillip Pi wrote: On Wed, 12 May 2004, Herold Heiko wrote: OK, I did more tests. I noticed -v is already enabled by default since the you probably have verbose=on in your wgetrc file. Good idea. Should I delete wgetrc? I doubt that will fix my problem since I tried on two different Windows machines. FYI. I don't have wgetrc file anywhere. I only have sample.wgetrc file on the machines I used so it sounds like verbose is enabled by default regardless of wgetrc file. 5250K .. .. .. .. .. The timestamp was from almost an hour ago (I was in a meeting) during the download test. Notice it never timed out to retry or abort! Please What happens if you restart wget again with mirror-like options on the same directory tree ? Does it hang again on the same file ? If yes, what if you Which wget parameter options are they? I never noticed it hangs on the same file for each hang in different tests. Please remember sometimes I have missing files when downloads are complete. It is either hang, finish but incomplete, or perfect. Those are the three results I have seen from many tests. try to download that file only ? If not, could you for any chance run a sniffer on that machine (ethereal is free) ? I do not know how to use this network tool. If you can give me instructions I can try! It would be useful to know if really everything is freezed, or if, for example, for some reason the data is just trickling down at 1byte/minute or something similar (stuck in retrasmission?). I have no idea. Does wget have a bytes/bits per second statistics?
RE: wget hangs or downloads end up incomplete in Windows 2000 X P.
Not really. I know XP has its ICF enabled but 2000 doesn't have one. I can try it and see what happens. I added --passive-ftp parameter after wget.exe part. I doubt it will makes any differences. -- This is the ant. Treat it with respect. For it may very well be the next dominant lifeform of our planet. --Empire of the Ants movie /\___/\ / /\ /\ \ Phillip Pi (Ant) @ The Ant Farm: http://antfarm.ma.cx | |o o| | E-mail: [EMAIL PROTECTED] or [EMAIL PROTECTED] \ _ /Be sure you removed ANT from e-mail address if you get ( ) a returned e-mail. On Thu, 20 May 2004, Post, Mark K wrote: Are you behind a firewall or proxy of some kind? If so, you might want to try using passive FTP mode. Mark Post -Original Message- From: Phillip Pi [mailto:[EMAIL PROTECTED] Sent: Thursday, May 20, 2004 3:08 PM To: [EMAIL PROTECTED] Subject: RE: wget hangs or downloads end up incomplete in Windows 2000 X P. FYI. I noticed if I ctrl-c to get out of the hanging part and try to resume, my FTP seems to be broken and hangs. I tried manually with ftp.exe command in command line and it froze with dir command: Microsoft Windows XP [Version 5.1.2600] (C) Copyright 1985-2001 Microsoft Corp. C:\Documents and Settings\phillip_piftp 192.168.14.18 Connected to 192.168.14.18. 220 USSM-CPD Microsoft FTP Service (Version 5.0). User (192.168.14.18:(none)): domain\username 331 Password required for domain\username. Password: 230 User domain\username logged in. ftp dir 200 PORT command successful. 150 Opening ASCII mode data connection for /bin/ls. [stuck forever until I ctrl-c to break out of it] I either have to reboot the computer OR wait maybe ten minutes to try again with the FTP connection. On Wed, 12 May 2004, Phillip Pi wrote: On Wed, 12 May 2004, Herold Heiko wrote: OK, I did more tests. I noticed -v is already enabled by default since the you probably have verbose=on in your wgetrc file. Good idea. Should I delete wgetrc? I doubt that will fix my problem since I tried on two different Windows machines. FYI. I don't have wgetrc file anywhere. I only have sample.wgetrc file on the machines I used so it sounds like verbose is enabled by default regardless of wgetrc file. 5250K .. .. .. .. .. The timestamp was from almost an hour ago (I was in a meeting) during the download test. Notice it never timed out to retry or abort! Please What happens if you restart wget again with mirror-like options on the same directory tree ? Does it hang again on the same file ? If yes, what if you Which wget parameter options are they? I never noticed it hangs on the same file for each hang in different tests. Please remember sometimes I have missing files when downloads are complete. It is either hang, finish but incomplete, or perfect. Those are the three results I have seen from many tests. try to download that file only ? If not, could you for any chance run a sniffer on that machine (ethereal is free) ? I do not know how to use this network tool. If you can give me instructions I can try! It would be useful to know if really everything is freezed, or if, for example, for some reason the data is just trickling down at 1byte/minute or something similar (stuck in retrasmission?). I have no idea. Does wget have a bytes/bits per second statistics?
RE: wget hangs or downloads end up incomplete in Windows 2000 X P.
a potato chip across town. --Ron Darian /\___/\ / /\ /\ \ Phillip Pi (Ant) @ The Ant Farm: http://antfarm.ma.cx | |o o| | E-mail: [EMAIL PROTECTED] or [EMAIL PROTECTED] \ _ /Be sure you removed ANT from e-mail address if you get ( ) a returned e-mail. On Tue, 11 May 2004, Phillip Pi wrote: Herold, I will try using -v first and then -d if -v didn't show anything. On Tue, 11 May 2004, Herold Heiko wrote: Did you ever run the download with -v ? What did the log say when wget seemed to hang or regarding to the missing or corrupt files, or regarding the parsing of the directory index (or whatever it was) linking to those files ? If nothing usefull is logged, try again with -d (but be prepared, a huge amount of information will be logged - better redirect it to a file with -o log.txt or -a log.txt). If still nothing comes up, take a look at the server logs, if you can. -Original Message- From: Phillip Pi [mailto:[EMAIL PROTECTED] Sent: Monday, May 10, 2004 10:40 PM To: [EMAIL PROTECTED] Subject: wget hangs or downloads end up incomplete in Windows 2000 XP. Hello. I downloaded wget v1.9.1 (complete) from http://xoomer.virgilio.it/hherold/. I am having problems in downloading almost a GB of files (over 2600 files and 250 folders). Randomly, the download will just stall completely and never resume OR the download completes, but download is corrupted (sometimes missing files and subfolders). I also had this problem with old v1.8.2. The only way to fix is to set pause one second for each process, but this takes too long (almost an hour) with so many files and folders! Here's what I am using in batch file (download.bat -- changed URLs, account, and passwords for sample): @call wget -c -l0 -r -nH -w0 ftp://domain\username:[EMAIL PROTECTED]/Unreleasedbuilds /blah/blah/1/setups/SUBSETUP/* @call wget -c -l0 -r -nH -w0 ftp://domain\username:[EMAIL PROTECTED]/Unreleasedbuilds /blah/blah/1/setups/SUBSETUP/* I used a Pentium 3 1 Ghz system (512 MB of RAM) with Windows 2000 SP4 (all updates) and a Pentium 4 3 Ghz (HT enabled) with Windows XP Home SP1 (all updates). Each computer is using 100mb connection for network. Doing a copy in Windows' Explorer through network share has NO problems. I assume this method is slower transfer compared to wget command. I'd like to use script so I don't have to do this manually. ;)
wget v1.9 (Windows port) newbie needs help in download files recursively...
Hi. I am trying to get wget.exe v1.9 to work under Windows 9x and NT5 OS', but I cannot get it to work the way I want it. I am trying to download subfolders/subdiretories and binary files recursively from a specified folder. Notes: The FTP server is Microsoft FTP Service (Version 5.0). The password has $1 in it. I revised the texts to not show the real details due to private information. The example is in Windows 2000 SP4's CLI: C:\test\wget-v1.9wget -r ftp://domainname\user_name:[EMAIL PROTECTED]/builds/productname/version/8/subfolder/layout/* --14:07:02-- ftp://domainname%5Cuser_name:[EMAIL PROTECTED]/builds/productname/version/8/subfolder/layout/* = `192.168.0.222/builds/productname/version/8/subfolder/layout/.listing' Connecting to 192.168.0.222:21... connected. Logging in as domainname\user_name ... Logged in! == SYST ... done.== PWD ... done. == TYPE I ... done. == CWD /builds/productname/version/8/subfolder/layout ... done . == PORT ... done.== LIST ... done. accept: Unknown error I can do a manual FTP login and stuff without any problems, but can't do recursive downloads (limited due to ftp.exe). Any ideas? Thank you in advance. :) -- There's an ant crawling up your back in the nighttime. --TMBG /\___/\ / /\ /\ \Phillip Pi (Ant); The Ant Farm: http://antfarm.ma.cx | |o o| | \ _ /E-mail: [EMAIL PROTECTED] or [EMAIL PROTECTED] ( )
