Folks, I ran wget (1.9.1) on Debian GNU/Linux to find out how many links my site had, and after "Queue count 66246, maxcount 66247" links, the wget process ran out of memory. Is there a way to set the persistent state to disk instead of memory so that all the system memory and cache is not slowly consumed until the process halts? My site may have 1 M to 2 M links.
Thanks, OSC -- ___________________________________________________ Play 100s of games for FREE! http://games.mail.com/
