Re: wget crashes on a recursive download of my city's website

2022-06-12 Thread Tim Rühsen
On 06.06.22 23:07, Eric Gallager wrote: It took several hours before the crash happened, so I don't really want to run the command again just to get a backtrace... If you can get your hands on wget2: drop --preserve-permissions (FTP only) and add --max-thread=50 to your command line.

Re: wget crashes on a recursive download of my city's website

2022-06-12 Thread Tim Rühsen
The previous email triggered a bug in an already approved merge request - so it's not related to your issue (but nice to have found the issue anyway). So I let your wget command run with wget 1.21.3 over night. Andthis morning it showed the backtrace at exactly the same spot as you posted.

Re: wget crashes on a recursive download of my city's website

2022-06-11 Thread Tim Rühsen
On 06.06.22 23:07, Eric Gallager wrote: I was trying to use wget to download all of the calendar files on my city website: http://concordnh.gov/iCalendar.aspx Admittedly I'm kind of inexperienced at wget, so I probably didn't use the right command-line, but anyways it was: $ wget -r --tries=3 -c

Re: wget crashes on a recursive download of my city's website

2022-06-11 Thread Tim Rühsen
Nvm, just reproduced the crash (or another one), took no longer than 10 mins. I have no time right now to dig into it. Just in case someone else wants to chime in: This was on branch `origin/dynamic-buf-size`, where origin is https://gitlab.com/gnuwget/wget.git. Built with ./configure

wget crashes on a recursive download of my city's website

2022-06-06 Thread Eric Gallager
I was trying to use wget to download all of the calendar files on my city website: http://concordnh.gov/iCalendar.aspx Admittedly I'm kind of inexperienced at wget, so I probably didn't use the right command-line, but anyways it was: $ wget -r --tries=3 -c --random-wait -E --preserve-permissions