Unfortunately this is on a shared hosting server that I have no control
over. I will reach out to their staff to see what can be done. I
appreciate the confirmation of fixes in the latter version though Tim.
Dave
On 3/11/22 2:16 PM, Tim Rühsen wrote:
Hey Dave,
just testing with wget 1.21.2 and it times out after 3s with your
command line.
So this is a long fixed issue. Your wget 1.19.4 is from Jan 2018 and
dozens or hundreds of issues has been fixed meanwhile. Please try to
update.
Regards, Tim
On 08.03.22 22:45, Dave Henderson wrote:
Thanks for getting back in touch Tim. Sorry it took a little bit to
respond. I tried your suggestion, but there is no difference in the
outcome - wget still hangs. Here is another URL to test:
https://www.usnews.com/news/politics/articles/2022-03-04/clinton-global-initiative-restarted-to-tackle-urgent-needs
I am using version 1.19.4 with the following switches:
wget -E -k -p -q -N --timeout=3 --tries=1 --server-response "URL"
Any other help would be appreciated!
Thanks,
Dave
On 2/25/22 9:33 AM, Tim Rühsen wrote:
On 16.02.22 00:32, Dave Henderson wrote:
Good afternoon. I am trying to use wget to crawl some sites and one
of the sites that it gets to makes it get stuck. I've tried using all
the timeout parameters, even each individually. None of them work.
It just stays stuck. Here's the link it is getting stuck on:
https://www.adidas.com/us/women-sports_bras?cm_mmc=AdiDisplay_-_-training-_--_-Billboard-_-Default_ad-_-dv%3ABrand-_-cn%3ABRAREVOLUTIONAPPSS22_Reach-_-pc%3Atraining&cm_mmc1=GLOBAL&cm_mmc2=adidas-GLOBAL-Brand-Display-training-Multiple-GLOBAL-BRAREVOLUTIONAPPSS22-2202
Looking forward to hearing back!
By default, wget retries up to 20x, with a growing time span between
retries.
Just try --timeout=3 --tries=1.
Regards, Tim
