Hello people! Lets say we choose 20 threads to fetch. How do they cooperate? I mean, who tells them what pages each one of them will fetch? Is it possible some of them to collide or fetch the same page without them knowing? I read the code and found that if the redirect is to the same page, it will not follow that redirect. Any advice would be very helpful!
Vangelis

