Hi everyone! Let's say we start a crawl with depth 5 and topN 500 and www.something.com, with domain(www.something.com) and regex urlfilters. I have noticed that the url: www.something.com is fetched, parsed and updated in every depth. Why is that happening? In my opinion the particular url should be fetched and parsed only in the 1st depth and updated in every depth.
Thank you in advance,
Vangelis
