> You can use the HostURLNormalizer for this task or just crawl the www OR > the non-www, not both. >
I'm trying to crawl only version without www. As I see, I can remove www. using proper configured regex-normalize.xml. But will it work if mobile365.ru redirect on www.mobile365.ru (it's very common situation in web) Thanks. Alexei