RE: Parsed segment has outlinks filtered

2019-10-18 Thread yossi.tamari
Hi Sachin, If you're using the default crawl script, I think the answer was in Sebastian's email: the default seems to be to filter only in the Parse step. This has changed recently, so the Fetch step now filters as well, but only if you have the latest code. Otherwise, you need to remove the

RE: Parsed segment has outlinks filtered

2019-10-17 Thread yossi.tamari
Hi Sachin, I'm not sure what you are trying to achieve: If you don't want to filter the outlinks, why do you enable urlfilter-regex? Anyway, if you set the property parse.filter.urls to false, the Parser will not filter outlinks at all. Yossi. -Original Message- From: Sachin