> If that's really the case (you know, it doesn't always work this way for > all sites)
Certainly, but for the network that I'm crawling it does. I'd actually already used the regex-urlfilter to do just this, but wasn't seeing any change in the results being returned. Regenerating the db from the segments should fix the problem? Thanks for your help.
