Hi, On Wed, Jun 6, 2012 at 10:16 AM, Markus Jelsma <[email protected]> wrote: > > > Better would be to run the normalizers first because that will solve the > problem. The default normalizers add a trailing slash to hosts when it's > missing, that means .au/ is not a suffix anymore and is not going to be > filtered out. > > Please check out NUTCH-1373 which 'may' begin to help solve the problem. I've only scanned over this one so apologies if this is out of context... I'm trying to get caught up with traffic!!!
hth Lewis
