What to do when encountering sites where nutch falls into recursion mode? Currently I'm solving this by removing these sites with the regex filter, but, is anything under development currently?
By recursion I mean nutch fetching <sfdsdf>.com/<sth>/<sth>/<sth>/<sth>/<sth>/<sth> and on and on.... Any tricks to limis the folder depth in the fetch mode? E.
