Hi if a url is denied by denied once by robots.txt rules,is crawled again by nutch?
-- View this message in context: http://www.nabble.com/denied-by-robots.txt-rules-tp24750517p24750517.html Sent from the Nutch - User mailing list archive at Nabble.com.
