I know you can enable language detect during index-more however is there a method to doing this during the crawl?
I'm interested in building an index as english only right now. what is the theory behind that? anyone have any experience? would it be building a huge black list, ignoring tlds until you find a computational method or??? thoughts anyone?
