Andy Liu wrote: > You can try indexing all 2-grams, 3-grams, and 4-grams in your corpus. Then > you can examine all the terms in your index and see which n-grams are used > the most.
Another idea can be to download a dump of the Wikipedia database (from http://download.wikimedia.org/) and use the list of article titles to see if the named concept has an article there, such as the 2-gram "Henry Ford" or the 4-gram "weapons of mass destruction". That's just a loose idea. I haven't tried it. Are there any good introductory books on modern, post-Google information retrieval? -- Lars Aronsson ([EMAIL PROTECTED]) Aronsson Datateknik - http://aronsson.se ------------------------------------------------------- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
