Today we met and discussed the future redesign of NSP. More details of this discussion will be provided shortly, but there were some other isssues to follow-up on.
First, we discussed Exact Tests in some detail, and I mentioned that my 1996 paper, Fishing for Exactness, gives what I hope is a good introductory explanation about Fisher's exact test, at least for 2x2 tables. You can find that paper here: http://xxx.lanl.gov/abs/cmp-lg/9608010 We also discussed that NSP has now been used in many applications other than what we originally imagined! This is I think a tribute to the ease of use that NSP provides. One recent example is an application in Intelligent Tutoring : Using Bigrams to Identify Relationships Between Student Certainness States and Tutor Responses in a Spoken Dialogue Corpus (Kate Forbes-Riley and Diane Litman), In Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue (SIGdial 2005), Lisbon, Portugal, September 2005. http://www.cs.pitt.edu/~litman/sigdial05-final.pdf There are in fact quite a few published papers that rely on (and cite) NSP. One of my goals is to compile an online bibliography, like we are doing for WordNet-Similarity. You can get a rough approximation of such a bibliography by using Google Scholar and searching for "ngram statistics package": http://scholar.google.com/scholar?hl=en&lr=&q=%22ngram+statistics+package%22&btnG=Search So, NSP has clearly made an impact, and is well worth the effort we will spend this year in its redesign. My two favorite things about NSP are the fact that you can specify the tokenization scheme via regexes, which I love, and then the ability to have bigrams with a flexible or floating window size. I'm also a very big fan of the more recent utility program kocos.pl, which allows us to see networks of co-occurring words. I hope you have your own favorite aspects of the package, and that you'll give it a try again if you haven't used it in a while. Keep in mind that if you use SenseClusters or any of our Word Sense Disambiguation tools, you are using NSP (it lurks in the background often!). Ted -- Ted Pedersen http://www.d.umn.edu/~tpederse ------------------------ Yahoo! Groups Sponsor --------------------~--> DonorsChoose.org helps at-risk students succeed. Fund a student project today! http://us.click.yahoo.com/G7lQgA/FpQLAA/HwKMAA/x3XolB/TM --------------------------------------------------------------------~-> Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/nlpatumd/ <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
