Hello, I am working with kenlm models and Moses. I have several different models and want to determine which model fits my data best before I train Moses. I know that there are simple command line calls for eg SRILM to calculate perplexity but I couldn't find anything equivalent for kenlm.
The only thing I could find is a python function model.score(sentence) but no information about the score itself. Does anybody know more about the score function of kenlm? Or does anybody know another way of calculating perplexity of a kenlm language model with respect to a test corpus? Thanks in advance, Sarah -- Sarah Schulz LT3 Language and Translation Technology Team Department of Translation, Interpreting and Communication Ghent University Groot-Brittanniëlaan 45 9000 Gent [email protected] _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
