by default the srilm prunes singletons

Miles

2008/8/5 John D. Burger <[EMAIL PROTECTED]>

> Hi -
>
> I'm still trying to debug my differences between old and new versions
> of Moses, which (for us) use SRILM and IRSTLM respectively.  My
> current puzzle is over the very different sizes of the language
> models resulting from SRILM and IRSTLM - the latter has 5 times as
> many 5-grams, for instance.
>
> I'm not using the -p (prune) switch for IRSTLM, and by my reading,
> SRILM does no pruning of low-frequency ngrams by default:
>
>   http://www.speech.sri.com/projects/srilm/manpages/ngram-count.1.html
>
> Does anyone have a different opinion?  Thanks!
>
> - John Burger
>   MITRE
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


-- 
The University of Edinburgh is a charitable body, registered in Scotland,
with registration number SC005336.
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to