More specifically, it's a sign that your data might have to be de-duplicated. The error occurs when there are no singleton n-grams of a certain order.
- Uli On Fri, Oct 23, 2015 at 7:22 AM, Marcin Junczys-Dowmunt <[email protected]> wrote: > Hi, > That's what --discount_fallback is for. > Best, > Marcin > > -- > Sent from my phone > > > -------- Wiadomość oryginalna -------- > Temat: [Moses-support] lmplz error > Od: Hieu Hoang > Do: moses-support > DW: > > > hi all > > does anyone know how to fix this error from lmplz: > terminate called after throwing an instance of > 'lm::builder::BadDiscountException' > what(): ERROR: 4-gram discount out of range for adjusted count 3: > -0.446424 > The command I was running is > .../lmplz --text .../Ubuntu.truecased.3 --order 5 --arpa > .../Ubuntu.lm.3 --prune 0 0 1 -T .../lm -S 20% > I guess there's not enough data to create a 5-gram > > -- > Hieu Hoang > http://www.hoang.co.uk/hieu > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > -- Ulrich Germann Senior Researcher School of Informatics University of Edinburgh
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
