Hi, this error is not that unusual when you train an n-gram model over part of speech tags. These tags are all very frequent, which then causes Kneser-Ney smoothing to fail.
You can address this by not using Kneser Ney smoothing for such models. This can be done in EMS by adding the line settings = "-interpolate -unk" to the [LM:...] section where you define the n-gram model over tags. -phi On Thu, Sep 12, 2013 at 10:27 PM, karan sharma <[email protected]>wrote: > > Hey, > I am using EMS for factored model.I am getting this error "step > LM:toy:train crashed". > > STDERR file: > one of required KneserNey count-of-counts is zero > error in discount estimator for order 1 > > Can anyone help with it? > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
