On Thu, Feb 9, 2012 at 10:30 AM, Katrin Tomanek <katrin.toma...@averbis.com>wrote:
> Hi, > > but somehow we have to force the model to know which context generator and > eos scanner to use. Otherwise, the features extracted during training and > during testing are inconsistent. > > I believe this is absolutely to be avoided -- otherways I cannot trust my > model. > > Maybe, for convenience, this could be done: > - if you are just interested in using different EOS chars (but still going > with the default context generator for feature extraction), then EOS chars > can be defined during training and will be stored in the model > - and for better customization, we might also allow users to specify a > custom factory which is stored in the model and insures consistency. > > What do you think? > > +1 to both. I suggest that you open a jira for the EOS improvement. It would of course be very nice if you can contribute this change. We receive contributions always via patches which are attached to the jira issues. Jörn
