Henry, It's really important that the pre-processing steps that prepare your source language for decoding must replicate the results of the preparation that created the source language half of your parallel corpus before training. Likewise, the post-processing of the target language after decoding must "undo" the preparation of the target language half of your parallel data. Many times, the individual steps and their order are unique for each translation model. So, you have to know and track what steps and versions of scripts that were used to create the translation model.
On Thu, 21 Jun 2012 11:27:12 +0200, Hieu Hoang <[email protected]> wrote: > yes, the preprocessing and postprocessing steps can be quite > complicated. > > if you use the experiment management system (EMS), it will set up the > steps for you. The EMS can be found in > scripts/ems > > there is no process than replaces tags, entities etc with > placeholders. > You have to do that yourself, perhaps by annotating the input > sentence > with xml > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc5 > > > On 20/06/2012 04:58, Henry Hu wrote: >> Hi all, >> >> I was wondering where the detailed steps of decoding are? I've look >> through at manual and document on http://www.statmt.org and not >> found >> them. >> >> Now, I've got some materials to translate. I suppose that I should >> follow these steps blew: >> >> . lowercase >> . replace tags, entities, etc with placeholders >> . tokenize >> . decode >> . detokenize >> . replace placeholders with tags, entities, etc >> . recase >> >> There are so many processes to handle. Where can I get a guide for >> decoding? Thanks for any suggestions. >> >> Best Regards, >> Henry >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
