Hi, for some reason that command needs to be called like this:
LC_ALL sort phrase-table | /STATMT/moses/misc/processPhraseTable -ttable 0 0 - -nscores 5 -out phrase-table See also documentation here: http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc2 -phi On Thu, Feb 28, 2008 at 4:13 PM, Hubert Crépy <[EMAIL PROTECTED]> wrote: > J C Read a écrit : > > > I've seen mention of filtering the model before translation. > > > Thanks for the hint, it did point me in the right direction. > I found the moses/scripts/training/filter-model-given-input.pl tool. > Given an a priori known input, it does reduce the model to a manageable > size. Works well for a static document. > Wouldn't work for on-the-fly translation of dynamic input, though... > > In the same directory, I found: > moses/scripts/training/filter-and-binarize-model-given-input.pl > which in turn pointed me to: > $ /STATMT/moses/misc/processPhraseTable -h > - convert ascii ttable in binary format > So this looks like the utility I was looking for, to convert my huge > translation table into a binary format. > I gave it a try, but unfortunately the only output is: > processing ptree for > ERROR: these functions are currently broken... > (whether I try it directly on the .gz zipped table or on a previously > gunzipped version -2Gb-, makes no difference...) > > -- > Hubert Crépy > > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
