Hi Henry Did you run 'export LC_ALL=C' before the processPhraseTable command? http://comments.gmane.org/gmane.comp.nlp.moses.user/3675
Failing that, check for control characters (such as vertical tabs) in your phrase table, cheers - Barry On Tuesday 15 May 2012 07:37:08 Henry Hu wrote: > Hi folks, > > I followed the guide: > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc3 > My phrase-table is about 4G size and the machine I'm using has 8G RAM. > But after running about 5 minutes, the command broke: > > $ cat phrase-table | sort | > /home/aaa/moses/mosesdecoder/dist/bin/processPhraseTable -ttable 0 0 - > -nscores 5 -out phrase-table > processing ptree for stdin > ERROR: xsource phrase already inserted (B)! > line(8): '000 ||| 000 - ||| 0.142857 0.82872 0.000498008 0.00133883 > 2.718 ||| ||| 7 2008' > f: 1 0 > Aborted > > I have no idea how to fix it. Thanks for any suggestion. > > Best Regards, > Henry > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > -- Barry Haddow University of Edinburgh +44 (0) 131 651 3173 -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
