!/bin/bash dist/bin/moses $@ nbest=$(magic argument parser to get nbest file name which should be something like grep and/or cut) detokenizer <$nbest >$nbest.detok mv $nbest.detok $nbest
Where detokenizer understands the n-best list format. On 03/17/2012 02:20 PM, Barry Haddow wrote: > But mert doesn't use the moses output, it uses the nbest list. > > On Saturday 17 Mar 2012 18:10:04 Kenneth Heafield wrote: >> Write a shell script? >> >> #!/bin/bash >> dist/bin/moses $@ |detokenizer >> >> Then tell mert that your Moses binary is this shell script. >> >> Kenneth >> >> On 03/17/2012 02:00 PM, Barry Haddow wrote: >>> Hi Salameh >>> >>> I don't think there's any way to do this in mert without code changes. >>> You could either run your recombiner across the nbest list after it is >>> output by moses (this would require changes to mert-moses.pl) or you can >>> alter the extractor in mert to do the recombining before extracting bleu >>> scores (requires changes to the C++ code in mert), >>> >>> cheers - Barry >>> >>> On Saturday 17 Mar 2012 17:16:58 Mohammad Salameh wrote: >>>> Hi >>>> I am translating from English to Arabic. >>>> And I have trained my model on segmented Arabic. >>>> When tuning, I want to to tune using non-segmented Arabic >>>> by recombining the Arabic translation output before each tuning >>>> iteration. I have already >>>> written the code for recombining Arabic segmented output. Is there a >>>> feature >>>> within MERT that can recombine the segmented output after each tuning >>>> iteration, >>>> and calculates BLEU score based on that ? Or i have to do some changes >>>> in the moses-mert.pl? >>>> >>>> >>>> Regards, >>>> Salameh >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
