Thanks Prof. I had missed the post-decoding-transliteration.pl step. I executed the same and got the output. The output is looking good and there is BLEU score improvement. Compliments to the efforts of the team.
Also created a small doc which goes through the steps for Unsupervised Transliteration without ems https://docs.google.com/document/d/1G9RjczZXWGHU6byJFORf6uToItph1jU_piL53wQhGXg/edit?usp=sharing Regards, On Fri, Sep 26, 2014 at 11:11 PM, Philipp Koehn <[email protected]> wrote: > Hi, > > did you run post-decoding transliteration? > > The original Moses run does not perform the transliteration, it only > produces > additional output that is used in the post-decoding transliterations step. > > That step is done by running $MOSES/scripts/Transliteration/ > post-decoding-transliteration.pl > > Post-decoding transliterations is fully integrated into EMS, but you can > also > run it by hand. Unfortunately there is no detailed documentation about the > script, but its options are pretty self-explanatory. > > -phi > > On Fri, Sep 26, 2014 at 7:43 AM, Ratish Puduppully <[email protected]> > wrote: > >> Hi, >> Thanks for introducing support for Unsupervised transliteration in moses. >> I was able to execute the same as mentioned using EMS. >> I wish to implement it using moses training scripts. I performed the >> following steps: >> >> - Set up srilm, mgiza >> - Execute train-transliteration-module.pl >> - It generated phrase table for transliteration >> - I then train moses for translation. I add two arguments: >> -post-decoding-translit >> yes, -transliteration-phrase-table <path to transliteration phrase table> >> >> Accordingly, my moses.ini has additional entries >> But during decoding, my transliteration phrase table is not being >> consulted. Thus the OOV words are not being transliterated. >> I have attached my moses.ini file >> Please help resolve the issue. >> >> -- >> Ratish Puduppully >> Research Engineer >> Center for Indian Language Technology <http://www.cfilt.iitb.ac.in/> >> Computer Science and Engineering Department <http://www.cse.iitb.ac.in/> >> IIT Bombay <http://www.iitb.ac.in/> >> email: [email protected] >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -- Ratish Puduppully Research Engineer Center for Indian Language Technology <http://www.cfilt.iitb.ac.in/> Computer Science and Engineering Department <http://www.cse.iitb.ac.in/> IIT Bombay <http://www.iitb.ac.in/> email: [email protected]
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
