Dear Jorg, I encountered similar issue for my character SMT experiments concurrently looking at your paper ( http://aclanthology.info/papers/combining-word-level-and-character-level-models-for-machine-translation-between-closely-related-languages) and added a line to call a script before the gzip of the nbest file within the MERT main loop.
At the end of section 2, you mention that: " [image: Inline image 1] " Preslav Nakov <http://aclanthology.info/people/preslav-nakov-5181> | Jörg Tiedemann <http://aclanthology.info/people/jorg-tiedemann-3696> *Anthology:*P12-2059 Volume:Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) <http://aclanthology.info/volumes/proceedings-of-the-50th-annual-meeting-of-the-association-for-computational-linguistics-volume-2-short-papers> *Authors:*Preslav Nakov <http://aclanthology.info/people/preslav-nakov-5181> | Jörg Tiedemann <http://aclanthology.info/people/jorg-tiedemann-3696> *Month:*July *Year:* 2012 *Venue:*ACL <http://aclanthology.info/venues/acl> *Address:*Jeju Island, Korea *SIG:* *Publisher:*Association for Computational Linguistics *Pages:*301–305 *URL:*http://aclweb.org/anthology/P12-2059 Regards, Ergun On Sat, Apr 22, 2017 at 8:41 PM, Hieu Hoang <[email protected]> wrote: > sounds good. You're always welcome to check it in yourself as long as you > look after it. Send me your github username or create a git pull request > > * Looking for MT/NLP opportunities * > Hieu Hoang > http://moses-smt.org/ > > > On 22 April 2017 at 15:44, Jorg Tiedemann <[email protected]> wrote: > >> >> Great - thanks. I modified a little to make it possible to pass a command >> to the new option. >> I hope I didn’t break anything. Maybe this modification could become part >> of the official moses package? >> >> Jörg >> >> Jörg Tiedemann >> [email protected] >> >> >> >> >> >> >> >> On 22 Apr 2017, at 15:50, Anoop (അനൂപ്) <[email protected]> >> wrote: >> >> Hi Jorg, >> >> I had made changes to mert-moses.perl to achieve exactly what you are >> looking for. Please find the script attached. >> >> To enable character level to word level transformation, you have to pass >> the option '--transform-decoded-file' to mert-moses.pl >> The script assumes that a caret token '^' has been added between words >> while preprocessing the corpora. So, all subwords between two carets are >> merged to create a single word. The changes are on line 826--834. >> >> Regards, >> Anoop. >> >> >> >> On Sat, Apr 22, 2017 at 5:10 PM, Jorg Tiedemann <[email protected]> >> wrote: >> >>> Hi, >>> >>> Is there an easy way to integrate a small script to process n-best lists >>> in mert-moses.perl before running mert at each iteration? An example would >>> be to merge character-level translations to run mert on word-level >>> segmentations. It’s probably rather straightforward to add an option to >>> specify a script for filtering but it may already exist and I just don’t >>> see it? >>> >>> Thanks! >>> Jörg >>> >>> ************************************************************ >>> ********************************** >>> Jörg Tiedemann >>> Department of Modern Languages http://blogs.helsinki.fi/tiedeman/ >>> University of Helsinki >>> http://blogs.helsinki.fi/language-technology/ >>> >>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> >> >> -- >> I claim to be a simple individual liable to err like any other fellow >> mortal. I own, however, that I have humility enough to confess my errors >> and to retrace my steps. >> >> http://flightsofthought.blogspot.com >> <mert-moses.pl>_______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -- Regards, Ergun
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
