Yes, true, I added that for an older version of mert but it changed a lot since then and I was too lazy to look for the best place in the latest script. That’s also why I’d like to include the option in the official repository now. I’ll do that now ...
Jörg > On 23 Apr 2017, at 00:27, Ergun Bicici <[email protected]> wrote: > > > Dear Jorg, > > I encountered similar issue for my character SMT experiments concurrently > looking at your paper > (http://aclanthology.info/papers/combining-word-level-and-character-level-models-for-machine-translation-between-closely-related-languages > > <http://aclanthology.info/papers/combining-word-level-and-character-level-models-for-machine-translation-between-closely-related-languages>) > and added a line to call a script before the gzip of the nbest file within > the MERT main loop. > > At the end of section 2, you mention that: > " > <image.png> > " Preslav Nakov <http://aclanthology.info/people/preslav-nakov-5181> | Jörg > Tiedemann <http://aclanthology.info/people/jorg-tiedemann-3696> > Anthology: > P12-2059 > Volume: > Proceedings of the 50th Annual Meeting of the Association for Computational > Linguistics (Volume 2: Short Papers) > <http://aclanthology.info/volumes/proceedings-of-the-50th-annual-meeting-of-the-association-for-computational-linguistics-volume-2-short-papers> > > Authors: > Preslav Nakov <http://aclanthology.info/people/preslav-nakov-5181> | Jörg > Tiedemann <http://aclanthology.info/people/jorg-tiedemann-3696> > Month: > July > Year: > 2012 > Venue: > ACL <http://aclanthology.info/venues/acl> > Address: > Jeju Island, Korea > SIG: > > Publisher: > Association for Computational Linguistics > Pages: > 301–305 > URL: > http://aclweb.org/anthology/P12-2059 <http://aclweb.org/anthology/P12-2059> > > Regards, > Ergun > > On Sat, Apr 22, 2017 at 8:41 PM, Hieu Hoang <[email protected] > <mailto:[email protected]>> wrote: > sounds good. You're always welcome to check it in yourself as long as you > look after it. Send me your github username or create a git pull request > > * Looking for MT/NLP opportunities * > Hieu Hoang > http://moses-smt.org/ <http://moses-smt.org/> > > > On 22 April 2017 at 15:44, Jorg Tiedemann <[email protected] > <mailto:[email protected]>> wrote: > > Great - thanks. I modified a little to make it possible to pass a command to > the new option. > I hope I didn’t break anything. Maybe this modification could become part of > the official moses package? > > Jörg > > Jörg Tiedemann > [email protected] <mailto:[email protected]> > > > > > > > >> On 22 Apr 2017, at 15:50, Anoop (അനൂപ്) <[email protected] >> <mailto:[email protected]>> wrote: >> >> Hi Jorg, >> >> I had made changes to mert-moses.perl to achieve exactly what you are >> looking for. Please find the script attached. >> >> To enable character level to word level transformation, you have to pass the >> option '--transform-decoded-file' tomert-moses.pl <http://mert-moses.pl/> >> The script assumes that a caret token '^' has been added between words >> while preprocessing the corpora. So, all subwords between two carets are >> merged to create a single word. The changes are on line 826--834. >> >> Regards, >> Anoop. >> >> >> >> On Sat, Apr 22, 2017 at 5:10 PM, Jorg Tiedemann <[email protected] >> <mailto:[email protected]>> wrote: >> Hi, >> >> Is there an easy way to integrate a small script to process n-best lists in >> mert-moses.perl before running mert at each iteration? An example would be >> to merge character-level translations to run mert on word-level >> segmentations. It’s probably rather straightforward to add an option to >> specify a script for filtering but it may already exist and I just don’t see >> it? >> >> Thanks! >> Jörg >> >> ********************************************************************************************** >> Jörg Tiedemann >> Department of Modern Languages http://blogs.helsinki.fi/tiedeman/ >> <http://blogs.helsinki.fi/tiedeman/> >> University of Helsinki >> http://blogs.helsinki.fi/language-technology/ >> <http://blogs.helsinki.fi/language-technology/> >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] <mailto:[email protected]> >> http://mailman.mit.edu/mailman/listinfo/moses-support >> <http://mailman.mit.edu/mailman/listinfo/moses-support> >> >> >> >> >> -- >> I claim to be a simple individual liable to err like any other fellow >> mortal. I own, however, that I have humility enough to confess my errors and >> to retrace my steps. >> >> http://flightsofthought.blogspot.com >> <http://flightsofthought.blogspot.com/><mert-moses.pl >> <http://mert-moses.pl/>>_______________________________________________ >> Moses-support mailing list >> [email protected] <mailto:[email protected]> >> http://mailman.mit.edu/mailman/listinfo/moses-support >> <http://mailman.mit.edu/mailman/listinfo/moses-support> > > > _______________________________________________ > Moses-support mailing list > [email protected] <mailto:[email protected]> > http://mailman.mit.edu/mailman/listinfo/moses-support > <http://mailman.mit.edu/mailman/listinfo/moses-support> > > > > > > -- > > Regards, > Ergun
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
