Hi Andrew, I was adding the WER scorer I implemented in my old version of Moses to a fresh, up-to-date version of Moses and it seems that WER has already been added to Moses. There is a translation scorer (CDER) that can also compute WER. This is good news for you.
To run MERT using WER (1-WER, actually) you just need to add --mertargs="\"--sctype WER\"" in the command line. Cheers -- Felipe El 06/11/13 02:58, Andrew Shin escribió: > thank you very much for your reply. > > I would very much like to try your source files. > I greatly appreciate your help. > > > Date: Tue, 5 Nov 2013 16:01:31 +0100 > > From: [email protected] > > To: [email protected] > > CC: [email protected] > > Subject: Re: [Moses-support] getting WER metrics > > > > Hi Andrew, > > > > I recently implemented WER for tunnig (MERT) with Moses on an old > > version of Moses I am using. Contributing my code is on my TODO list; I > > have not done it yet because I want to be sure that it does not break > > anything in the up-to-date version. If you want to try yourself I can > > send you the source files. > > > > Cheers > > -- > > Felipe > > > > El 28/10/13 16:37, Francis Tyers escribió: > > > There is a package in Apertium which is a simple perl script which > > > calculates WER and PER: > > > > > > https://svn.code.sf.net/p/apertium/svn/trunk/apertium-eval-translator > > > > > > > http://wiki.apertium.org/wiki/Evaluation#Using_apertium-eval-translator_for_WER_and_PER > > > > > > Fran > > > > > > El dl 28 de 10 de 2013 a les 11:33 -0400, en/na Philipp Koehn va > > > escriure: > > >> Hi, > > >> > > >> Moses currently does not include a tool to measure WER. > > >> It should be simple to write, so I would encourage you to > > >> implement it and contribute it back. > > >> > > >> -phi > > >> > > >> On Sun, Oct 27, 2013 at 11:11 PM, Andrew Shin > <[email protected]> wrote: > > >>> Hello, > > >>> sorry to ask another question.. > > >>> > > >>> I've done getting BLEU score in the past following the baseline > tutorial, > > >>> but is there a way to also get WER given a reference text? > > >>> > > >>> Thank you very much for your help. > > >>> > > >>> _______________________________________________ > > >>> Moses-support mailing list > > >>> [email protected] > > >>> http://mailman.mit.edu/mailman/listinfo/moses-support > > >>> > > >> _______________________________________________ > > >> Moses-support mailing list > > >> [email protected] > > >> http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > > > > > -- > > Felipe Sánchez Martínez > > Dep. de Llenguatges i Sistemes Informàtics > > Universitat d'Alacant, E-03071 Alacant (Spain) > > Tel.: +34 965 903 400, ext: 2966 Fax: +34 965 909 326 > > http://www.dlsi.ua.es/~fsanchez -- Felipe Sánchez Martínez Dep. de Llenguatges i Sistemes Informàtics Universitat d'Alacant, E-03071 Alacant (Spain) Tel.: +34 965 903 400, ext: 2966 Fax: +34 965 909 326 http://www.dlsi.ua.es/~fsanchez _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
