r a
> specific domain? However, the engines performance outside my domain
> equals almost to zero?
>
> Best,
>
> Daniel
>
> *Von:*miles...@gmail.com [mailto:miles...@gmail.com] *Im Auftrag von
> *Miles Osborne
> *Gesendet:* 26 April 2012 21:17
> *An:* John D Bur
utside my domain
> equals almost to zero?
>
> Best,
>
> Daniel
>
> *Von:*miles...@gmail.com [mailto:miles...@gmail.com] *Im Auftrag von
> *Miles Osborne
> *Gesendet:* 26 April 2012 21:17
> *An:* John D Burger
> *Cc:* Daniel Schaut; moses-support@mit.edu
> *Betreff:* Re:
Daniel Schaut wrote:
> To conclude, one could say that I’ve created an engine suitable for a
> specific domain? However, the engine’s performance outside my domain equals
> almost to zero?
This is always a problem, especially with statistical MT. For example, we've
evaluated high-performing s
performance outside my domain equals almost to
zero?
Best,
Daniel
Von: miles...@gmail.com [mailto:miles...@gmail.com] Im Auftrag von Miles Osborne
Gesendet: 26 April 2012 21:17
An: John D Burger
Cc: Daniel Schaut; moses-support@mit.edu
Betreff: Re: [Moses-support] Higher BLEU/METEOR score than
Very short sentences will give you high scores.
Also multiple references will boost them
Miles
On Apr 26, 2012 8:13 PM, "John D Burger" wrote:
> I =think= I recall that pairwise BLEU scores for human translators are
> usually around 0.50, so anything much better than that is indeed suspect.
>
>
I =think= I recall that pairwise BLEU scores for human translators are usually
around 0.50, so anything much better than that is indeed suspect.
- JB
On Apr 26, 2012, at 14:18 , Daniel Schaut wrote:
> Hi all,
>
>
> I’m running some experiments for my thesis and I’ve been told by a more
> exp
El dj 26 de 04 de 2012 a les 20:18 +0200, en/na Daniel Schaut va
escriure:
> Hi all,
>
> I’m running some experiments for my thesis and I’ve been told by a
> more experienced user that the achieved scores for BLEU/METEOR of my
> MT engine were too good to be true. Since this is the very first MT
>
Hi Daniel
BLEU scores do vary according to test set, but the scores you report are much
higher than usual.
The most likely thing is that you have some of your test set included in your
training set,
cheers - Barry
On Thursday 26 April 2012 19:18:33 Daniel Schaut wrote:
> Hi all,
>
> I'm runn
Hi all,
I'm running some experiments for my thesis and I've been told by a more
experienced user that the achieved scores for BLEU/METEOR of my MT engine
were too good to be true. Since this is the very first MT engine I've ever
made and I am not experienced with interpreting scores, I really don'
