Try testset-small.de with your multibleu command instead of testset-small.en,
Best
Marcin
--
Sent from my phone-------- Wiadomość oryginalna -------- Temat: Re: [Moses-support] baseline-system has very low BLEU-Score Od: Raphael Hoeps
Do: [email protected]
DW:
yes, I checked that. My model was
trained with "--f en --e de". Could there be any problem with my
usage of the multi-bleu.perl script? Because I really think that
my translation output is not that bad, that it deserves such a low
score.
I am calling:
mosesdecoder/scripts/generic/multi-bleu.perl -lc
mosesdecoder/corpus/testset-small.en <
mosesdecoder/working/testset-small.translated
But when I look at the files:
less mosesdecoder/corpus/testset-small.en
less mosesdecoder/working/testset-small.translated
I see a German translation that is quite okay in my eyes with a
lot of correctly translated sentences. Any more ideas? I think I'm
going crazy.
Thanks,
Raphael
Am 18.11.2015 um 19:38 schrieb Tom Hoar:
I agree with Rico that you mixed up your languages.
The most likely location is in your train-model.perl command line.
The --e value must match the LM's language. So, double check that
it included
"--f EN --e DE"
That's assuming your corpus file suffixes were EN & DE.
Date: Wed, 18 Nov 2015 16:17:42 +0000
From: Rico Sennrich <[email protected]>
Subject: Re: [Moses-support] baseline-system has very low
BLEU-Score
To: [email protected]
Hi Raphael,
just to re-iterate: are you sure you used the correct (German)
reference
file to score your (German) translation output, and didn't
mistakenly
use the (English) input as reference?
best wishes,
Rico
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
|
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
