Hello,
Can you please help me with the following error?
When I run the Tuning process with the following command ((nohup nice
~/mosesdecoder/scripts/training/mert-moses.pl ~/corpus/news-test2008.true.fr
~/corpus/news-test2008.true.en ~/mosesdecoder/bin/moses train/model/moses.ini
--mertdir ~/mosesdecoder/bin/ --decoder-flags="-threads 4" &> mert.out)) the
process stops immediately after it finishes calculating the best translation
with the following exit codes:
Failed to get order of scores from nbestlist 'run1.best100.out': No such file
or directory at /home/kjoze/mosesdecoder/scripts/training/mert-moses.pl line
1474.
coring the nbestlist.
exec: /home/kjoze/working/mert-work/extractor.sh
Executing: /home/kjoze/working/mert-work/extractor.sh > extract.out 2>
extract.err
Exit code: 1
ERROR: Failed to run '/home/kjoze/working/mert-work/extractor.sh'. at
/home/kjoze/mosesdecoder/scripts/training/mert-moses.pl line 1744.
The contents of mert-moses.pl file at line 1474 is:
sub get_order_of_scores_from_nbestlist {
# read the first line and interpret the ||| label: num num num label2: num
||| column in nbestlist
# return the score labels in order
my $fname_or_source = shift;
# print STDERR "Peeking at the beginning of nbestlist to get order of scores:
$fname_or_source\n";
1474à open my $fh, $fname_or_source or die "Failed to get order of scores from
nbestlist '$fname_or_source': $!";
my $line = <$fh>;
close $fh;
die "Line empty in nbestlist '$fname_or_source'" if !defined $line;
my ($sent, $hypo, $scores, $total) = split /\|\|\|/, $line;
$scores =~ s/^\s*|\s*$//g;
die "No scores in line: $line" if $scores eq "";
my @order = ();
my $label = undef;
my $sparse = 0; # we ignore sparse features here
foreach my $tok (split /\s+/, $scores) {
Please advise. Does changing the news-test2008.true.fr file contents has any
influence?
Thank you.
Kind regards,
Jože
From: [email protected] [mailto:[email protected]] On Behalf Of Philipp Koehn
Sent: Friday, March 04, 2016 11:03 PM
To: Joze Kadivec
Cc: [email protected]
Subject: Re: [Moses-support] In-domain dictionary - where to include it
Hi,
the most straight-forward way is to add it to the phrase table.
You could add it multiple times, if you want it to be given more weight than
the regular parallel corpus.
-phi
On Tue, Feb 23, 2016 at 3:10 PM, Joze Kadivec <[email protected]> wrote:
Hello,
I just recently installed Moses and would like to use it as part of my
masters thesis on Domain adaptation for less-resourced Slovenian language. I
was given some domain specific dictionaries for which I need your advice.
Where should I include it? Should I simply paste their contents to the end
of aligned corpora files used to create translation model? Is there another
way to use the dictionaries more efficiently?
Thank you.
Kind regards,
Jože Kadivec
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support