it will run, but you shouldn't do any decode paths where the
translations steps are not connected, eg
1 T 0
1 T 1
1 T 2
because the results are very bad
Hieu Hoang
www.hoang.co.uk/hieu
-----Original Message-----
From: Sandrine GAY [mailto:[EMAIL PROTECTED]
Sent: 03 December 2007 13:37
To: Hieu Hoang
Cc: [email protected]
Subject: Re: [Moses-support] Multiple path decoding with Moses
Thank you for answering so quicly.
Yes I understand, I have to add steps to create the missing factors in
the second path.
Maybe something like that:
0 T 0
0 T 1
0 G 0
1 T 0
1 T 1
1 T 2
Sandrine
2007/12/3, Hieu Hoang <[EMAIL PROTECTED]>:
hi sandrine
you have 3 language models, 1 for each factor type.
this is ok for the decoding path
0 T 0
0 T 1
0 G 0
because this path creates all 3 factor types.
however, the path
1 T 2
only create the surface form, therefore the language models for lemma &
tags blows up
Hieu Hoang
www.hoang.co.uk/hieu
-----Original Message-----
From: [EMAIL PROTECTED] [mailto:
<mailto:[EMAIL PROTECTED]> [EMAIL PROTECTED] On
Behalf Of Sandrine GAY
Sent: 03 December 2007 11:31
To: [email protected]
Subject: [Moses-support] Multiple path decoding with Moses
Hi,
I have been playing with factored translation.
Now I would like to use moses with multiple decoding paths.
I use 3 factors: surface word (0), lemma (1) and tag (2).
The 2 paths are :
- translate lemma then translate tag then generate word from lemma and
tag
or
- translate word directly
I have encountered a problem when running moses:
Defined parameters (per moses.ini or switch):
config: ./vf3_d_20071203.trame.dev_filtered/moses.ini
distortion-limit: 6
generation-file: 1,2 0 1
./giza/vf3_d_20071203/model/generation.1,2-0
input-factors: 0 1 2
input-file: ./dev/trame.dev_lc.3f.en-fr.en
lmodel-file: 0 1 4 ./lm/vf3_d_20071203.trame.train.lemme.en-
fr.fr.4g.lm.gz
0 2 7
./lm/vf3_d_20071203.trame.train.tag.en-fr.fr.7g.lm.gz
0 0 4
./lm/vf3_d_20071203.trame.train_lc.en-fr.fr.4g.lm.gz
mapping: 0 T 0 0 T 1 0 G 0 1 T 2
ttable-file: 1 1 5
./vf3_d_20071203.trame.dev_filtered/phrase-table.1-1
2 2 5
./vf3_d_20071203.trame.dev_filtered/phrase-table.2-2
0 0 5 ./vf3_d_20071203.trame.dev_filtered/phrase-
table.0-0
ttable-limit: 20 0 0 0
weight-d: 0.6
weight-generation: 0.3
weight-l: 0.1667 0.1667 0.1667
weight-t: 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2
0.2
weight-w: -1
Loading lexical distortion models...
have 0 models
Start loading LanguageModel
./lm/vf3_d_20071203.trame.train.lemme.en-fr.fr.4g.lm.gz : [0.000]
seconds
Start loading LanguageModel ./lm/vf3_d_20071203.trame.train.tag.en-
fr.fr.7g.lm.gz : [0.000] seconds
Start loading LanguageModel
./lm/vf3_d_20071203.trame.train_lc.en-fr.fr.4g.lm.gz : [0.000] seconds
Finished loading LanguageModels : [0.000] seconds
weight-generation: 0.300 ./giza/vf3_d_20071203/model/generation.1,
2-0.gz
Start loading PhraseTable
./vf3_d_20071203.trame.dev_filtered/phrase-table.1-1 : [0.000] seconds
Start loading PhraseTable
./vf3_d_20071203.trame.dev_filtered/phrase-table.2-2 : [1.000] seconds
Start loading PhraseTable ./vf3_d_20071203.trame.dev_filtered/phrase-
table.0-0 : [5.000] seconds
Finished loading phrase tables : [7.000] seconds
Created input-output object : [7.000] seconds
Translating: using|use|VVG a|a|DT trailer|trailer|NN
moses: LanguageModelSRI.cpp:154: virtual float
LanguageModelSRI::GetValue(const std::vector<const Word*,
std::allocator<const Word*> >&, const void**, unsigned int*) const:
Assertion `(*contextFactor[count-1])[factorType] != __null' failed.
I don't know what to look for to fix it
Note: if I only specify one path (mapping: 0 T 0 0 T 1 0 G 0 0 T 2), the
execution doesn't crash.
Here is my moses.ini file:
# input factors
[input-factors]
0
1
2
# mapping steps
[mapping]
0 T 0
0 T 1
0 G 0
1 T 2
# translation tables: source-factors, target-factors, number of scores,
file
[ttable-file]
1 1 5 ./vf3_d_20071203.trame.dev_filtered/phrase- table.1-1
2 2 5 ./vf3_d_20071203.trame.dev_filtered/phrase-table.2-2
0 0 5 ./vf3_d_20071203.trame.dev_filtered/phrase-table.0-0
# generation models: source-factors, target-factors, number-of-weights,
filename
[generation-file]
1,2 0 1 ./giza/vf3_d_20071203/model/generation.1,2-0
# language models: type(srilm/irstlm), factors, order, file
[lmodel-file]
0 1 4 ./lm/vf3_d_20071203.trame.train.lemme.en-fr.fr.4g.lm.gz
0 2 7 ./lm/vf3_d_20071203.trame.train.tag.en-fr.fr.7g.lm.gz
0 0 4 ./lm/vf3_d_20071203.trame.train_lc.en-fr.fr.4g.lm.gz
Thank you very much,
best regards,
Sandrine Gay
--
Sandrine GAY
27 rue de Versailles
91300 MASSY
06 73 22 81 73
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
