Hi Pham Thi Anh Vi.
Actually, it seems that irstlm fails in opening the LM file:
if ((diskid=open(filename, O_RDONLY))<0){
std::cerr << "cannot open " << filename << "\n";
error("dying");
}
I don't think the failure is due to the fact that the file does not exist
or contains something which is not expected, because in such cases the
failure would occur in different places of the code. Actually, I do not
understand what is the problem. Maybe something related to the Fedora
framework. I suggest to perform the following attempts:
a. avoid memory mapping: what is the behaviour if the suffix .mm is removed
from the LM filename?
b. compile a toy (very small) LM and try to use that, both with and w/o the
memory mapping mechanism
In case those attempts do not help in understanding the problem, you can
send me the toy LM and I'll try to use it, just to see what happen under our
redhat linux OS.
Mauro
Pham Thi Anh Vi wrote:
>
> Hi all,
> I use IRST LM Toolkit to build huge LM. I receive the /lm.irst.gz/ and
> then I convert into compact binary format /lm.blm/ with command
>
> compile-lm language-model.srilm language-model.blm
>
>
> Then, I use Memory Mapping to directly access the (binary) LM file
> stored on the hard disk by add suffix ./mm /to lm./blm/
> When running moses under Fedora Server core 8, I get error :
> ./moses -f moses.ini
> Defined parameters (per moses.ini or switch):
> config: moses.ini
> distortion-file: 0-0 msd-bidirectional-fe 6
> /home/viegrid/working/Decoder/corpus_22112008_400k/bin/reordering-table.msd-bidirectional-fe.0.5.0-0.gz
>
>
> distortion-limit: 6
> input-factors: 0
> lmodel-file: 1 0 5
> /home/viegrid/working/Data/Huge-Lm/lm_22112008_irst.blm.mm
> <http://lm_22112008_irst.blm.mm>
> mapping: 0 T 0
> ttable-file: 0 0 5
> /home/viegrid/working/Decoder/corpus_22112008_400k/bin/phrase-table.0-0.gz
>
> ttable-limit: 20 0
> weight-d: 0.3 0.3 0.3 0.3 0.3 0.3 0.3
> weight-l: 0.5000
> weight-t: 0.2 0.2 0.2 0.2 0.2
> weight-w: -1
> Loading lexical distortion models...
> have 1 models
> Creating lexical reordering...
> weights: 0.300 0.300 0.300 0.300 0.300 0.300
> binary file loaded, default OFF_T: -1
> Created lexical orientation reordering
> Start loading LanguageModel
> /home/viegrid/working/Data/Huge-Lm/lm_22112008_irst.blm.mm
> <http://lm_22112008_irst.blm.mm> : [0.000] seconds
> In LanguageModelIRST::Load: nGramOrder = 5
> Loading LM file (no MAP)
> blmt
> loadbin()
> cannot open /home/viegrid/working/Data/Huge-Lm/lm_22112008_irst.blm.mm
> <http://lm_22112008_irst.blm.mm>
> dying
> terminate called after throwing an instance of 'std::runtime_error'
> what(): dying
> Aborted
>
> Would you please tell me What happen with my decoding? Why it cannot
> read the /home/viegrid/working/Data/Huge-Lm/lm_22112008_irst.blm.mm
> <http://lm_22112008_irst.blm.mm> file (pathfile is correct).
>
> Thanks,
> --
> Vip
>
>
--
Mauro Cettolo
FBK - Ricerca Scientifica e Tecnologica
Via Sommarive 18
38100 Povo (Trento), Italy
Phone: (+39) 0461-314551
E-mail: [email protected]
URL: http://hlt.fbk.eu/people/cettolo
E cuale esie la me Patrie? cent, centmil, nissune
parcè che par picjâ lis bandieris spes a si picjin i omis
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
