Just for anyone with same obstacles : it solved by binarize the phrase table as
follows
If phrase
table is large
~/mosesdecoder/bin/CreateOnDiskPt 1 1 4 100 2
~/Phd/April/nplm/-dir/model/phrase-table.gz phrase-table.folder
Change
moses.ini ::
[feature]
PhraseDictionaryMemory path=phrase-table.1.gz ....
to
[feature]
PhraseDictionaryOnDisk path=phrase-table.1.folder ....
Marwa N. Refaie
From: [email protected]
To: [email protected]
Subject: Bilm train "IndexError: list index out of range"
Date: Fri, 17 Apr 2015 22:48:29 +0000
Hi all,
I trained BiLM with English-Arabic corpus , & it give better Blue score. But
when work with different bigger corpus I have this error !!
target_aligns[tpos].append(spos)IndexError: list index out of range
I have file .ngrams which stopped after small no of lines by this error ??? any
help plz ??
2015-04-18 00:42:19 INFO: Vocabulary size: 111432015-04-18 00:42:19 INFO:
Reading vocabulary from ai2.true.ar....................2015-04-18 00:42:19
INFO: Vocabulary size: 162402015-04-18 00:42:19 INFO: Extracting
ngramsTraceback (most recent call last): File
"/home/marwa/mosesdecoder/scripts/training/bilingual-lm/extract_training.py",
line 167, in <module> main() File
"/home/marwa/mosesdecoder/scripts/training/bilingual-lm/extract_training.py",
line 107, in main ofh) File
"/home/marwa/mosesdecoder/scripts/training/bilingual-lm/extract.py", line 74,
in get_ngrams target_aligns[tpos].append(spos)IndexError: list index out of
range
Marwa N. Refaie
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
