Hi,
Not sure this is the cause, but I noticed an inconsistency. It looks
like you configured an order of 5:
In LanguageModelIRST::Load: nGramOrder = 5
but the model has order 3:
blmt
loadbin()
lmtable::loadbin_dict()
dict->size(): 414
loadbin_level (level 1)
loading 414 1-grams
done (level1)
loadbin_level (level 2)
loading 786 2-grams
done (level2)
loadbin_level (level 3)
loading 909 3-grams
done (level3)
done
OOV code is 413
IRST: m_unknownId=413
Try fixing that and, if it helps, we'll know where to look.
Unrelated: is moses-support having double vision today?
Kenneth
On 05/14/2012 07:25 AM, Fong Po Po wrote:
> Dear all:
>
> I have install the newest Moses from
> https://github.com/moses-smt
>
> I use irstlm-5.70.03
> I install the newest Moses:
> handsome@ubuntu:/home/sunnymoon/research/mosesdecoder$
> <http://hk.mc1908.mail.yahoo.com/mc/compose?to=handsome@ubuntu:/home/sunnymoon/research/mosesdecoder$>
> sudo ./bjam --with-srilm=/home/sunnymoon/research/srilm
> --with-irstlm=/usr/local/irstlm
> --with-giza=/home/sunnymoon/research/giza-pp/bin/
> I do training:
> handsome@ubuntu:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing$
> <mailto:handsome@ubuntu:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing$>
>
> /home/sunnymoon/research/mosesdecoder/scripts/training/train-model.perl
> -root-dir
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/
> -giza-f2e
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/
> -giza-e2f
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/
> -model-dir
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/
> -corpus-dir
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/corpus
> -corpus sample -f port -e chinese -alignment grow-diag-final-and
> -reordering msd-bidirectional-fe -lm
> 0:5:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/sample.blm
> It geneates moses.ini:
>
> #########################
> ### MOSES CONFIG FILE ###
> #########################
> # input factors
> [input-factors]
> 0
> # mapping steps
> [mapping]
> 0 T 0
> # translation tables: table type (hierarchical(0), textual (0), binary
> (1)), source-factors, target-factors, number of scores, file
> # OLD FORMAT is still handled for back-compatibility
> # OLD FORMAT translation tables: source-factors, target-factors, number
> of scores, file
> # OLD FORMAT a binary table type (1) is assumed
> [ttable-file]
> 0 0 0 5
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//phrase-table.gz
> # no generation models, no generation-file section
> # language models: type(srilm/irstlm), factors, order, file
> [lmodel-file]
> 1 0 5
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/sample.blm
>
> # limit on how many phrase translations e for each phrase f are loaded
> # 0 = all elements loaded
> [ttable-limit]
> 20
> # distortion (reordering) files
> [distortion-file]
> 0-0 wbe-msd-bidirectional-fe-allff 6
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//reordering-table.wbe-msd-bidirectional-fe.gz
> # distortion (reordering) weight
> [weight-d]
> 0.3
> 0.3
> 0.3
> 0.3
> 0.3
> 0.3
> 0.3
> # language model weights
> [weight-l]
> 0.5000
>
> # translation model weights
> [weight-t]
> 0.20
> 0.20
> 0.20
> 0.20
> 0.20
> # no generation models, no weight-generation section
> # word penalty
> [weight-w]
> -1
> [distortion-limit]
> 6
>
> I do translation:
> handsome@ubuntu:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing$
> <http://hk.mc1908.mail.yahoo.com/mc/compose?to=handsome@ubuntu:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing$>
> ./moses -f moses.ini < sample.port > out
> Defined parameters (per moses.ini or switch):
> config: moses.ini
> distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//reordering-table.wbe-msd-bidirectional-fe.gz
>
> distortion-limit: 6
> input-factors: 0
> lmodel-file: 1 0 5
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/sample.blm
>
> mapping: 0 T 0
> ttable-file: 0 0 0 5
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//phrase-table.gz
>
> ttable-limit: 20
> weight-d: 0.3 0.3 0.3 0.3 0.3 0.3 0.3
> weight-l: 0.5000
> weight-t: 0.20 0.20 0.20 0.20 0.20
> weight-w: -1
> Loading lexical distortion models...have 1 models
> Creating lexical reordering...
> weights: 0.300 0.300 0.300 0.300 0.300 0.300
> Loading table into memory...done.
> Start loading LanguageModel
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/sample.blm
> : [0.000] seconds
> In LanguageModelIRST::Load: nGramOrder = 5
> Language Model Type of
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing/sample.blm
> is 1
> blmt
> loadbin()
> lmtable::loadbin_dict()
> dict->size(): 414
> loadbin_level (level 1)
> loading 414 1-grams
> done (level1)
> loadbin_level (level 2)
> loading 786 2-grams
> done (level2)
> loadbin_level (level 3)
> loading 909 3-grams
> done (level3)
> done
> OOV code is 413
> IRST: m_unknownId=413
> Finished loading LanguageModels : [0.000] seconds
> Start loading PhraseTable
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//phrase-table.gz
> : [0.000] seconds
> filePath:
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//phrase-table.gz
> Finished loading phrase tables : [0.000] seconds
> Start loading phrase table from
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//phrase-table.gz
> : [0.000] seconds
> Reading
> /home/sunnymoon/research/mosesdecoder/scripts/training/model-testing//phrase-table.gz
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> ****************************************************************************************************
> Finished loading phrase tables : [0.000] seconds
> IO from STDOUT/STDIN
> Created input-output object : [0.000] seconds
> Segmentation fault
> handsome@ubuntu:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing$
> <http://hk.mc1908.mail.yahoo.com/mc/compose?to=handsome@ubuntu:/home/sunnymoon/research/mosesdecoder/scripts/training/model-testing$>
>
>
> But it occurs Segmentation fault, Why? Can you help me? Thanks!
> Best Regards,
> Fong Pui Chi
>
>
>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
