Hi,

there seems to be some oddity since Moses assumes to have to load a
SCFG phrase table.

In any case:

It is better not to run Moses with a plain "PhraseDictionaryMemory"
which is very
inefficient and uses a lot of RAM. Rather convert the phrase table first into
compact or binary format.

http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc10

http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc10

-phi

On Thu, Jun 5, 2014 at 12:55 AM, charmaine ponay <[email protected]> wrote:
> hi, what does it mean when i get this error after escaping special
> characters and training my corpus?
>
> $ ../mosesdecoder-master/bin/moses -f Charmaine/training/model/moses.ini <
> Charmaine/testing.fl > Charmaine/Testing/CharmaineOut
> Defined parameters (per moses.ini or switch):
>         config: Charmaine/training/model/moses.ini
>         distortion-limit: 6
>         feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4
> path=/masters/Charmaine/training/model/phrase-table.gz input-factor=0
> output-factor=0 Distortion SRILM name=LM0 factor=0
> path=/masters/Charmaine/preprocessed/training.clean.en.lm order=3
>         input-factors: 0
>         mapping: 0 T 0
>         weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
> TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5
> ../mosesdecoder-master/bin
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
> num-features=4 path=/masters/Charmaine/training/model/phrase-table.gz
> input-factor=0 output-factor=0
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=Distortion
> FeatureFunction: Distortion0 start: 7 end: 7
> line=SRILM name=LM0 factor=0
> path=/masters/Charmaine/preprocessed/training.clean.en.lm order=3
> FeatureFunction: LM0 start: 8 end: 8
> Start loading text SCFG phrase table. Moses  format : [0.000] seconds
> Reading /masters/Charmaine/training/model/phrase-table.gz
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> Segmentation fault (core dumped)
>
> Regards,
>
> Charmaine Salvador - Ponay
> Instructor
> Information and Computer Studies Dept.
> University of Santo Tomas
>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to