On 5 June 2014 16:44, Philipp Koehn <[email protected]> wrote: > Hi, > > there seems to be some oddity since Moses assumes to have to load a > SCFG phrase table. > The memory phrase table is for both phrase-based and SCFG models. I've just changed the debugging output to avoid confusion
> > In any case: > > It is better not to run Moses with a plain "PhraseDictionaryMemory" > which is very > inefficient and uses a lot of RAM. Rather convert the phrase table first > into > compact or binary format. > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc10 > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc10 > > -phi > > On Thu, Jun 5, 2014 at 12:55 AM, charmaine ponay <[email protected]> > wrote: > > hi, what does it mean when i get this error after escaping special > > characters and training my corpus? > > > > $ ../mosesdecoder-master/bin/moses -f Charmaine/training/model/moses.ini > < > > Charmaine/testing.fl > Charmaine/Testing/CharmaineOut > > Defined parameters (per moses.ini or switch): > > config: Charmaine/training/model/moses.ini > > distortion-limit: 6 > > feature: UnknownWordPenalty WordPenalty PhrasePenalty > > PhraseDictionaryMemory name=TranslationModel0 table-limit=20 > num-features=4 > > path=/masters/Charmaine/training/model/phrase-table.gz input-factor=0 > > output-factor=0 Distortion SRILM name=LM0 factor=0 > > path=/masters/Charmaine/preprocessed/training.clean.en.lm order=3 > > input-factors: 0 > > mapping: 0 T 0 > > weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= > 0.2 > > TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5 > > ../mosesdecoder-master/bin > > line=UnknownWordPenalty > > FeatureFunction: UnknownWordPenalty0 start: 0 end: 0 > > line=WordPenalty > > FeatureFunction: WordPenalty0 start: 1 end: 1 > > line=PhrasePenalty > > FeatureFunction: PhrasePenalty0 start: 2 end: 2 > > line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20 > > num-features=4 path=/masters/Charmaine/training/model/phrase-table.gz > > input-factor=0 output-factor=0 > > FeatureFunction: TranslationModel0 start: 3 end: 6 > > line=Distortion > > FeatureFunction: Distortion0 start: 7 end: 7 > > line=SRILM name=LM0 factor=0 > > path=/masters/Charmaine/preprocessed/training.clean.en.lm order=3 > > FeatureFunction: LM0 start: 8 end: 8 > > Start loading text SCFG phrase table. Moses format : [0.000] seconds > > Reading /masters/Charmaine/training/model/phrase-table.gz > > > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > > Segmentation fault (core dumped) > > > > Regards, > > > > Charmaine Salvador - Ponay > > Instructor > > Information and Computer Studies Dept. > > University of Santo Tomas > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
