Hi Hieu, I am at the last step of the incremental training. 1. I have produced the alignment file for the incremental data. 2. I then just append the new-alignment file and the incremental data to the original data and alignment file. 3. Furthermore I create the memory mapped suffix array phrase table(mmsapt).
When I am using the new mmsapt information during decoding I am getting the following error ( which was fine before adding the incremental data) Created input-output object : [0.086] seconds this is a test sentence Translating line 0 in thread id 139739320297216 Translating: this is a test sentence binary file loaded, default OFF_T: -1 Line 0: Initialize search took 0.064 seconds total Alignment range error at sentence 53994! 4/7 6/5 Alignment range error at sentence 54530! 17/19 18/18 Alignment range error at sentence 50292! 0/13 9/9 Alignment range error at sentence 50120! 25/36 31/31 Alignment range error at sentence 55089! 11/27 19/19 terminate called recursively terminate called after throwing an instance of 'terminate called recursively terminate called recursively util::Exception' terminate called recursively Aborted I am not sure if I am doing anything wrong here? Thanks and regards, sandipan On 8 September 2014 10:11, Sandipan Dandapat <[email protected]> wrote: > Hi, > This worked. > Thanks and regards, > sandipan > > On 7 September 2014 16:09, Hieu Hoang <[email protected]> wrote: > >> sorry, i meant >> >> >> On 7 September 2014 16:08, Hieu Hoang <[email protected]> wrote: >> >>> you HAVE to change both >>> num-features=7 >>> AND >>> [weight] >>> PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7 >>> >>> >>> On 7 September 2014 16:06, Sandipan Dandapat <[email protected] >>> > wrote: >>> >>>> Hi Hieu, >>>> Even I tried with '7' and it fails with the error message >>>> >>>> Exception: moses/ScoreComponentCollection.cpp:248 in void >>>> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, >>>> const std::vector<float>&) threw util::Exception'. >>>> Feature function PT0 specified 7 dense scores or weights. Actually has 4 >>>> >>>> In contrast, when I am using binarised pharse table, I use >>>> num-features=4 and this works fine. I am attaching the Moses.ini file in >>>> case I am doing anything wrong there. >>>> >>>> Thanks and regards, >>>> sandipan >>>> >>>> >>>> On 7 September 2014 15:46, Hieu Hoang <[email protected]> wrote: >>>> >>>>> maybe's it's 7 scores >>>>> >>>>> >>>>> On 7 September 2014 14:59, Sandipan Dandapat < >>>>> [email protected]> wrote: >>>>> >>>>>> Hi Hieu, >>>>>> I also tried the same but generates the error below: >>>>>> >>>>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void >>>>>> Moses::Mmsapt::Load() threw util::Exception because >>>>>> `this->m_feature_names.size() != this->m_numScoreComponents'. >>>>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values >>>>>> provided by Phrase table (7) does not match number specified in Moses >>>>>> config file (4)! >>>>>> >>>>>> Thanks and regards, >>>>>> sandipan >>>>>> >>>>>> >>>>>> On 6 September 2014 09:50, Hieu Hoang <[email protected]> wrote: >>>>>> >>>>>>> I'm not sure how many scores there are in the phrase table >>>>>>> PhraseDictionaryBitextSampling >>>>>>> It may be 4. In which case you must specify >>>>>>> >>>>>>> [feature] >>>>>>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ... >>>>>>> >>>>>>> [weight] >>>>>>> PT0= 0.1 0.2 0.3 0.4 >>>>>>> >>>>>>> >>>>>>> On 05/09/14 14:12, Sandipan Dandapat wrote: >>>>>>> >>>>>>> Hi, >>>>>>> During incremental retraining I specified the following line in >>>>>>> moses .ini >>>>>>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 >>>>>>> num-features=9 >>>>>>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en >>>>>>> L2=pl >>>>>>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1 >>>>>>> >>>>>>> this generates the error: >>>>>>> Feature function PT0 specified 9 dense scores or weights. Actually >>>>>>> has 0. >>>>>>> >>>>>>> which is solved when num-features is changed to '0' >>>>>>> but generates the error below: >>>>>>> >>>>>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual >>>>>>> void Moses::Mmsapt::Load() threw util::Exception because >>>>>>> `this->m_feature_names.size() != this->m_numScoreComponents'. >>>>>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature >>>>>>> values provided by Phrase table (7) does not match number specified in >>>>>>> Moses config file (0)! >>>>>>> Changing it to 7 also does not help. >>>>>>> >>>>>>> I have tried with >>>>>>> Mmsapt name=PT0 output-factor=0 num-features=0 >>>>>>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en >>>>>>> L2=pl >>>>>>> >>>>>>> but does not work. >>>>>>> What I need to do at this stage of retraining using moses? >>>>>>> >>>>>>> Thanks and regards, >>>>>>> sandipan >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Moses-support mailing >>>>>>> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Moses-support mailing list >>>>>>> [email protected] >>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Hieu Hoang >>>>> Research Associate >>>>> University of Edinburgh >>>>> http://www.hoang.co.uk/hieu >>>>> >>>>> >>>>> _______________________________________________ >>>>> Moses-support mailing list >>>>> [email protected] >>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>> >>>>> >>>> >>> >>> >>> -- >>> Hieu Hoang >>> Research Associate >>> University of Edinburgh >>> http://www.hoang.co.uk/hieu >>> >>> >> >> >> -- >> Hieu Hoang >> Research Associate >> University of Edinburgh >> http://www.hoang.co.uk/hieu >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
