Of course... I forgot that tuning runs the decoder this way and you need to give the flags.
Thanks, that helped. Andreas On Tue, Mar 15, 2011 at 1:42 PM, Sara Stymne <[email protected]> wrote: > Hi, > > Did you use the flag: > -decoder-flags "-use-alignment-info -print-alignment-info-in-n-best > -alignment-output-file - -include-alignment-in-n-best" > (or whichever flags you want the decoder to use) > > as input to the tuning script? That should hopefully help if you didn't. > > /Sara > > > 2011-03-15 12:12, Andreas Kull skrev: >> Hi, >> >> I trained my model with -phrase-word-alignment and created the phrase >> table with -alignment-info with a previous version. >> >> If I run the decoder with: >> -use-alignment-info >> -print-alignment-info-in-n-best >> -n-best-list - 1 >> -alignment-output-file - >> -include-alignment-in-n-best >> >> I get the alignment information I want. >> >> >> I checked out the latest version today and installed the scripts. But >> if I compile a binary phrase-table with the -alignment-info switch (to >> preserve the word-to-word-alignment) and use it for tuning, I get the >> aforementioned error. >> The error does not occur, if I compile the binary phrase-table without >> the -alignment-info switch (the word-to-word-alignment gets lost) and >> use it for tuning. >> >> Regards, >> Andreas >> >> On Mon, Mar 14, 2011 at 6:13 PM, Philipp Koehn<[email protected]> wrote: >>> Hi, >>> >>> if you train your model with the switch "-phrase-word-alignment" to >>> train-model.perl >>> and run your decoder with "-alignment-output-file FILE", then you get the >>> word >>> alignment information. Tuning should run without problems (or >>> additional switches). >>> >>> You need to check out the latest version from SVN, since there have been >>> very recent updates. >>> >>> -phi >>> >>> On Mon, Mar 14, 2011 at 11:26 AM, Andreas Kull<[email protected]> >>> wrote: >>>> I'm referring to >>>> http://www.mail-archive.com/[email protected]/msg01917.html >>>> >>>> Perhaps I didn't understand it correctly. >>>> >>>> >>>> My error message: >>>> """ >>>> reading bin ttable >>>> size of OFF_T 8 >>>> ERROR:You are asking binary phrase table without word alignments but >>>> the file do not exist. Please check if you had generated the correct >>>> phrase table without word alignment >>>> (/home/user/mosesdecoder/corpora/europarl/50/training/model/phrase-table.binphr.srctree,/home/user/mosesdecoder/corpora/europarl/50/training/model/phrase-table.binphr.tgtdata) >>>> >>>> ERROR:bin ttable was read in a wrong way >>>> >>>> Segmentation fault >>>> Exit code: 139 >>>> """ >>>> >>>> The binary table is declared correctly and was created with the >>>> -alignment-info switch: >>>> >>>> In moses.ini: >>>> [ttable-file] >>>> 1 0 0 5 >>>> /home/user/mosesdecoder/corpora/europarl/50/training/model/phrase-table >>>> >>>> >>>> Regards, >>>> Andreas >>>> >>>> On Mon, Mar 14, 2011 at 11:04 AM, Philipp Koehn<[email protected]> >>>> wrote: >>>>> Hi, >>>>> >>>>> re-using tuning weights from a different run is perfectly fine. >>>>> >>>>> Having said that, I do not fully understand why it is not possible >>>>> to use the phrase table with word alignment information during >>>>> tuning. What seems to be the problem? >>>>> >>>>> -phi >>>>> >>>>> On Mon, Mar 14, 2011 at 9:05 AM, Andreas Kull<[email protected]> >>>>> wrote: >>>>>> Hi, >>>>>> >>>>>> as far as I know it is currently not possible to start the tuning >>>>>> process with binary phrase-tables that contain word alignment >>>>>> information (created via -alignment-info switch). >>>>>> >>>>>> Is it possible to use the binary phrase table without word-to-word >>>>>> alignment information for tuning and copy the generated tuning values >>>>>> in a moses.ini which uses a binary phrase-table with word-to-word >>>>>> alignment information? Is this a valid workaround or will I run into >>>>>> problems? >>>>>> >>>>>> >>>>>> Regards, >>>>>> Andreas >>>>>> _______________________________________________ >>>>>> Moses-support mailing list >>>>>> [email protected] >>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>> >>>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
