Felipe, Thanks for the code. I appreciate the help. :) However, that's not what I was wondering.
I know that during the 2nd MT Marathon in Wandlitz in May 2008, work was done on implementing a suffix array data structure so that Moses could extract phrase pairs directly from an aligned parallel corpus at runtime, without the necessity of first running an explicit off-line phrase table extraction process. I don't know what the end result of that work was, nor do I know if any followup work was performed. My question was in regard to those issues. Specifically, does anyone know where things ended with regard to the suffix array code in Moses at the end of the MT Marathon in Wandlitz? And is functionality currently present in Moses to allow an aligned parallel corpus backed by a suffix array to act in place of a pre-computed phrase table? Thanks, Lane On Nov 28, 2009, at 8:38 AM, Felipe Sánchez Martínez wrote: > Hi, > > If I understood correctly you want to have access to the binary phrase > table on your own program to extract some entries on the fly. Attached > you will find a piece of code that does exactly this. > > Hope it helps > Greetings > -- > Felipe. > > > El vie, 27-11-2009 a las 14:36 -0600, Lane Schwartz escribió: >> Hi all, >> >> I'm just wanting to double-check the current state of the suffix >> array >> code in Moses. Can it be used to extract translation table entries >> on- >> the-fly? >> >> Also, has anyone written up a paper on this in Moses? I'd like to >> know >> who to cite if this has been written up. ;) >> >> Cheers, >> Lane >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support > > > -- > Felipe Sánchez Martínez <[email protected]> > Departamento de Lenguajes y Sistemas Informáticos > Universidad de Alicante, E-03071 Alicante (Spain) > Tel.: +34 965 903 400, ext: 2966 Fax: +34 965 909 326 > http://www.dlsi.ua.es/~fsanchez > <pmoses.cc> _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
