Dear Hieu, Thanks for the note on thax and the original .cpp code.
Fredik fixed the bug. Apparently there was an error in the original textbook print and it was addressed in the errata but i didn't notice it. http://stackoverflow.com/questions/25109001/phrase-extraction-algorithm-for-statistical-machine-translation Regards, Liling P/S: Cam on anh nhieu. On Mon, Aug 4, 2014 at 11:38 AM, Hieu Hoang <[email protected]> wrote: > hi liling > > > On 3 August 2014 22:02, liling tan <[email protected]> wrote: > >> >> Dear Moses community, >> >> I have reimplemented the phrasal extraction algorithm as presented on the >> page 133 of Philip Koehn's SMT book for NLTK in >> https://github.com/alvations/nltk/blob/develop/nltk/align/phrase_based.py >> >> However, there is some bug that i can't figure out why am I not achieving >> the desired output as shown on the alignment table, see >> http://stackoverflow.com/questions/25109001/phrase-extraction-algorithm-for-statistical-machine-translation >> for more detail >> >> >> *Does anyone find what went wrong with my implementation?* >> >> *Are there other python based implementation of the same algorithm?* >> > i don't know of a python implementation. There is a java implementaton by > Jonathon Weese called Thrax. > http://cs.jhu.edu/~jonny/thrax/ > >> >> *Where in the Moses toolkit is can the phrasal extraction function be >> found? What is the input of that function?* >> > phrase-extract/extract-main.cpp > void ExtractTask::extract(SentenceAlignment &sentence) line 350 - 447 > You may want to base your code on my cleaned up implementation > > https://github.com/hieuhoang/mosesdecoder/tree/hieu/contrib/other-builds/extract-mixed-syntax > > >> Regards, >> Liling >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
