Hi, There is going to be a transliteration module in Moses soon. We (me and Hassan Sajjad) are working on it.
Cheers, Nadir On Thu, Nov 28, 2013 at 10:17 AM, <[email protected]> wrote: > Send Moses-support mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. Re: Regarding Transliteration using Moses (Hieu Hoang) > 2. Re: Hierarchical Tune Crash (Hieu Hoang) > 3. Re: Regarding Transliteration using Moses (Pratik Jain) > 4. Re: Word-to-word alignment when moses-parallel.pl is used > (Philipp Koehn) > 5. Re: Regarding Transliteration using Moses (Kunal Sachdeva) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 27 Nov 2013 17:19:17 +0000 > From: Hieu Hoang <[email protected]> > Subject: Re: [Moses-support] Regarding Transliteration using Moses > To: Pranjal Das <[email protected]> > Cc: moses-support <[email protected]> > Message-ID: > <CAEKMkbi4nmAf3NfPBTp6eKgc-j3UR3t01dLBp2PO=np93b3...@mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > There's no support for transliteration in Moses. If you create 1, please > let us know and we can add it to Moses > > > On 27 November 2013 07:44, Pranjal Das <[email protected]> wrote: > >> hii, >> i have completed my translation using moses toolkit,following the manual >> for installing moses,GIZZA++,IRSTLM and have tried out the sample models >> for translation and applying those on my own parallel corpus(fr-en),now i >> am facing problems regarding transliteration as there is no proper way >> given in the manual for Transliteration using moses.kindly help me with >> transliteration steps.where i can find them. >> >> >> >> Thanku >> >> Regards, >> >> *Pranjal Das* >> Department of Information Technology, >> Gauhati University Institute of Science and Technology,Guwahati,India >> Phone- +91-8399879454 >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20131127/6c689762/attachment-0001.htm > > ------------------------------ > > Message: 2 > Date: Wed, 27 Nov 2013 17:21:27 +0000 > From: Hieu Hoang <[email protected]> > Subject: Re: [Moses-support] Hierarchical Tune Crash > To: burak ayd?n <[email protected]> > Cc: moses-support <[email protected]> > Message-ID: > <caekmkbh8h-2ar0rgh03m+ztpmftpzdqdmykrwu6vcqe4hh1...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Can you please send me your moses.ini file and the EMS config file you used. > > I recently changed the phrase-table so that the number of scores went from > 5 to 4. This is the source of a few problems people have been having > > > On 27 November 2013 11:21, burak ayd?n <[email protected]> wrote: > >> Hello, >> >> My hiero experiment (with latest moses and with config.hierarchical >> example in it) crashes at the Tuning_tune step with the following error: >> >> *Start loading text SCFG phrase table. Moses format : [0.000] seconds* >> *max-chart-span: 20* >> *max-chart-span: 1000* >> *Check obj->GetMisc("NumScores") == m_numScoreComponents failed in >> moses/TranslationalModel/RuleTable/PhraseDictionaryOnDisk.cpp:91* >> *Aborted (core dumped)* >> *Exit code: 134* >> *The decoder died.* >> >> I checked the phrase table and the tuning-step's filtered table of this >> experiment. They were not empty. What causes this crash? >> >> Regards >> Burak >> >> >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20131127/1e1e6a76/attachment-0001.htm > > ------------------------------ > > Message: 3 > Date: Thu, 28 Nov 2013 01:14:57 +0530 > From: Pratik Jain <[email protected]> > Subject: Re: [Moses-support] Regarding Transliteration using Moses > To: Hieu Hoang <[email protected]> > Cc: moses-support <[email protected]>, Pranjal Das > <[email protected]> > Message-ID: > <cacxoyhcnfnycdm4ik1eliysefugrlgf7i88d5vl1gxp9ujp...@mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Just get a parallel list of words in the 2 languages. Try to break each > word syllable-wise or simply character-wise. Thus, each line of the two > files would have single words with a space between each character (or each > syllable). Use these 2 files to train the system as normal translation task. > If your word list is large enough, this works quite nice. Try it out, it > worked good for me. > > > On Wed, Nov 27, 2013 at 10:49 PM, Hieu Hoang <[email protected]> wrote: > >> There's no support for transliteration in Moses. If you create 1, please >> let us know and we can add it to Moses >> >> >> On 27 November 2013 07:44, Pranjal Das <[email protected]> wrote: >> >>> hii, >>> i have completed my translation using moses toolkit,following the manual >>> for installing moses,GIZZA++,IRSTLM and have tried out the sample models >>> for translation and applying those on my own parallel corpus(fr-en),now i >>> am facing problems regarding transliteration as there is no proper way >>> given in the manual for Transliteration using moses.kindly help me with >>> transliteration steps.where i can find them. >>> >>> >>> >>> Thanku >>> >>> Regards, >>> >>> *Pranjal Das* >>> Department of Information Technology, >>> Gauhati University Institute of Science and Technology,Guwahati,India >>> Phone- +91-8399879454 >>> >>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> >> >> -- >> Hieu Hoang >> Research Associate >> University of Edinburgh >> http://www.hoang.co.uk/hieu >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20131128/c26abc4f/attachment-0001.htm > > ------------------------------ > > Message: 4 > Date: Wed, 27 Nov 2013 23:19:10 +0000 > From: Philipp Koehn <[email protected]> > Subject: Re: [Moses-support] Word-to-word alignment when > moses-parallel.pl is used > To: CHATZITHEODOROU Konstantinos <[email protected]> > Cc: "[email protected]" <[email protected]> > Message-ID: > <CAAFADDBaOp4WtEQAwcRoNvpeaShr0wguegJ6=7bymbj2pyv...@mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > > Hi, > > the script has an option "alignment-output-file" - did you try this? > > -phi > > On Tue, Nov 26, 2013 at 8:13 PM, CHATZITHEODOROU Konstantinos > <[email protected]> wrote: >> Hi all, >> >> Could you please give an example on how to output the word-to-word alignment >> during decoding when moses-parallel.pl is used? >> >> Thank you in advance for your help. >> >> Regards, >> Konstantinos >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> > > > ------------------------------ > > Message: 5 > Date: Thu, 28 Nov 2013 15:43:33 +0530 > From: Kunal Sachdeva <[email protected]> > Subject: Re: [Moses-support] Regarding Transliteration using Moses > To: Pranjal Das <[email protected]> > Cc: [email protected] > Message-ID: > <caof+9dc+gf3uansztijteykncmzzzsdoub9xjrdr11gcfl_...@mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Hi Pranjal, > Please have a look at this. > > http://www.researchgate.net/publication/255968530_Transliteration_Systems_Across_Indian_Languages_Using_Parallel_Corpora > > Regards > Kunal > > > > > On Wed, Nov 27, 2013 at 1:14 PM, Pranjal Das <[email protected]> wrote: > >> hii, >> i have completed my translation using moses toolkit,following the manual >> for installing moses,GIZZA++,IRSTLM and have tried out the sample models >> for translation and applying those on my own parallel corpus(fr-en),now i >> am facing problems regarding transliteration as there is no proper way >> given in the manual for Transliteration using moses.kindly help me with >> transliteration steps.where i can find them. >> >> >> >> Thanku >> >> Regards, >> >> *Pranjal Das* >> Department of Information Technology, >> Gauhati University Institute of Science and Technology,Guwahati,India >> Phone- +91-8399879454 >> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20131128/117e4494/attachment.htm > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 85, Issue 51 > ********************************************* _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
