Hi all, Probably not the appropriate thread to bring this discussion, but since 'suffix arrays' are only discussed in the context of Incremental training in the documentation, I'd like to think of them as relevant to the discussion on Incremental training.
1. I've trained a batch model using the Europarl corpus including all the steps. 2. Now, I'd like to refrain from loading the tables and instead use the suffix arrays. I've made the change to the ttable-file entry in the config file as suggested in the documentation, but am wondering about what needs to be done about the distortion-file entry. When left unchanged, it loads the re-ordering file(which I "assumed" would be computed on the fly like the features in the translation table), and when I comment the entry about that I get an error due to the weights for the d-parameter that are obtained after MERT. I was unable to find any documentation on the site about suffix arrays, so I'd appreciate any help that you can give. - Prasanth On Thu, Oct 20, 2011 at 7:31 AM, Jehan Pages <[email protected]> wrote: > Hi, > > 2011/10/6 Philipp Koehn <[email protected]>: > > Hi, > > > > for the Moses support on this, please take a look at: > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc27 > > I add my voice here as that's quite an interesting topic! Thanks for > the reading! :-) > > In this page, I can read this: "Note that at the moment the > incremental phrase table code is not thread safe." Basically all it > implies for Moses users is: do not try to make 2 incremental trainings > at a time. Right? > > Also I didn't do any of this yet (probably much later), but I already > have a few question (I'll have probably more later): > 1/ just vocabulary: when you say "truecase", you mean the lowercase step, > right? > > 2/ And when you says the mt engine is updated via XML-RPC, so it means > the incremental training will work only in Moses server mode, I guess. > But you don't give at all the XML-RPC request which must be done for > this particular interaction. > > Thanks! > > Jehan > > P.S.: by the way, the search engine on the website does not seem to > work (always return a blank page on my Firefox 7.0.1/GNU/Linux), I > have to use external search engines to search on the website. > > > -phi > > > > 2011/10/6 Jesús González Rubio <[email protected]>: > >> 2011/10/6 HOANG Cong Duy Vu <[email protected]> > >>> > >>> Hi all, > >>> > >>> I am working on the problem that tries to develop a SMT system that can > >>> learn incrementally. The scenario is as follows: > >>> > >>> - A state-of-the-art SMT system tries to translate a source language > >>> sentence from users. > >>> - Users identify some translation errors in translated sentence and > then > >>> give the correction. > >>> - SMT system gets the correction and learn from that immediately. > >>> > >>> What I mean is whether SMT system can learn the user corrections > (without > >>> re-training) incrementally. > >>> > >>> Do you know any similar ideas or have any advice or suggestion? > >>> > >>> Thanks in advance! > >>> > >>> -- > >>> Cheers, > >>> Vu > >>> > >>> _______________________________________________ > >>> Moses-support mailing list > >>> [email protected] > >>> http://mailman.mit.edu/mailman/listinfo/moses-support > >>> > >> > >> Hi Vu, > >> You can try searching for "Interactive machine translation",for example > this > >> paper covers the details of the online retraining of an MT system: > >> Online Learning for Interactive Statistical Machine Translation > >> aclweb.org/anthology/N/N10/N10-1079.pdf > >> Cheers > >> -- > >> Jesús > >> > >> _______________________________________________ > >> Moses-support mailing list > >> [email protected] > >> http://mailman.mit.edu/mailman/listinfo/moses-support > >> > >> > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > -- "Theories have four stages of acceptance. i) this is worthless nonsense; ii) this is an interesting, but perverse, point of view, iii) this is true, but quite unimportant; iv) I always said so." --- J.B.S. Haldane
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
