On 10/27/10, Hieu Hoang <[email protected]> wrote: > err, error correction on the iphone is rubbish! > > i meant to say, 'you may have given the ems the ini file and told it to > skip tuning' > > On 27/10/2010 16:56, Hieu Hoang wrote: >> Not sure. YouTube have given ema the ini file& told it to skip tuning >> >> Hieu >> Sent from my flying horse >> >> On 27 Oct 2010, at 15:29, John Morgan<[email protected]> wrote: >> >>> Hieu, >>> Thanks for the references. >>> I'm working on an English to Pashto project right now with very little >>> training data (~35k segments). >>> I'm getting good results with the hierarchical models, but I'd like to >>> try all the options available in the ems. >>> >>> For my first tree2string setup I set the input parser to the collins >>> parser. >>> I set hierarchical-rule-set to true. >>> I ignored tuning. >>> The results I got were not as good as a hierarchical system, but >>> better than a phrase-based system under similar conditions. I'm >>> rerunning this experiment to verify the results. >>> I run into problems when I introduce tuning. I've modified my >>> experiment.meta file and it's possible my problems come from there. >>> My guess right now is that if tuning and hierarchical-rule-set are >>> both set in the configuration file, there is no route through the >>> experiment.meta file. >>> But why does a tree2string system work without tuning? >>> >>> John >>> >>> >>> >>> On 10/27/10, Hieu Hoang<[email protected]> wrote: >>>> hey john >>>> >>>> i'm interested in how your tree-to-string model gets on as i'm looking @ >>>> these models myself. >>>> >>>> are you doing english-foreign ? and you're using an english parser? >>>> >>>> fyi, what you're doing is unlikely to be better than hierarchical model. >>>> syntax constraints are usually too strict. >>>> >>>> Liang Huang's paper that did this used a very small test corpora. >>>> http://www.cis.upenn.edu/~lhuang3/amta06-sdtedl.pdf >>>> imho, to get them to work, u need to a forest >>>> http://www.cis.upenn.edu/~lhuang3/forest-based-translation.pdf >>>> or to relax the syntax >>>> http://aclweb.org/anthology-new/W/W10/W10-1761.pdf >>>> >>>> On 26/10/2010 19:54, John Morgan wrote: >>>>> Hieu, >>>>> According to the TUNING_tune.?.STDERR file it looks like tuning >>>>> succeeded and a moses.ini.? file was generated under the tuning >>>>> directory. >>>>> >>>>> I had hierarchical-rule-set = true set in my configuration file. I >>>>> guess this is the cause of my problems, right? >>>>> I'm trying to build a tree to string system. >>>>> Thanks, >>>>> John >>>>> >>>>> >>>>> On 10/26/10, Hieu Hoang<[email protected]> wrote: >>>>>> hi john >>>>>> >>>>>> do you know what the error is? It's usually found in the log file >>>>>> TUNING_tune.??.STDERR >>>>>> can you send me an example of your input& a few files of the >>>>>> translation >>>>>> bmodel. >>>>>> >>>>>> using inputtype=0 (normal sentence) should be ok if it's a hiero model >>>>>> or >>>>>> a >>>>>> string-to-tree model. you only need inputtype=3 if you're doing a >>>>>> tree-to-string model >>>>>> >>>>>> On 26 October 2010 15:30, John Morgan<[email protected]> >>>>>> wrote: >>>>>> >>>>>>> -- >>>>>>> Regards, >>>>>>> John J Morgan >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> Hello, >>>>>>> I'm trying to get an English to Pashto system working with >>>>>>> syntax-directed models in the ems framework. >>>>>>> Tuning with mert fails. >>>>>>> I think I've tracked down the problem to the commandline option >>>>>>> inputtype = 0. inputtype is set to 3 in the moses.ini, but the >>>>>>> automatically generated tuning script sets inputtype to 0 for the >>>>>>> moses_chart decoder. I set inputtype = 3 under the [TUNING] module >>>>>>> in >>>>>>> my configuration file and mert tuning runs for 8 iterations then >>>>>>> crashes. >>>>>>> What is the correct setting for inputtype when training >>>>>>> syntax-directed >>>>>>> models? >>>>>>> >>>>>>> I'm successful if I stay away from mert tuning. >>>>>>> Thanks, >>>>>>> _______________________________________________ >>>>>>> Moses-support mailing list >>>>>>> [email protected] >>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>>> >>>>>>> >>> >>> -- >>> Regards, >>> John J Morgan >
I ran the decoding step by hand using the commandline automatically generated by experiment.perl. I can get the decoder to translate by deleting the -v 0 option to moses_chart. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
