Okay fine. So the backoff apparently works even though the code seemed to suggest something different to me. Got it wrong I guess.
Maybe there's some other problem in my setup, for instance with factored generation steps. Thanks anyway for looking into this. On Sun, 2015-04-19 at 12:52 +0400, Hieu Hoang wrote: > i used the following simple moses.ini file. the decoder seems to be > doing what is expected. Models, input and & output attached. > [input-factors] > 0 > > [mapping] > 0 T 0 > 1 T 1 > > > [feature] > UnknownWordPenalty > PhraseDictionaryCompact name=pt input-factor=0 output-factor=0 > path=pt.compact num-features=1 > PhraseDictionaryCompact name=pt2 input-factor=0 output-factor=0 > path=pt2.compact num-features=1 > > [weight] > pt= 1 > pt2= 1 > > [decoding-graph-backoff] > 0 > 1 > > > > > Hieu Hoang > Researcher > > New York University, Abu Dhabi > > http://www.hoang.co.uk/hieu > > > On 17 April 2015 at 01:26, Matthias Huck <[email protected]> wrote: > I think your remark in the mail from January was correct, it > has to be > ePos-sPos+1 > backoff > but currently still is > ePos-sPos+1 <= backoff > > Are you able to somehow test this? > > > On Thu, 2015-04-16 at 23:57 +0400, Hieu Hoang wrote: > > ah yes, I thought the backoff was doing the opposite to what > it's > > supposed to do so I changed the comparison around. I checked > that it > > backed off, but i didn't run it through tuning. > > > > it may still be wrong, or there may be strange interaction > with the tuning. > > > > > > On 16/04/2015 22:16, Matthias Huck wrote: > > > Well, what's that business mentioned in your mail from > January (quoted > > > below), with the backoff being broken, then being broken > more, then > > > possibly been fixed - or not? > > > > > > > > https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19 > > > > > > > > > I set up a system that was supposed to do backoff with > factored > > > generation steps, more or less in the manner of what's > described in this > > > paper: Interpolated Backoff for Factored Translation > Models, Philipp > > > Koehn and Barry Haddow, AMTA 2012. > > > > > > MIRA tunes all the weights of the backoff models to 0. > With exactly the > > > same configuration, this did not happen last year > (February 2014). Maybe > > > the [decoding-graph-backoff] setting didn't have any > effect prior to > > > some of your code modifications, and the models were > actually competing > > > in older setups? Or it's buggy now. I can't really tell. > > > > > > I can show you the two setups if you want. > > > > > > > > > > > > On Thu, 2015-04-16 at 21:34 +0400, Hieu Hoang wrote: > > >> Didn't know it has changed. How should it behave and how > does it > > >> actually behave? > > >> > > >> On 16 Apr 2015 21:04, "Matthias Huck" > <[email protected]> wrote: > > >> Hi Hieu, > > >> > > >> It seems that [decoding-graph-backoff] doesn't > quite behave > > >> like last > > >> year any more. Can you briefly explain how its > behaviour has > > >> changed, > > >> i.e. what it did before and what it does now? > Can you please > > >> also let me > > >> know whether there's a way to reproduce the old > behaviour via > > >> configuration options? > > >> > > >> Cheers, > > >> Matthias > > >> > > >> > > >> > > >> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang > wrote: > > >> > >From the git history, I think it was slightly > broken, then > > >> I broke it even > > >> > more in May 2014. > > >> > > > >> > > > >> > > https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19 > > >> > > > >> > It was > > >> > endPos-startPos+1 >= backoff > > >> > then > > >> > endPos-startPos+1 <= backoff > > >> > I think it should be > > >> > endPos-startPos+1 > backoff > > >> > > > >> > I'll change it if it's ok with everyone > > >> > > > >> > > > >> > On 9 January 2015 at 15:11, Marcin > Junczys-Dowmunt > > >> <[email protected]> > > >> > wrote: > > >> > > > >> > > Hm, we have been using it at WIPO, but I > have to admit I > > >> never checked > > >> > > it _actually_ does anything useful. We sorta > believe it > > >> does. > > >> > > > > >> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze: > > >> > > > > >> > > Hi All > > >> > > > > >> > > Does anyone use this functionality in Moses > when you have > > >> multiple > > >> > > phrase-tables? > > >> > > > > >> > > From the code, it doesn't look like it > works as described > > >> in > > >> > > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures > > >> > > > > >> > > Maybe I'm missing something > > >> > > > > >> > > -- > > >> > > Hieu Hoang > > >> > > Research Associate > > >> > > University of Edinburgh > > >> > > http://www.hoang.co.uk/hieu > > >> > > > > >> > > > > >> > > > > >> > > > _______________________________________________ > > >> > > Moses-support mailing > > >> > > [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support > > >> > > > > >> > > > > >> > > > > >> > > > _______________________________________________ > > >> > > Moses-support mailing list > > >> > > [email protected] > > >> > > > http://mailman.mit.edu/mailman/listinfo/moses-support > > >> > > > > >> > > > > >> > > > >> > > > >> > > _______________________________________________ > > >> > Moses-support mailing list > > >> > [email protected] > > >> > > http://mailman.mit.edu/mailman/listinfo/moses-support > > >> > The University of Edinburgh is a charitable > body, registered > > >> in > > >> > Scotland, with registration number SC005336. > > >> > > >> > > >> > > >> -- > > >> The University of Edinburgh is a charitable > body, registered > > >> in > > >> Scotland, with registration number SC005336. > > >> > > >> > > > > > > > > > > > > -- > The University of Edinburgh is a charitable body, registered > in > Scotland, with registration number SC005336. > > > > -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
