the domain-adaptation routine has added more scores to the phrase-table. You need to tell the binarizer that. This works for me
MOSES_DIR=/Users/hieu/workspace/github/mosesdecoder $MOSES_DIR/bin/CreateOnDiskPt 1 1 7 100 2 test-phrase-table test-phrase-table.bin Hieu Hoang Researcher New York University, Abu Dhabi http://www.hoang.co.uk/hieu On 1 April 2015 at 19:41, jian zhang <[email protected]> wrote: > Hi Hieu: > > Attached is a 10-line phrase table to generate the error. > > I am using command: > > /system/mosesdecoder-master/bin/CreateOnDiskPt 1 1 4 100 2 > /experiments/de-en/domains-30-03-2015/domain-indicator/steps/1/test-phrase-table > > /experiments/de-en/domains-30-03-2015/domain-indicator/steps/1/test-phrase-table.bin > terminate called after throwing an instance of 'util::Exception' > what(): OnDiskPt/PhraseNode.cpp:97 in void > OnDiskPt::PhraseNode::Save(OnDiskPt::OnDiskWrapper&, size_t, size_t) threw > util::Exception because `m_saved'. > Already saved > Aborted (core dumped) > > Regards, > > Jian > > > On Wed, Apr 1, 2015 at 4:32 PM, jian zhang <[email protected]> > wrote: > >> H >> >> On Wed, Apr 1, 2015 at 4:20 PM, Hieu Hoang <[email protected]> wrote: >> >>> strange. is it possible you can make the text phrase-table available for >>> download >>> >>> Hieu Hoang >>> Research Associate >>> New York University, Abu Dhabi >>> http://www.hoang.co.uk/hieu >>> >>> On 1 April 2015 at 14:27, jian zhang <[email protected]> wrote: >>> >>>> Hi, >>>> >>>> When I am binarizing phrase table with domain sparse features, I got >>>> exception: >>>> >>>> Executing: /system/mosesdecoder-master/bin/CreateOnDiskPt 1 1 4 100 2 >>>> /experiments/de-en/domains-30-03-2015/domain-indicator/tuning/filtered.1/phrase-table.0-0.1.1 >>>> /experiments/de-en/domains-30-03-2015/domain-indicator/tuning/filtered.1/phrase-table.0-0.1.1.bin >>>> terminate called after throwing an instance of 'util::Exception' >>>> what(): OnDiskPt/PhraseNode.cpp:97 in void >>>> OnDiskPt::PhraseNode::Save(OnDiskPt::OnDiskWrapper&, size_t, size_t) threw >>>> util::Exception because `m_saved'. >>>> Already saved >>>> >>>> I am using ems on moses version 3.0, and the configuration for domain >>>> feature is >>>> domain-features = "subset" >>>> >>>> The phrase table entries look like: >>>> ! ! ! ! ! ! ! ||| ! ! ! ! ! ! ! ||| 0.41129 0.0415342 0.344595 >>>> 9.9589e-05 2.718 1 1 ||| 0-0 1-1 2-2 3-3 4-4 5-5 6-6 ||| 124 148 51 ||| ||| >>>> ! ! ! ! ! ! ! ||| ! ! ! ! ! ! ||| 0.00574516 0.0415342 0.00590043 >>>> 0.000371446 2.718 1 1 ||| 1-0 0-1 2-1 3-2 4-3 5-4 6-5 ||| 152 148 2 ||| ||| >>>> ! ! ! ! ! ! ! ||| ! ! ! ! ! ||| 0.000320174 0.0415342 0.00044132 >>>> 0.00138541 2.718 1 1 ||| 0-0 1-0 1-1 2-1 3-1 2-2 4-2 3-3 5-3 4-4 6-4 ||| >>>> 204 148 1 ||| ||| >>>> >>>> Did I miss anything? >>>> >>>> Thanks, >>>> >>>> Jian >>>> >>>> -- >>>> Jian Zhang >>>> Centre for Next Generation Localisation (CNGL) >>>> <http://www.cngl.ie/index.html> >>>> Dublin City University <http://www.dcu.ie/> >>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>> >> >> >> -- >> Jian Zhang >> Centre for Next Generation Localisation (CNGL) >> <http://www.cngl.ie/index.html> >> Dublin City University <http://www.dcu.ie/> >> > > > > -- > Jian Zhang > Centre for Next Generation Localisation (CNGL) > <http://www.cngl.ie/index.html> > Dublin City University <http://www.dcu.ie/> >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
