Which memory pool are you talking about? Hieu Hoang http://www.hoang.co.uk/hieu On 9 Mar 2016 7:13 pm, "Marcin Junczys-Dowmunt" <[email protected]> wrote:
> Hm, that's new. > I guess this is connected with moses switching recently to memory pools > and no one bothered to check whether the query tool still works after that. > > You could check out branch "wipoNew" which still has a Moses 2.1 version, > the tool should work there. > > W dniu 09.03.2016 o 19:09, Lane Schwartz pisze: > > Right. So I added that, and now I get a crash. Here's the backtrace: > > Program received signal SIGABRT, Aborted. >> 0x00007ffff5f985e9 in raise () from /lib64/libc.so.6 >> Missing separate debuginfos, use: debuginfo-install >> bzip2-libs-1.0.6-12.el7.x86_64 glibc-2.17-78.el7.x86_64 >> libgcc-4.8.3-9.el7.x86_64 libstdc++-4.8.3-9.el7.x86_64 >> libxml2-2.9.1-5.el7_1.2.x86_64 xmlrpc-c-1.32.5-1905.svn2451.el7.x86_64 >> xmlrpc-c-c++-1.32.5-1905.svn2451.el7.x86_64 >> xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-13.el7.x86_64 >> (gdb) bt >> #0 0x00007ffff5f985e9 in raise () from /lib64/libc.so.6 >> #1 0x00007ffff5f99cf8 in abort () from /lib64/libc.so.6 >> #2 0x00007ffff5fd8dd7 in __libc_message () from /lib64/libc.so.6 >> #3 0x00007ffff5fe01bd in _int_free () from /lib64/libc.so.6 >> #4 0x000000000041e763 in std::__valarray_release_memory (__p=0x1039600) >> at /usr/include/c++/4.8.2/bits/valarray_array.h:66 >> #5 0x0000000000420c7b in std::valarray<float>::~valarray >> (this=0x1039558, __in_chrg=<optimized out>) at >> /usr/include/c++/4.8.2/valarray:703 >> #6 0x000000000041ff1b in Moses::FVector::~FVector (this=0x1039528, >> __in_chrg=<optimized out>) at moses/FeatureVector.h:127 >> #7 0x0000000000436078 in >> Moses::ScoreComponentCollection::~ScoreComponentCollection (this=0x1039528, >> __in_chrg=<optimized out>) at ./moses/ScoreComponentCollection.h:87 >> #8 0x000000000055f865 in Moses::TargetPhrase::~TargetPhrase >> (this=0x10394c0, __in_chrg=<optimized out>) at moses/TargetPhrase.cpp:151 >> #9 0x00000000004c0db7 in std::_Destroy<Moses::TargetPhrase> >> (__pointer=0x10394c0) at /usr/include/c++/4.8.2/bits/stl_construct.h:93 >> #10 0x00000000004bfdde in >> std::_Destroy_aux<false>::__destroy<Moses::TargetPhrase*> >> (__first=0x10394c0, __last=0x10395f0) at >> /usr/include/c++/4.8.2/bits/stl_construct.h:103 >> #11 0x00000000004bebbb in std::_Destroy<Moses::TargetPhrase*> >> (__first=0x10394c0, __last=0x10395f0) at >> /usr/include/c++/4.8.2/bits/stl_construct.h:126 >> #12 0x00000000004bdc4b in std::_Destroy<Moses::TargetPhrase*, >> Moses::TargetPhrase> (__first=0x10394c0, __last=0x10395f0) at >> /usr/include/c++/4.8.2/bits/stl_construct.h:151 >> #13 0x000000000052028a in std::vector<Moses::TargetPhrase, >> std::allocator<Moses::TargetPhrase> >::_M_insert_aux (this=0x1039080, >> __position=warning: can't find linker symbol for virtual table for >> `Moses::TargetPhrase' value >> ..., __x=...) at /usr/include/c++/4.8.2/bits/vector.tcc:384 >> #14 0x000000000051d873 in std::vector<Moses::TargetPhrase, >> std::allocator<Moses::TargetPhrase> >::push_back (this=0x1039080, __x=...) >> at /usr/include/c++/4.8.2/bits/stl_vector.h:913 >> #15 0x000000000083341e in Moses::PhraseDecoder::DecodeCollection >> (this=0xfd5130, tpv=..., encodedBitStream=..., sourcePhrase=..., >> topLevel=true, eval=false) >> at moses/TranslationModel/CompactPT/PhraseDecoder.cpp:279 >> #16 0x0000000000833087 in >> Moses::PhraseDecoder::CreateTargetPhraseCollection (this=0xfd5130, >> sourcePhrase=..., topLevel=true, eval=false) at >> moses/TranslationModel/CompactPT/PhraseDecoder.cpp:237 >> #17 0x00000000004bbb1f in >> Moses::PhraseDictionaryCompact::GetTargetPhraseCollectionRaw >> (this=0x7fffffffda50, sourcePhrase=...) at >> moses/TranslationModel/CompactPT/PhraseDictionaryCompact.cpp:148 >> #18 0x000000000040ef67 in main (argc=6, argv=0x7fffffffe298) at >> misc/queryPhraseTableMin.cpp:64 > > > On Wed, Mar 9, 2016 at 1:02 PM, Marcin Junczys-Dowmunt <[email protected] > > wrote: > >> Your phrase table has 11 scores, you need to add "-n 11" >> >> W dniu 09.03.2016 o 19:01, Lane Schwartz pisze: >> >> $ ./bin/queryPhraseTableMin -t >>> newstest2013.filtered.3/phrase-table.0-0.1.1.minphr <<< "une" >>> terminate called after throwing an instance of 'util::Exception' >>> what(): moses/ScoreComponentCollection.cpp:252 in void >>> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*, >>> const std::vector<float>&) threw util::Exception. >>> Feature function PhraseDictionaryCompact0 specified 4 dense scores or >>> weights. Actually has 11 >>> Aborted (core dumped) >> >> >> Am I calling this correctly? Something's not right. >> >> On Wed, Mar 9, 2016 at 12:56 PM, Marcin Junczys-Dowmunt < >> [email protected]> wrote: >> >>> There is queryPhraseTableMin that reads phrases from stdin and returns >>> all entries in the compact phrase table. Just do a script that generates >>> all substrings from a sentence and pass it to that program. >>> >>> W dniu 09.03.2016 o 18:53, Lane Schwartz pisze: >>> >>> Ah, excellent! Can this info be gotten via one of the standalone query >>> programs? I've never used those, but I'm guessing that's what they're for? >>> >>> I have a phrase-table.0-0.1.1.gz that looks like this: >>> >>> a , au contraire , ||| , however , ||| 6.70231e-06 1.67288e-09 0.0150266 >>>> 0.00200436 2.718 1 1 1 1 1 1 ||| 1-0 2-1 3-1 4-2 ||| 17936 8 1 ||| ||| >>>> a , au contraire , ||| , instead , ||| 0.000785703 5.71013e-05 >>>> 0.0150266 0.022757 2.718 1 1 1 1 1 1 ||| 1-0 2-1 3-1 4-2 ||| 153 8 1 ||| >>>> ||| >>> >>> And I have a phrase-table.0-0.1.1.minphr. >>> >>> What would be the recommended mechanism for getting phrases for a >>> particular sentence using a query program? >>> >>> Thanks, >>> >>> Lane >>> >>> >>> >>> On Wed, Mar 9, 2016 at 12:42 PM, Marcin Junczys-Dowmunt < >>> [email protected]> wrote: >>> >>>> With verbose 3 it's actually there, just before it starts outputting >>>> the search graph, take another look. There is a list sorted by source >>>> sentence spans. >>>> >>>> W dniu 09.03.2016 o 18:39, Lane Schwartz pisze: >>>> >>>> I don't suppose anyone knows of a relatively easy way to print the list >>>> of translation options for each sentence? >>>> >>>> verbose=2 tells how many translation options there are, but not what >>>> they are >>>> verbose=3 prints the search graph as it's being constructed, but still >>>> not what I'm looking for >>>> >>>> Thanks, >>>> Lane >>>> >>>> >>>> >>>> _______________________________________________ >>>> Moses-support mailing >>>> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>>> >>> >>> >>> -- >>> When a place gets crowded enough to require ID's, social collapse is not >>> far away. It is time to go elsewhere. The best thing about space travel >>> is that it made it possible to go elsewhere. >>> -- R.A. Heinlein, "Time Enough For Love" >>> >>> >>> >> >> >> -- >> When a place gets crowded enough to require ID's, social collapse is not >> far away. It is time to go elsewhere. The best thing about space travel >> is that it made it possible to go elsewhere. >> -- R.A. Heinlein, "Time Enough For Love" >> >> >> > > > -- > When a place gets crowded enough to require ID's, social collapse is not > far away. It is time to go elsewhere. The best thing about space travel > is that it made it possible to go elsewhere. > -- R.A. Heinlein, "Time Enough For Love" > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
