Dear Dr. Philipp,
I am using the reordering table too.
I also tried without reordering table and it has given me
this error..
lt-moses: TargetPhrase.cpp:82: void TargetPhrase::SetScore(const
ScoreProducer*, const std::vector<float, std::allocator<float> >&, const
std::vector<float, std::allocator<float> >&, float, const LMList&):
Assertion `weightT.size() == scoreVector.size()' failed. Aborted (core
dumped)
I am attaching the complete log as a text file.
But now the process is very fast and it would be a great help if i can
overcome
this error.
Thanks
Sushil
On Sun, May 25, 2008 at 3:01 PM, Philipp Koehn <[EMAIL PROTECTED]> wrote:
> Hi,
>
> this should not happen with the binarized translation table.
> It should load failry quickly (seconds, if that) and not use
> very little RAM. Maybe something went wrong with the
> binarization? How about the reordering table (if you use one)?
>
> -phi
>
> On Sat, May 24, 2008 at 2:37 PM, sushil ronghe <[EMAIL PROTECTED]>
> wrote:
> >
> > Hello all,
> >
> > I have trained the translation model using english-german parallel corpus
> > (europarl)
> > Size of phrase-table = 4.2 GB and language model = 249.1MB
> >
> > I am getting this error:
> > Loading table into memory..terminate called after throwing an instance of
> > 'std:bad_alloc'
> > what(): std:bad_alloc
> > Aborted (core dumped)
> >
> >
> > I tried with binary tables : collection of binary file produce is about 2
> GB
> > But I am still getting the same error. (I have also configured the
> moses.ini
> > so that
> > it will find the binary tables).
> > I am using moses compiled with irstlm on ubuntu
> > (machine configuration: core 2 Duo 2gz 2.512 GB of ram).
> > Should i need to upgrade my ram or is there any other way.
> >
> >
> > thanks
> >
> >
> >
> >
> >
> > --
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > [email protected]
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
>
--
********************************
sushil ronghe
*********************************
Defined parameters (per moses.ini or switch):
config: endetask/model/moses.ini
distortion-limit: 6
input-factors: 0
lmodel-file: 1 0 3 /home/sushil/trServer/NTBaseline/lm/europarl.lm
mapping: 0 T 0
ttable-file: 0 0 1
/home/sushil/trServer/NTBaseline/endetask/model/phrase-table
ttable-limit: 10
weight-d: 0.3 0.3 0.3 0.3 0.3 0.3 0.3
weight-l: 0.5000
weight-t: 0.2 0.2 0.2 0.2 0.2
weight-w: -1
Loading lexical distortion models...
have 0 models
Start loading LanguageModel /home/sushil/trServer/NTBaseline/lm/europarl.lm :
[0.000] seconds
In LanguageModelIRST::Load: nGramOrder = 3
Loading LM file (no MAP)
\data\
loadtxt()
1-grams: reading 91496 entries
2-grams: reading 2028123 entries
3-grams: reading 1958656 entries
4-grams: reading 2060144 entries
5-grams: reading 1654102 entries
done
starting to use OOV words [<unk>]
OOV code is 91496
OOV code is 91496
IRST: m_unknownId=91496
Set dictionary_upperbound to: 91498
Set logOOVpenalty to: 0.000
Finished loading LanguageModels : [27.000] seconds
Start loading PhraseTable
/home/sushil/trServer/NTBaseline/endetask/model/phrase-table : [27.000] seconds
using binary phrase tables for idx 0
reading bin ttable
size of OFF_T 8
binary phrasefile loaded, default OFF_T: -1
Finished loading phrase tables : [28.000] seconds
IO from STDOUT/STDIN
Created input-output object : [28.000] seconds
Translating: dies ist kleines haus
lt-moses: TargetPhrase.cpp:82: void TargetPhrase::SetScore(const
ScoreProducer*, const std::vector<float, std::allocator<float> >&, const
std::vector<float, std::allocator<float> >&, float, const LMList&): Assertion
`weightT.size() == scoreVector.size()' failed.
Aborted (core dumped)
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
