Hi,
I’m having a problem using processPhraseTableMin to compress a phrase table
with 7 scores - the program consistently coredumps at step 3 - command and
relevant output below. Is there anything I’m doing glaringly wrong?
Thanks!
-Jeremy
Command:
1tqoct1:model> $MOSES/bin/processPhraseTableMin -in phrase-table.1.gz -out
phrase-table.1 -threads all -nscores 7
Once we get to step 3:
Intermezzo: Calculating Huffman code sets
Creating Huffman codes for 471366 target phrase symbols
tcmalloc: large alloc 13983629312 bytes == 0xb14ce000 @
tcmalloc: large alloc 27967250432 bytes == 0x3f3ca4000 @
tcmalloc: large alloc 15681406635450368 bytes == (nil) @
terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
Top looked like this when the program ran into trouble:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
27416 jgwinnup 20 0 45.9g 30g 4.0g R 10.6 3.0 1589:17 processPhraseTa
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
