there are ways of making training run ok even with large amount of data.

However, we need to know exactly where the problem is. What the the EXACT command you ran, including all arguments? Can you send me the entire command line output that contains the error, not just the single line with the error

On 28/09/14 15:07, Ihab Ramadan wrote:

I was training the translation model the language model is done successfully, the command was train-model.perl

It generates the corpus folder and start to make the other files in the giza.src-trg files using GIZA program, after a while it generates this error

I agree with you that could be a run out of memory exception because the data I use this time is much bigger than the previous one but what you mean by “something odd with the data”

*From:*[email protected] [mailto:[email protected]] *On Behalf Of *Hieu Hoang
*Sent:* Sunday, September 28, 2014 3:38 PM
*To:* [email protected]
*Cc:* moses-support
*Subject:* Re: [Moses-support] Training error ("Terminate called after throwing an instance of 'std::bad_alloc' ")

what is the exact command you ran? Were you training the translation model or the language model? and can you provide more details on the output.

it seems to have run out of memory. That shouldn't happen unless there's something odd with the data

On 28 September 2014 11:02, Ihab Ramadan <[email protected] <mailto:[email protected]>> wrote:

Dears,

I got this error during the training process of some big parallel files ( 600 MB for each) “Terminate called after throwing an instance of 'std::bad_alloc'”

Note : I ran the clean script before training

Any suggestions?

Best Regards

/Ihab Ramadan/| Senior Developer|Saudisoft <http://www.saudisoft.com/> - Egypt| *Tel * +2 02 330 320 37 Ext- 0| Mob+201007570826 <tel:%2B201007570826> | Fax+20233032036 <tel:%2B20233032036> | *Follow us on *linked <http://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Aprimary>* | **ZA102637861* <https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bookmark>* | **ZA102637858* <https://twitter.com/Saudisoft>


_______________________________________________
Moses-support mailing list
[email protected] <mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support




--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu


_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to