Dear Raj,

That’s a great work my friend,

This files make the script work but it takes long time to finish also it did 
not generate the model folder which contain the moses.ini file 

Is this normal? 

And I now try to run it again as I suspect that the server was shut down before 
the training was completed but i notice that it starts form the beginning and 
did not use the existing files generated

Thanks Raj it still a great work

 

 

From: Raj Dabre [mailto:[email protected]] 
Sent: Thursday, October 30, 2014 4:54 PM
To: [email protected]
Cc: [email protected]
Subject: Re: [Moses-support] Incremental training

 

Ahh.... i totally forgot that part.

Sorry.

PFA.

Just place them in the folder where the shell scripts full_train.sh and 
align_new.sh are.

Hopefully it should run now.

Please let me know if you succeed.

 

On Thu, Oct 30, 2014 at 11:44 PM, Ihab Ramadan <[email protected]> wrote:

Dear Raj,

It is a great solution 

I installed MGIZA++ successfully and I am using your scripts to run training 

And I followed the steps you mentioned but I faces this error when I was 
running the full_train.sh script

 

bla bla  bla 

.

.

.

.

 

Starting MGIZA 

Initializing Global Paras 

DEBUG: EnterDEBUG: PrefixDEBUG: LogParsing Arguments 

ERROR:  Cannot open configuration file configgiza.fwd!

Starting MGIZA 

Initializing Global Paras 

DEBUG: EnterDEBUG: PrefixDEBUG: LogParsing Arguments 

ERROR:  Cannot open configuration file configgiza.rev!

 

 

This two files does not exists 

should they be generated from the installation? 

How to get them?

 

From: Raj Dabre [mailto:[email protected]] 
Sent: Sunday, October 26, 2014 6:21 PM
To: [email protected]
Cc: [email protected]
Subject: Re: [Moses-support] Incremental training

 

Hello Ihab,

I would suggest using mgiza++. 
http://www.kyloo.net/software/doku.php/mgiza:overview

It is very easy to use.

I also wrote some scripts to make it easy for training.
Visit the link below for my scripts.
https://drive.google.com/folderview?id=0B2gN8qfxTTUoSU43OFBhZXpPZ3M 
<https://drive.google.com/folderview?id=0B2gN8qfxTTUoSU43OFBhZXpPZ3M&usp=sharing>
 &usp=sharing 

Usage:

To train basic IBM models:
bash full_train.sh <src_corpus_file_name> <tgt_corpus_file_name> 
<model_folder_base> <corpus_folder_base> <path_to_mgizapp_installation>

To align 2 new files using previously trained models (aka continue training).

bash align_new.sh <new_src_corpus_file_name> <new_tgt_corpus_file_name> 
<old_src_corpus_file_name> <old_tgt_corpus_file_name> <model_folder_base> 
<corpus_folder_base> <path_to_mgizapp_installation>

There is also a python script which you had better replace in the scripts 
folder of mgiza++. I have modified it to work with my scripts.

Hope this helps.

 

 

On Sun, Oct 26, 2014 at 11:05 PM, Ihab Ramadan <[email protected]> wrote:

Dear All,

I just need a clear steps on how to do incremental training in moses, as the 
illustration in the manual is not cleared enough

Thanks

 

Best Regards

Ihab Ramadan| Senior Developer|  <http://www.saudisoft.com/> Saudisoft - Egypt 
| Tel  +2 02 330 320 37  Ext- 0 | Mob+201007570826 <tel:%2B201007570826>  | 
Fax+20233032036 <tel:%2B20233032036>  | Follow us on  
<http://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Aprimary>
 linked |  
<https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bookmark>
 ZA102637861 |  <https://twitter.com/Saudisoft> ZA102637858

 


_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support




-- 

Raj Dabre.
Research Student, 

Graduate School of Informatics,
Kyoto University.

CSE MTech, IITB., 2011-2014




-- 

Raj Dabre.
Research Student, 

Graduate School of Informatics,
Kyoto University.

CSE MTech, IITB., 2011-2014

_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to