Hello all
Ok, the subject of my message covers 2 different topics so let's start with the second one: Is it possible to enrich the lm and/or the phrase table? I mean, once we train the system with a specific corpus, is it possible to enrich it after we have gathered more data without retraining from scratch? As for your suggestion Hieu, indeed this is what I want. I tampered a lot with the scripts in the web project, especially the translate.cgi, and I am getting somewhere. However, my programming skills are still immature so I can't get the result I want. After I run daemon.pl, I can connect to my server with netcat, feed the sentence to moses, and get the output to my local machine. Unfortunately, the tokenizer and the detokenizer do not get invoked from inside the translate.cgi, so the translation I get is not clean (it includes patterns like |0-9| between words/phrases). I know it should be fairly easy for someone with perl knowledge to modify and strip down the translate.cgi file so it can be used with simple input or simple text files instead of web pages. Then again, I think the only files needed to run a moses daemon for simple input/ouput are the translate.cgi, daemon.pl, and the lib folder with the files RemoteProcess.pm and Subprocess.pm. Any ideas and thoughts are welcome. Thank you. Panagiotis _____ From: Hieu Hoang [mailto:[EMAIL PROTECTED] Sent: Friday, September 19, 2008 2:33 AM To: 'Panagiotis Kanavos'; [email protected] Subject: RE: [Moses-support] keep lm and phrase table in memory the /web subproject in the moses source code should give you a good example. The subproject creates a persistent process to translate incoming web queries. the alternative is to write a c++ program which calls the decoder directly. The decoder is implemented as a library to enable you to do just that. Hieu Hoang www.hoang.co.uk/hieu _____ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Panagiotis Kanavos Sent: 18 September 2008 22:33 To: [email protected]; Marcello Federico Subject: Re: [Moses-support] keep lm and phrase table in memory Thanks for your reply. I installed these programs and (partially) connected the 2 systems. However, I can't find much documentation so I can use them properly, that is send the input from the local machine to moses in the server and then have it back translated while moses waits for the next sentence. On the local machine, I used sth like hose ServerName port_number --in sometext . and on the server I used sth like faucet port_number --out --verbose moses -f /path/to/moses.ini -i . When I ran the command from the local machine, moses on the server indeed started loading the tables in memory but I didn't receive any output, either on the server or on the local machine. I know I miss a lot of things so if you, or anyone else, know how to use these programs I would appreciate your advice. Thank you. Panagiotis _____ > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED]; [email protected] > Date: Thu, 18 Sep 2008 14:15:30 +0200 > Subject: RE: [Moses-support] keep lm and phrase table in memory > > Hi, > > Moses can be read text line-by-line from stdin and output translation to stdout. Hence, > it should be very simple to set-up a client/server architecture through the hose/faucet > linux commands. > > -- Marcello > > __________ > From: [EMAIL PROTECTED] [EMAIL PROTECTED] On Behalf Of Panos [EMAIL PROTECTED] > Sent: Thursday, September 18, 2008 2:04 PM > To: [email protected] > Subject: [Moses-support] keep lm and phrase table in memory > > Hello, > > Is there a way to keep the language model and the phrase table in memory without running the decoder? I am trying to connect moses to an external application so that I can feed sentences for translation whenever I want. However, having to load the lm and the phrase table into memory for every single sentence I send is very time consuming. Moses runs on a Ubuntu Hardy 64bit server with 8GB of memory. > > Thank you. > > Panagiotis Kanavos
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
