Hi barry, thank you for your pormpt and exhaustive answer. I still have other questions:
----Messaggio originale---- Da: [email protected]. ac.uk Data: 23/08/2011 12.06 A: <[email protected]>, "ivgua@tiscali. it"<[email protected]> Ogg: Re: [Moses-support] Minimum requirements, punctuation and other general questions Hi Ivan On Tuesday 23 August 2011 09:45, [email protected] wrote: > I'm new to that ml, and to Moses, and I have several questions > about that software: > 1. What are the minimum hardware requirements for > model training in moses? For example a server with that > configuration: > Memory: >= 4gb > CPU: = 2 Cores >It really depends how big your models are. That configuration will only work >with fairly small models. Since a lot of the training is done on disk, you >need plenty of disk space too. > 2. If i plan to > use the mosesserver application it is ok to place it in the same > server where the models are trained? Or is better to have them on a > different server? >There's no problem with doing this, except that if you want to run training >and run the mosesserver at the same time, then your machine needs to have >sufficient resources. Ok, i discovered that probably we can have a 64gb ram 8/12 cores machine. The requirements for translation are the same for the training? I prepared two language models in binary format. And i noticed that when the server is loading/translating it takes 89/90% of ram (actually the test environment has 4gb of RAM), and 10% of cpu. But when there aren't pending translation the memory used is 0%. So for translation machine i still need a 8/12 cores, or i can have a "smaller" machine? For translation what is important? Memory or CPU? And for example with 64gb ram, approximatively how many models can i load on the same machine (suppose we have models with ~400'000/800'000 sentences)? > 3. Is possible to load more than one language model > in one moses server instance? If not, How many server instances could > run on the same server. A configuration of 4gb ram and 1 cpu is ok? >Yes, you can load more than 1 LM in a moses server instance. Again, your >configuration depends on the size of the models, but that machine would only >work with small models. Our experimental machines have 32-72 G ram, and 8-16 >cpus. > 4. > Actually i'm running moses on a test environment with 2 istances of > moses server. The translation seems to be ok. But i have a problem, if > the phrase contains punctuation, the words with punctuation are not > translated. > > For example: > put here your text --> introducir aquí su > texto > put here your text. --> introducir aquí su text > > There is a > solution to avoid that? >Yes, you need to tokenise your input. Look at the moses step-by-step guide. >http://www.statmt.org/moses_steps.html Thank you. It worked :) > 5. Is There a way to have case insensitive > translations? (Actually i need to lower the input string). >Yes, moses includes a script for lowercasing. Again, this is covered in the >step- by-step guide. > 6. Is there > some kind of support for doc, pdf (in general documents) translation > in moses? > >There are no tools in moses itself to handle pdf documents. However there are >various tools built on top of moses which might have this support, Ok, thanks. >cheers - Barry Bye and thanks, Ivan -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. Tutto Incluso 20 Mega light: telefono + ADSL a soli 19,95 € al mese fino al 2 gennaio 2014. Risparmi 324 euro! Passa a Tiscali: http://abbonati.tiscali.it/rd/rd2.html?u=http%3A%2F%2Fabbonati.tiscali.it%2Ftelefono-adsl%2Fprodotti%2Ftc%2Ftuttoincluso_light%2F%3FWT.mc_id%3D01fw%26r=TS00000A00002%26dm=DM_03%26p=footer _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
