Hello,
thanks for the tips! When talking about using a Sun Grid Engine I was referring tuning. Making use of a cluster is supposed to speed up the tuning process (see http://www.statmt.org/moses/?n=Moses.FAQ#ntoc10). In this context I wondered what hardware exactly is needed for such a cluster. Sandra Von: Tom Hoar [mailto:[email protected]] Gesendet: Freitag, 28. Januar 2011 09:01 An: Noubours, Sandra Cc: [email protected] Betreff: Re: [Moses-support] running moses on a cluster with sge Sandra, What kind of capacity do you need to support? I just finished translating 21,000 pages, over 1/2 million phrases, in 22 hours on an old Intel Core2Quad, 2.4 Ghz with 4 GB RAM and a 4-disk RAID-0. Moses was configured with binarized phrase/reordering tables and kenlm binarized language model. The advances in Moses supporting efficient binarized tables/models are great! We're planning tests for a 2-socket host with two Intel Xeon 5680 6-core 3.33 Ghz CPU's, 48 GB RAM and 4 1-TB disks as RAID0. With 12 cores (totaling 24 simultaneous threads according to Intel specs), we're expecting to boot capacity to well over 15 million phrases per day on one host. What's the advantage of running Moses on a grid or cluster? Tom On Fri, 28 Jan 2011 08:40:22 +0100, "Noubours, Sandra" <[email protected]> wrote: Hello, I would like to run Moses on a cluster. I am yet inexperienced in using Sun Grid as well as clusters in common. Could you give me any instructions or tips for implementing a Linux-Cluster with Sun Grid Engine for running Moses? a) What kind of cluster would you recommend, i.e. how many machines, how many cpus, what memory, etc.? b) When tuning is performed with the multicore option it does not use more than one cpu. Does the tuning step use more than one cpu when run on a cluster? c) Can Sun Grid implement a cluster virtually on one computer, so that jobs are spread locally to different cpus of one computer? Thank you and best regards! Sandra
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
