Hi Hieu, My latest tests on a netbook (dual core 1.6 Ghz, 2GB Ram, 320 GB 5400 rpm):
- test sets had a size of 1000 to 2000 sentences and the complete parallel corpus was around 1.8 mil words (~950 sentences each) - I performed several training steps for chart and pb-decoding using an unfactored model and a tree-based one - phrase, rule and reodering tables were binarized and/or filtered - training pipeline using the chart-decoder took up almost twice as much time compared to the pb decoder ranging from 5 to 12hrs per run-through - step 2 and 3 took up the most time (grow-diag-final-and) - during the alignment GIZA stopped from time to time (probably due to the IO waits you mentioned) - moses git rev cb5213a, GIZA++, IRSTLM 5.70.04, Ubuntu 10.4 As Tom already mentioned, tests on desktops run much smoother. Hope this might help, too. -Daniel -----Ursprüngliche Nachricht----- Von: [email protected] [mailto:[email protected]] Im Auftrag von Tom Hoar Gesendet: Mittwoch, 22. Februar 2012 15:48 An: Hieu Hoang Cc: moses-support Betreff: Re: [Moses-support] MT training on a laptop I don't like to admit it, but I run some tests on a Samsung netbook with a dual-core Atom 1.6 Ghz, 2 GB Ram and 300 GB 5400 rpm hard disk. typically only use a small ~40K pair test corpus. Only use MGIZA++ and snt2cooc slows to slower-than a crawl on one core. Have several desktops we draft into action sometimes. 4 GB w/ 3 Ghz Pentium Dual-cores. They run much smoother and faster than on the 2 GB netbook. We're running SVN rev 4153 from mid-August last year on Ubuntu 10.04. Plan to update our binaries to the GITHUB version 2-3 months after the Ubuntu 12.04 LTS is launched in the spring. Hope this helps. Tom On Wed, 22 Feb 2012 12:54:36 +0000, Hieu Hoang <[email protected]> wrote: > hi all > > does anyone have experience running the training pipeline on a laptop? > It seem very slow to me, especially some parts of the GIZA++ alignment > (and possibly later stages too). Seems to be crawling due to IO waits > on a GIZA process called snt2cooc.out. This doesn't happens when > running on larger servers. Has anyone else encounter this problem? > > I'm using a MacBook 2.4Ghz dual core, OSX 10.7.3, 240GB disk (5400 > spin), 4GB ram. > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
