hi there, while using my IRSTLM there is a problem saying Set IRSTLM environment variable with path to irstlm but after that I do uname -m which results i686 and uname -s which results Linux and finally ln -s i686-redhat-linux-gnu i686
but the problem still there, what am I do ? Thanks for your reply Best Regards. On Mon, Apr 9, 2012 at 7:15 PM, <[email protected]> wrote: > Send Moses-support mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://mailman.mit.edu/mailman/listinfo/moses-support > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Moses-support digest..." > > > Today's Topics: > > 1. IRSTLM build-lm.sh changes for parallel build (Tom Hoar) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 09 Apr 2012 20:58:51 +0700 > From: Tom Hoar <[email protected]> > Subject: [Moses-support] IRSTLM build-lm.sh changes for parallel build > To: Moses support <[email protected]> > Message-ID: > <[email protected]> > Content-Type: text/plain; charset="utf-8" > > > > I sent this to the irstlm list, but also include it here in case this > team has some comments. > > Hieu recently checked in changes to the > build-lm.sh script to run the splits in parallel. About 6 months ago, we > replaced IRSTLM's shell script with a Python wrapper to give us more > control in our environment. We also prepared to multi-process the > splits. We stopped work because of concerns that parallel processing > might overloading system RAM resources. > > As we know, building LM's is > memory intensive. Without the parallel processing, each serialized split > can use 100% of the host's RAM, but the extra CPU cores sit idle. > Parallel processing uses all CPU's, but each CPU competes for RAM > resources. > > * Is the final result of a build identical if you build > with one chunk or 3 splits or 30 splits? > * Are there any > advantages/disadvantages to use a large number of splits with a queue > manager so-as to only parallel process up to the max number of CPU's and > reduce the RAM requirements with more but smaller splits? > * Has anyone > experimented with other ways to reduce the RAM requirement for each > process while still allowing them to run in parallel? > > Tom > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mailman.mit.edu/mailman/private/moses-support/attachments/20120409/5f77d651/attachment-0001.htm > > ------------------------------ > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > End of Moses-support Digest, Vol 66, Issue 14 > ********************************************* >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
