I'm afraid so. out of interest, what are your reasons for using RandLM? Do you have lots of monolingual data that won't fit into a normal LM? Can you give an estimate of how many GB/TB? Are you using RandLM as a secondary model to a normal LM, or on it own?
On 18/07/2013 16:34, Gebruers Rudi wrote: > Thanks for the feedback, folks! I take it, then, that is not possible to use > on a 64-bit platform an old RandLM model that was built on a 32-bit platform. > The RandLM has to be rebuilt on the 64-bit platform first. > > I'll keep you posted about my findings. > > Best regards, > Rudi > > From: [email protected] [mailto:[email protected]] On Behalf Of Hieu Hoang > Sent: 18 July 2013 17:25 > To: Gebruers Rudi > Cc: [email protected] > Subject: Re: [Moses-support] moses + randlm problem > > some feedback from the only person still working on it: **NO** > On 18 July 2013 13:25, Hieu Hoang <[email protected]> wrote: > You should try to build the RandLM on the same machine as the one you're > running it on. > > RandLM hasn't been tested extensively with 32-64-bit combinations, and the > main developers are long gone. > > Please report back what you find. > On 16 July 2013 12:20, Gebruers Rudi <[email protected]> wrote: > Hi folks, > > I installed SRILM 1.6.0, RandLM 0.2.5, and then compiled a moses decoder (git > version June 28) with both RandLM and SRILM on a 64-bit (openSUSE 12.3) > platform (“build.log” in attachment). > > When requested to use KenLM, this moses decoder correctly loads > “europarl.srilm.gz” (from the “sample-models” bundle) and translates “das ist > ein kleines haus” into “this is a small house”. So far, so good. > > However, when I try to use the same decoder with a RandLM model that was > generated on a 32-bit platform, I run into problems as moses simply refuses > to load the RandLM model and dies: > > Defined parameters (per moses.ini or switch): > config: x-fr.ini > distortion-limit: 6 > input-factors: 0 > lmodel-file: 5 0 5 /home/rgeb/smt/models/lm/x-fr.BloomMap > mapping: T 0 > ttable-file: 1 0 0 5 /home/rgeb/smt/models/pt/x-fr > ttable-limit: 20 > … > Aborted > > On the other hand, the very same “x-fr.BloomMap” is loaded correctly and used > without any problem by another moses decoder which I built on a 32-bit > (Cygwin) platform some time ago. > > Has anyone got a clue about what is going wrong here? Didn’t RandLM compile > correctly (into the new moses decoder)? Am I using obsolete RandLM settings > in my “moses.ini”? Should I somehow manipulate the RandLM model that was > built on a 32-bit platform before I can use it on a 64-bit platform? … > > Any help would be highly appreciated. > > Regards, > Rudi > > ----- > Translation engineer - ITP nv > R.Gebruers @ itp-europe.com > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
