Thanks Hieu. Ken, did you hear that? Hieu's calling you a "funky"
guy!
Tom
On Fri, 18 Nov 2011 09:25:22 +0700, Hieu Hoang wrote:
Hi Tom
You don't need to rebinarise the phrase and reordering table
when switching between 32/64 bit machines. If you see any different,
please let me know
It only required with KenLM ('til now) because this
has some funky optimisation which is memory/gcc-version dependent
On 18
November 2011 07:21, Tom Hoar wrote:
Thank you Ken, this is great
news because DoMY compiles for the
32/64-bit platform during
installation, and users aren't aware of the
differences. Now, if they
upgrade from a test 32-bit platform, they can
reuse the LM's on the new
64-bit.
As a point of reference, is it necessary to re-compile the
binarized
phrase and reordering tables between 32/64-bit platforms?
It's been a
while since I encountered this and simply don't remember.
Tom
On Thu, 17 Nov 2011 19:25:01 +0000, Kenneth Heafield
wrote:
>
Hi,
>
> A number of people have complained that kenlm binary files
were
> not
> portable across 32-bit and 64-bit or across ancient gcc
(RedHat stale
> linux) to modern gcc. 974a708 fixes this.
>
> If you
run 64-bit with modern gcc (as most of you do), your
> current
>
binary files will continue to work and will now be portable.
>
Otherwise,
> it will throw an exception if you try to load an old
file.
>
> The easiest way to determine if your binary file needs to
>
rebuilt
> is to run
>
> lm/query binary_file
>
> If it returns
success then there is no need to rebuild.
>
> Binary files are not
portable across endianness and never will be.
> In
> general,
portability across architecture pairs other than x86 and
> x86_64
> is
not guaranteed.
>
> Kenneth
>
_______________________________________________
> Moses-support mailing
list
> [email protected] [3]
>
http://mailman.mit.edu/mailman/listinfo/moses-support [4]
_______________________________________________
Moses-support mailing
list
[email protected]
[5]
http://mailman.mit.edu/mailman/listinfo/moses-support
[6]
Links:
------
[1] mailto:[email protected]
[2]
mailto:[email protected]
[3] mailto:[email protected]
[4]
http://mailman.mit.edu/mailman/listinfo/moses-support
[5]
mailto:[email protected]
[6]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
