A pedantic point: they can be arranged any way you like but must be
accessed in multiples of 32 bits. The KenLM trie data structure does
not follow this alignment. However, NICT added code to KenLM for ARM
that accesses the data in an aligned way by rounding up/down and doing
multiple accesses.
Kenneth
On 11/27/12 11:33, Hieu Hoang wrote:
> 2. To save memory and have quick loading time, the language model and
> phrase-table has to be binarized. The binary phrase-table isn't a
> problem. However, ARM chips require that datastructures be in multiple
> of 32-bits ('aligned'). This isn't the case with some datastructure in
> the irstlm (maybe also kenlm).
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support