as the error says, this is likely because you did not set the environment variable

   LC_ALL=C

when you ran the 'sort' command.

It may also be that your data is not encoded in utf8.


On 06/11/17 19:35, safae berrichi wrote:

Hi all ,

I send you this message to ask you for a help concerning a problem in the step of binarization of phrase-table in Moses machine translation.

Indeed before the test step it is necessary to binarised phrase-table and lexicalized reordering model to make mosesdecoder star quickly, and it is made by the following command: *" ~ / mosesdecoder / bin / processPhraseTableMin \ - in train / model / phrase-table Gz - nscores 4 \-out binarised-model / phrase-table",* but unfortunately an error occurred during the execution of this command:

Pass 1/3: Creating hash function for rank assignment
terminate called after throwing an instance of 'util::Exception'  what():  moses/TranslationModel/CompactPT/BlockHashIndex.cpp:375 in void Moses::BlockHashIndex::CalcHash(size_t, void*) threw util::Exception.
ERROR: Input file does not appear to be sorted with LC_ALL=C sort

Can you please tell me what could be wrong here?

--

=========================================
*Safae BERRICHI*
*
PhD Candidate in *
Computer Science
**
Laboratory
*
**
Department of Mathematics and Computer Science
Faculty of Science, *
Mohammed First
**
University
*
**
Oujda, Morocco.
T*
el: (+212)*6 50 36 08 79
*
*
*
=========================================

<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> Garanti sans virus. www.avg.com <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>



_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
http://moses-smt.org/

_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to