as the error says, this is likely because you did not set the
environment variable
LC_ALL=C
when you ran the 'sort' command.
It may also be that your data is not encoded in utf8.
On 06/11/17 19:35, safae berrichi wrote:
Hi all ,
I send you this message to ask you for a help concerning a problem in
the step of binarization of phrase-table in Moses machine translation.
Indeed before the test step it is necessary to binarised phrase-table
and lexicalized reordering model to make mosesdecoder star quickly,
and it is made by the following command: *" ~ / mosesdecoder / bin /
processPhraseTableMin \ - in train / model / phrase-table Gz - nscores
4 \-out binarised-model / phrase-table",* but unfortunately an error
occurred during the execution of this command:
Pass 1/3: Creating hash function for rank assignment
terminate called after throwing an instance of 'util::Exception'
what(): moses/TranslationModel/CompactPT/BlockHashIndex.cpp:375 in
void Moses::BlockHashIndex::CalcHash(size_t, void*) threw util::Exception.
ERROR: Input file does not appear to be sorted with LC_ALL=C sort
Can you please tell me what could be wrong here?
--
=========================================
*Safae BERRICHI*
*
PhD Candidate in *
Computer Science
**
Laboratory
*
**
Department of Mathematics and Computer Science
Faculty of Science, *
Mohammed First
**
University
*
**
Oujda, Morocco.
T*
el: (+212)*6 50 36 08 79
*
*
*
=========================================
<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Garanti sans virus. www.avg.com
<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
http://moses-smt.org/
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support