Hi all,
In my project I need language model to calculate the probability of each
sentence, I have to use kenlm https://kheafield.com/code/kenlm/ but for
some sentences give me wrong probability when the sentences have words not
analysis like this:
Курчатов – Шар темір жолы салынды, ал оның жалғасы (ұзындығы 150 км) 2007 ж.
#Kurçatov – *Шар demir yolu yapıldı, o #devam (uzunluku 150 km) 2007 #yıl
||| 0
#Kurçatov – *Шар demir yolu yapıldı, o onun devamı (uzunluku 150 km) 2007
#yıl ||| -0.880188
is anyone used it before and can tell me how to deal with this problem or
is there any other toolkit can you point me to use it ?
best regards,
Sevilay
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Apertium-stuff mailing list
Apertium-stuff@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/apertium-stuff
