Dear dongxinghua, I've seen this error too when the corpus is large and contains large repeated sections.
François -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: vendredi 10 décembre 2010 13:03 To: [email protected] Subject: Moses-support Digest, Vol 50, Issue 12 Send Moses-support mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://mailman.mit.edu/mailman/listinfo/moses-support or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of Moses-support digest..." Today's Topics: 1. KneserNey discounts error! (dongxinghua0213) 2. Re: KneserNey discounts error! (Philipp Koehn) 3. Moses server (Mehmet Tatl?c?o?lu) ---------------------------------------------------------------------- Message: 1 Date: Fri, 10 Dec 2010 13:02:15 +0800 (CST) From: dongxinghua0213 <[email protected]> Subject: [Moses-support] KneserNey discounts error! To: moses-support <[email protected]>, "Hieu Hoang" <[email protected]>, "Philipp Koehn" <[email protected]> Message-ID: <[email protected]> Content-Type: text/plain; charset="gbk" Hi. when I build lm using the following command : /home/top/programming/language_model/srilm/bin/i686/ngram-count -order 3 -interpolate -kndiscount -text /media/sdb3/working-dir2/lm/lm -lm /media/sdb3/working-dir2/lm/raw.uy.lm an error occurs: one of modified KneserNey discounts is negative error in discount estimator for order 3 Could somebody help me , thank you in advance ! -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20101210/afffe62b/attachment-0001.htm ------------------------------ Message: 2 Date: Fri, 10 Dec 2010 05:17:33 +0000 From: Philipp Koehn <[email protected]> Subject: Re: [Moses-support] KneserNey discounts error! To: dongxinghua0213 <[email protected]> Cc: moses-support <[email protected]>, Hieu Hoang <[email protected]> Message-ID: <[email protected]> Content-Type: text/plain; charset=GB2312 Hi, this may happen i the corpus is very small, or if you build a model over a corpus with a small vocabulary (e.g. POS tags). Just do not use the -kndiscount switch in that case. -phi 2010/12/10 dongxinghua0213 <[email protected]>: > Hi. > when I build lm using the following command : > /home/top/programming/language_model/srilm/bin/i686/ngram-count -order 3 > -interpolate -kndiscount -text /media/sdb3/working-dir2/lm/lm -lm > /media/sdb3/working-dir2/lm/raw.uy.lm > an error occurs: > one of modified KneserNey discounts is negative > error in discount estimator for order 3 > Could somebody help me , thank you in advance ! > > ________________________________ > ????163/126??????????????iphone ipad???????? ------------------------------ Message: 3 Date: Fri, 10 Dec 2010 14:02:07 +0200 From: Mehmet Tatl?c?o?lu <[email protected]> Subject: [Moses-support] Moses server To: [email protected] Message-ID: <[email protected]> Content-Type: text/plain; charset="utf-8" Hi, I am working on decoding an input received through a port, and I'd like to produce the output and send it to the port. I've followed the instructions on the page http://www.statmt.org/moses/?n=Moses.WebTranslation, and I managed to setup the server. When I run daemon.pl for a specific port, it starts to listen that port appropriately. As it is mentioned on the web page, I can send input strings by the command echo "Hello world" | nc <hostname> <port>. When I send an input by using this command in an other terminal window (still with the same PC), it produces the output, but the output is printed on the daemon.pl's window, not to the window where I sent input. To clarify the situation, here is my daemon.pl window and i/o window: Console where daemon.pl is running: > meh...@mehmet-desktop:~/mosesdecoder/web$ ./bin/daemon.pl localhost 7070 Defined parameters (per moses.ini or switch): config: > /home/mehmet/projeler/tr-en/trunk/trainings/06-12-2010-0028/tuning/moses.ini distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6 > /home/mehmet/projeler/tr-en/trunk/trainings/06-12-2010-0028/model/binary/reordering-table.wbe-msd-bidirectional-fe distortion-limit: 6 input-factors: 0 lmodel-file: 1 0 5 /home/mehmet/projeler/tr-en/trunk/lm/tr/ > tr.qblm.mm mapping: 0 T 0 report-segmentation: ttable-file: 1 0 0 5 > /home/mehmet/projeler/tr-en/trunk/trainings/06-12-2010-0028/model/binary/phrase-table ttable-limit: 20 weight-d: 0.0297437 0.021298 0.0295493 0.0704284 0.0715931 0.107471 > 0.0650318 weight-l: 0.08927 weight-t: 0.0586011 0.0385914 0.0689658 0.0358147 -0.0226796 weight-w: -0.290962 Loading lexical distortion models...have 1 models Creating lexical reordering... weights: 0.021 0.030 0.070 0.072 0.107 0.065 binary file loaded, default OFF_T: -1 Start loading LanguageModel /home/mehmet/projeler/tr-en/trunk/lm/tr/ > tr.qblm.mm : [1.000] seconds In LanguageModelIRST::Load: nGramOrder = 5 Loading LM file (no MAP) Qblmt loadbin() reading 256 centers reading 256 centers reading 256 centers reading 256 centers reading 256 centers mapping 759317 1-grams mapping 13427632 2-grams mapping 5488911 3-grams mapping 4341113 4-grams mapping 3094047 5-grams done OOV code is 759316 IRST: m_unknownId=759316 Finished loading LanguageModels : [4.000] seconds Start loading PhraseTable > /home/mehmet/projeler/tr-en/trunk/trainings/06-12-2010-0028/model/binary/phrase-table > : [4.000] seconds filePath: > /home/mehmet/projeler/tr-en/trunk/trainings/06-12-2010-0028/model/binary/phrase-table Finished loading phrase tables : [4.000] seconds IO from STDOUT/STDIN Created input-output object : [4.000] seconds Translating: hello world > reading bin ttable size of OFF_T 8 binary phrasefile loaded, default OFF_T: -1 Collecting options took 0.520 seconds Search took 0.520 seconds BEST TRANSLATION: merhaba d?nya [11] [total=-2.355] <<0.000, -2.000, 0.000, > -1.545, 0.000, 0.000, -0.368, 0.000, 0.000, -27.502, -1.892, -2.774, -0.843, > -2.831, 2.000>> reset caches Translation took 0.690 seconds Finished translating The I/O window: > meh...@mehmet-desktop:~$ echo "hello world" | nc localhost 7070 meh...@mehmet-desktop:~$ So, the output is produced, but still, I cannot get the produced output where I sent the input. How can I make it send output to where it came from? On the other hand, how can I allow the users sharing the same network to send input and receive translations through the port 7070, given that I have an IP address of 10.0.0.1 in this network? -- Mehmet Tatl?c?o?lu Cell Phone: +90 532 201 85 64 -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20101210/a64fe68f/attachment.htm ------------------------------ _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support End of Moses-support Digest, Vol 50, Issue 12 ********************************************* _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
