Point 3 you indicate, "increasing the verbosity of moses" refers to running Moses with the -threads option with the -verbose option set at a higher number. The -verbose option controls the Moses log output. This has nothing to do with the number of tokens in the source input.
I've never heard of a max limit on the source input token length. If this only happens with mosesserver and not the moses binary with -xml-input, have you looked at other differences between the two, for example, the network path? Does your network have a buffer length of only 2,000 bytes that would truncate input to mosesserver? On 2012-10-27 02:25, Nikhil Bojja wrote: > Hi all, > I have a multi-threaded Mosesserver running which seems to crash when it gets input sentences of size > 430 words. (~2000-2300 chars). Point 3 in http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc26 [1] does seem to indicate this behavior and I'm assuming verbosity equals long inputs. Also this seems to be tied to number of words in input than anything else. > Also, this seems to happen with both KenLM, and IRSTLM (LM's trained with IRSTLM and run with KenLM ie). Heard from a friend that it happens with SRILM as well. Moses binary or Mosesserver running in serial mode dont have these issues though. xmlrpc doesn't seem to be the culprit either, as serial mode works fine. Wondering if this was fixed in any of the recent builds or if anyone has insights on how this could be fixed. > Thank you, > Nikhil Links: ------ [1] http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc26
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
