Barry,
The long sentences were odd to me, too. Nonetheless, would the search space account for his observation, "Moses binary or Mosesserver running in serial mode dont have these issues"? I took "serial mode" to mean mosesserver with -threads 0 or simply using moses binary, and using the long sentence. Nikhil, can you confirm? On 2012-10-27 13:27, Barry Haddow wrote: > Hi Nikhil > > Using such long sentences will increase the search space, which could lead to Moses running out of memory. Is it possible to split the sentences into smaller chunks? > > Cheers - Barry > > Sent from my ZX81 > > ----- Reply message ----- > From: "Nikhil Bojja" > Date: Fri, Oct 26, 2012 20:25 > Subject: [Moses-support] Multi-threaded mosesserver crashes with large inputs > To: > > Hi all, > > I have a multi-threaded Mosesserver running which seems to crash when it > gets input sentences of size > 430 words. (~2000-2300 chars). Point 3 in > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc26 [1] does seem to > indicate this behavior and I'm assuming verbosity equals long inputs. Also > this seems to be tied to number of words in input than anything else. > > Also, this seems to happen with both KenLM, and IRSTLM (LM's trained with > IRSTLM and run with KenLM ie). Heard from a friend that it happens with > SRILM as well. Moses binary or Mosesserver running in serial mode dont have > these issues though. xmlrpc doesn't seem to be the culprit either, as > serial mode works fine. Wondering if this was fixed in any of the recent > builds or if anyone has insights on how this could be fixed. > > Thank you, > Nikhil Links: ------ [1] http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc26
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
