Hi Nikhil Using such long sentences will increase the search space, which could lead to Moses running out of memory. Is it possible to split the sentences into smaller chunks?
Cheers - Barry Sent from my ZX81 ----- Reply message ----- From: "Nikhil Bojja" <[email protected]> Date: Fri, Oct 26, 2012 20:25 Subject: [Moses-support] Multi-threaded mosesserver crashes with large inputs To: <[email protected]> Hi all, I have a multi-threaded Mosesserver running which seems to crash when it gets input sentences of size > 430 words. (~2000-2300 chars). Point 3 in http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc26 does seem to indicate this behavior and I'm assuming verbosity equals long inputs. Also this seems to be tied to number of words in input than anything else. Also, this seems to happen with both KenLM, and IRSTLM (LM's trained with IRSTLM and run with KenLM ie). Heard from a friend that it happens with SRILM as well. Moses binary or Mosesserver running in serial mode dont have these issues though. xmlrpc doesn't seem to be the culprit either, as serial mode works fine. Wondering if this was fixed in any of the recent builds or if anyone has insights on how this could be fixed. Thank you, Nikhil
The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
