RE: mapred.child.java.opts

! -Original Message- From: Sebastian Nagel [mailto:wastl.na...@googlemail.com.INVALID] Sent: 10 December 2018 10:37 To: user@nutch.apache.org Subject: Re: mapred.child.java.opts Hi, > The 1000MB is static value, will the crawl bash script respect NUTCH_HEAPSIZE? Yes, in local mode it will resp

Re: mapred.child.java.opts

astian Nagel [mailto:wastl.na...@googlemail.com.INVALID] > Sent: 07 December 2018 15:44 > To: user@nutch.apache.org > Subject: Re: mapred.child.java.opts > > Hi, > > yes, of course, the comments just one line above even encourages you to do so: > > # note that some of the options l

Re: mapred.child.java.opts

t; 1000MB is statically set for java - > mapred.child.java.opts=-Xmx1000m > > Any idea why?, Can I change it?, What will be the impact? > Kind regards, > Hany Shehata > Enterprise Engineer > Green Six Sigma Certified > Solutions Architect, Marketing and Communications IT &g

RE: mapred.child.java.opts

15:44 To: user@nutch.apache.org Subject: Re: mapred.child.java.opts Hi, yes, of course, the comments just one line above even encourages you to do so: # note that some of the options listed here could be set in the # corresponding hadoop site xml param file For most use cases this value is ok. On

Re: mapred.child.java.opts

aik, the properties mapreduce.map.java.opts resp. mapreduce.reduce.java.opts will override mapred.child.java.opts on Hadoop 2.x, so on a recent configured Hadoop cluster there is usually zero impact. There is also a Jira issue open to make the heap memory configurable in distributed mode, s

mapred.child.java.opts

Hello, While checking the Nutch (1.15) crawl bash file, I noticed at line 211 that 1000MB is statically set for java - > mapred.child.java.opts=-Xmx1000m Any idea why?, Can I change it?, What will be the impact? Kind regards, Hany Shehata Enterprise Engineer Green Six Sigma Certified Soluti