I have the dfs.replication value set to 2 in my hadoop-site.xml
Note that in hadoop-defaults.xml the value is 3, so it doesn't explain the 10 requested that I see in the logs.
again, this only happens on the generate task.

The generate eventually finishes ~30 to 40 minutes to select out 5000 URL's since it's competing with the loop that generates these messages.

I noticed that the hadoop.log  rolled this morning and the logging of
fs.FSNamesystem - Could not find any nodes with sufficient capacity

seems to have stopped.

Jason

On Feb 2, 2007, at 5:49 AM, djames wrote:


Hello

I'm not sure, but there is a parameter in hadoop-site.xml conf file that
could be a solution to your probleme:


<property>
  <name>dfs.replication</name>
  <value>2</value>
</property>


Reply via email to