Hi Tao, Then this will deal more with the network specifications. Since your nodes are not within the same local network, the conf/slaves file and /etc/hosts file should be tailored to reflect the actual IP of your nodes. Besides, the inter-sub-network communication should be properly configured (I guess maybe you can try talk with your network administrator?)
Xin On Mon, Sep 13, 2010 at 11:58 AM, Tao You <[email protected]> wrote: > Hi Feng, > active nodes are 20 in our evironment(5 in each datacenter), and > hadoop is actually running. when we did wordcount example, mapers and > reducers can not communicate to each other using external ip(dns) in > ec2. > they alwasy tried to communicate by internal ips. internal ips can be > used to do interactions in the same datacenters, but internal ips > cannot be used to do interactions between two nodes of different > datacenters. so, the following error occured. > "INFO mapred.JobClient: Task Id : > attempt_201009121539_0002_m_000003_1, Status : FAILED > Too many fetch-failures > WARN mapred.JobClient: Error reading task > outputip-10-48-98-34.eu-west-1.compute.internal" > Thanks, > Tao You >
