It says in the logs org.apache.hadoop.mapred.ReduceTask: java.net.ConnectException: Connection refused
You have a network problem. Do you have firewall enabled. Raj and please do not spam the list with the same message. >________________________________ > From: hadoop hive <[email protected]> >To: [email protected]; [email protected] >Sent: Friday, February 3, 2012 6:02 AM >Subject: Problem in reduce phase(critical) > >On Fri, Feb 3, 2012 at 4:56 PM, hadoop hive <[email protected]> wrote: > >> hey folks, >> >> i m getting this error while running mapreduce and these comes up in >> reduce phase.. >> >> >> 2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0 copy failed: >> attempt_201201271626_5282_m_000007_2 from hadoopdata3 >> 2012-02-03 16:41:19,954 WARN org.apache.hadoop.mapred.ReduceTask: >> java.net.ConnectException: Connection refused >> at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:513) >> at >> sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1345) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1339) >> at >> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:993) >> at >> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1447) >> at >> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1349) >> at >> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1261) >> at >> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1195) >> Caused by: java.net.ConnectException: Connection refused >> at java.net.PlainSocketImpl.socketConnect(Native Method) >> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) >> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) >> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) >> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) >> at java.net.Socket.connect(Socket.java:519) >> at sun.net.NetworkClient.doConnect(NetworkClient.java:158) >> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394) >> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529) >> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233) >> at sun.net.www.http.HttpClient.New(HttpClient.java:306) >> at sun.net.www.http.HttpClient.New(HttpClient.java:323) >> at >> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:837) >> at >> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:778) >> at >> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:703) >> at >> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1026) >> ... 4 more >> >> 2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: Task >> attempt_201201271626_5282_r_000000_0: Failed fetch #4 from >> attempt_201201271626_5282_m_000007_2 >> 2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: Failed to >> fetch map-output from attempt_201201271626_5282_m_000007_2 even after >> MAX_FETCH_RETRIES_PER_MAP retries... reporting to the JobTracker >> 2012-02-03 16:41:19,995 WARN org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0 adding host hadoopdata3 to penalty box, >> next contact in 150 seconds >> 2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0: Got 1 map-outputs from previous >> failures >> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0 Need another 1 map output(s) where 0 is >> already in progress >> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0 Scheduled 0 outputs (1 slow hosts and0 >> dup hosts) >> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: >> Penalized(slow) Hosts: >> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: >> hadoopdata3 Will be considered after: 99 seconds. >> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0 Need another 1 map output(s) where 0 is >> already in progress >> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: >> attempt_201201271626_5282_r_000000_0 Scheduled 0 outputs (1 slow hosts and0 >> dup hosts) >> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: >> Penalized(slow) Hosts: >> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: >> hadoopdata3 Will be considered after: 39 seconds. >> >> > > >
