Hi all,
We are using hadoop-0.17.2 for some time now. Since yesterday, We have
been seeing jobTracker failing to respond with an OutOfMemory Error very
frequently. Things are going fine after restarting it. But the problem
is occurring after a while. Below is the exception that we are seeing in
jobtracker logs. Can someone please suggest what is going wrong in
this?
2008-11-19 14:17:46,059 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 9001, call
heartbeat([EMAIL PROTECTED], false,
true, 16068)
from 205.188.170.107:51492: error: java.io.IOException:
java.lang.OutOfMemoryError: Java heap space
java.io.IOException: java.lang.OutOfMemoryError: Java heap space
at java.util.regex.Pattern.compile(Pattern.java:1452)
at java.util.regex.Pattern.<init>(Pattern.java:1133)
at java.util.regex.Pattern.compile(Pattern.java:847)
at java.lang.String.replace(String.java:2208)
at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
at org.apache.hadoop.fs.Path.initialize(Path.java:137)
at org.apache.hadoop.fs.Path.<init>(Path.java:126)
at org.apache.hadoop.fs.Path.<init>(Path.java:50)
at
org.apache.hadoop.mapred.Task.getTaskOutputPath(Task.java:214)
at org.apache.hadoop.mapred.Task.setConf(Task.java:517)
at
org.apache.hadoop.mapred.TaskInProgress.getTaskToRun(TaskInProgress.java
:745)
at
org.apache.hadoop.mapred.JobInProgress.obtainNewMapTask(JobInProgress.ja
va:664)
at
org.apache.hadoop.mapred.JobTracker.getNewTaskForTaskTracker(JobTracker.
java:1585)
at
org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:1309)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:446)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
2008-11-19 14:18:11,869 WARN org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 9001, call
heartbeat([EMAIL PROTECTED], false,
true, 16077) f
rom 205.188.170.84:54871: discarded for being too old (133957)
2008-11-19 14:18:11,869 WARN org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 9001, call
heartbeat([EMAIL PROTECTED], false,
true, 16082)
from 205.188.170.90:32934: discarded for being too old (133957)
Thanks
Pallavi
