[
https://issues.apache.org/jira/browse/HADOOP-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758896#action_12758896
]
Koji Noguchi commented on HADOOP-6284:
--------------------------------------
Reproducing this error, it is crashing when trying to create
/tmp/hsperf_knoguchi
[pid 17137] open("/tmp/hsperfdata_knoguchi/17135", O_RDWR|O_CREAT|O_TRUNC,
0600) = 3
[pid 17137] ftruncate(3, 32768) = 0
[pid 17137] mmap2(NULL, 32768, PROT_READ|PROT_WRITE, MAP_SHARED, 3, 0xf7fb817c)
= 0xfffffffff7fec000
[pid 17137] close(3) = 0
[pid 17137] --- SIGBUS (Bus error) @ 0 (0) ---
Since /tmp is a tmpfs, open itself goes through which is confusing the jvm.
It would have been nice if we can set different /tmp, but this is hard coded in
java.
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6447182
It is suggested that
"One workaround would be to disable the temporary mapping of hsperfdata file by
using "-XX:-UsePerfData". "
This can almost be done by setting HADOOP_CLIENT_OPTS but we also have this in
the hadoop script.
{noformat}
JAVA_PLATFORM=`CLASSPATH=${CLASSPATH} ${JAVA} -Xmx32m
org.apache.hadoop.util.PlatformName | sed -e "s/ /_/g"`
{noformat}
which also fails when /tmp is full.
Can we have a way to set options for this command or hardcode
"-XX:-UsePerfData" in the above line?
We have couple of incidents where one user fills up /tmp and failing all the
hadoop commands from that node.
> Any hadoop commands crashing jvm (SIGBUS) when /tmp (tmpfs) is full
> --------------------------------------------------------------------
>
> Key: HADOOP-6284
> URL: https://issues.apache.org/jira/browse/HADOOP-6284
> Project: Hadoop Common
> Issue Type: Improvement
> Components: scripts
> Reporter: Koji Noguchi
> Priority: Minor
>
> {noformat}
> [knoguchi@ ~]$ df /tmp
> Filesystem 1K-blocks Used Available Use% Mounted on
> tmpfs 524288 524288 0 100% /tmp
> [knoguchi@ ~]$ hadoop dfs -ls
> #
> # An unexpected error has been detected by Java Runtime Environment:
> #
> # SIGBUS (0x7) at pc=0x00824077, pid=19185, tid=4160617360
> #
> # Java VM: Java HotSpot(TM) Server VM (10.0-b22 mixed mode linux-x86)
> # Problematic frame:
> # C [libc.so.6+0x6e077] memset+0x37
> #
> # An error report file with more information is saved as:
> # /homes/knoguchi/hs_err_pid19185.log
> #
> # If you would like to submit a bug report, please visit:
> # http://java.sun.com/webapps/bugreport/crash.jsp
> #
> Aborted
> [knoguchi@ ~]$
> {noformat}
> This does not happen when /tmp is not in tmpfs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
