[
https://issues.apache.org/jira/browse/HADOOP-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701222#action_12701222
]
Koji Noguchi commented on HADOOP-5712:
--------------------------------------
We observed Namenode was spending more time in GC than usual.
No metrics stood out.
Audit showed many rename operations like the following.
{noformat}
2009-04-17 23:00:03,957 INFO org.apache.hadoop.fs.FSNamesystem.audit:
ugi=user1,users,
ip=/99.111.222.111 cmd=rename
src=/user/user1/agg_results/20090417/part-00489
dst=/user/user1/.Trash/Current/part-00489.507
perm=user1:users:rw-r--r--
{noformat}
It turns out that this user had large number of small jobs and was calling
{noformat}
hadoop dfs -rmr $outdir/\*
{noformat}
after each job.
> Namenode slowed down when many files with same filename were moved to Trash
> ---------------------------------------------------------------------------
>
> Key: HADOOP-5712
> URL: https://issues.apache.org/jira/browse/HADOOP-5712
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.3
> Reporter: Koji Noguchi
> Priority: Minor
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
