On Tue, Oct 25, 2011 at 05:58:20PM -0700, Steve Lewis wrote: > While I can see file sizes with the web interface, it is very difficult to > tell which directories are taking up space especially > when nested by several levels
Here's a oneliner we use on occasion:
$ find store/user/ -mindepth 1 -maxdepth 1 -type d | sed -re 's/^/\//' |\
xargs hadoop fs -dus | sort -rnk2 | head
`hadoop -dus` will calculate the directory size recursively (similar to `du
-s`).
--
Will Maier - UW High Energy Physics
cel: 608.438.6162
tel: 608.263.9692
web: http://www.hep.wisc.edu/~wcmaier/
smime.p7s
Description: S/MIME cryptographic signature
