Re: [gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-02-03 Thread Frank Steinmetzger
On Tue, Feb 02, 2016 at 07:03:07PM -0600, Dale wrote:

> >> I want to determine the size of the contents of all directories of a
> >> tree of directories on a hexacore AMD64 machine with 4GB RAM an one
> >> harddisk (containing that tree) -- most efficiently (least time
> >> consuming).
> > A bit late to the game, but here is my way for this.
> > For a one-off thing, I use the already-mentioned excellent ncdu, which
> > provides vi-style navigation and even offers interactive deletion.
> >
> > du is a viable option for quick use on smaller lists. But when it comes down
> > to actual comparable lists to be stored and archived, I like to use tree. In
> > particular, I use it to store lists of content of my external harddisks, so
> > I can find out what I stored where without having to turn the disks on,
> > including used disk space.
> > [...]

> Have you seen this tool?
>
> sys-fs/treesize
>
> It seems to be a tool more along the lines of what you are doing.  I

Well I have filelight and kdirstat for that, but those are all graphical.
What I use tree for is to archive the stats of a directory (and all of its
files) into a file for when I want to look at it withouth actually having to
plug in the drive. And if I can do that within my beloved Vim, all the
better. :)

-- 
Gruß | Greetings | Qapla’
Please do not share anything from, with or about me on any social network.

Next time travel seminar: two weeks ago.


signature.asc
Description: Digital signature


Re: [gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-02-02 Thread Dale
Frank Steinmetzger wrote:
> On Wed, Jan 27, 2016 at 05:25:37PM +0100, meino.cra...@gmx.de wrote:
>> Hi,
>>
>> I want to determine the size of the contents of all directories of a
>> tree of directories on a hexacore AMD64 machine with 4GB RAM an one
>> harddisk (containing that tree) -- most efficiently (least time
>> consuming).
> A bit late to the game, but here is my way for this.
> For a one-off thing, I use the already-mentioned excellent ncdu, which
> provides vi-style navigation and even offers interactive deletion.
>
> du is a viable option for quick use on smaller lists. But when it comes down
> to actual comparable lists to be stored and archived, I like to use tree. In
> particular, I use it to store lists of content of my external harddisks, so
> I can find out what I stored where without having to turn the disks on,
> including used disk space.
>
> For that purpose, I use two different outputs. One paints the tree as such
> using ascii art, showing the size next to the indented name:
> tree -ax -n --du -h --dirsfirst
>
> The other one is a tabular format that is easier to look at in long lists,
> because it aligns size and date and prints the whole path, which also makes
> it easier to diff:
> tree -afx -DFins --dirsfirst --du --timefmt "%F %T"
>
> Tata


Have you seen this tool?

sys-fs/treesize 

It seems to be a tool more along the lines of what you are doing.  I
just noticed it in portage myself and thought it may be something that
would interest you.  I might add, there are other tree variations on
this too.  You may find eix tree interesting to look at. 

Dale

:-)  :-) 



Re: [gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-02-02 Thread Frank Steinmetzger
On Wed, Jan 27, 2016 at 05:25:37PM +0100, meino.cra...@gmx.de wrote:
> Hi,
>
> I want to determine the size of the contents of all directories of a
> tree of directories on a hexacore AMD64 machine with 4GB RAM an one
> harddisk (containing that tree) -- most efficiently (least time
> consuming).

A bit late to the game, but here is my way for this.
For a one-off thing, I use the already-mentioned excellent ncdu, which
provides vi-style navigation and even offers interactive deletion.

du is a viable option for quick use on smaller lists. But when it comes down
to actual comparable lists to be stored and archived, I like to use tree. In
particular, I use it to store lists of content of my external harddisks, so
I can find out what I stored where without having to turn the disks on,
including used disk space.

For that purpose, I use two different outputs. One paints the tree as such
using ascii art, showing the size next to the indented name:
tree -ax -n --du -h --dirsfirst

The other one is a tabular format that is easier to look at in long lists,
because it aligns size and date and prints the whole path, which also makes
it easier to diff:
tree -afx -DFins --dirsfirst --du --timefmt "%F %T"

Tata
-- 
Gruß | Greetings | Qapla’
Please do not share anything from, with or about me on any social network.

I had a problem and used Java. Now I have a ProblemFactory.


signature.asc
Description: Digital signature


Re: [gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-01-27 Thread Dutch Ingraham
On Wed, Jan 27, 2016 at 04:28:43PM -0400, David M. Fellows wrote:
> On Wed, 27 Jan 2016 17:25:37 +0100 
> meino.cra...@gmx.de wrote -
> > Hi,
> > 
> > I want to determine the size of the contents of all directories of a
> > tree of directories on a hexacore AMD64 machine with 4GB RAM an one
> > harddisk (containing that tree) -- most efficiently (least time
> > consuming).
> > 
> > I tried this (cwd = root of that tree):
> > 
> > find . -depth -type d -print0 | xargs -0 -P 6 du -bsx {} \;
> > 
> > . Is there any to do this faster?
> > 
> > Thank you very much in advance for any help!
> > Best regards,
> > Meino
> 
>man du
> 
> Dave F


Here's a couple of nice ones:

< du -sh /* | sort -rh >

< du -axk / | awk '$1 > 2^20 {print}' | sort -rn | head -20 >

You could also check out the application ncdu for a curses-based
du command analyzer.



Re: [gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-01-27 Thread Daniel Frey
On 01/27/2016 08:25 AM, meino.cra...@gmx.de wrote:
> Hi,
> 
> I want to determine the size of the contents of all directories of a
> tree of directories on a hexacore AMD64 machine with 4GB RAM an one
> harddisk (containing that tree) -- most efficiently (least time
> consuming).
> 
> I tried this (cwd = root of that tree):
> 
> find . -depth -type d -print0 | xargs -0 -P 6 du -bsx {} \;
> 
> . Is there any to do this faster?
> 
> Thank you very much in advance for any help!
> Best regards,
> Meino
> 
> 
> 
> 
> 

Did you try `du -cxb .` ?

Dan 



Re: [gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-01-27 Thread David M. Fellows
On Wed, 27 Jan 2016 17:25:37 +0100 
meino.cra...@gmx.de wrote -
> Hi,
> 
> I want to determine the size of the contents of all directories of a
> tree of directories on a hexacore AMD64 machine with 4GB RAM an one
> harddisk (containing that tree) -- most efficiently (least time
> consuming).
> 
> I tried this (cwd = root of that tree):
> 
> find . -depth -type d -print0 | xargs -0 -P 6 du -bsx {} \;
> 
> . Is there any to do this faster?
> 
> Thank you very much in advance for any help!
> Best regards,
> Meino

   man du

Dave F



[gentoo-user] Record sizes of directories of a directory tree (huge) most efficiently

2016-01-27 Thread Meino . Cramer
Hi,

I want to determine the size of the contents of all directories of a
tree of directories on a hexacore AMD64 machine with 4GB RAM an one
harddisk (containing that tree) -- most efficiently (least time
consuming).

I tried this (cwd = root of that tree):

find . -depth -type d -print0 | xargs -0 -P 6 du -bsx {} \;

. Is there any to do this faster?

Thank you very much in advance for any help!
Best regards,
Meino