Re: [BackupPC-users] considerations on i-nodes

2018-04-18 Thread frush
Torsten-
Nice writeup of a way to help manage the backupPC file system.   
On Wed, 2018-04-18 at 13:25 +0200, f...@igh.de wrote:
> Dear List, 
> 
> running BackupPC v4 I sometimes ran out of i-nodes...
> 
-- 
Ray Frush "Either you are part of the solution
T:970.491.5527 or part of the precipitate."
-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-*-
Colorado State University | IS | System Administrator--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] considerations on i-nodes

2018-04-18 Thread fi
Dear List, 

running BackupPC v4 I sometimes ran out of i-nodes. 

I have about twelve servers to backup with a total amount of about 2
TB and aboz 20 million files. I keep about 50 backups.  

On an ext4 file system it is likely to run out of i-nodes rather than
to run out of disk space (this holds if the file system was created
using the default parameters). In my situation I have only used half
the space but almost all i-nodes available. 

Because I prefer ext4 for it's robustness and reliability I have to
consider i-nodes. 

We have the pool (or cpool) storing the actual files. And we have the
pc directory storing the structure. The most files in pc are small or
even empty, but they are many (in my case ten times more than the
actual files in pool). They waste an enourmous amount of disk
space. 

So I created a separate (logical) partition of only 200 GB in size and
formatted with 1024 bytes per inode and per block (mkfs.ext4 -b 1024
-i 1024 ...). I later use it for pc.

Then I simply copied the pc entries (note: only the entries, not the
complete directory) to the new partition using cp -a. This took about
50 hours but worked correctly (this also shows, that BackupPC v4 can be
replicated). Afterwards I removed the entries from the original pc
directory and mounted the new partition there. 

I started BackupPC once again and it works like a charm. 

In this constellation remarkable space for the future backup space was
released. If I ever would run out of space or i-nodes again I will
simply increase either of the partitions.

As a suggestion I would recommend an information about i-nodes
consumption in the server status page. 


Finally I am looking for a formula that could be used to estimate the
required disk space and i-nodes depending on the number  and size of
files and the number of backups kept. 


Best regards


Torsten



-- 

Torsten Finke
f...@igh.de
 
Ingenieurgemeinschaft IgH
Gesellschaft für Ingenieurleistungen mbH
Heinz-Bäcker-Str. 34
D-45356 Essen



--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/