Re: Best filesystem options for large drive

2015-02-13 Thread Boris Goldberg
Hello Nick, Thursday, February 12, 2015, 9:26:01 AM, you wrote: NH On 02/12/15 10:10, Boris Goldberg wrote: Hello Nick, NH ... I was entertaining the idea of making a 100 TB OpenBSD based archive storage, even asked the list. The only answer pointed to that FAQ page, and it stopped me from

Re: Best filesystem options for large drive

2015-02-12 Thread Boris Goldberg
Hello Nick, Wednesday, February 11, 2015, 1:05:20 PM, you wrote: NH On 02/11/15 11:58, Jan Stary wrote: On Feb 10 17:48:22, na...@mips.inka.de wrote: On 2015-02-10, yary not@gmail.com wrote: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine

Re: Best filesystem options for large drive

2015-02-12 Thread Nick Holland
On 02/12/15 10:10, Boris Goldberg wrote: Hello Nick, ... I was entertaining the idea of making a 100 TB OpenBSD based archive storage, even asked the list. The only answer pointed to that FAQ page, and it stopped me from pursuing that idea. Servers with 128 GB of RAM aren't uncommon, but

Re: Best filesystem options for large drive

2015-02-11 Thread Jan Stary
On Feb 10 17:48:22, na...@mips.inka.de wrote: On 2015-02-10, yary not@gmail.com wrote: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine will have 1.5GB RAM, from what I've read that's not enough memory to fsck a 4TB volume without

Re: Best filesystem options for large drive

2015-02-11 Thread yary
Thanks all for the tuning flags the example. I'll take a look at the man pages and file set. Doesn't look like the 4TB FFS2 will be a problem on this machine after all.

Re: Best filesystem options for large drive

2015-02-11 Thread Nick Holland
On 02/11/15 11:58, Jan Stary wrote: On Feb 10 17:48:22, na...@mips.inka.de wrote: On 2015-02-10, yary not@gmail.com wrote: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine will have 1.5GB RAM, from what I've read that's not enough memory to

Re: Best filesystem options for large drive

2015-02-11 Thread andrew fabbro
On Wed, Feb 11, 2015 at 6:43 AM, Janne Johansson icepic...@gmail.com wrote: You can invent how many journals and whatevers you like to hope to prevent the state from being inconsistent, but broken or breaking sectors will sooner or later force you to run over all files and read/check them, and

Re: Best filesystem options for large drive

2015-02-11 Thread Janne Johansson
2015-02-10 17:44 GMT+01:00 yary not@gmail.com: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine will have 1.5GB RAM, from what I've read that's not enough memory to fsck a 4TB volume without painful swapping. Is there some

Re: Best filesystem options for large drive

2015-02-11 Thread Otto Moerbeek
On Tue, Feb 10, 2015 at 11:35:32PM +0100, Jan Stary wrote: On Feb 10 17:48:22, na...@mips.inka.de wrote: On 2015-02-10, yary not@gmail.com wrote: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine will have 1.5GB RAM, from what I've

Re: Best filesystem options for large drive

2015-02-10 Thread Kenneth Gober
here's an example for fsck on a largish volume with a lot of files: # df -hi /nfs/archive Filesystem SizeUsed Avail Capacity iused ifree %iused Mounted on /dev/sd0e 3.6T2.3T1.2T67% 3900811 119021683 3% /nfs/archive # umount /nfs/archive # \time -l fsck -f

Re: Best filesystem options for large drive

2015-02-10 Thread Christian Weisgerber
On 2015-02-10, yary not@gmail.com wrote: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine will have 1.5GB RAM, from what I've read that's not enough memory to fsck a 4TB volume without painful swapping. It vastly depends on the number of

Best filesystem options for large drive

2015-02-10 Thread yary
I'm setting up an openBSD 5.6 box with a 4TB raid to back up a video editing cluster. I'll be using BackupPC which likes to have a single large volume so it can de-duplicate files using hard links. Thus the main volume will be all the 4TB. I know FFS2 can handle that size easily, but I'm worried

Re: Best filesystem options for large drive

2015-02-10 Thread Jan Stary
On Feb 10 17:48:22, na...@mips.inka.de wrote: On 2015-02-10, yary not@gmail.com wrote: I know FFS2 can handle that size easily, but I'm worried about fsck taking forever. This machine will have 1.5GB RAM, from what I've read that's not enough memory to fsck a 4TB volume without