Re: How to make fsck run faster?

2006-07-24 Thread Antti Harri
On Sat, 22 Jul 2006, Otto Moerbeek wrote: Hmmm, I didn't record the numbers. It could be that fsck is swapping in your case, which will make it very slow. Can your check that? It doesn't start swapping. I was wrong about the speed improvement, currently I have only 2 million files on that

Re: How to make fsck run faster?

2006-07-24 Thread Otto Moerbeek
On Mon, 24 Jul 2006, Antti Harri wrote: On Sat, 22 Jul 2006, Otto Moerbeek wrote: Hmmm, I didn't record the numbers. It could be that fsck is swapping in your case, which will make it very slow. Can your check that? It doesn't start swapping. I was wrong about the speed improvement,

Re: How to make fsck run faster?

2006-07-22 Thread Otto Moerbeek
On Sat, 22 Jul 2006, Antti Harri wrote: On Mon, 17 Jul 2006, Otto Moerbeek wrote: Another thing is to move to larger block and fragment sizes. Depending on the size distribution of your files, this will waste some space, though. I tested 1TB filesystems with varying block and

Re: How to make fsck run faster?

2006-07-22 Thread Otto Moerbeek
On Sat, 22 Jul 2006, Otto Moerbeek wrote: I'll try to do some measurements with various block and fragment sized the coming week. That'll take some time, though. Well, I actually found some time already. I list the newfs and fsck time for blocksize 65536 and 4 fragment sizes of a 1Tb

Re: How to make fsck run faster?

2006-07-21 Thread Antti Harri
On Mon, 17 Jul 2006, Otto Moerbeek wrote: Another thing is to move to larger block and fragment sizes. Depending on the size distribution of your files, this will waste some space, though. I tested 1TB filesystems with varying block and fragment sizes, and it is really nice to see the speedup

Re: How to make fsck run faster?

2006-07-17 Thread Otto Moerbeek
On Mon, 17 Jul 2006, Antti Harri wrote: On Sun, 16 Jul 2006, Nick Holland wrote: nope, you can still likely use multiple partitions. Break your backup job into smaller chunks, put each chunk on its own partition. Or put each machine on its own partition. Or ... Interesting ideas. I

Re: How to make fsck run faster?

2006-07-17 Thread Nick Holland
Antti Harri wrote: On Sun, 16 Jul 2006, Nick Holland wrote: nope, you can still likely use multiple partitions. Break your backup job into smaller chunks, put each chunk on its own partition. Or put each machine on its own partition. Or ... Interesting ideas. I didn't think that having

How to make fsck run faster?

2006-07-16 Thread Antti Harri
Hello, I have a 3.8 machine with millions of files. The exact number of files varies a lot but it's always more than 5M. One day I had a power failure and I had to wait for fsck to complete on reboot. Fsck took more than two hours! At that time there were 8,8M files on the drive. Is there any

Re: How to make fsck run faster?

2006-07-16 Thread janus
On Sun, Jul 16, 2006 at 10:45:55PM +0300, Antti Harri wrote: I have a 3.8 machine with millions of files. The exact number of files varies a lot but it's always more than 5M. One day I had a power failure and I had to wait for fsck to complete on reboot. Fsck took more than two hours! At that

Re: How to make fsck run faster?

2006-07-16 Thread knitti
On 7/16/06, Antti Harri [EMAIL PROTECTED] wrote: Kernel is 3.8 GENERIC and there is one large ffs partition on the SATA disc, roughly the size of 180G. Most of the files make smaller slices and mount only the ones r/w which you absolutely need. the bigger a fs is, the longer it takes, and the

Re: How to make fsck run faster?

2006-07-16 Thread Antti Harri
On Sun, 16 Jul 2006, knitti wrote: On 7/16/06, Antti Harri [EMAIL PROTECTED] wrote: Kernel is 3.8 GENERIC and there is one large ffs partition on the SATA disc, roughly the size of 180G. Most of the files make smaller slices and mount only the ones r/w which you absolutely need. the bigger a

Re: How to make fsck run faster?

2006-07-16 Thread Raja Subramanian
On Sun, 16 Jul 2006, knitti wrote: The machine is doing backups, it copies yesterdays backup as hardlinks as base of the new backup and then updates it. Have a look at rdiff-backup.sf.net. It does incremental backups without hard linking. HTH. - Raja

Re: How to make fsck run faster?

2006-07-16 Thread Raja Subramanian
On 7/17/06, Raja Subramanian [EMAIL PROTECTED] wrote: On Sun, 16 Jul 2006, knitti wrote: The machine is doing backups, it copies yesterdays backup as hardlinks as base of the new backup and then updates it. Have a look at rdiff-backup.sf.net. It does incremental backups without hard

Re: How to make fsck run faster?

2006-07-16 Thread Nick Holland
Antti Harri wrote: On Sun, 16 Jul 2006, knitti wrote: On 7/16/06, Antti Harri [EMAIL PROTECTED] wrote: Kernel is 3.8 GENERIC and there is one large ffs partition on the SATA disc, roughly the size of 180G. Most of the files make smaller slices and mount only the ones r/w which you absolutely

Re: How to make fsck run faster?

2006-07-16 Thread Antti Harri
On Sun, 16 Jul 2006, Nick Holland wrote: nope, you can still likely use multiple partitions. Break your backup job into smaller chunks, put each chunk on its own partition. Or put each machine on its own partition. Or ... Interesting ideas. I didn't think that having the same amount of