Re: Home NAS

2019-11-18 Thread Roderick
What can be newer or not existent yesterday, but has the same filename? Something that one changed with an editor? Would not be better to use a version contro system? Rod. On Mon, 18 Nov 2019, Nick Holland wrote: On 2019-11-17 11:39, Jean-François Simon wrote: Hi, I found it, there exist

Re: Home NAS

2019-11-18 Thread Nick Holland
On 2019-11-17 11:39, Jean-François Simon wrote: > Hi, > > I found it, there exist glastree which is available from ports. > > Nice small "poor man's" backup as the author qualifies, > though makes incremental backup through hard links: > > # if yesterday does not exist or today is newer,

Re: Home NAS

2019-11-17 Thread Janne Johansson
Den lör 16 nov. 2019 kl 22:49 skrev Karel Gardas : > > I tried a home NAS with ZFS, then BTRFS. Those filesystems needs tons of > RAM (~1 GB of RAM by TB of disk), preferably ECC. > > For NAS you prefer ECC anyway and 1 GB RAM consumption per 1 TB of drive > is urban legend probably passed by

Re: Home NAS

2019-11-17 Thread Patrick Marchand
Hi, On 11/17, Predrag Punosevac wrote: > Patrick Marchand wrote: > > On 11/15, Predrag Punosevac wrote: > > > Patrick Marchand wrote: > > > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > > > backups) for a home NAS over the next few weeks. I'll probably do a > > > >

Re: Home NAS

2019-11-17 Thread Predrag Punosevac
Milun Rajkovic wrote: > Pardon my ignorance and lack of deeper knowledge regarding the matter, > but since when is XFS not even considered for such uses? > Since 2005 if you are Solaris guy. Since 2008 if you are ZFS on FreeBSD or Hammer 1 DragonFly guy. XFS is indeed the most stable and

Re: Home NAS

2019-11-17 Thread Predrag Punosevac
Patrick Marchand wrote: > Hello, > > On 11/15, Predrag Punosevac wrote: > > Patrick Marchand wrote: > > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > > backups) for a home NAS over the next few weeks. I'll probably do a > > > presentation about the experience at

Re: Home NAS

2019-11-17 Thread Milun Rajkovic
Pardon my ignorance and lack of deeper knowledge regarding the matter, but since when is XFS not even considered for such uses? Cheers Milun On Sun, Nov 17, 2019, 21:11 Patrick Marchand wrote: > Hello, > > On 11/15, Predrag Punosevac wrote: > > Patrick Marchand wrote: > > > I'll be playing

Re: Home NAS

2019-11-17 Thread Patrick Marchand
Hello, On 11/15, Predrag Punosevac wrote: > Patrick Marchand wrote: > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > backups) for a home NAS over the next few weeks. I'll probably do a > > presentation about the experience at the Montreal BSD user group > >

Re: Home NAS

2019-11-17 Thread Jean-François Simon
Hi, I found it, there exist glastree which is available from ports. Nice small "poor man's" backup as the author qualifies, though makes incremental backup through hard links: # if yesterday does not exist or today is newer, copy the file # else hard link the file to yesterday

Re: Home Nas -> Montreal BUG

2019-11-16 Thread Patrick Marchand
Hey, Since I'm getting off-list questions from more than one person, I'll post here as well. On 11/15, Patrick Marchand wrote: > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > backups) for a home NAS over the next few weeks. I'll probably do a > presentation about the

Re: Home NAS

2019-11-16 Thread Karel Gardas
On 2019-11-15 14:34, Rafael Possamai wrote: My experience with ZFS (FreeNAS for the most part) is that it becomes more "expensive" to expand your pool after the fact (for a couple of different reasons, see below), That's probably case with more complex ZFS RAID setup, but for this particular

Re: Home NAS

2019-11-16 Thread Karel Gardas
On 2019-11-14 15:26, Jan Betlach wrote: Hi guys, I am setting up a home NAS for five users. Total amount of data stored on NAS will not exceed 5 TB. Clients are Macs and OpenBSD machines, so that SSHFS works fine from both (no need for NFS or Samba). I am much more familiar and comfortable

Re: Home NAS

2019-11-16 Thread Karel Gardas
On 2019-11-15 16:02, pierre1.bar...@orange.com wrote: Hello, I tried a home NAS with ZFS, then BTRFS. Those filesystems needs tons of RAM (~1 GB of RAM by TB of disk), preferably ECC. For NAS you prefer ECC anyway and 1 GB RAM consumption per 1 TB of drive is urban legend probably passed

Re: Home NAS

2019-11-16 Thread Jean-François Simon
Hi, I remind there was an incremental backup which I used to run in cron, doing good job of making daily, weekly and monthly backups of deltas. I could not find the name of this, it was available from packages as far as I remember and created directory trees to the dates filled in with only

Re: Home NAS

2019-11-16 Thread Predrag Punosevac
Paolo Aglialoro wrote: > A fundamental element missing from the 1st mail is on which hardware should > run your software-defined NAS and for which use. > > I exclude you are talking about several nodes, on which you can run Ceph or > GlusterFS filesystems. > "Ceph & Gluster are WILDLY

Re: Home NAS

2019-11-16 Thread Paolo Aglialoro
A fundamental element missing from the 1st mail is on which hardware should run your software-defined NAS and for which use. I exclude you are talking about several nodes, on which you can run Ceph or GlusterFS filesystems. Is it a single full size multi-disk server planned for intensive

Re: Home NAS

2019-11-15 Thread Jordan Geoghegan
On 2019-11-15 20:47, Predrag Punosevac wrote: Jan Betlach wrote: [snip] 2. A HP P222 array controller works right out of the box on OpenBSD, maybe FreeBSD as well but the combination of ZFS and RAID controller seems weird to me. FreeBSD has a better support for HWRaid cards than OpenBSD.

Re: Home NAS

2019-11-15 Thread Predrag Punosevac
Jan Betlach wrote: > - FFS seems to be reliable and stable enough for my purpose. ZFS is too > complicated and bloated (of course it has its advantages), however major > factor for me has been that it is not possible to encrypt ZFS natively > on FreeBSD as of now. Illumos distro OmniOS CE

Re: Home NAS

2019-11-15 Thread gwes
[misc intermediate comments removed] On 11/15/19 3:54 AM, Andrew Luke Nesbit wrote: In particular I'm trying to figure out a generally applicable way of taking a _consistent_ backup of a disk without resorting to single user mode. I think COW file systems might help in this regard but I

Re: Home NAS

2019-11-15 Thread Zhi-Qiang Lei
I have a HP Gen8 Microserver running as a NAS using OpenBSD. It has been serving well for like 5 months. I choose OpenBSD over FreeBSD because: 1. FreeBSD was my first consideration because of ZFS, but as far as I know, ZFS doesn’t work well with RAID controller, and neither FreeBSD nor OpenBSD

Re: Home NAS

2019-11-15 Thread Patrick Marchand
Hi, I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite backups) for a home NAS over the next few weeks. I'll probably do a presentation about the experience at the Montreal BSD user group afterwards. It does not require as many ressources as ZFS or BTRFS, but offers many

Re: Home NAS

2019-11-15 Thread Jan Betlach
Possamai Envoyé : vendredi 15 novembre 2019 14:35 À : Jan Betlach Cc : misc@openbsd.org Objet : Re: Home NAS My experience with ZFS (FreeNAS for the most part) is that it becomes more "expensive" to expand your pool after the fact (for a couple of different reasons, see below), but if

Re: Home NAS

2019-11-15 Thread pierre1.bardou
Objet : Re: Home NAS My experience with ZFS (FreeNAS for the most part) is that it becomes more "expensive" to expand your pool after the fact (for a couple of different reasons, see below), but if 5TB is all you're ever going to need in this specific case, I think you should be fine an

Re: Home NAS

2019-11-15 Thread Rafael Possamai
My experience with ZFS (FreeNAS for the most part) is that it becomes more "expensive" to expand your pool after the fact (for a couple of different reasons, see below), but if 5TB is all you're ever going to need in this specific case, I think you should be fine and can take advantage of ZFS

Re: Home NAS

2019-11-15 Thread Raymond, David
I don't know how current tape systems are, but I have been burnt by them in the past. Either the tape deteriorates or the tape writer company goes out of business. My current approach is to keep stuff I want to keep on current online storage in multiple places plus offline USB. Data get

Re: Home NAS

2019-11-15 Thread Raf Czlonka
On Fri, Nov 15, 2019 at 08:54:54AM GMT, Andrew Luke Nesbit wrote: > On 15/11/2019 10:11, gwes wrote: > > > The backup(8) program can assist this by storing deltas so that > > more frequent backups only contain deltas from the previous > > less frequent backup. > > I've not used backup(8) before,

Re: Home NAS

2019-11-15 Thread Andrew Luke Nesbit
On 15/11/2019 10:11, gwes wrote: On 11/14/19 3:52 PM, Andrew Luke Nesbit wrote: On 15/11/2019 07:44, Raymond, David wrote: I hadn't heard about file corruption on OpenBSD.  It would be good to get to the bottom of this if it occurred. I was surprised when I read mention of it too, without

Re: Home NAS

2019-11-14 Thread gwes
On 11/14/19 3:52 PM, Andrew Luke Nesbit wrote: Hi Dave, On 15/11/2019 07:44, Raymond, David wrote: I hadn't heard about file corruption on OpenBSD.  It would be good to get to the bottom of this if it occurred. I was surprised when I read mention of it too, without any real claim or

Re: Home NAS

2019-11-14 Thread Jon Tabor
I'm running a small home NAS on OpenBSD, in a very similar configuration as your intended configuration, right down to the rsync backup scripts. It's worked very well so far, though I've only had it in place for a bit over a year. I chose OpenBSD over FreeBSD due to being far more comfortable

Re: Home NAS

2019-11-14 Thread Andrew Luke Nesbit
Hi Dave, On 15/11/2019 07:44, Raymond, David wrote: I hadn't heard about file corruption on OpenBSD. It would be good to get to the bottom of this if it occurred. I was surprised when I read mention of it too, without any real claim or detailed analysis to back it up. This is why I added

Re: Home NAS

2019-11-14 Thread Raymond, David
Andrew, I hadn't heard about file corruption on OpenBSD. It would be good to get to the bottom of this if it occurred. Dave On 11/14/19, U'll Be King of the Stars wrote: > On 15/11/2019 04:45, Raymond, David wrote: >> I have done similar things on Linux for years and am now doing them on >>

Re: Home NAS

2019-11-14 Thread U'll Be King of the Stars
On 15/11/2019 04:45, Raymond, David wrote: I have done similar things on Linux for years and am now doing them on OpenBSD. Sounds like what you want to do can be done with a simple rsync script. OpenBSD ffs (ufs) should be stable, it has been around for decades in various incarnations. I have

Re: Home NAS

2019-11-14 Thread Raymond, David
I have done similar things on Linux for years and am now doing them on OpenBSD. Sounds like what you want to do can be done with a simple rsync script. OpenBSD ffs (ufs) should be stable, it has been around for decades in various incarnations. I have never noticed bit rot in this system, though

Re: Home NAS

2019-11-14 Thread Roderick
On Thu, 14 Nov 2019, Jan Betlach wrote: Should I byte the bullet and build the NAS on FreeBSD taking advantage of ZFS, snapshots, replications, etc? Or is this an overkill? I built my "NAS" with FreeBSD due to the self healing properties of ZFS with checksums and redundant data, and due to

Re: Home NAS

2019-11-14 Thread Eduardo Minguez Perez
On Thu, Nov 14, 2019 at 3:29 PM Jan Betlach wrote: > > Hi guys, > > I am setting up a home NAS for five users. Total amount of data stored > on NAS will not exceed 5 TB. > Clients are Macs and OpenBSD machines, so that SSHFS works fine from > both (no need for NFS or Samba). > I am much more