Re: Home NAS

2019-11-18 Thread Roderick
What can be newer or not existent yesterday, but has the same filename? Something that one changed with an editor? Would not be better to use a version contro system? Rod. On Mon, 18 Nov 2019, Nick Holland wrote: On 2019-11-17 11:39, Jean-François Simon wrote: Hi, I found it, there exist

Re: Home NAS

2019-11-18 Thread Nick Holland
On 2019-11-17 11:39, Jean-François Simon wrote: > Hi, > > I found it, there exist glastree which is available from ports. > > Nice small "poor man's" backup as the author qualifies, > though makes incremental backup through hard links: > > # if yesterday does not exist or today is newer,

Re: Home NAS

2019-11-17 Thread Janne Johansson
Den lör 16 nov. 2019 kl 22:49 skrev Karel Gardas : > > I tried a home NAS with ZFS, then BTRFS. Those filesystems needs tons of > RAM (~1 GB of RAM by TB of disk), preferably ECC. > > For NAS you prefer ECC anyway and 1 GB RAM consumption per 1 TB of drive > is urban lege

Re: Home NAS

2019-11-17 Thread Patrick Marchand
Hi, On 11/17, Predrag Punosevac wrote: > Patrick Marchand wrote: > > On 11/15, Predrag Punosevac wrote: > > > Patrick Marchand wrote: > > > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > > > backups) for a home NAS

Re: Home NAS

2019-11-17 Thread Predrag Punosevac
Milun Rajkovic wrote: > Pardon my ignorance and lack of deeper knowledge regarding the matter, > but since when is XFS not even considered for such uses? > Since 2005 if you are Solaris guy. Since 2008 if you are ZFS on FreeBSD or Hammer 1 DragonFly guy. XFS is indeed the most stable and

Re: Home NAS

2019-11-17 Thread Predrag Punosevac
Patrick Marchand wrote: > Hello, > > On 11/15, Predrag Punosevac wrote: > > Patrick Marchand wrote: > > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > > backups) for a home NAS over the next few weeks. I'll probably do a > &

Re: Home NAS

2019-11-17 Thread Milun Rajkovic
gt; > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > > backups) for a home NAS over the next few weeks. I'll probably do a > > > presentation about the experience at the Montreal BSD user group > > > afterwards. It does not require as many ressou

Re: Home NAS

2019-11-17 Thread Patrick Marchand
Hello, On 11/15, Predrag Punosevac wrote: > Patrick Marchand wrote: > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > > backups) for a home NAS over the next few weeks. I'll probably do a > > presentation about the experience at the Mo

Re: Home NAS

2019-11-17 Thread Jean-François Simon
Hi, I found it, there exist glastree which is available from ports. Nice small "poor man's" backup as the author qualifies, though makes incremental backup through hard links: # if yesterday does not exist or today is newer, copy the file # else hard link the file to yesterday

Re: Home Nas -> Montreal BUG

2019-11-16 Thread Patrick Marchand
Hey, Since I'm getting off-list questions from more than one person, I'll post here as well. On 11/15, Patrick Marchand wrote: > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > backups) for a home NAS over the next few weeks. I'll probably do a > presentat

Re: Home NAS

2019-11-16 Thread Karel Gardas
On 2019-11-15 14:34, Rafael Possamai wrote: My experience with ZFS (FreeNAS for the most part) is that it becomes more "expensive" to expand your pool after the fact (for a couple of different reasons, see below), That's probably case with more complex ZFS RAID setup, but for this particular

Re: Home NAS

2019-11-16 Thread Karel Gardas
On 2019-11-14 15:26, Jan Betlach wrote: Hi guys, I am setting up a home NAS for five users. Total amount of data stored on NAS will not exceed 5 TB. Clients are Macs and OpenBSD machines, so that SSHFS works fine from both (no need for NFS or Samba). I am much more familiar and comfortable

Re: Home NAS

2019-11-16 Thread Karel Gardas
On 2019-11-15 16:02, pierre1.bar...@orange.com wrote: Hello, I tried a home NAS with ZFS, then BTRFS. Those filesystems needs tons of RAM (~1 GB of RAM by TB of disk), preferably ECC. For NAS you prefer ECC anyway and 1 GB RAM consumption per 1 TB of drive is urban legend probably passed

Re: Home NAS

2019-11-16 Thread Jean-François Simon
Hi, I remind there was an incremental backup which I used to run in cron, doing good job of making daily, weekly and monthly backups of deltas. I could not find the name of this, it was available from packages as far as I remember and created directory trees to the dates filled in with only

Re: Home NAS

2019-11-16 Thread Predrag Punosevac
ph & Gluster are WILDLY different solutions to different problems." https://www.reddit.com/r/sysadmin/comments/9onemk/ceph_vs_glusterfs/ OP is taking about home NAS. That pretty much means that the files will be accessed by SSHFS, NFS, or CIFS. Note that OmniOS has a kernel implementation of CIF

Re: Home NAS

2019-11-16 Thread Paolo Aglialoro
A fundamental element missing from the 1st mail is on which hardware should run your software-defined NAS and for which use. I exclude you are talking about several nodes, on which you can run Ceph or GlusterFS filesystems. Is it a single full size multi-disk server planned for intensive

Re: Home NAS

2019-11-15 Thread Jordan Geoghegan
On 2019-11-15 20:47, Predrag Punosevac wrote: Jan Betlach wrote: [snip] 2. A HP P222 array controller works right out of the box on OpenBSD, maybe FreeBSD as well but the combination of ZFS and RAID controller seems weird to me. FreeBSD has a better support for HWRaid cards than OpenBSD.

Re: Home NAS

2019-11-15 Thread Predrag Punosevac
ro OmniOS CE https://omniosce.org/ has support for native encryption since r151032 https://github.com/omniosorg/omnios-build/blob/r151032/doc/ReleaseNotes.md Patrick Marchand wrote: > Hi, > > > I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite > backups) f

Re: Home NAS

2019-11-15 Thread gwes
[misc intermediate comments removed] On 11/15/19 3:54 AM, Andrew Luke Nesbit wrote: In particular I'm trying to figure out a generally applicable way of taking a _consistent_ backup of a disk without resorting to single user mode. I think COW file systems might help in this regard but I

Re: Home NAS

2019-11-15 Thread Zhi-Qiang Lei
cooling issue. However, I was confident to get a replacement and no data was lost. As the 5TB limitation, I haven’t been there. > On Nov 14, 2019, at 10:26 PM, Jan Betlach wrote: > > > Hi guys, > > I am setting up a home NAS for five users. Total amount of data stored on NAS &

Re: Home NAS

2019-11-15 Thread Patrick Marchand
Hi, I'll be playing around with DragonflyBSD Hammer2 (and multiple offsite backups) for a home NAS over the next few weeks. I'll probably do a presentation about the experience at the Montreal BSD user group afterwards. It does not require as many ressources as ZFS or BTRFS, but offers many

Re: Home NAS

2019-11-15 Thread Jan Betlach
Hi, thank you all for comments. I am restoring backup to my new OpenBSD based home NAS as of writing this. Why I have decided to go this route and not with other option like ZFS: - FFS seems to be reliable and stable enough for my purpose. ZFS is too complicated and bloated (of course

Re: Home NAS

2019-11-15 Thread pierre1.bardou
Hello, I tried a home NAS with ZFS, then BTRFS. Those filesystems needs tons of RAM (~1 GB of RAM by TB of disk), preferably ECC. I found it very expensive for home usage, so I wouldn't recommend it. Recovy systems were also inexistent at the time (no btrfsck), I don't know if it has improved

Re: Home NAS

2019-11-15 Thread Rafael Possamai
age of ZFS features like you said. I have sources for this at home (a couple of articles and link to a forum thread), but these are saved on my desktop at home. Just let me know and I'll share them with you later. On Thu, Nov 14, 2019, 8:27 AM Jan Betlach wrote: > > Hi guys, > > I am

Re: Home NAS

2019-11-15 Thread Raymond, David
I don't know how current tape systems are, but I have been burnt by them in the past. Either the tape deteriorates or the tape writer company goes out of business. My current approach is to keep stuff I want to keep on current online storage in multiple places plus offline USB. Data get

Re: Home NAS

2019-11-15 Thread Raf Czlonka
On Fri, Nov 15, 2019 at 08:54:54AM GMT, Andrew Luke Nesbit wrote: > On 15/11/2019 10:11, gwes wrote: > > > The backup(8) program can assist this by storing deltas so that > > more frequent backups only contain deltas from the previous > > less frequent backup. > > I've not used backup(8) before,

Re: Home NAS

2019-11-15 Thread Andrew Luke Nesbit
On 15/11/2019 10:11, gwes wrote: On 11/14/19 3:52 PM, Andrew Luke Nesbit wrote: On 15/11/2019 07:44, Raymond, David wrote: I hadn't heard about file corruption on OpenBSD.  It would be good to get to the bottom of this if it occurred. I was surprised when I read mention of it too, without

Re: Home NAS

2019-11-14 Thread gwes
On 11/14/19 3:52 PM, Andrew Luke Nesbit wrote: Hi Dave, On 15/11/2019 07:44, Raymond, David wrote: I hadn't heard about file corruption on OpenBSD.  It would be good to get to the bottom of this if it occurred. I was surprised when I read mention of it too, without any real claim or

Re: Home NAS

2019-11-14 Thread Jon Tabor
I'm running a small home NAS on OpenBSD, in a very similar configuration as your intended configuration, right down to the rsync backup scripts. It's worked very well so far, though I've only had it in place for a bit over a year. I chose OpenBSD over FreeBSD due to being far more comfortable

Re: Home NAS

2019-11-14 Thread Andrew Luke Nesbit
Hi Dave, On 15/11/2019 07:44, Raymond, David wrote: I hadn't heard about file corruption on OpenBSD. It would be good to get to the bottom of this if it occurred. I was surprised when I read mention of it too, without any real claim or detailed analysis to back it up. This is why I added

Re: Home NAS

2019-11-14 Thread Raymond, David
Andrew, I hadn't heard about file corruption on OpenBSD. It would be good to get to the bottom of this if it occurred. Dave On 11/14/19, U'll Be King of the Stars wrote: > On 15/11/2019 04:45, Raymond, David wrote: >> I have done similar things on Linux for years and am now doing them on >>

Re: Home NAS

2019-11-14 Thread U'll Be King of the Stars
On 15/11/2019 04:45, Raymond, David wrote: I have done similar things on Linux for years and am now doing them on OpenBSD. Sounds like what you want to do can be done with a simple rsync script. OpenBSD ffs (ufs) should be stable, it has been around for decades in various incarnations. I have

Re: Home NAS

2019-11-14 Thread Raymond, David
will propagate to the backup. Using rsync without the --delete option most of the time alleviates this somewhat. Only run with --delete when the backup starts getting full and you are confident that your NAS drive is ok. Dave On 11/14/19, Jan Betlach wrote: > > Hi guys, > > I am setti

Re: Home NAS

2019-11-14 Thread Roderick
On Thu, 14 Nov 2019, Jan Betlach wrote: Should I byte the bullet and build the NAS on FreeBSD taking advantage of ZFS, snapshots, replications, etc? Or is this an overkill? I built my "NAS" with FreeBSD due to the self healing properties of ZFS with checksums and redundant data, and due to

Re: Home NAS

2019-11-14 Thread Eduardo Minguez Perez
On Thu, Nov 14, 2019 at 3:29 PM Jan Betlach wrote: > > Hi guys, > > I am setting up a home NAS for five users. Total amount of data stored > on NAS will not exceed 5 TB. > Clients are Macs and OpenBSD machines, so that SSHFS works fine from > both (no need for NFS or Sam

Home NAS

2019-11-14 Thread Jan Betlach
Hi guys, I am setting up a home NAS for five users. Total amount of data stored on NAS will not exceed 5 TB. Clients are Macs and OpenBSD machines, so that SSHFS works fine from both (no need for NFS or Samba). I am much more familiar and comfortable with OpenBSD than with FreeBSD. My