Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Need link

Dave

On Tue, Dec 20, 2022, 1:52 AM Dale  wrote:

> Wols Lists wrote:
> > On 18/12/2022 22:11, Dale wrote:
> >> Wol wrote:
> >>> On 18/12/2022 18:59, Dale wrote:
>  Since this is local, I just use rsync to do my backups.  I did have to
>  change the options a bit.  It seems TrueNAS doesn't like some of the
>  permissions or something.
> >>>
> >>> Are you running the rsync daemon on the NAS? I'm probably teaching
> >>> grandma to suck eggs, but that massively reduces the need for network
> >>> traffic.
> >>>
> >>> Cheers,
> >>> Wol
> >>>
> >>>
> >>
> >>
> >> I mount the NAS on my Gentoo rig.  I mount it under /mnt.  Then I run
> >> rsync and copy from the source to the mount point for the NAS.  I may
> >> could go the other way but never thought about doing it that way.  Kinda
> >> sounds backwards to me but I dunno. ;-)
> >>
> > Sounds to me like you're doing it all wrong either way ...
> >
> > What is *supposed* to happen is that you have the daemon running on
> > one machine and the client on the other - doesn't matter which.
> >
> > Then the client tells the daemon what files are to be copied, THE TWO
> > COMPARE CHECKSUMS, and only the stuff that fails the checksum is
> > copied. So if you're doing an incremental backup, network usage and
> > writes are kept to a minimum.
> >
> > I tell people to an in-place backup if they're running on a snapshot
> > setup, because again it only writes stuff that has actually changed.
> >
> > Cheers,
> > Wol
> >
> >
>
>
> Do you have a link to the proper way to do it?  I don't copy to a
> different machine often so my current method may be the problem.  Maybe
> the way you mention will work much better, even a little better would be
> nice. ;-)
>
> Dale
>
> :-)  :-)
>
>

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Dave

On Sun, Dec 18, 2022, 2:54 PM Wol  wrote:

> On 18/12/2022 18:59, Dale wrote:
> > Since this is local, I just use rsync to do my backups.  I did have to
> > change the options a bit.  It seems TrueNAS doesn't like some of the
> > permissions or something.
>
> Are you running the rsync daemon on the NAS? I'm probably teaching
> grandma to suck eggs, but that massively reduces the need for network
> traffic.
>
> Cheers,
> Wol
>
>

Re: [gentoo-user] NAS and replacing with larger drives

[Wol]

On 21/12/2022 20:40, Frank Steinmetzger wrote:

Yes? In a mirror setup, all member drives of a mirror have the same content
(at least in ZFS).

Raid 10 distributes its content across several mirrors. This is the cause
for its increased performance. So when one of the mirrors (not single drive,
but a whole set of mirrored drives) fails, the pool is gone.


Linux will happily give you a 2-copy mirror across 3 drives - 3x6TB drives
will give you 9TB useful storage ...



I admit, I’ve never head of that. (Though it sounds like raid-5 to me.)


Raid 5 has a parity drive (or rather, raid 4 has a parity drive. Raid 5 
smears parity across all disks). It does not store duplicate copies. 
Raid 10 has duplicate data and no parity.



Read up on linux raid-10. It is NOT raid-1+0.

Drive   sda sdb sdc

Blocks   1   1   2
 2   3   3
 4   4   5
 5   6   6

etc ...

https://raid.wiki.kernel.org/index.php/What_is_RAID_and_why_should_you_want_it%3F

(Disclaimer - I either wrote or heavily edited it.)

Cheers,
Wol

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Wed, Dec 21, 2022 at 08:03:36PM + schrieb Wol:
> On 21/12/2022 06:19, Frank Steinmetzger wrote:
> > Am Wed, Dec 21, 2022 at 05:53:03AM + schrieb Wols Lists:
> > 
> > > On 21/12/2022 02:47, Dale wrote:
> > > > I think if I can hold out a little while, something really nice is going
> > > > to come along.  It seems there is a good bit of interest in having a
> > > > Raspberry Pi NAS that gives really good performance.  I'm talking a NAS
> > > > that is about the same speed as a internal drive.  Plus the ability to
> > > > use RAID and such.  I'd like to have a 6 bay with 6 drives setup in
> > > > pairs for redundancy.  I can't recall what number RAID that is.
> > > > Basically, if one drive fails, another copy still exists.  Of course,
> > > > two independent NASs would be better in my opinion.  Still, any of this
> > > > is progress.
> > > 
> > > That's called either Raid-10 (linux), or Raid-1+0 (elsewhere). Note that 
> > > 1+0
> > > is often called 10, but linux-10 is slightly different.
> > 

> > In layman’s term, a stripe of mirrors. Raid-1 is the mirror, Raid-0 a (JBOD)
> > pool. So mirror + pool = mirrorpool, hence the 1+0 → 10.
> 
> Except raid-10 is not a stripe of mirrors.
> It's each block is saved to two different drives. (Or 3, or more, so long
> as you have more drives than mirrors.)

Yes? In a mirror setup, all member drives of a mirror have the same content
(at least in ZFS).

Raid 10 distributes its content across several mirrors. This is the cause
for its increased performance. So when one of the mirrors (not single drive,
but a whole set of mirrored drives) fails, the pool is gone.

> Linux will happily give you a 2-copy mirror across 3 drives - 3x6TB drives
> will give you 9TB useful storage ...

I admit, I’ve never head of that. (Though it sounds like raid-5 to me.)

> > If I wanted to increase my capacity, I’d have to replace *all* drives with
> > bigger ones. With a mirror, only the drives in one of the mirrors need
> > replacing. And the rebuild process would be quicker and less painful, as
> > each drive will only be read once to rebuild its partner, and there is no
> > parity calculation involved. In a RAID, each drive is replaced one by one,
> > and each replacement requires a full read of all drives’ payload.
>
> If you've got a spare SATA connection or whatever, each replacement does not
> need a full read of all drives. "mdadm --add /dev/sdx --replace /dev/sdy".
> That'll stream sdy on to sdx, and only hammer the other drives if sdy
> complains ...

Strange that I didn’t think of that, even though it’s a perfectly clear
concept. In ZFS there is also a replace function which would do just that.
Currently I plan on keeping my old drives (who would want to buy them off of
me anyways) and just reorganise them in Z1 over Z2. I’ll just have to move
all data off to temprary external drives.

> > With older
> > drives, this is cause for some concern whether the disks may survive that.
> > That’s why, with increasing disk capacities, raid-5 is said to be obsolete.
> > Because if another drive fails during rebuild, you are officially screwed.
> > 
> > Fun, innit?
> > 
> They've always said that. Just make sure you don't have multiple drives from
> the same batch, then they're less likely statistically to fail at the same
> time. I'm running raid-5 over 3TB partitions ...

Yeah, I bought my drives from different shops back then for that reason.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

When the going gets tough, the tough get going.
... and so do I. – Alf


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Wol]

On 21/12/2022 06:19, Frank Steinmetzger wrote:

Am Wed, Dec 21, 2022 at 05:53:03AM + schrieb Wols Lists:


On 21/12/2022 02:47, Dale wrote:

I think if I can hold out a little while, something really nice is going
to come along.  It seems there is a good bit of interest in having a
Raspberry Pi NAS that gives really good performance.  I'm talking a NAS
that is about the same speed as a internal drive.  Plus the ability to
use RAID and such.  I'd like to have a 6 bay with 6 drives setup in
pairs for redundancy.  I can't recall what number RAID that is.
Basically, if one drive fails, another copy still exists.  Of course,
two independent NASs would be better in my opinion.  Still, any of this
is progress.


That's called either Raid-10 (linux), or Raid-1+0 (elsewhere). Note that 1+0
is often called 10, but linux-10 is slightly different.


In layman’s term, a stripe of mirrors. Raid-1 is the mirror, Raid-0 a (JBOD)
pool. So mirror + pool = mirrorpool, hence the 1+0 → 10.


Except raid-10 is not a stripe of mirrors. It's each block is saved to 
two different drives. (Or 3, or more, so long as you have more drives 
than mirrors.)


Linux will happily give you a 2-copy mirror across 3 drives - 3x6TB 
drives will give you 9TB useful storage ...



I'd personally be inclined to go for raid-6. That's 4 data drives, 2 parity
(so you could have an "any two" drive failure and still recover).
A two-copy 10 or 1+0 is vulnerable to a two-drive failure. A three-copy is
vulnerable to a three-drive failure.


At first, I had only two drives in my 4-bay NAS, which were of course set up
as a mirror. After a year, when it became full, I bought the second pair of
drives and had long deliberations by then, what to choose. I went for raid-6
(or RaidZ2 in ZFS parlance). With only four disks, it has the same net
capacity as a pair of mirrors, but at the advantage that *any* two drives
may fail, not just two particular ones. A raid of mirrors has performance
benefits over a parity raid, but who cares for a simple Gbit storage device.

With increasing number of disks, a mirror setup is at a disadvantage with
storage efficiency – it’s always 50 % or less, if you mirror over more than
two disks. But with only four disks, that was irrelevant in my case. On the
plus-side, each mirror can have a different physical disk size, so you can
more easily mix’n’match what you got lying around, or do upgrades in smaller
increments.

If I wanted to increase my capacity, I’d have to replace *all* drives with
bigger ones. With a mirror, only the drives in one of the mirrors need
replacing. And the rebuild process would be quicker and less painful, as
each drive will only be read once to rebuild its partner, and there is no
parity calculation involved. In a RAID, each drive is replaced one by one,
and each replacement requires a full read of all drives’ payload.


If you've got a spare SATA connection or whatever, each replacement does 
not need a full read of all drives. "mdadm --add /dev/sdx --replace 
/dev/sdy". That'll stream sdy on to sdx, and only hammer the other 
drives if sdy complains ...



With older
drives, this is cause for some concern whether the disks may survive that.
That’s why, with increasing disk capacities, raid-5 is said to be obsolete.
Because if another drive fails during rebuild, you are officially screwed.

Fun, innit?

They've always said that. Just make sure you don't have multiple drives 
from the same batch, then they're less likely statistically to fail at 
the same time. I'm running raid-5 over 3TB partitions ...


Cheers,
Wol

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Tue, Dec 20, 2022 at 11:52 PM Dale  wrote:

> This is why at some point, I'd like to have two sets of backups.  RAID
> or not.

Amazon Snowball? :-) ;-)

MArk

Re: [gentoo-user] NAS and replacing with larger drives

[William Kenworthy]

On 21/12/22 14:19, Frank Steinmetzger wrote:

Am Wed, Dec 21, 2022 at 05:53:03AM + schrieb Wols Lists:


On 21/12/2022 02:47, Dale wrote:
...

In layman’s term, a stripe of mirrors. Raid-1 is the mirror, Raid-0 a (JBOD)
pool. So mirror + pool = mirrorpool, hence the 1+0 → 10.

...


I tend to use older drives that have led a hard life - so failure 
happens and I have to be prepared for it (by having good backups!)


I have found mirrors to be problematic  - sometimes when one drive 
fails, it causes a cascade of fails that includes the data on the 
mirror.  With raid-10, its worse (even more fragile). When I eventually 
moved away from raid for my main data store it was because of a 
catastrophic failure of a bcache ssd fronting one of the mirrors causing 
all data to be lost - somewhat self-caused by using bcache to try and 
get some more speed out of the system, but as a RAID 10 with 4 HDD 
fronted by 4x SSD it should have survived ...  In the end, I realised 
that raided data gave me a small speedup with little or no benefit as 
regards reliable data storage.  I currently have one linux raid 10 using 
4xSSD's that has suffered one SSD abrupt failure and survived - which I 
regard as "being lucky".  SSD's are an issue as they usually fail 
abruptly without warning whereas spinning rust usually gives some warning.


I've never tried RAID-6 as it was still considered buggy/risky at the time.

No matter what storage system you use, offline backups are better - raid 
is NOT a viable backup.



Fun, innit?


YEP!

BillK

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Wols Lists wrote:
> On 21/12/2022 02:47, Dale wrote:
>> I think if I can hold out a little while, something really nice is going
>> to come along.  It seems there is a good bit of interest in having a
>> Raspberry Pi NAS that gives really good performance.  I'm talking a NAS
>> that is about the same speed as a internal drive.  Plus the ability to
>> use RAID and such.  I'd like to have a 6 bay with 6 drives setup in
>> pairs for redundancy.  I can't recall what number RAID that is.
>> Basically, if one drive fails, another copy still exists.  Of course,
>> two independent NASs would be better in my opinion.  Still, any of this
>> is progress.
>
> That's called either Raid-10 (linux), or Raid-1+0 (elsewhere). Note
> that 1+0 is often called 10, but linux-10 is slightly different.
>
> I'd personally be inclined to go for raid-6. That's 4 data drives, 2
> parity (so you could have an "any two" drive failure and still recover).
>
> A two-copy 10 or 1+0 is vulnerable to a two-drive failure. A
> three-copy is vulnerable to a three-drive failure.
>
> In other words, a two-copy raid-10 might be taken out by a failure
> that a raid-6 will survive. A three-copy raid-10 might be taken out by
> a failure that will take out a raid-6. Choose your poison :-)
>
> Cheers,
> Wol
>
> .
>


This is why at some point, I'd like to have two sets of backups.  RAID
or not.  If I alternate between the two or update one weekly and the
other monthly, odds of both being lost for some reason is slim.  Nothing
is ever impossible but not very likely.  I could even keep the monthly
backup, or second backup, in a outbuilding.  That would protect from a
house fire or something.  I have a fire safe but still. 

I'm hoping that this Raspberry thing will work out.  My reasons, I can
upgrade easily, change OS and/or software if I want plus I may can even
expand to a larger number of drives if needed.  Buying a pre-built NAS,
I think I'd be stuck with whatever I bought.  Most likely no path for
upgrade, changing OS and/or software or much of anything else either. 
Basically, it is what it is when I buy it.  Given the info in the video
you shared, I think something good is coming as soon as things get back
to going again. 

Thanks again for the link.  It lead to some other good videos too. 

Dale

:-)  :-)

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Wed, Dec 21, 2022 at 05:53:03AM + schrieb Wols Lists:

> On 21/12/2022 02:47, Dale wrote:
> > I think if I can hold out a little while, something really nice is going
> > to come along.  It seems there is a good bit of interest in having a
> > Raspberry Pi NAS that gives really good performance.  I'm talking a NAS
> > that is about the same speed as a internal drive.  Plus the ability to
> > use RAID and such.  I'd like to have a 6 bay with 6 drives setup in
> > pairs for redundancy.  I can't recall what number RAID that is.
> > Basically, if one drive fails, another copy still exists.  Of course,
> > two independent NASs would be better in my opinion.  Still, any of this
> > is progress.
> 
> That's called either Raid-10 (linux), or Raid-1+0 (elsewhere). Note that 1+0
> is often called 10, but linux-10 is slightly different.

In layman’s term, a stripe of mirrors. Raid-1 is the mirror, Raid-0 a (JBOD)
pool. So mirror + pool = mirrorpool, hence the 1+0 → 10.

> I'd personally be inclined to go for raid-6. That's 4 data drives, 2 parity
> (so you could have an "any two" drive failure and still recover).
> A two-copy 10 or 1+0 is vulnerable to a two-drive failure. A three-copy is
> vulnerable to a three-drive failure.

At first, I had only two drives in my 4-bay NAS, which were of course set up
as a mirror. After a year, when it became full, I bought the second pair of
drives and had long deliberations by then, what to choose. I went for raid-6
(or RaidZ2 in ZFS parlance). With only four disks, it has the same net
capacity as a pair of mirrors, but at the advantage that *any* two drives
may fail, not just two particular ones. A raid of mirrors has performance
benefits over a parity raid, but who cares for a simple Gbit storage device.

With increasing number of disks, a mirror setup is at a disadvantage with
storage efficiency – it’s always 50 % or less, if you mirror over more than
two disks. But with only four disks, that was irrelevant in my case. On the
plus-side, each mirror can have a different physical disk size, so you can
more easily mix’n’match what you got lying around, or do upgrades in smaller
increments.

If I wanted to increase my capacity, I’d have to replace *all* drives with
bigger ones. With a mirror, only the drives in one of the mirrors need
replacing. And the rebuild process would be quicker and less painful, as
each drive will only be read once to rebuild its partner, and there is no
parity calculation involved. In a RAID, each drive is replaced one by one,
and each replacement requires a full read of all drives’ payload. With older
drives, this is cause for some concern whether the disks may survive that.
That’s why, with increasing disk capacities, raid-5 is said to be obsolete.
Because if another drive fails during rebuild, you are officially screwed.

Fun, innit?

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

The boss is a human just like everyone else, he just doesn’t know.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Wols Lists]

On 21/12/2022 02:47, Dale wrote:

I think if I can hold out a little while, something really nice is going
to come along.  It seems there is a good bit of interest in having a
Raspberry Pi NAS that gives really good performance.  I'm talking a NAS
that is about the same speed as a internal drive.  Plus the ability to
use RAID and such.  I'd like to have a 6 bay with 6 drives setup in
pairs for redundancy.  I can't recall what number RAID that is.
Basically, if one drive fails, another copy still exists.  Of course,
two independent NASs would be better in my opinion.  Still, any of this
is progress.


That's called either Raid-10 (linux), or Raid-1+0 (elsewhere). Note that 
1+0 is often called 10, but linux-10 is slightly different.


I'd personally be inclined to go for raid-6. That's 4 data drives, 2 
parity (so you could have an "any two" drive failure and still recover).


A two-copy 10 or 1+0 is vulnerable to a two-drive failure. A three-copy 
is vulnerable to a three-drive failure.


In other words, a two-copy raid-10 might be taken out by a failure that 
a raid-6 will survive. A three-copy raid-10 might be taken out by a 
failure that will take out a raid-6. Choose your poison :-)


Cheers,
Wol

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Thu, Dec 15, 2022 at 10:08:02PM -0600 schrieb Dale:
>
> I just read a news story about a new NAS model from Terramaster.
> (Interestingly, they have their OS on an internal USB stick, so it’s easy to
> swap it out for a standard Linux. And it uses a nice Celeron N5100 x86
> processor.)
>
>> Eventually, I plan to build a Raspberry Pi NAS.  When I do, I'll post
>> everything major I needed, boards, case etc for everyone to look at. 
>> I'll even try to upload some pics, or share as attachments if there is
>> interest.  Unless I find one heck of a deal on a used NAS that is. 
>> Still may build one even then.  ;-)
> In the comments section of the article, there was a link to this:
> https://www.youtube.com/watch?v=R2S2RMNv7OU
> A Raspberry Pi NAS with 1 Petabyte of storage. Enjoy. :)
>

I think if I can hold out a little while, something really nice is going
to come along.  It seems there is a good bit of interest in having a
Raspberry Pi NAS that gives really good performance.  I'm talking a NAS
that is about the same speed as a internal drive.  Plus the ability to
use RAID and such.  I'd like to have a 6 bay with 6 drives setup in
pairs for redundancy.  I can't recall what number RAID that is. 
Basically, if one drive fails, another copy still exists.  Of course,
two independent NASs would be better in my opinion.  Still, any of this
is progress. 

I've watched some videos by that guy but I don't recall seeing that
one.  That one, while pricey, shows that a lot can be done with a little
Raspberry Pi.  I read that a version 5 is coming, if they ever become
available again.  Right now, it seems the supply chain has grinded to a
halt.  It's hard to find quite a few things at the moment. 

Thanks for the link.  I have a feeling even better is coming soon. 

Dale

:-)  :-) 

P. S.  My backup I started days ago, maybe 1/4 to 1/3 of the way
through.  It's made it to the names starting with F.  It has a ways to
go.  A lot of stuff starts with 'The'.  That alone is quite large.  It's
making progress tho.  Slowly.  ;-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Thu, Dec 15, 2022 at 10:08:02PM -0600 schrieb Dale:

I just read a news story about a new NAS model from Terramaster.
(Interestingly, they have their OS on an internal USB stick, so it’s easy to
swap it out for a standard Linux. And it uses a nice Celeron N5100 x86
processor.)

> Eventually, I plan to build a Raspberry Pi NAS.  When I do, I'll post
> everything major I needed, boards, case etc for everyone to look at. 
> I'll even try to upload some pics, or share as attachments if there is
> interest.  Unless I find one heck of a deal on a used NAS that is. 
> Still may build one even then.  ;-)

In the comments section of the article, there was a link to this:
https://www.youtube.com/watch?v=R2S2RMNv7OU
A Raspberry Pi NAS with 1 Petabyte of storage. Enjoy. :)

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

Windows is great, you can download Linux with it.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Wols Lists wrote:
> On 18/12/2022 22:11, Dale wrote:
>> Wol wrote:
>>> On 18/12/2022 18:59, Dale wrote:
 Since this is local, I just use rsync to do my backups.  I did have to
 change the options a bit.  It seems TrueNAS doesn't like some of the
 permissions or something.
>>>
>>> Are you running the rsync daemon on the NAS? I'm probably teaching
>>> grandma to suck eggs, but that massively reduces the need for network
>>> traffic.
>>>
>>> Cheers,
>>> Wol
>>>
>>>
>>
>>
>> I mount the NAS on my Gentoo rig.  I mount it under /mnt.  Then I run
>> rsync and copy from the source to the mount point for the NAS.  I may
>> could go the other way but never thought about doing it that way.  Kinda
>> sounds backwards to me but I dunno. ;-)
>>
> Sounds to me like you're doing it all wrong either way ...
>
> What is *supposed* to happen is that you have the daemon running on
> one machine and the client on the other - doesn't matter which.
>
> Then the client tells the daemon what files are to be copied, THE TWO
> COMPARE CHECKSUMS, and only the stuff that fails the checksum is
> copied. So if you're doing an incremental backup, network usage and
> writes are kept to a minimum.
>
> I tell people to an in-place backup if they're running on a snapshot
> setup, because again it only writes stuff that has actually changed.
>
> Cheers,
> Wol
>
>


Do you have a link to the proper way to do it?  I don't copy to a
different machine often so my current method may be the problem.  Maybe
the way you mention will work much better, even a little better would be
nice. ;-)

Dale

:-)  :-) 

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[William Kenworthy]

On 19/12/22 21:30, Rich Freeman wrote:

On Mon, Dec 19, 2022 at 7:51 AM Wols Lists  wrote:

On 19/12/2022 12:00, Rich Freeman wrote:

On Mon, Dec 19, 2022 at 12:11 AM Dale  wrote:

If I like these Raspberry things, may make a media box out of one.  I'd
like to have a remote tho.  

So, I've done that.  Honestly, these days a Roku is probably the
better option, or something like a Google Chromecast or the 47 other
variations on this them.

Where do you put that 2TB drive on your Roku or Chromecast?

I'm thinking of building a media server, not to drive the TV, but to
record and store. I thought that was what a media server was!

So, he said "media box," which I assumed meant the client that
attaches to the TV.  There are some canned solutions for media servers
- I think the NVidia Shield can run Plex server for example.  However,
in general server-side I'd go amd64.

My current solution is:
1. Moosefs for storage: amd64 container for the master, and ARM SBCs
for the chunkservers which host all the USB3 hard drives.  With a
modest number of them performance is very good, though certainly not
as good as Ceph or local storage.  (I do have moosefs in my overlay -
might try to get that into the main repo when I get a chance.)
2. Plex server in a container on amd64 (looking to migrate this to k8s
over the holiday).
3. Rokus or TV apps for the clients.


Very similar to what I have (intel/arm for moosefs) - I am effectively 
using moosefs as a distributed NAS (fuse mount onto whatever system(s) I 
am using) with built in data protection and redundancy.  LVM and similar 
pooling is discouraged as it defeats some of the built in data 
protection. To increase storage, just add a disk, format, add to the 
config and reload - it automatically redistributes the data.  Similarly, 
you can add/remove storage or whole storage systems while live with no 
risk to your data (within limits!!!) With LVM, if a drive fails, you are 
SOL and offline until you can recover and restore the data.  On a recent 
holiday, an SD card failed and a moosefs arm SBC in AU went offline - 
discovered the next morning when doing status checks from a ship in the 
Mediterranean(!) - it had already backfilled and protection was back at 
normal, moosefs was just missing 2Tb of storage space.  5 weeks later 
when I got home, I replaced the SD card, rebooted and readded the system 
all with no risk to the data.


Dale, I was where you are about 10 or so years ago and was forced to 
move on when that design hit its limits - forget LVM etc, these days 
there are lots of better ways to do what you want with less risk to your 
data.  Another factor is power - moosefs is currently 1 intel and 7 arm 
SBC's that use 90-110w (most of which is due to using ancient WD and 
Seagate hard drives) - where as my intel desktop is 90w when idle, or 
over 300 w when compiling etc. so its off unless its being used. Power 
is important to me as its expensive!!


BillK

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Rich Freeman]

On Mon, Dec 19, 2022 at 11:43 AM Mark Knecht  wrote:
>
> On Mon, Dec 19, 2022 at 6:30 AM Rich Freeman  wrote:
> 
> > My current solution is:
> > 1. Moosefs for storage: amd64 container for the master, and ARM SBCs
> > for the chunkservers which host all the USB3 hard drives.
>
> I'm trying to understand the form factor of what you are mentioning above.
> Presumably the chunkservers aren't sitting on a lab bench with USB
> drives hanging off of them. Can you point me  toward and example of
> what you are using?

Well, a few basically are just sitting on a bench, but most are in
half-decent cases (I've found that Pi4s really benefit from a decent
case as they will thermal throttle otherwise).  I then have USB3 hard
drives attached.  I actually still have one RockPro64 with an LSI HBA
on a riser card but I'm going to be moving those drives to USB3-SATA
adapters because dealing with the kernel patches needed to fix the
broken PCIe driver is too much fuss, and the HBA uses a TON of power
which I didn't anticipate when I bought it (ugh, server gear).

Really at this point for anything new 2GB Pi4s are my preferred go-to
with Argon ONE v2 cases.  Then I just get USB3 hard drives on sale at
Best Buy for ~$15/TB if possible.  USB3 will handle a few hard drives
depending on how much throughput they're getting, but this setup is
more focused on capacity/cost than performance anyway.

The low memory requirement for the chunkservers is a big part of why I
went with MooseFS instead of Ceph.  The OSDs for Ceph recommend
something like 4GB per hard drive which adds up very fast.

The USB3 hard drives do end up strewn about a fair bit, but they have
their own enclosures anyway.  I just label them well.

>
> I've been considering some of these new mini-computers that have
> a couple of 2.5Gb/S Ethernet ports and 3 USB 3 ports but haven't
> moved forward because I want it packaged in a single case.

Yeah, better ethernet would definitely be on my wish list.  I'll
definitely take a look at the state of those the next time I add a
node.

> Where does the master reside? In a container on your desktop
> machine or is that another element on your network?

In an nspawn container on one of my servers.  It is pretty easy to set
up or migrate so it can go anywhere, but it does benefit from a bit
more CPU/RAM.  Running it in a container creates obvious dependency
challenges if I want to mount moosefs on the same server - that can be
solved with systemd dependencies, but it won't figure that out on its
own.

> > 2. Plex server in a container on amd64 (looking to migrate this to k8s
> > over the holiday).
>
> Why Kubernetes?

I run it 24x7.  This is half an exercise to finally learn and grok
k8s, and half an effort to just develop better container practices in
general.  Right now all my containers run in nspawn which is actually
a very capable engine, but it does nothing for image management, so my
containers are more like pets than cattle.  I want to get to a point
where everything is defined by a few trivially backed-up config files.

One thing I do REALLY prefer with nspawn is its flexibility around
networking.  An nspawn container can use a virtual interface attached
to any bridge, which means you can give them their own IPs, routes,
gateways, VLANs, and so on.  Docker and k8s are pretty decent about
giving containers a way to listen on the network for connection
(especially k8s ingress or load balancers), but they do nothing really
to manage the outbound traffic, which just uses the host network
config.  On a multi-homed network or when you want to run services for
VLANs and so on it seems like a lot of trouble.  Sure, you can go
crazy with iptables and iproute2 and so on, but I used to do that with
non-containerized services and hated it.  With nspawn it is pretty
trivial to set that stuff up and give any container whatever set of
interfaces you want bridged however you want them.  I actually fussed
a little with running a k8s node inside an nspawn container so that I
could just tie pods to nodes to do exotic networking but clusters
inside containers (using microk8s which runs in snapd) was just a
bridge too far...

-- 
Rich

Re: [gentoo-user] NAS and replacing with larger drives

[ralfconn]

On 12/18/22 23:08, Dale wrote:

Mark Knecht wrote:



On Sun, Dec 18, 2022 at 12:20 PM Dale  wrote:

> root@truenas[~]# iperf -s
> 
> Server listening on TCP port 5001
> TCP window size: 64.0 KByte (default)
> 
>
>
> And nothing.  Several minutes later, still nothing.  And it 
continues to sit there.  I don't think it is working.  :/

>
> Still, odds are, whatever it is, I'm not likely going to be able to 
change it.  That poor old CPU just may not have the needed 
instruction set to be really fast for this.  Maybe a different 
encryption would be better.  I dunno.  It's temporary anyway.

>
> And still nothing.  It's been sitting there since I read the last 
message.  Still, nothing.

>
Sadly, you didn't read all of my instructions or apparently read the 
man page or help file


All you've done is start the server which listens for a connection.

Now go to your Gentoo Land machine that you want to backup and execute

iperf -c IP.ADDR.OF.SERVER

Wait 10 seconds and hit ctrl-C



Oh, I read that but didn't get that one worked with the other. Ooops.  
Thing is, I don't have the second command on my Gentoo install.  :/  
It sort of grumbles about that.  May look into that later.  Got other 
things in the air right now.


Dale

$ eix iperf
[I] net-misc/iperf
 Available versions:
 (2)    2.0.14a **2.*l
 (3)    3.12
   {debug ipv6 sctp threads}
 Installed versions:  3.12(3)(10:20:30 AM 10/08/2022)(-sctp)
 Homepage:    https://github.com/esnet/iperf
 Description: A TCP, UDP, and SCTP network bandwidth 
measurement tool

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

Hi Rich

On Mon, Dec 19, 2022 at 6:30 AM Rich Freeman  wrote:

> My current solution is:
> 1. Moosefs for storage: amd64 container for the master, and ARM SBCs
> for the chunkservers which host all the USB3 hard drives.

I'm trying to understand the form factor of what you are mentioning above.
Presumably the chunkservers aren't sitting on a lab bench with USB
drives hanging off of them. Can you point me  toward and example of
what you are using?

I've been considering some of these new mini-computers that have
a couple of 2.5Gb/S Ethernet ports and 3 USB 3 ports but haven't
moved forward because I want it packaged in a single case.

Where does the master reside? In a container on your desktop
machine or is that another element on your network?



> 2. Plex server in a container on amd64 (looking to migrate this to k8s
> over the holiday).

Why Kubernetes? Is the Plex server safer when not being used? How
long does it take to spin up an instance and do the TV apps understand
this operation? Or would it be up and running all the time?

Thanks,
Mark

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Rich Freeman]

On Mon, Dec 19, 2022 at 7:51 AM Wols Lists  wrote:
>
> On 19/12/2022 12:00, Rich Freeman wrote:
> > On Mon, Dec 19, 2022 at 12:11 AM Dale  wrote:
> >> If I like these Raspberry things, may make a media box out of one.  I'd
> >> like to have a remote tho.  
>
> > So, I've done that.  Honestly, these days a Roku is probably the
> > better option, or something like a Google Chromecast or the 47 other
> > variations on this them.
>
> Where do you put that 2TB drive on your Roku or Chromecast?
>
> I'm thinking of building a media server, not to drive the TV, but to
> record and store. I thought that was what a media server was!

So, he said "media box," which I assumed meant the client that
attaches to the TV.  There are some canned solutions for media servers
- I think the NVidia Shield can run Plex server for example.  However,
in general server-side I'd go amd64.

My current solution is:
1. Moosefs for storage: amd64 container for the master, and ARM SBCs
for the chunkservers which host all the USB3 hard drives.  With a
modest number of them performance is very good, though certainly not
as good as Ceph or local storage.  (I do have moosefs in my overlay -
might try to get that into the main repo when I get a chance.)
2. Plex server in a container on amd64 (looking to migrate this to k8s
over the holiday).
3. Rokus or TV apps for the clients.

-- 
Rich

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Wols Lists]

On 19/12/2022 12:00, Rich Freeman wrote:

On Mon, Dec 19, 2022 at 12:11 AM Dale  wrote:

If I like these Raspberry things, may make a media box out of one.  I'd
like to have a remote tho.  



So, I've done that.  Honestly, these days a Roku is probably the
better option, or something like a Google Chromecast or the 47 other
variations on this them.


Where do you put that 2TB drive on your Roku or Chromecast?

I'm thinking of building a media server, not to drive the TV, but to 
record and store. I thought that was what a media server was!


Cheers,
Wol

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Rich Freeman]

On Mon, Dec 19, 2022 at 12:11 AM Dale  wrote:
>
> If I like these Raspberry things, may make a media box out of one.  I'd
> like to have a remote tho.  ;-)

So, I've done that.  Honestly, these days a Roku is probably the
better option, or something like a Google Chromecast or the 47 other
variations on this them.  Keep in mind that low-powered devices like
ARM SBCs (or Rokus) are very picky about codecs.  If you're running
something like Plex the software will offload the transcoding to a
server when the codec isn't supported by the player, but if you're
doing something more DIY then you need to ensure your library conforms
to the specs or your player will just die.  Even 1080p can be pushing
it for software decoding on an ARM SBC, and forget 4k.  Heck, realtime
software transcoding 4k is pretty hard on most amd64 servers as well -
they will do it but it will use a significant amount of CPU just for
one stream.

These days I'm using Pis just for moosefs storage, and all the
compute-heavy stuff is on amd64.  For players I just use TV clients or
Rokus plus Plex server on amd64.  I don't really get any benefit out
of completely DIYing the client side and LIRC is a PITA.

-- 
Rich

Re: [gentoo-user] NAS and replacing with larger drives

[Wols Lists]

On 18/12/2022 22:11, Dale wrote:

Wol wrote:

On 18/12/2022 18:59, Dale wrote:

Since this is local, I just use rsync to do my backups.  I did have to
change the options a bit.  It seems TrueNAS doesn't like some of the
permissions or something.


Are you running the rsync daemon on the NAS? I'm probably teaching
grandma to suck eggs, but that massively reduces the need for network
traffic.

Cheers,
Wol





I mount the NAS on my Gentoo rig.  I mount it under /mnt.  Then I run
rsync and copy from the source to the mount point for the NAS.  I may
could go the other way but never thought about doing it that way.  Kinda
sounds backwards to me but I dunno. ;-)


Sounds to me like you're doing it all wrong either way ...

What is *supposed* to happen is that you have the daemon running on one 
machine and the client on the other - doesn't matter which.


Then the client tells the daemon what files are to be copied, THE TWO 
COMPARE CHECKSUMS, and only the stuff that fails the checksum is copied. 
So if you're doing an incremental backup, network usage and writes are 
kept to a minimum.


I tell people to an in-place backup if they're running on a snapshot 
setup, because again it only writes stuff that has actually changed.


Cheers,
Wol

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Dale]

Rich Freeman wrote:
> On Sun, Dec 18, 2022 at 4:53 PM Dale  wrote:
>> It took some digging around but I found out it is a AMD Phenom 9750 quad
>> core.
> You might want to hook a Kill-a-watt to that and see how much power it
> uses.  Those older AMD processors were really inefficient.
>
> One thing I've come to appreciate with anything that runs 24x7 is to
> consider the energy bill to run things.  That's why the bulk of my
> storage is running on ARM SBCs.  Those things use almost no power when
> idle, while even a modern amd64 system will often use more at idle
> than an ARM will at full load.
>
> Most of the newer CPUs are MUCH better in performance per watt as
> well.  A server that uses just 50W 24x7 costs about $65/yr (and I have
> pretty cheap electricity due to a 1yr contract - odds are it costs
> quite a bit more for most of this list).  That's a fairly significant
> amount of money so it can pay to optimize things, especially if you
> replace what was a power-hungry performance CPU from 10 years ago with
> a lower-end CPU from today that probably has double the performance
> for 10% of the power draw.  Obviously if you want bleeding edge the
> electricity bill won't cover the up-front costs, but lower end CPUs
> are very cost-effective and efficient compared to really old systems
> that people tend to use for these kinds of projects.
>


My UPS has a power meter thing on it which is pretty close.  It shows a
little over 100 watts for rig and monitor to when running.  Given it is
winter time here, I don't mind the extra heat.  It's either the puter or
a heater.  Given the forecast, I'm considering a emerge -e world pretty
soon.  lol  This NAS box won't run 24/7 tho.  I'll run it when I update
backups then shut it down and maybe even move it to a out building. 
Once I build a Raspberry thingy, I may have one as a 24/7 NAS box and
take some load off my main rig.  That I would like to have more
efficiency with.  That's for later tho.  First, I want to build a small
one that will fit in my fire safe.  Of course, I still want a larger
safe so that maybe I can have a 6 bay NAS box.  I wish I could find a
commercial or bank type safe that is used.  If it isn't to heavy. 

I still remember my old AMD 2500+ single core rig.  That thing pulled
over 400 watts idle.  If I was compiling a lot and all the fans were
running plus hard drives were busy, it would pull even more, close to
500 watts or something.  It's been a while but I remember winters were
nice but summers made the A/C run a good bit longer.  Thing is, my
current rig is much faster, likely 10 times faster, and pulls less than
200 watts even if at full power plus I have a LOT more hard drives.  It
goes to show, you can't measure computer power by what it pulls from the
wall.  :-)

If I like these Raspberry things, may make a media box out of one.  I'd
like to have a remote tho.  ;-)

Dale

:-)  :-) 

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Rich Freeman]

On Sun, Dec 18, 2022 at 4:53 PM Dale  wrote:
>
> It took some digging around but I found out it is a AMD Phenom 9750 quad
> core.

You might want to hook a Kill-a-watt to that and see how much power it
uses.  Those older AMD processors were really inefficient.

One thing I've come to appreciate with anything that runs 24x7 is to
consider the energy bill to run things.  That's why the bulk of my
storage is running on ARM SBCs.  Those things use almost no power when
idle, while even a modern amd64 system will often use more at idle
than an ARM will at full load.

Most of the newer CPUs are MUCH better in performance per watt as
well.  A server that uses just 50W 24x7 costs about $65/yr (and I have
pretty cheap electricity due to a 1yr contract - odds are it costs
quite a bit more for most of this list).  That's a fairly significant
amount of money so it can pay to optimize things, especially if you
replace what was a power-hungry performance CPU from 10 years ago with
a lower-end CPU from today that probably has double the performance
for 10% of the power draw.  Obviously if you want bleeding edge the
electricity bill won't cover the up-front costs, but lower end CPUs
are very cost-effective and efficient compared to really old systems
that people tend to use for these kinds of projects.

-- 
Rich

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Sun, Dec 18, 2022 at 03:53:28PM -0600 schrieb Dale:
>
>>> Did you ever tell us the exact CPU you have in there? All I can remember is
>>> it has 4 cores. And some AMD processor with a II in its name, but that was
>>> you main rig, right?
>> It took some digging around but I found out it is a AMD Phenom 9750 quad
>> core.
> Great! That’s a model from 2008:
> https://en.wikipedia.org/wiki/List_of_AMD_Phenom_processors#%22Agena%22_(B2/B3,_65_nm,_Quad-core)
>
>>  It lists some extensions but I don't see any that are related to
>> encryption.  No AES or whatever for sure.  Unless I missed it.  I used
> The instruction set’s original proposal is about as young as your processor:
> https://en.wikipedia.org/wiki/AES_instruction_set
>
>> My main rig has a AMD FX-8350 Eight-Core Processor and 32GBs of memory. 
>> I'm thinking about a new rig eventually.  Rig is getting a little age on
>> it.  ;-) 
> At least it has AES ;-)
> https://en.wikipedia.org/wiki/List_of_AMD_FX_processors#Piledriver_Core_(Vishera,_32_nm)
>
> I’ve been thinking about a new build for about a year now, aiming at a
> power-efficient Ryzen 5700G. But I can’t let go of my trusty old (8 years)
> i5-4590.
>


What worries me, a cap on the mobo deciding to take a long break and let
the stink out.  I checked when I bought it, they do use high dollar caps
but still, they age no matter how well they are made.  I do have a
backup mobo tho.  Current is a Gigabyte 970 but backup is a 870.  It
will even run the same kernel I think. 

I just need to make time to find out where I get the most bang for the
buck.  I read a few weeks ago that Intel is the most cost effective
now.  It used to be that power compared to money that AMD was a much
better deal.  Things have changed.  That's all for another day tho. 
Gotta save up some money.  Likely need about $1,000 or maybe even more. 
I could reuse some things tho.  Mobo, CPU and memory being the big
things I'd need to even start.  Maybe a power supply too.  My P/S is
only a few years old tho.  Fairly modern.  Plenty of watts. 

One of these days. 

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Wol wrote:
> On 18/12/2022 18:59, Dale wrote:
>> Since this is local, I just use rsync to do my backups.  I did have to
>> change the options a bit.  It seems TrueNAS doesn't like some of the
>> permissions or something.
>
> Are you running the rsync daemon on the NAS? I'm probably teaching
> grandma to suck eggs, but that massively reduces the need for network
> traffic.
>
> Cheers,
> Wol
>
>


I mount the NAS on my Gentoo rig.  I mount it under /mnt.  Then I run
rsync and copy from the source to the mount point for the NAS.  I may
could go the other way but never thought about doing it that way.  Kinda
sounds backwards to me but I dunno. ;-)

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sun, Dec 18, 2022 at 12:20 PM Dale  > wrote:
> 
> > root@truenas[~]# iperf -s
> > 
> > Server listening on TCP port 5001
> > TCP window size: 64.0 KByte (default)
> > 
> >
> >
> > And nothing.  Several minutes later, still nothing.  And it
> continues to sit there.  I don't think it is working.  :/
> >
> > Still, odds are, whatever it is, I'm not likely going to be able to
> change it.  That poor old CPU just may not have the needed instruction
> set to be really fast for this.  Maybe a different encryption would be
> better.  I dunno.  It's temporary anyway.
> >
> > And still nothing.  It's been sitting there since I read the last
> message.  Still, nothing.
> >
> Sadly, you didn't read all of my instructions or apparently read the
> man page or help file
>
> All you've done is start the server which listens for a connection.
>
> Now go to your Gentoo Land machine that you want to backup and execute
>
> iperf -c IP.ADDR.OF.SERVER
>
> Wait 10 seconds and hit ctrl-C


Oh, I read that but didn't get that one worked with the other.  Ooops. 
Thing is, I don't have the second command on my Gentoo install.  :/  It
sort of grumbles about that.  May look into that later.  Got other
things in the air right now. 

Dale

:-)  :-) 

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sun, Dec 18, 2022 at 03:53:28PM -0600 schrieb Dale:

> > Did you ever tell us the exact CPU you have in there? All I can remember is
> > it has 4 cores. And some AMD processor with a II in its name, but that was
> > you main rig, right?
>
> It took some digging around but I found out it is a AMD Phenom 9750 quad
> core.

Great! That’s a model from 2008:
https://en.wikipedia.org/wiki/List_of_AMD_Phenom_processors#%22Agena%22_(B2/B3,_65_nm,_Quad-core)

> It lists some extensions but I don't see any that are related to
> encryption.  No AES or whatever for sure.  Unless I missed it.  I used

The instruction set’s original proposal is about as young as your processor:
https://en.wikipedia.org/wiki/AES_instruction_set

> My main rig has a AMD FX-8350 Eight-Core Processor and 32GBs of memory. 
> I'm thinking about a new rig eventually.  Rig is getting a little age on
> it.  ;-) 

At least it has AES ;-)
https://en.wikipedia.org/wiki/List_of_AMD_FX_processors#Piledriver_Core_(Vishera,_32_nm)

I’ve been thinking about a new build for about a year now, aiming at a
power-efficient Ryzen 5700G. But I can’t let go of my trusty old (8 years)
i5-4590.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.
So this unvaccinated man comes in no bar ...


signature.asc
Description: PGP signature

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Sun, Dec 18, 2022 at 01:07:43PM -0600 schrieb Dale:
>
>> See other reply that has more info.  I'm pretty sure it is the
>> encryption maxing out the CPU.
> The most simple benchmark is dd: unlock the LUKS layer on your HDD. then
> first read from the HDD directly and then from the LUKS device:
>
> dd if= of=/dev/null bs=1M count=1000
> dd if= of=/dev/null bs=1M count=1000
>
> It will tell you the transfer rate in MB/s.

One thing about it, the speed is likely what its going to be.  Whether
it is the encryption or whatever, it is what it is.  It did improve a
little with the 1GB network card but not a whole lot.

>> Mostly, I need a better CPU.  If I encrypt anyway. 
> Did you ever tell us the exact CPU you have in there? All I can remember is
> it has 4 cores. And some AMD processor with a II in its name, but that was
> you main rig, right?
>


It took some digging around but I found out it is a AMD Phenom 9750 quad
core.  It lists some extensions but I don't see any that are related to
encryption.  No AES or whatever for sure.  Unless I missed it.  I used
the command cpuid to get this info on BSD.

My main rig has a AMD FX-8350 Eight-Core Processor and 32GBs of memory. 
I'm thinking about a new rig eventually.  Rig is getting a little age on
it.  ;-) 

Dale

:-)  :-) 

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sun, Dec 18, 2022 at 01:30:45PM -0700 schrieb Mark Knecht:

> I don't know how to get the CPU flags on FreeBSD nor
> how to determine if encryption is hardware or software
> based on TrueNAS. Given some time I might Google
> that.

Wikipedia has lists of practically everything:
https://en.wikipedia.org/wiki/List_of_AMD_processors
(We just need to know on which to click ;-) )

Another good source for such stuff is https://www.cpu-world.com/ .

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

Remember: now are the good old times
which you will be raving about in ten year’s time.


signature.asc
Description: PGP signature

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

sysctl hw

SNIP>

sudo dmidecode -t processor -t cache

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 1:07 PM Rich Freeman  wrote:
>
> On Sun, Dec 18, 2022 at 2:30 PM Frank Steinmetzger  wrote:
> >
> > Am Sun, Dec 18, 2022 at 01:07:43PM -0600 schrieb Dale:
> >
> > > Mostly, I need a better CPU.  If I encrypt anyway.
> >
> > Did you ever tell us the exact CPU you have in there? All I can
remember is
> > it has 4 cores. And some AMD processor with a II in its name, but that
was
> > you main rig, right?
>
> What encryption algorithm are you using?  You should see if this is
> hardware-accelerated in the kernel for your CPU, or if not if there is
> another strong algorithm which is.  Most newer CPUs will tend to have
> hardware support for algorithms like AES, and the kernel will use
> this.  This will greatly improve CPU performance.
>
> I've run into this issue with zfs on Raspberry Pis.  ZFS does the
> encryption internally, and the openzfs code didn't have support for
> ARM hardware encryption the last time I checked (this could have
> changed).  I found that dm-crypt works MUCH better on Pis as a result,
> as the kernel does have ARM encryption hardware support.
>
> Again, this all depends on the algorithm.  If you're using something
> exotic odds are the hardware won't handle it natively.
>
> --
> Rich

Great background info Rich. Thanks.

If Dale would supply us with the first few lines of the following command I
think it would help

mark@truenas1:~ $ sysctl hw
hw.machine: amd64
hw.model: Intel(R) Core(TM) i3-2120 CPU @ 3.30GHz
hw.ncpu: 4


Note that hw.ncpu isn't actually cores but rather threads. My
processor has just 2 cores.

I don't know how to get the CPU flags on FreeBSD nor
how to determine if encryption is hardware or software
based on TrueNAS. Given some time I might Google
that.

Cheers,
Mark

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Rich Freeman]

On Sun, Dec 18, 2022 at 2:30 PM Frank Steinmetzger  wrote:
>
> Am Sun, Dec 18, 2022 at 01:07:43PM -0600 schrieb Dale:
>
> > Mostly, I need a better CPU.  If I encrypt anyway.
>
> Did you ever tell us the exact CPU you have in there? All I can remember is
> it has 4 cores. And some AMD processor with a II in its name, but that was
> you main rig, right?

What encryption algorithm are you using?  You should see if this is
hardware-accelerated in the kernel for your CPU, or if not if there is
another strong algorithm which is.  Most newer CPUs will tend to have
hardware support for algorithms like AES, and the kernel will use
this.  This will greatly improve CPU performance.

I've run into this issue with zfs on Raspberry Pis.  ZFS does the
encryption internally, and the openzfs code didn't have support for
ARM hardware encryption the last time I checked (this could have
changed).  I found that dm-crypt works MUCH better on Pis as a result,
as the kernel does have ARM encryption hardware support.

Again, this all depends on the algorithm.  If you're using something
exotic odds are the hardware won't handle it natively.

-- 
Rich

Re: [gentoo-user] NAS and replacing with larger drives

[Wol]

On 18/12/2022 18:59, Dale wrote:

Since this is local, I just use rsync to do my backups.  I did have to
change the options a bit.  It seems TrueNAS doesn't like some of the
permissions or something.


Are you running the rsync daemon on the NAS? I'm probably teaching 
grandma to suck eggs, but that massively reduces the need for network 
traffic.


Cheers,
Wol

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sun, Dec 18, 2022 at 01:07:43PM -0600 schrieb Dale:

> See other reply that has more info.  I'm pretty sure it is the
> encryption maxing out the CPU.

The most simple benchmark is dd: unlock the LUKS layer on your HDD. then
first read from the HDD directly and then from the LUKS device:

dd if= of=/dev/null bs=1M count=1000
dd if= of=/dev/null bs=1M count=1000

It will tell you the transfer rate in MB/s.

> Mostly, I need a better CPU.  If I encrypt anyway. 

Did you ever tell us the exact CPU you have in there? All I can remember is
it has 4 cores. And some AMD processor with a II in its name, but that was
you main rig, right?

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

It's not a bug, it's tradition!


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 12:20 PM Dale  wrote:

> root@truenas[~]# iperf -s
> 
> Server listening on TCP port 5001
> TCP window size: 64.0 KByte (default)
> 
>
>
> And nothing.  Several minutes later, still nothing.  And it continues to
sit there.  I don't think it is working.  :/
>
> Still, odds are, whatever it is, I'm not likely going to be able to
change it.  That poor old CPU just may not have the needed instruction set
to be really fast for this.  Maybe a different encryption would be better.
I dunno.  It's temporary anyway.
>
> And still nothing.  It's been sitting there since I read the last
message.  Still, nothing.
>
Sadly, you didn't read all of my instructions or apparently read the man
page or help file

All you've done is start the server which listens for a connection.

Now go to your Gentoo Land machine that you want to backup and execute

iperf -c IP.ADDR.OF.SERVER

Wait 10 seconds and hit ctrl-C

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 12:08 PM Dale  wrote:

> I just might find a simple distro that I can install on that thing.
Honestly, I don't really care what is on it as long as it does what I want
and I can figure out how to make it work easily enough.


Consider Ubuntu Server. It's text only and will likely have everything you
need to start other than the NFS server which is easy enough to install.
ssh is on it by default,

You will need a monitor to install.

Update after install is probably two commands which is more or less
equivalent to emerge -DuN world but takes only a couple of minutes.

sudo apt update
sudo apt upgrade

There are lots of web pages that will tell you how to install and configure
the NFS server. It's not hard and only necessary if you actually want to
create mounts. Not necessary for rsync.

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sun, Dec 18, 2022 at 11:39 AM Dale  > wrote:
> >
> 
> >
> > I suspect it has something to do with this being a older system.  I
> > wouldn't be surprised if the SATA was a older and slower version.  I
> > guess I could google it.
> >
> You need to study your specs. Even the first version of SATA, SATA 1,
> was capable of 150MB/S. SATA2 does 300MB/S. This is unlikely IMO
> to be due to SATA specs. 
>
> Have you run iperf yet as I suggested? It will easily tell you what the 
> network performance is and takes 5 seconds in NGL.

I ran it but it never returned anything.  I let it sit for at least a
minute but it just sat there.  I don't have that command on my Gentoo
rig.  This is what it did on the NAS box.


root@truenas[~]# iperf -s

Server listening on TCP port 5001
TCP window size: 64.0 KByte (default)



And nothing.  Several minutes later, still nothing.  And it continues to
sit there.  I don't think it is working.  :/

Still, odds are, whatever it is, I'm not likely going to be able to
change it.  That poor old CPU just may not have the needed instruction
set to be really fast for this.  Maybe a different encryption would be
better.  I dunno.  It's temporary anyway. 

And still nothing.  It's been sitting there since I read the last
message.  Still, nothing. 

Dale

:-)  :-) 

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sun, Dec 18, 2022 at 8:49 AM Jack  > wrote:
> >
> > On 12/18/22 10:38, Mark Knecht wrote:
> > > Wipe the machine and start over with Gentoo from scratch...
> > > Wipe the machine and start over with Gentoo from scratch...
> > > Humm, I think you should...
> > > Wipe the machine and start over with Gentoo from scratch...
> >
> > First there was Linux from Scratch.
> >
> > Next came Beyond Linux from Scratch.
> >
> > Then there was Gentoo.
> >
> > Now, the latest, greatest installment: Gentoo from Scratch.
> >
>
> Gawd, that's funny! Thanks for making me smile, assuming I found what
> you're talking about:
>
> https://wiki.gentoo.org/wiki/Gentoo_ebuild_tree_from_scratch
>
> Just what every Gentoo user needs. More management!
>
> I really have fallen off the deep end thinking computers are just
> tools to get a job done. I'm ashamed of myself...
>
> In the really early days of Gentoo circa 2003 when I started there was
> some choice about regular Gentoo or a really low level install. I
> failed with the low level one but soon learned that every package on
> my machine was going to get rebuilt anyway so why bother?
>
> :-( Sad Mark. I'm a putz...

It is connected properly.  Everything I have is 1GB now.  When I got
fiber internet, I had to upgrade everything.  With the old DSL, well,
even a 10MB card would have worked.  lol 

See other reply that has more info.  I'm pretty sure it is the
encryption maxing out the CPU.  It's really the only thing that is
working hard.  Everything else seems to be doing more waiting than
anything. 

I just might find a simple distro that I can install on that thing. 
Honestly, I don't really care what is on it as long as it does what I
want and I can figure out how to make it work easily enough.  Still, I
wouldn't want Gentoo on a rig that slow.  I wouldn't have GUI stuff like
KDE, Firefox, libreoffice on it so that would save a lot of time but
still, even a headless machine would require some compile times.  Heck,
Ubuntu, Arch or any number of other distros would likely work just
fine.  Mostly, I need a better CPU.  If I encrypt anyway. 

This will work for the time being.  Now that I figured out how to make
it work.  ROFL

Dale

:-) 

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Jack]

On 2022.12.18 11:17, Mark Knecht wrote:

On Sun, Dec 18, 2022 at 8:49 AM Jack 
wrote:
>
> On 12/18/22 10:38, Mark Knecht wrote:
> > Wipe the machine and start over with Gentoo from scratch...
> > Wipe the machine and start over with Gentoo from scratch...
> > Humm, I think you should...
> > Wipe the machine and start over with Gentoo from scratch...
>
> First there was Linux from Scratch.
>
> Next came Beyond Linux from Scratch.
>
> Then there was Gentoo.
>
> Now, the latest, greatest installment: Gentoo from Scratch.
>

Gawd, that's funny! Thanks for making me smile, assuming I found what
you're talking about:

https://wiki.gentoo.org/wiki/Gentoo_ebuild_tree_from_scratch

I actually hadn't seen that, but it fits.


Just what every Gentoo user needs. More management!

I really have fallen off the deep end thinking computers are just  
tools to get a job done. I'm ashamed of myself...
I've long said that many folks have computers to play games, but for  
me, the computer IS the game.


In the really early days of Gentoo circa 2003 when I started there  
was some choice about regular Gentoo or a really low level install. I  
failed with the low level one but soon learned that every package on  
my machine was going to get rebuilt anyway so why bother?


:-( Sad Mark. I'm a putz...

Jack

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Sun, Dec 18, 2022 at 09:12:37AM -0600 schrieb Dale:
>
>>> On Sat, Dec 17, 2022 at 4:42 PM Dale >> > wrote:
>>> 
 My reasoning is simple, I'm already familiar with LVM and how to
>>> manage it.  
>>> 
>>> […]
>>> Wipe the machine. You'll be happier.
>>>
>>> Best wishes,
>>> Mark
>> Well, I finally got it so I could do a backup.  I didn't need a hammer
>> but the thought crossed my mind.  lol  Even tho I now have a 1GB network
>> card, it's still really slow.  It shows up as a 1GB connection on both
>> my Gentoo machine and the NAS machine.  This is a example of the speeds
>> I'm seeing.  Just snippets. 
>>
>>
>> 277,193,507 100%   16.18MB/s    0:00:16
>> 519,216,571 100%   18.86MB/s    0:00:26
>> 738,078,565 100%   23.54MB/s    0:00:29
>>
>>
>> As you can see, the files sizes are large enough it should do better. 
> Gbit nets at around 116..117 MB/s.
>
>> When I use iftop, it shows it isn't doing anywhere near the speed it
>> should, maybe 1/4th or so.  I'd expect at least double or triple that
>> speed.  In all honesty, I'd think the hard drive would be the limiting
>> factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
>> encrypted drives.  I think the encryption slows that down.  When copying
>> from a plain drive to a plain drive, I get 100MBs/sec or so. 
>>
>> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
>> and 8GBs of memory.
> OK, so you already noticed that encryption slows you down. This won’t happen
> with a CPU that has AES instructions (well, and if the encryption you chose
> actually uses AES, and not something else like Blowfish). So I guess your
> CPU is too old, given your earlier descriptions.
>
> When I built my NAS in November 2016, I installed a Celeron G1840 at first.
> A very affordable (33 €) and frugal CPU (2 cores, 53 W, which were never
> actually drawn). I knew it didn’t have AES back then (Intel removed that
> limit from Celerons in architectures after Haswell), but from experiments I
> knew it would achieve around 150..160 MB/s with LUKS, which was enough for
> Gbit ethernet. But not for scrubs, when all HDDs were worked in parallel. So
> after a year I did an upgrade after all and bought the smallest and cheapest
> CPU that had AES, an i3-41xx.
>
>> It should have enough horsepower under the hood. 
>> Maybe it is something I'm not aware of.  It is a older rig so maybe it
>> isn't SATA's fastest version, maybe even the original or something.  I
> SATA 2 is 3 Gbit/s, so still not saturated by a single HDD.

This could be a SATA 1.  I don't recall the speed of that.  Thing is,
when I go to a console and use htop, it shows the CPU is maxed out most
of the time.  It kinda gets busy for a good bit, idle for a short time
then back to close to 100%.  It has plenty of memory even tho it is
caching a lot in memory.  It shows less than 1GB actually used by the
system itself, not including cache tho.  With that info, I suspect the
CPU is the bottleneck.  It's the only thing that is showing heavy
usage.  This may have nothing to do with SATA.  I suspect it is the
encryption that really hits the CPU hard.  Also, the CPU temp is good
too.  I replaced the stock cooler with a larger model.  I think it is
running around 100F or so. I don't think temps are a issue. 


>
> Network transfers are single-core work. If it is really such an old machine,
> I guess the CPU is the bottleneck again. Do you transfer via ssh? If so, use
> something else that doesn’t encrypt the transport stream. When I am bound by
> CPU in such cases (like with my ancient netbook with an Atom N450), and I
> don’t want to set up a file server (that is nowhere near as flexible as ssh
> anyways), I use netcat:
>
> On the receiving end, start a netcat listener and extract from it:
> nc -l -p $Portnumber | tar xf -
> The portnumber must be any number above 1024, if you’re not root.
>
> And on the sender, pack all your stuff into a tar (uncompressed!, since
> videos aren’t compressible further and it will bog down the CPU again) and
> pipe it to the receiver:
> tar cf - * | nc $Destination_IP $Portnumber
>
> Once the client is done, press Ctrl+C on the receiver.
>
> Or maybe use rsync with the rsync-protocol instead of ssh. That’ll be more
> flexible, because the tar-and-nc method doesn’t know about existing files on
> the receiving end. (But I’ve never tested that approach.)
>

Since this is local, I just use rsync to do my backups.  I did have to
change the options a bit.  It seems TrueNAS doesn't like some of the
permissions or something.  Anyway, I found a way that works.  As I
mentioned above, I think this is a CPU issue.  It does show that I need
to see how encryption will work with the CPU on a Raspberry Pi tho. 
Maybe the newer ones will have the needed support and not cause problems. 

While at it, the dashboard CPU info doesn't really show the CPU maxing
out as well as htop does.  If someone thinks their TrueNAS box 

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sun, Dec 18, 2022 at 12:38:45PM -0600 schrieb Dale:

> I suspect it has something to do with this being a older system.

Very likely. :)

> I wouldn't be surprised if the SATA was a older and slower version.

I hate to repeat myself, but no. Here are the speeds of SATA:

Generation   Year   Gross bandwidth   Net bandwidth
-
SATA 1   2003 1.5 Gbps1.2 Gbps (150 MB/s)
SATA 2   2004 3.0 Gbps2.4 Gbps (300 MB/s)
SATA 3   2008 6.0 Gbps4.8 Gbps (600 MB/s)

Even SATA 1 is faster than your new ethernet card.

> I guess I could google it. 

My source (as most often): https://en.wikipedia.org/wiki/SATA
If you know the name of a technical thing, the quickest way to concise
facts is wikipedia.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

The stupid keep tidy.  The genius controls chaos.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 11:39 AM Dale  wrote:
>

>
> I suspect it has something to do with this being a older system.  I
> wouldn't be surprised if the SATA was a older and slower version.  I
> guess I could google it.
>
You need to study your specs. Even the first version of SATA, SATA 1,
was capable of 150MB/S. SATA2 does 300MB/S. This is unlikely IMO
to be due to SATA specs.

Have you run iperf yet as I suggested? It will easily tell you what the
network performance is and takes 5 seconds in NGL.

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Michael wrote:
> On Sunday, 18 December 2022 15:12:37 GMT Dale wrote:
>> Mark Knecht wrote:
>>> On Sat, Dec 17, 2022 at 4:42 PM Dale >> > wrote:
>>> 
>>>
 My reasoning is simple, I'm already familiar with LVM and how to
>>> manage it.  
>>> 
>>>
>>> Take the machine, wipe it and build a NAS from scratch with Gentoo. If
>>> all you want is an NFS mount that won't be difficult. Add an NFS
>>> server, export your mount and you're done, right? Managing it over the
>>> long term will be far more work than TrueNAS but you will be
>>> comfortable with changing disks and adding network cards which
>>> is important to you. Life is too short to deal with things you really
>>> don't enjoy.
>>>
>>> I would not suggest you look at Ubuntu Server because it's NGL. 10
>>> minutes to install, 3 minutes to figure out how to add the NFS server.
>>> However it's a different package manager and truly not as nice as
>>> emerge/portage so you probably won't like that part of NGL either. I
>>> truly don't like apt, but it works if I stay in my lane so I've
>>> learned to do that, the advantage being I've never had to build a
>>> package from scratch and I've never in 5 or 6 years had an update fail.
>>>
>>> Wipe the machine. You'll be happier.
>>>
>>> Best wishes,
>>> Mark
>> Well, I finally got it so I could do a backup.  I didn't need a hammer
>> but the thought crossed my mind.  lol  Even tho I now have a 1GB network
>> card, it's still really slow.  It shows up as a 1GB connection on both
>> my Gentoo machine and the NAS machine.  This is a example of the speeds
>> I'm seeing.  Just snippets. 
>>
>>
>> 277,193,507 100%   16.18MB/s0:00:16
>> 519,216,571 100%   18.86MB/s0:00:26
>> 738,078,565 100%   23.54MB/s0:00:29
>>
>>
>> As you can see, the files sizes are large enough it should do better. 
>> When I use iftop, it shows it isn't doing anywhere near the speed it
>> should, maybe 1/4th or so.  I'd expect at least double or triple that
>> speed.  In all honesty, I'd think the hard drive would be the limiting
>> factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
>> encrypted drives.  I think the encryption slows that down.  When copying
>> from a plain drive to a plain drive, I get 100MBs/sec or so. 
>>
>> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
>> and 8GBs of memory.  It should have enough horsepower under the hood. 
>> Maybe it is something I'm not aware of.  It is a older rig so maybe it
>> isn't SATA's fastest version, maybe even the original or something.  I
>> can't find anything in lspci or dmesg so not real sure where to look on
>> BSD. 
>>
>> Anyway, it's progress for now at least.  ;-)  At this rate, it'll be
>> done in about a week, maybe.  o_O
>>
>> Dale
>>
>> :-)  :-) 
> Has it auto-negotiated a full-duplex connection at 1Gbps?  Run ifconfig and 
> check the output, it should say something like:
>
> media: Ethernet autoselect (1000baseT )
>
> If not, then you may need to set this up manually.

Mine says that here too. 


media: Ethernet autoselect (1000baseT )


You know, it's not that easy to copy that from a console on BSD.  It was
kind enough to give me a hint on how tho.  ;-) 

I was pretty sure it was at full speed.  In iftop it showed it was a 1GB
connection, just not using much of it. 

I suspect it has something to do with this being a older system.  I
wouldn't be surprised if the SATA was a older and slower version.  I
guess I could google it. 

Dale

:-)  :-) 



signature.asc
Description: OpenPGP digital signature

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
and 8GBs of memory.  It should have enough horsepower under the hood.
Maybe it is something I'm not aware of.  It is a older rig so maybe it
isn't SATA's fastest version, maybe even the original or something.  I
can't find anything in lspci or dmesg so not real sure where to look on
BSD.


Mine is similar. It's an i3-2120 which is 2 core, 4 threads with 8GB of
DRAM. The NIC is on the motherboard and I don't remember what motherboard I
bought. It was used and cost my about $50.

Re: [gentoo-user] NAS and replacing with larger drives

[Wol]

On 18/12/2022 15:12, Dale wrote:
I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU 
and 8GBs of memory.  It should have enough horsepower under the hood.  
Maybe it is something I'm not aware of.  It is a older rig so maybe it 
isn't SATA's fastest version, maybe even the original or something.  I 
can't find anything in lspci or dmesg so not real sure where to look on 
BSD.


What's the path between systems? Are they both plugged into the same 
gigabit router? Have you got a switch or something in there? I've heard 
pretty bad things about switches and lowest common denominator and 
messing up your speeds ...


Cheers,
Wol

Re: Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 8:49 AM Jack 
wrote:
>
> On 12/18/22 10:38, Mark Knecht wrote:
> > Wipe the machine and start over with Gentoo from scratch...
> > Wipe the machine and start over with Gentoo from scratch...
> > Humm, I think you should...
> > Wipe the machine and start over with Gentoo from scratch...
>
> First there was Linux from Scratch.
>
> Next came Beyond Linux from Scratch.
>
> Then there was Gentoo.
>
> Now, the latest, greatest installment: Gentoo from Scratch.
>

Gawd, that's funny! Thanks for making me smile, assuming I found what
you're talking about:

https://wiki.gentoo.org/wiki/Gentoo_ebuild_tree_from_scratch

Just what every Gentoo user needs. More management!

I really have fallen off the deep end thinking computers are just tools to
get a job done. I'm ashamed of myself...

In the really early days of Gentoo circa 2003 when I started there was some
choice about regular Gentoo or a really low level install. I failed with
the low level one but soon learned that every package on my machine was
going to get rebuilt anyway so why bother?

:-( Sad Mark. I'm a putz...

Living in NGL: was: [gentoo-user] NAS and replacing with larger drives

[Jack]

On 12/18/22 10:38, Mark Knecht wrote:

Wipe the machine and start over with Gentoo from scratch...
Wipe the machine and start over with Gentoo from scratch...
Humm, I think you should...
Wipe the machine and start over with Gentoo from scratch...


First there was Linux from Scratch.

Next came Beyond Linux from Scratch.

Then there was Gentoo.

Now, the latest, greatest installment: Gentoo from Scratch.

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 8:29 AM Mark Knecht  wrote:
>
>
>
> On Sun, Dec 18, 2022 at 8:13 AM Dale  wrote:
> >
> > Well, I finally got it so I could do a backup.  I didn't need a hammer
but the thought crossed my mind.  lol  Even tho I now have a 1GB network
card, it's still really slow.  It shows up as a 1GB connection on both my
Gentoo machine and the NAS machine.  This is a example of the speeds I'm
seeing.  Just snippets.
> >
> >
> > 277,193,507 100%   16.18MB/s0:00:16
> > 519,216,571 100%   18.86MB/s0:00:26
> > 738,078,565 100%   23.54MB/s0:00:29
> >
> >
> > As you can see, the files sizes are large enough it should do better.
When I use iftop, it shows it isn't doing anywhere near the speed it
should, maybe 1/4th or so.  I'd expect at least double or triple that
speed.  In all honesty, I'd think the hard drive would be the limiting
factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
encrypted drives.  I think the encryption slows that down.  When copying
from a plain drive to a plain drive, I get 100MBs/sec or so.
> >
> > I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
and 8GBs of memory.  It should have enough horsepower under the hood.
Maybe it is something I'm not aware of.  It is a older rig so maybe it
isn't SATA's fastest version, maybe even the original or something.  I
can't find anything in lspci or dmesg so not real sure where to look on BSD.
> >
> > Anyway, it's progress for now at least.  ;-)  At this rate, it'll be
done in about a week, maybe.  o_O
> >
> > Dale
> >
>
> To what end Dale? Aren't you painting yourself into a corner with a
system you don't really want to run? Wipe the machine and start over from
scratch with Gentoo.
>
> From my vantage point you don't provide enough information for me to make
an educated guess.
>
> 1) Is your data coming off the host machine able to transfer to other
machines at 1Gb/S type speeds?
>
> 2) Can data coming off of your NAS transfer to other machines at 1G/S
type speeds?
>
> 3) How are the two machines connected? If they are going through a router
or hub, do you know that hub doesn't limit throughput?
>
> 4) Is anything else happening on the network? Video flowing around while
people are watching TV or something?
>
> 5) CPU horsepower isn't the only potential bottleneck. Are your disks in
the NAS operating slowly? Are you running out of memory?
>
>Have you considered running something like iperf?
>
> Mark

Run iperf -s in the TrueNAS shell service in the GUI

>From you Gentoo Land box run

mark@science2:~$ iperf -c truenas1

Client connecting to truenas1, TCP port 5001
TCP window size: 85.0 KByte (default)

[  1] local 192.168.86.43 port 50710 connected with 192.168.86.92 port 5001
[ ID] Interval   Transfer Bandwidth
[  1] 0.-10.0418 sec  1.07 GBytes   918 Mbits/sec
mark@science2:~$

Then immediately wipe the machine and start over with Gentoo, or at least
start over with the Linux version of TrueNAS.

I would have used the Linux version if it had existed when I built the
machine. I don't love BSD, but not because it doesn't work but because
certain CLI tools have slightly different options.

Wipe the machine and start over with Gentoo from scratch...
Wipe the machine and start over with Gentoo from scratch...
Humm, I think you should...
Wipe the machine and start over with Gentoo from scratch...

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 18, 2022 at 8:13 AM Dale  wrote:
>
> Well, I finally got it so I could do a backup.  I didn't need a hammer
but the thought crossed my mind.  lol  Even tho I now have a 1GB network
card, it's still really slow.  It shows up as a 1GB connection on both my
Gentoo machine and the NAS machine.  This is a example of the speeds I'm
seeing.  Just snippets.
>
>
> 277,193,507 100%   16.18MB/s0:00:16
> 519,216,571 100%   18.86MB/s0:00:26
> 738,078,565 100%   23.54MB/s0:00:29
>
>
> As you can see, the files sizes are large enough it should do better.
When I use iftop, it shows it isn't doing anywhere near the speed it
should, maybe 1/4th or so.  I'd expect at least double or triple that
speed.  In all honesty, I'd think the hard drive would be the limiting
factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
encrypted drives.  I think the encryption slows that down.  When copying
from a plain drive to a plain drive, I get 100MBs/sec or so.
>
> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
and 8GBs of memory.  It should have enough horsepower under the hood.
Maybe it is something I'm not aware of.  It is a older rig so maybe it
isn't SATA's fastest version, maybe even the original or something.  I
can't find anything in lspci or dmesg so not real sure where to look on
BSD.
>
> Anyway, it's progress for now at least.  ;-)  At this rate, it'll be done
in about a week, maybe.  o_O
>
> Dale
>

To what end Dale? Aren't you painting yourself into a corner with a system
you don't really want to run? Wipe the machine and start over from scratch
with Gentoo.

>From my vantage point you don't provide enough information for me to make
an educated guess.

1) Is your data coming off the host machine able to transfer to other
machines at 1Gb/S type speeds?

2) Can data coming off of your NAS transfer to other machines at 1G/S type
speeds?

3) How are the two machines connected? If they are going through a router
or hub, do you know that hub doesn't limit throughput?

4) Is anything else happening on the network? Video flowing around while
people are watching TV or something?

5) CPU horsepower isn't the only potential bottleneck. Are your disks in
the NAS operating slowly? Are you running out of memory?

   Have you considered running something like iperf?

Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sun, Dec 18, 2022 at 09:12:37AM -0600 schrieb Dale:

> > On Sat, Dec 17, 2022 at 4:42 PM Dale  > > wrote:
> > 
> > >
> > > My reasoning is simple, I'm already familiar with LVM and how to
> > manage it.  
> > 
> > […]
> > Wipe the machine. You'll be happier.
> >
> > Best wishes,
> > Mark
>
> Well, I finally got it so I could do a backup.  I didn't need a hammer
> but the thought crossed my mind.  lol  Even tho I now have a 1GB network
> card, it's still really slow.  It shows up as a 1GB connection on both
> my Gentoo machine and the NAS machine.  This is a example of the speeds
> I'm seeing.  Just snippets. 
> 
> 
> 277,193,507 100%   16.18MB/s    0:00:16
> 519,216,571 100%   18.86MB/s    0:00:26
> 738,078,565 100%   23.54MB/s    0:00:29
> 
> 
> As you can see, the files sizes are large enough it should do better. 

Gbit nets at around 116..117 MB/s.

> When I use iftop, it shows it isn't doing anywhere near the speed it
> should, maybe 1/4th or so.  I'd expect at least double or triple that
> speed.  In all honesty, I'd think the hard drive would be the limiting
> factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
> encrypted drives.  I think the encryption slows that down.  When copying
> from a plain drive to a plain drive, I get 100MBs/sec or so. 
>
> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
> and 8GBs of memory.

OK, so you already noticed that encryption slows you down. This won’t happen
with a CPU that has AES instructions (well, and if the encryption you chose
actually uses AES, and not something else like Blowfish). So I guess your
CPU is too old, given your earlier descriptions.

When I built my NAS in November 2016, I installed a Celeron G1840 at first.
A very affordable (33 €) and frugal CPU (2 cores, 53 W, which were never
actually drawn). I knew it didn’t have AES back then (Intel removed that
limit from Celerons in architectures after Haswell), but from experiments I
knew it would achieve around 150..160 MB/s with LUKS, which was enough for
Gbit ethernet. But not for scrubs, when all HDDs were worked in parallel. So
after a year I did an upgrade after all and bought the smallest and cheapest
CPU that had AES, an i3-41xx.

> It should have enough horsepower under the hood. 
> Maybe it is something I'm not aware of.  It is a older rig so maybe it
> isn't SATA's fastest version, maybe even the original or something.  I

SATA 2 is 3 Gbit/s, so still not saturated by a single HDD.

Network transfers are single-core work. If it is really such an old machine,
I guess the CPU is the bottleneck again. Do you transfer via ssh? If so, use
something else that doesn’t encrypt the transport stream. When I am bound by
CPU in such cases (like with my ancient netbook with an Atom N450), and I
don’t want to set up a file server (that is nowhere near as flexible as ssh
anyways), I use netcat:

On the receiving end, start a netcat listener and extract from it:
nc -l -p $Portnumber | tar xf -
The portnumber must be any number above 1024, if you’re not root.

And on the sender, pack all your stuff into a tar (uncompressed!, since
videos aren’t compressible further and it will bog down the CPU again) and
pipe it to the receiver:
tar cf - * | nc $Destination_IP $Portnumber

Once the client is done, press Ctrl+C on the receiver.

Or maybe use rsync with the rsync-protocol instead of ssh. That’ll be more
flexible, because the tar-and-nc method doesn’t know about existing files on
the receiving end. (But I’ve never tested that approach.)

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

You sould borrow money only from pessimists, because they don’t expect it back.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Michael]

On Sunday, 18 December 2022 15:12:37 GMT Dale wrote:
> Mark Knecht wrote:
> > On Sat, Dec 17, 2022 at 4:42 PM Dale  > > wrote:
> > 
> > 
> > > My reasoning is simple, I'm already familiar with LVM and how to
> > 
> > manage it.  
> > 
> > 
> > Take the machine, wipe it and build a NAS from scratch with Gentoo. If
> > all you want is an NFS mount that won't be difficult. Add an NFS
> > server, export your mount and you're done, right? Managing it over the
> > long term will be far more work than TrueNAS but you will be
> > comfortable with changing disks and adding network cards which
> > is important to you. Life is too short to deal with things you really
> > don't enjoy.
> > 
> > I would not suggest you look at Ubuntu Server because it's NGL. 10
> > minutes to install, 3 minutes to figure out how to add the NFS server.
> > However it's a different package manager and truly not as nice as
> > emerge/portage so you probably won't like that part of NGL either. I
> > truly don't like apt, but it works if I stay in my lane so I've
> > learned to do that, the advantage being I've never had to build a
> > package from scratch and I've never in 5 or 6 years had an update fail.
> > 
> > Wipe the machine. You'll be happier.
> > 
> > Best wishes,
> > Mark
> 
> Well, I finally got it so I could do a backup.  I didn't need a hammer
> but the thought crossed my mind.  lol  Even tho I now have a 1GB network
> card, it's still really slow.  It shows up as a 1GB connection on both
> my Gentoo machine and the NAS machine.  This is a example of the speeds
> I'm seeing.  Just snippets. 
> 
> 
> 277,193,507 100%   16.18MB/s0:00:16
> 519,216,571 100%   18.86MB/s0:00:26
> 738,078,565 100%   23.54MB/s0:00:29
> 
> 
> As you can see, the files sizes are large enough it should do better. 
> When I use iftop, it shows it isn't doing anywhere near the speed it
> should, maybe 1/4th or so.  I'd expect at least double or triple that
> speed.  In all honesty, I'd think the hard drive would be the limiting
> factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
> encrypted drives.  I think the encryption slows that down.  When copying
> from a plain drive to a plain drive, I get 100MBs/sec or so. 
> 
> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
> and 8GBs of memory.  It should have enough horsepower under the hood. 
> Maybe it is something I'm not aware of.  It is a older rig so maybe it
> isn't SATA's fastest version, maybe even the original or something.  I
> can't find anything in lspci or dmesg so not real sure where to look on
> BSD. 
> 
> Anyway, it's progress for now at least.  ;-)  At this rate, it'll be
> done in about a week, maybe.  o_O
> 
> Dale
> 
> :-)  :-) 

Has it auto-negotiated a full-duplex connection at 1Gbps?  Run ifconfig and 
check the output, it should say something like:

media: Ethernet autoselect (1000baseT )

If not, then you may need to set this up manually.

signature.asc
Description: This is a digitally signed message part.

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sat, Dec 17, 2022 at 4:42 PM Dale  > wrote:
> 
> >
> > My reasoning is simple, I'm already familiar with LVM and how to
> manage it.  
> 
>
> Take the machine, wipe it and build a NAS from scratch with Gentoo. If
> all you want is an NFS mount that won't be difficult. Add an NFS
> server, export your mount and you're done, right? Managing it over the
> long term will be far more work than TrueNAS but you will be
> comfortable with changing disks and adding network cards which
> is important to you. Life is too short to deal with things you really
> don't enjoy.
>
> I would not suggest you look at Ubuntu Server because it's NGL. 10
> minutes to install, 3 minutes to figure out how to add the NFS server.
> However it's a different package manager and truly not as nice as
> emerge/portage so you probably won't like that part of NGL either. I
> truly don't like apt, but it works if I stay in my lane so I've
> learned to do that, the advantage being I've never had to build a
> package from scratch and I've never in 5 or 6 years had an update fail.
>
> Wipe the machine. You'll be happier.
>
> Best wishes,
> Mark


Well, I finally got it so I could do a backup.  I didn't need a hammer
but the thought crossed my mind.  lol  Even tho I now have a 1GB network
card, it's still really slow.  It shows up as a 1GB connection on both
my Gentoo machine and the NAS machine.  This is a example of the speeds
I'm seeing.  Just snippets. 


277,193,507 100%   16.18MB/s    0:00:16
519,216,571 100%   18.86MB/s    0:00:26
738,078,565 100%   23.54MB/s    0:00:29


As you can see, the files sizes are large enough it should do better. 
When I use iftop, it shows it isn't doing anywhere near the speed it
should, maybe 1/4th or so.  I'd expect at least double or triple that
speed.  In all honesty, I'd think the hard drive would be the limiting
factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for
encrypted drives.  I think the encryption slows that down.  When copying
from a plain drive to a plain drive, I get 100MBs/sec or so. 

I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU
and 8GBs of memory.  It should have enough horsepower under the hood. 
Maybe it is something I'm not aware of.  It is a older rig so maybe it
isn't SATA's fastest version, maybe even the original or something.  I
can't find anything in lspci or dmesg so not real sure where to look on
BSD. 

Anyway, it's progress for now at least.  ;-)  At this rate, it'll be
done in about a week, maybe.  o_O

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sat, Dec 17, 2022 at 4:42 PM Dale  wrote:

>
> My reasoning is simple, I'm already familiar with LVM and how to manage
it.


Take the machine, wipe it and build a NAS from scratch with Gentoo. If all
you want is an NFS mount that won't be difficult. Add an NFS server, export
your mount and you're done, right? Managing it over the long term will be
far more work than TrueNAS but you will be comfortable with changing disks
and adding network cards which is important to you. Life is too short to
deal with things you really don't enjoy.

I would not suggest you look at Ubuntu Server because it's NGL. 10 minutes
to install, 3 minutes to figure out how to add the NFS server. However it's
a different package manager and truly not as nice as emerge/portage so you
probably won't like that part of NGL either. I truly don't like apt, but it
works if I stay in my lane so I've learned to do that, the advantage being
I've never had to build a package from scratch and I've never in 5 or 6
years had an update fail.

Wipe the machine. You'll be happier.

Best wishes,
Mark

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Dave

On Sat, Dec 17, 2022, 11:42 AM Dale  wrote:

> Mark Knecht wrote:
>
>
>
> On Sat, Dec 17, 2022 at 8:52 AM Dale  wrote:
> >
> > Mark Knecht wrote:
> >
> >
> >
> > On Fri, Dec 16, 2022 at 8:50 PM Dale  wrote:
> >
> > > I
> > > wonder, could one install the LVM stuff and use that?  That would be
> > > interesting.  I wonder if there is a NAS software that uses LVM
> > > instead.  Interesting thought.  I just may go bug google on that one.
>  o_O
> >
> > Maybe I'm missing the point but why would you want LVM on a
> > storage pool? If I'm doing backups I just want space. I let TrueNas
> > put it on disk and give it back if asked. Why put another layer
> > of indirection?
> >
> > If you're intending to use it as simple NAS - i.e. - the only copy
> > of some data on your network - then possibly LVM might
> > be interesting, but then you need a second TrueNAS box
> > to back that up. NAS as a mountable data location is
> > different than NAS doing backups which is what I thought
> > this thread was about. What am I not remembering?
> >
> > - Mark
> >
> >
> > It's more about me being more used to using LVM.  Also, more used to
> Linux as well.  BSD is not something I have much experience with and until
> recently, none with ZFS.  Even the little experience I have with BSD was
> well over a decade ago, maybe two decades ago.  I barely remember it really.
> >
> > By replacing ZFS with LVM, I'm working with something I'm familiar with
> and less likely to mess up things.  Things get messed up enough without
> adding more confusion.  ;-)
> >
> > Dale
> >
> > :-)  :-)
>
> Hummm...I don't know Dale, I don't know... ZFS is a file system.
> LVM is an abstraction on top (or underneath?) of a file system.
> My understanding of LVM is that it frees you from hard decisions
> on partition sizes, not that it replaces ZFS or ext3/4/5.
>
>
> That is true.  Thing is, I've learned how to manage LVM even with
> encrypted data.  I've also learned how to expand storage without losing
> data or getting confused about what I'm doing.  To me, using LVM is pretty
> easy given the notes I have for the tasks I do most often.
>
>
> You may or may not know this but TrueNAS is available as a
> Linux version:
>
> https://www.truenas.com/blog/first-release-of-truenas-on-linux/
>
> I don't recommend it. It's new. Let someone else figure it out. However
> it might be more to your liking, and because it's Linux you'd be more
> comfortable messing it up. ;0-
>
> WRT you I recommend that you try living in NGL for a while. Possibly
> you are just a bit too indoctrinated in the religion of building packages
> 30-50 times a year believing (without hard data) that it provides value.
> Instead you might just consider relaxing and letting the system
> take care of itself. In the last year I've only updated my TrueNAS box
> twice that I can remember.
>
> On the other hand if system tweaking is what brings you joy then
> Que Sera Sera .
>
> Good luck,
> Mark
>
>
>
> It's not that I want to compile things, it's that I want to use things I'm
> already really familiar with.  If I bought a Raspberry Pi and built a NAS
> with it, I don't care if I compile the software on it or not as long as it
> has the software I need or I can install what I need.  From what I've read,
> compiling on a Raspberry isn't much fun.  It's very time consuming. Having
> a OS, binary one at that, that is Linux based is a big plus.  I can run
> LVM, cryptsetup and such in likely every Linux distro out there and get the
> same result as on my Gentoo box.  Switching to BSD, using ZFS, means I have
> to learn a whole new set of tools and methods.  I had enough fun learning
> LVM and I don't think LVM is going to die anytime soon.  It should be
> around for the foreseeable future.  As it is, even now, I still don't get
> how ZFS works.  I just followed a guide to get it working, sort of.  It's
> still not encrypted.  Figuring that out is next.  That should be fun.
>
> My network card is out for delivery.  A few days late but better than
> never I guess.  I'll see if the drivers needed for it are available as
> modules or not.  I suspect they are tho based on info in this thread.
>
> Dale
>
> :-)  :-)
>

Re: [gentoo-user] NAS and replacing with larger drives

[Wol]

On 17/12/2022 20:03, Mark Knecht wrote:

I'm just asking what's the purpose of doing LVM, or your
suggested layering, specifically on a storage pool for a
home user like Dale? That's the part I don't understand,
especially for a new NAS user like Dale?


From my POV, snapshots, in-place short-term backups, it's just flexible.

Actually, my main use of lvm is on my system partition - take a 
snapshot, emerge @world, make sure everything is okay ...


What I *thought* I wanted it for was my /home partition - my wife is 
forever losing stuff, getting muddled and what have you. But I don't 
think snapshotting would actually protect against what she does :-(


But the ability to snapshot anything where you think you might be doing 
something dangerous is just great - it means you can revert a disaster...


And below that, integrity/raid? Well raid protects against a drive 
failure, integrity protects against disk corruption. They're all 
unlikely events, but I've got loads of disk space, a powerful system, 
and I don't stress it, so I've got power to spare for it.


Cheers,
Wol

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sat, Dec 17, 2022 at 12:10 PM Wol  > wrote:
> 
> > Do you want the system layered, with each layer doing one job? Use
> > dm-integrity to protect against corruption, raid to join the disks, lvm
> > to partition them, and ext to manage the directories and files.
> >
> > I do the latter ...
>
> No argument there, at least on a group of drives where you 
> want to have flexibility in the future. Desktop computers or
> system drives certainly. You didn't tell me what replaces
> the compression aspect of the problem but I'm sure there's
> something. It's a great strategy if you have the expertise and
> time to set it up and then manage it when a problem arises,
> if it ever arises. 
>
> I'm just asking what's the purpose of doing LVM, or your
> suggested layering, specifically on a storage pool for a 
> home user like Dale? That's the part I don't understand, 
> especially for a new NAS user like Dale?
>
> Mark
>
>
>

My reasoning is simple, I'm already familiar with LVM and how to manage
it.  While I swap drives on my Gentoo rig pretty regular lately, I don't
want to be limited from doing that on a NAS either.  If for example I
want to replace a 10TB drive with a 16TB drive, LVM makes that easy and
I know how to do it already.  With ZFS tho, is that even doable and if
it is, do I want to learn to do it with a new tool?  From what I've
seen, I'm not even sure you can do that.  It seems you can expand by
adding a drive but not replace or shrink. 

As a example.  I went back to a basic pool of two drives.  I then
recreated a dataset, or whatever it is called, and added for it to be
encrypted.  Since I did that, I get write errors.  I can mount it just
fine but that's it.  I have no idea what the cause is, google isn't
helping and to be honest, I'm thinking about target practice for the
thing.  It took me a good long while to set up the most basic thing. 
Adding encryption shouldn't be hard but apparently, it is more difficult
than I thought.  That or its so secure even I can't use it even with the
password.  lol 

This is what I like about LVM and cryptsetup.  I create a partition, or
use a whole drive, as needed.  I use cryptsetup to start the process
with one drive.  I then put ext4 on top of that.  Then I add a second
drive to that pv, add that to the volume group, extend the file system,
all done.  And it is encrypted as well.  If I need to move from one
drive to say a larger drive, no problem.  Add drive, move data, remove
old drive, extend file system if needed, all done.  I have notes but
I've done it a lot recently and have the general idea still glued to the
back of my head.  ;-)  Thing is, ZFS isn't making sense to me so I'm
clueless where to start when something goes wrong or even getting it to
work period.  I may try watching a video on ZFS and see if that helps. 
Maybe it will, maybe I'll still prefer LVM.  After all, I'm a old dog. 
New tricks ain't easy.  ROFL 

If I bought a pre-made NAS, I'd just have to deal with it.  I'd keep
hammering until I got it to where I could backup my data.  If I build a
Raspberry thing, NAS software may not be my first choice.  Maybe, just
maybe, my light bulb will pop on and I can make sense of TrueNAS and
ZFS.  If so, fine.  Right now, it's a lot of work with really no gain. 
I'm not able to backup my data yet.  It's a brick, time consuming and
confusing brick at that. 

After supper, I'm rebooting and see if I can beat some sense into
again.  Seriously considering using dd and starting over from scratch. 
I can't figure out how to do that with the GUI thing.  No delete button,
that I can find anyway. 

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sat, Dec 17, 2022 at 09:09:48AM -0700 schrieb Mark Knecht:

> On Sat, Dec 17, 2022 at 8:52 AM Dale  wrote:

> > > I
> > > wonder, could one install the LVM stuff and use that?  That would be
> > > interesting.  I wonder if there is a NAS software that uses LVM
> > > instead.  Interesting thought.  I just may go bug google on that one.
> >
> > Maybe I'm missing the point but why would you want LVM on a
> > storage pool? If I'm doing backups I just want space. I let TrueNas
> > put it on disk and give it back if asked. Why put another layer
> > of indirection?
> > […]
> It's more about me being more used to using LVM.  Also, more used to
> Linux as well.  BSD is not something I have much experience with and until
> recently, none with ZFS.  Even the little experience I have with BSD was
> well over a decade ago, maybe two decades ago.  I barely remember it really.

The truenas interface is supposed to hide all that from you. As Mark wrote
two posts up, it’s an appliance. You install it once, that’s it. I think you
can install addons, but don’t have to. You maybe do updates once in a while,
perhaps not even that if it’s a critical production host. You don’t ssh into
it to do maintenance or to add or remove disks on the commandline. That’s
what the web UI is for. All of it. The biggest and most obvious difference
for me would be how devices are named in comparison to Linux.

> Hummm...I don't know Dale, I don't know... ZFS is a file system.
> LVM is an abstraction on top (or underneath?) of a file system.
> My understanding of LVM is that it frees you from hard decisions
> on partition sizes, not that it replaces ZFS or ext3/4/5.

LVM is “just” an abstraction layer between file system and storage. At the
bottom there are your block devices (drives, image files), which then may or
may not be RAIDed. Then you have LVM on top of that to encompass all those
devices into one big “virtual hard drive” and partition it (logical
volumes). And lastly you put file systems into those volumes. So there are
two, three (or even four, if you add encryption somewhere in between) layers
stacked onto your raw devices.

ZFS OTOH is all of that in one. It takes the raw block devices as a whole,
puts them (optionally) into redundancy structures, allows for “partitions”
(i.e. datasets) and lastly also *is* the file system. The advantage is that
it can combine its knowledge about all those layers to improve performance
and reliability. So for instance it distributes writes according to vdev
occupancy (LVM has no knowledge about the FS layer above it). Or when you
rebuild a RAID, only those parts that are actually used by the FS need to be
reconstructed, not the whole disk.

I may come off as a ZFS fanboy in this thread. But I am in no way an expert,
just a small-time user with just that one NAS with one RAID setup. That’s
it. I did a lot of reading beforehand, whether I should use it or mdadm or
btrfs. All my knowledge comes from that time, I never worked with it in my
professional life.

I also use LVM on my systems these days, just in case my root partition
becomes crowded and needs some extra space that I can take from the media
partition. Had to do this once, it went quick and was a fun experience.

> WRT you I recommend that you try living in NGL for a while. Possibly
> you are just a bit too indoctrinated in the religion of building packages
> 30-50 times a year believing (without hard data) that it provides value.

+1
I admit I like the occasional update of my Gentoo NAS. But that’s also
because it’s my last living Gentoo device. I always liked the environment,
still do. Gentoo was my first Linux after all, that stuff stays in your
mind. But oh the time-consuming hassle sometimes.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

The fantasy of men is often inadequate to grasp the reality of women.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sat, Dec 17, 2022 at 12:10 PM Wol  wrote:

> Do you want the system layered, with each layer doing one job? Use
> dm-integrity to protect against corruption, raid to join the disks, lvm
> to partition them, and ext to manage the directories and files.
>
> I do the latter ...

No argument there, at least on a group of drives where you
want to have flexibility in the future. Desktop computers or
system drives certainly. You didn't tell me what replaces
the compression aspect of the problem but I'm sure there's
something. It's a great strategy if you have the expertise and
time to set it up and then manage it when a problem arises,
if it ever arises.

I'm just asking what's the purpose of doing LVM, or your
suggested layering, specifically on a storage pool for a
home user like Dale? That's the part I don't understand,
especially for a new NAS user like Dale?

Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Wol]

On 17/12/2022 16:09, Mark Knecht wrote:

Hummm...I don't know Dale, I don't know... ZFS is a file system.
LVM is an abstraction on top (or underneath?) of a file system.
My understanding of LVM is that it frees you from hard decisions
on partition sizes, not that it replaces ZFS or ext3/4/5.


Do one thing and do it well. That's LVM. Or ext.

Jack of all trades. That's ZFS.

Do you want the filesystem doing everything from the hard drive up? Use ZFS.

Do you want the system layered, with each layer doing one job? Use 
dm-integrity to protect against corruption, raid to join the disks, lvm 
to partition them, and ext to manage the directories and files.


I do the latter ...

Cheers,
Wol

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sat, Dec 17, 2022 at 9:42 AM Dale  wrote:
>

>
> That is true.  Thing is, I've learned how to manage LVM even with
encrypted data.  I've also learned how to expand storage without losing
data or getting confused about what I'm doing.  To me, using LVM is pretty
easy given the notes I have for the tasks I do most often.
>

> It's not that I want to compile things, it's that I want to use things
I'm already really familiar with.  If I bought a Raspberry Pi and built a
NAS with it, I don't care if I compile the software on it or not as long as
it has the software I need or I can install what I need.  From what I've
read, compiling on a Raspberry isn't much fun.  It's very time consuming.
Having a OS, binary one at that, that is Linux based is a big plus.  I can
run LVM, cryptsetup and such in likely every Linux distro out there and get
the same result as on my Gentoo box.  Switching to BSD, using ZFS, means I
have to learn a whole new set of tools and methods.  I had enough fun
learning LVM and I don't think LVM is going to die anytime soon.  It should
be around for the foreseeable future.  As it is, even now, I still don't
get how ZFS works.  I just followed a guide to get it working, sort of.
It's still not encrypted.  Figuring that out is next.  That should be fun.
>

Maybe just live with TrueNAS for a month or two and get to know it on a
friendly level first?

I think I'm still not understanding the need for LVM. Help me understand. I
see ZFS on TrueNAS as a combination of mdadm and a file system. I'm not
sure I even have partitions. My ZFS pool is just using the whole drive, but
that was all I wanted. Are you planning on using your drive space for other
things? (Plex server in a jail, or remote real-time storage for instance)
If so maybe LVM would help isolate backups - which I thought was why you
wanted this machine - from a VM of some type running on the same machine -
which I don't think you've suggested.

> My network card is out for delivery.  A few days late but better than
never I guess.  I'll see if the drivers needed for it are available as
modules or not.  I suspect they are tho based on info in this thread.

Good luck. Hope the new card makes your life easier.

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sat, Dec 17, 2022 at 8:52 AM Dale  > wrote:
> >
> > Mark Knecht wrote:
> >
> >
> >
> > On Fri, Dec 16, 2022 at 8:50 PM Dale  > wrote:
> >
> > > I
> > > wonder, could one install the LVM stuff and use that?  That would be
> > > interesting.  I wonder if there is a NAS software that uses LVM
> > > instead.  Interesting thought.  I just may go bug google on that
> one.  o_O
> >
> > Maybe I'm missing the point but why would you want LVM on a
> > storage pool? If I'm doing backups I just want space. I let TrueNas
> > put it on disk and give it back if asked. Why put another layer
> > of indirection?
> >
> > If you're intending to use it as simple NAS - i.e. - the only copy
> > of some data on your network - then possibly LVM might
> > be interesting, but then you need a second TrueNAS box
> > to back that up. NAS as a mountable data location is
> > different than NAS doing backups which is what I thought
> > this thread was about. What am I not remembering?
> >
> > - Mark
> >
> >
> > It's more about me being more used to using LVM.  Also, more used to
> Linux as well.  BSD is not something I have much experience with and
> until recently, none with ZFS.  Even the little experience I have with
> BSD was well over a decade ago, maybe two decades ago.  I barely
> remember it really.
> >
> > By replacing ZFS with LVM, I'm working with something I'm familiar
> with and less likely to mess up things.  Things get messed up enough
> without adding more confusion.  ;-)
> >
> > Dale
> >
> > :-)  :-)
>
> Hummm...I don't know Dale, I don't know... ZFS is a file system.
> LVM is an abstraction on top (or underneath?) of a file system.
> My understanding of LVM is that it frees you from hard decisions
> on partition sizes, not that it replaces ZFS or ext3/4/5.
>

That is true.  Thing is, I've learned how to manage LVM even with
encrypted data.  I've also learned how to expand storage without losing
data or getting confused about what I'm doing.  To me, using LVM is
pretty easy given the notes I have for the tasks I do most often. 


> You may or may not know this but TrueNAS is available as a 
> Linux version:
>
> https://www.truenas.com/blog/first-release-of-truenas-on-linux/
>
> I don't recommend it. It's new. Let someone else figure it out. However
> it might be more to your liking, and because it's Linux you'd be more
> comfortable messing it up. ;0-
>
> WRT you I recommend that you try living in NGL for a while. Possibly 
> you are just a bit too indoctrinated in the religion of building packages 
> 30-50 times a year believing (without hard data) that it provides value. 
> Instead you might just consider relaxing and letting the system 
> take care of itself. In the last year I've only updated my TrueNAS box
> twice that I can remember.
>
> On the other hand if system tweaking is what brings you joy then
> Que Sera Sera .
>
> Good luck,
> Mark


It's not that I want to compile things, it's that I want to use things
I'm already really familiar with.  If I bought a Raspberry Pi and built
a NAS with it, I don't care if I compile the software on it or not as
long as it has the software I need or I can install what I need.  From
what I've read, compiling on a Raspberry isn't much fun.  It's very time
consuming. Having a OS, binary one at that, that is Linux based is a big
plus.  I can run LVM, cryptsetup and such in likely every Linux distro
out there and get the same result as on my Gentoo box.  Switching to
BSD, using ZFS, means I have to learn a whole new set of tools and
methods.  I had enough fun learning LVM and I don't think LVM is going
to die anytime soon.  It should be around for the foreseeable future. 
As it is, even now, I still don't get how ZFS works.  I just followed a
guide to get it working, sort of.  It's still not encrypted.  Figuring
that out is next.  That should be fun. 

My network card is out for delivery.  A few days late but better than
never I guess.  I'll see if the drivers needed for it are available as
modules or not.  I suspect they are tho based on info in this thread. 

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sat, Dec 17, 2022 at 8:52 AM Dale  wrote:
>
> Mark Knecht wrote:
>
>
>
> On Fri, Dec 16, 2022 at 8:50 PM Dale  wrote:
>
> > I
> > wonder, could one install the LVM stuff and use that?  That would be
> > interesting.  I wonder if there is a NAS software that uses LVM
> > instead.  Interesting thought.  I just may go bug google on that one.
 o_O
>
> Maybe I'm missing the point but why would you want LVM on a
> storage pool? If I'm doing backups I just want space. I let TrueNas
> put it on disk and give it back if asked. Why put another layer
> of indirection?
>
> If you're intending to use it as simple NAS - i.e. - the only copy
> of some data on your network - then possibly LVM might
> be interesting, but then you need a second TrueNAS box
> to back that up. NAS as a mountable data location is
> different than NAS doing backups which is what I thought
> this thread was about. What am I not remembering?
>
> - Mark
>
>
> It's more about me being more used to using LVM.  Also, more used to
Linux as well.  BSD is not something I have much experience with and until
recently, none with ZFS.  Even the little experience I have with BSD was
well over a decade ago, maybe two decades ago.  I barely remember it really.
>
> By replacing ZFS with LVM, I'm working with something I'm familiar with
and less likely to mess up things.  Things get messed up enough without
adding more confusion.  ;-)
>
> Dale
>
> :-)  :-)

Hummm...I don't know Dale, I don't know... ZFS is a file system.
LVM is an abstraction on top (or underneath?) of a file system.
My understanding of LVM is that it frees you from hard decisions
on partition sizes, not that it replaces ZFS or ext3/4/5.

You may or may not know this but TrueNAS is available as a
Linux version:

https://www.truenas.com/blog/first-release-of-truenas-on-linux/

I don't recommend it. It's new. Let someone else figure it out. However
it might be more to your liking, and because it's Linux you'd be more
comfortable messing it up. ;0-

WRT you I recommend that you try living in NGL for a while. Possibly
you are just a bit too indoctrinated in the religion of building packages
30-50 times a year believing (without hard data) that it provides value.
Instead you might just consider relaxing and letting the system
take care of itself. In the last year I've only updated my TrueNAS box
twice that I can remember.

On the other hand if system tweaking is what brings you joy then
Que Sera Sera .

Good luck,
Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Fri, Dec 16, 2022 at 8:50 PM Dale  > wrote:
>
> > I
> > wonder, could one install the LVM stuff and use that?  That would be
> > interesting.  I wonder if there is a NAS software that uses LVM
> > instead.  Interesting thought.  I just may go bug google on that
> one.  o_O
>
> Maybe I'm missing the point but why would you want LVM on a
> storage pool? If I'm doing backups I just want space. I let TrueNas 
> put it on disk and give it back if asked. Why put another layer
> of indirection?
>
> If you're intending to use it as simple NAS - i.e. - the only copy
> of some data on your network - then possibly LVM might
> be interesting, but then you need a second TrueNAS box
> to back that up. NAS as a mountable data location is
> different than NAS doing backups which is what I thought
> this thread was about. What am I not remembering?
>
> - Mark

It's more about me being more used to using LVM.  Also, more used to
Linux as well.  BSD is not something I have much experience with and
until recently, none with ZFS.  Even the little experience I have with
BSD was well over a decade ago, maybe two decades ago.  I barely
remember it really.

By replacing ZFS with LVM, I'm working with something I'm familiar with
and less likely to mess up things.  Things get messed up enough without
adding more confusion.  ;-)

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Fri, Dec 16, 2022 at 8:50 PM Dale  wrote:

>
> I noticing that now.  Once the install is done and you have the IP
> address, heck, you don't need a monitor for much of anything it
> appears.  I even found a console so one can type in things to do.

Exactly. My TrueNAS machines haven't had a monitor attached
since they were built. Everything you need is there. It's more a
storage appliance than a computer.

> I
> wonder, could one install the LVM stuff and use that?  That would be
> interesting.  I wonder if there is a NAS software that uses LVM
> instead.  Interesting thought.  I just may go bug google on that one.  o_O

Maybe I'm missing the point but why would you want LVM on a
storage pool? If I'm doing backups I just want space. I let TrueNas
put it on disk and give it back if asked. Why put another layer
of indirection?

If you're intending to use it as simple NAS - i.e. - the only copy
of some data on your network - then possibly LVM might
be interesting, but then you need a second TrueNAS box
to back that up. NAS as a mountable data location is
different than NAS doing backups which is what I thought
this thread was about. What am I not remembering?

- Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sat, Dec 17, 2022 at 12:49:01AM -0600 schrieb Dale:

> > While ZFS has the same pooling feature as LVM, meaning you can bunch several
> > disks together to create a JBOD, it has one big disadvantage over LVM: you
> > can grow a pool, but not shrink it. Actually, while reading up on stuff for
> > this thread, I learned that these days it is actually possible to remove a
> > mirror vdev from a mirror-only pool (a mirror can technically also be a
> > single device). But according to
> > https://utcc.utoronto.ca/~cks/space/blog/solaris/ZFSWhyNoVdevRemoval
> > it’s not perfect either.
> >
> 
> One thing about LVM, I already know how to use it.  I've got notes on
> how to do things and it has worked.  With ZFS I'd have to learn it all
> over again plus it could confuse me with my using LVM on my main rig. 
> In a way, if I build a Raspberry NAS, I'd like to have Linux and LVM on
> the thing.  At least then I have experience moving data and such.  Right
> now, I don't even have the basics of ZFS or BSD.  I'm not saying TrueNAS
> is bad or anything, just that I don't really care for the learning
> curve.  Then the confusion part on top of that. 

The beauty of the WebUI is that it abstracts all of that away. You don’t
have to be in the know about the inner works and create pools and vdevs by
hand. Though it might be handy in case something breaks in an unexpected
way.

> I've read there are distros built for Raspberry thingys.  I'd be shocked
> if it isn't doable.  I'd be shocked if someone hasn't already done it
> even.   

It’s called RaspberryPi OS (formerly knows as Raspbian). It has the kernel,
some start scripts and settings files that control which stuff to load at
boot. Pis boot differently to x86 hardware; there is no Grub & co.

I don’t particularly like Debian’s apt, which is why I’m also experimenting
with Arch on arm, Arch being my favorite distro for my everyday these days.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

“Oh, gravity, thou art a heartless bitch.” – Dr. Sheldon Cooper


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Fri, Dec 16, 2022 at 09:50:01PM -0600 schrieb Dale:
>
>>> My point is: there is no need for a monitor. ;-)
>>>
>> I noticing that now.  Once the install is done and you have the IP
>> address, heck, you don't need a monitor for much of anything it
>> appears.  I even found a console so one can type in things to do.  I
>> wonder, could one install the LVM stuff and use that?  That would be
>> interesting.
>>
>> I wonder if there is a NAS software that uses LVM instead.  Interesting
>> thought.  I just may go bug google on that one.  o_O
> Interestingly, after feeding LVM NAS to my search engine, one of the first
> results was a Qnap user forum thread which reads that Qnaps use LVM. It
> makes sense, since they most likely use a “normal” linux software RAID
> underneath, and LVM is then the best way to dynamically manage the space on
> top of that.
>
> While ZFS has the same pooling feature as LVM, meaning you can bunch several
> disks together to create a JBOD, it has one big disadvantage over LVM: you
> can grow a pool, but not shrink it. Actually, while reading up on stuff for
> this thread, I learned that these days it is actually possible to remove a
> mirror vdev from a mirror-only pool (a mirror can technically also be a
> single device). But according to
> https://utcc.utoronto.ca/~cks/space/blog/solaris/ZFSWhyNoVdevRemoval
> it’s not perfect either.
>


With LVM, I usually either move data to a larger drive or just add a
additional drive.  I think I shrunk once, I think.  Still, one always
wants to have options.

One thing about LVM, I already know how to use it.  I've got notes on
how to do things and it has worked.  With ZFS I'd have to learn it all
over again plus it could confuse me with my using LVM on my main rig. 
In a way, if I build a Raspberry NAS, I'd like to have Linux and LVM on
the thing.  At least then I have experience moving data and such.  Right
now, I don't even have the basics of ZFS or BSD.  I'm not saying TrueNAS
is bad or anything, just that I don't really care for the learning
curve.  Then the confusion part on top of that. 

I've read there are distros built for Raspberry thingys.  I'd be shocked
if it isn't doable.  I'd be shocked if someone hasn't already done it
even.   

Time will tell I guess.

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Fri, Dec 16, 2022 at 09:50:01PM -0600 schrieb Dale:

> > My point is: there is no need for a monitor. ;-)
> >
> 
> I noticing that now.  Once the install is done and you have the IP
> address, heck, you don't need a monitor for much of anything it
> appears.  I even found a console so one can type in things to do.  I
> wonder, could one install the LVM stuff and use that?  That would be
> interesting.
>
> I wonder if there is a NAS software that uses LVM instead.  Interesting
> thought.  I just may go bug google on that one.  o_O

Interestingly, after feeding LVM NAS to my search engine, one of the first
results was a Qnap user forum thread which reads that Qnaps use LVM. It
makes sense, since they most likely use a “normal” linux software RAID
underneath, and LVM is then the best way to dynamically manage the space on
top of that.

While ZFS has the same pooling feature as LVM, meaning you can bunch several
disks together to create a JBOD, it has one big disadvantage over LVM: you
can grow a pool, but not shrink it. Actually, while reading up on stuff for
this thread, I learned that these days it is actually possible to remove a
mirror vdev from a mirror-only pool (a mirror can technically also be a
single device). But according to
https://utcc.utoronto.ca/~cks/space/blog/solaris/ZFSWhyNoVdevRemoval
it’s not perfect either.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

5 of 4 people have problems with subsets.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Fri, Dec 16, 2022 at 04:43:25PM -0600 schrieb Dale:
>
>>> 4) While I cannot tell you if the card you ordered has a Linux or FreeBSD
>>> driver, I can point out that on the left hand side of your TrueNAS 
>>> dashboard, accessible in your browser hopefully, there is a pulldown
>>> called 'Network'. It should hopefully show you the current network
>>> interface which in my case is called 're0'. On the right you might,
>>> hopefully
>>> possibly see a big blue button called "ADD". Consider giving that button 
>>> a push after you've installed your new card.
>> 4:  I have a monitor hooked up still so I can do it the text way if
>> needed.  It mentions about setting up the network as one of the
>> options.
>>
>> Since you mentioned it has a GUI option, I may just do that. 
>> So long as it works. 
> That’s what I referred to earlier: you get a web interface built-in that
> takes care of all the chores. I always wanted to set up shares on my NAS so
> that guests could easily access it anonymously, but safely (meaning: no
> write access). I never had the patience to go through the whole setup of ftp
> and/or samba with the proper users and directories. But a web UI could take
> care of all of that. Plus it’s shiny. :D
>
> My point is: there is no need for a monitor. ;-)
>

I noticing that now.  Once the install is done and you have the IP
address, heck, you don't need a monitor for much of anything it
appears.  I even found a console so one can type in things to do.  I
wonder, could one install the LVM stuff and use that?  That would be
interesting.  I wonder if there is a NAS software that uses LVM
instead.  Interesting thought.  I just may go bug google on that one.  o_O

The network card is getting closer.  May be here tomorrow.  Maybe.  One
can never really tell about these things. 

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Fri, Dec 16, 2022 at 04:43:25PM -0600 schrieb Dale:

> > 4) While I cannot tell you if the card you ordered has a Linux or FreeBSD
> > driver, I can point out that on the left hand side of your TrueNAS 
> > dashboard, accessible in your browser hopefully, there is a pulldown
> > called 'Network'. It should hopefully show you the current network
> > interface which in my case is called 're0'. On the right you might,
> > hopefully
> > possibly see a big blue button called "ADD". Consider giving that button 
> > a push after you've installed your new card.

> 4:  I have a monitor hooked up still so I can do it the text way if
> needed.  It mentions about setting up the network as one of the
> options.
>
> Since you mentioned it has a GUI option, I may just do that. 
> So long as it works. 

That’s what I referred to earlier: you get a web interface built-in that
takes care of all the chores. I always wanted to set up shares on my NAS so
that guests could easily access it anonymously, but safely (meaning: no
write access). I never had the patience to go through the whole setup of ftp
and/or samba with the proper users and directories. But a web UI could take
care of all of that. Plus it’s shiny. :D

My point is: there is no need for a monitor. ;-)

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

LCARS - Linux Can Also Run Starships


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Thu, Dec 15, 2022 at 9:08 PM Dale  > wrote:
> 
> > 2:  Hardware change.  The Dell comes with a 100MB network card.  I
> > ordered a 1GB card.  I plan to put it in when it gets here.  Will it see
> > the new card and work automatically or will it take some work to get the
> > network going?  On my Gentoo rig, I have to enable drivers in the kernel
> > and recompile.  I'm not sure about BSD tho.  Since it is sort of a
> > binary thing, does TrueNAS handle hardware changes such as a network
> > card well?
> 
>
> At the risk of repeating a bit of what Frank said I'll put in my 2
> cents as a
> TrueNAS user. No intention to be snarky on my side, just pointing
> a few things out.
>
> 1) Welcome to the world of "not Gentoo". What I think you are describing
> as a 'binary thing' is, for the most part, the way we work out here.
>
> 2) I disagree with your description of how "it's done" in Gentoo Land. You
> made a choice to put your network driver in the kernel. You could have
> built it as a module and loaded that module. Both would have worked.
>
> 3) Out here in Not Gentoo Land (NGL) they supply you with 100's of
> modules and generally installers figure out which ones to load. My main 
> NGL machine has literally over 100 modules loaded. I don't know what 
> they do (for the most part) and mostly I don't care.
>
> 4) While I cannot tell you if the card you ordered has a Linux or FreeBSD
> driver, I can point out that on the left hand side of your TrueNAS 
> dashboard, accessible in your browser hopefully, there is a pulldown
> called 'Network'. It should hopefully show you the current network
> interface which in my case is called 're0'. On the right you might,
> hopefully
> possibly see a big blue button called "ADD". Consider giving that button 
> a push after you've installed your new card.
>
>    I believe you will get this figured out very soon. Continue exploring
> the NGL world. 
>
> Mark


1:  The binary thing is a distro or package that I don't compile
myself.  So, yea, not Gentoo. 

2:  True for some I guess.  The only module I have is my video drivers. 
I build everything else I need into the kernel.  It's how I learned to
do it ages ago and so far, it works really well.  BSD tho may do that a
different way.  I played with BSD once years ago.  I been doing the
Gentoo way for a LOT longer.  Last binary distro I used was Mandrake and
it changed names a long time ago I think. 

3:  That's what I'm hoping for but with no recent BSD experience and not
able to find info with google, I hoped someone who used TrueNAS or BSD
would know how its done.  A couple people did.  ;-) 

4:  I have a monitor hooked up still so I can do it the text way if
needed.  It mentions about setting up the network as one of the
options.  Since you mentioned it has a GUI option, I may just do that. 
So long as it works. 

Thanks for the info.  It helped. 

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Thu, Dec 15, 2022 at 10:08:02PM -0600 schrieb Dale:
>
>> I have a couple questions.  I currently have the NAS thingy on a older
>> Dell machine.  It has a 4 core CPU and 8GBs of ram so it is acceptable,
>> for the time being at least.  Bad thing is, only two drive bays.  :/  I
>> have a few questions that I can't quite find answers to with google. 
>>
>> 1:  I have the OS on a USB stick.  From what I've read, they do fail due
>> to wear at some point.
> OTOH, TrueNAS is designed to run from it, so I would assume it handles its
> root drive with care. Perhaps you can disable verbose logging and such.

I've just read that changes were made a while back and they recommend
not using a USB stick anymore.  It works but they tend to not last as
long as they once did.  There could be any number of variables in that
tho. 

>
>> If I reinstall TrueNAS on a new USB stick, will it automatically see the
>> previous pools and such or do I have to set everything up again fresh?
> Pools and their metadata are stored inside the pools. In Linux, you don’t
> even need to set up fstab. The pool stores its mount point internally. So
> you just start the zfs daemon and it does everything magically.
>
>> In other words, will I lose data?
> You won’t lose data, of course. But I think you meant settings(?). Probably
> about users, shares and such. Perhaps it has an export feature which can be
> run periodically.
>
>> This also includes if it is encrypted.
> Encryption is a built-in ZFS feature. So yes, it will remember that. Not
> sure about the decryption process (keyfile).

That's what I was expecting.  I may test that theory just so I don't run
into any surprises.  I kinda figure it works a lot like LVM does. 
Different but details stored on the drive itself.  Basically, works
wherever you put it. 


>
>> 2:  Hardware change.  The Dell comes with a 100MB network card.  I
>> ordered a 1GB card.  I plan to put it in when it gets here.  Will it see
>> the new card and work automatically or will it take some work to get the
>> network going?
> I assume the kernel is built like many general-purpose-distros: with
> everything in it you may need for the purpose. But since it is BSD, it may
> have driver issues (availability and stability for certain cards).
> Sometimes, when I read news about a new product, people complain that the
> NIC is not Intel and will thus cause problems with BSD, especially with
> niche stuff like the Killer-brand ethernet cards.
>
>> and recompile.  I'm not sure about BSD tho.  Since it is sort of a
>> binary thing, does TrueNAS handle hardware changes such as a network
>> card well? 
> I don’t see a connection between being a “binary thing” and hardware change.
> Your gentoo is also a binary thing once it is compiled. ;-)

My thinking was, I didn't compile any of the software myself.  Sort of
like if I install a binary based distro.  It may have a feature or
driver turned on, it may not. Maybe you are right, it will at least have
the driver it needs built as a module and it will load it and work
fine.  I have the same card in my Gentoo box so it is Linux compatible
so in theory, should work in BSD as well.  I'd think.  ;-)  First thing,
it has to get here.  It's already two days later than originally claimed. 

>> I also found out something power wise.  The Dell when booted and sitting
>> idle consumes about 120 watts monitor and all.
> I figured as much when you mentioned its 100 Mbps card. It must be old then,
> and back then, idle power was a non-issue.
>
>> My main rig consumes just under 200 watts.  Not to bad
> That’s a very lot for my taste. With a lower mid-range GPU (110 W Radeon R7
> 370) and one spinning rust, my 8-year-old PC used to idle at 50 W. Without
> the HDD and with Intel graphics it is now at 27 W. Still not a good number
> when compared with today’s hardware.

My Gentoo rig is a little old too.  AMD 8 core CPU, 32GBs of memory,
LOTS of hard drives.  I think there is eight in there right now.  A
couple may be older but most are newer. 


>> but a Raspberry Pi would likely consume 15, 20 watts max according to what
>> I've read.
> My 3B idles at 5 W tops, I think. It cannot be much more under load since it
> comes without a built-in heat spreader.
>
>> Given the number of hard drives, it could pull 25 or 30 watts max but
>> doubtful it would get that high.  I'm looking at 4 bays but also found a 6
>> bay.  I think 6 is overkill tho. 
> My four-bay NAS has four 6 TB drives and it draws around 50 W at idle. But
> that’s because it is a server board, incuding IPMI chip (and—interestingly—
> an internal USB-A for an OS stick). And it’s Haswell generation, so almost a
> decade old design. For this reason I switch it on only every few weeks or
> even months and only keep it running for a short time.
>

>From what I've read, the Raspberry Pi pretty much all sip on power. 
They really efficient.  It's nice to know that even tho the one you
mention is more 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Thu, Dec 15, 2022 at 9:08 PM Dale  wrote:

> 2:  Hardware change.  The Dell comes with a 100MB network card.  I
> ordered a 1GB card.  I plan to put it in when it gets here.  Will it see
> the new card and work automatically or will it take some work to get the
> network going?  On my Gentoo rig, I have to enable drivers in the kernel
> and recompile.  I'm not sure about BSD tho.  Since it is sort of a
> binary thing, does TrueNAS handle hardware changes such as a network
> card well?


At the risk of repeating a bit of what Frank said I'll put in my 2 cents as
a
TrueNAS user. No intention to be snarky on my side, just pointing
a few things out.

1) Welcome to the world of "not Gentoo". What I think you are describing
as a 'binary thing' is, for the most part, the way we work out here.

2) I disagree with your description of how "it's done" in Gentoo Land. You
made a choice to put your network driver in the kernel. You could have
built it as a module and loaded that module. Both would have worked.

3) Out here in Not Gentoo Land (NGL) they supply you with 100's of
modules and generally installers figure out which ones to load. My main
NGL machine has literally over 100 modules loaded. I don't know what
they do (for the most part) and mostly I don't care.

4) While I cannot tell you if the card you ordered has a Linux or FreeBSD
driver, I can point out that on the left hand side of your TrueNAS
dashboard, accessible in your browser hopefully, there is a pulldown
called 'Network'. It should hopefully show you the current network
interface which in my case is called 're0'. On the right you might,
hopefully
possibly see a big blue button called "ADD". Consider giving that button
a push after you've installed your new card.

   I believe you will get this figured out very soon. Continue exploring
the NGL world.

Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Thu, Dec 15, 2022 at 10:08:02PM -0600 schrieb Dale:

> I have a couple questions.  I currently have the NAS thingy on a older
> Dell machine.  It has a 4 core CPU and 8GBs of ram so it is acceptable,
> for the time being at least.  Bad thing is, only two drive bays.  :/  I
> have a few questions that I can't quite find answers to with google. 
> 
> 1:  I have the OS on a USB stick.  From what I've read, they do fail due
> to wear at some point.

OTOH, TrueNAS is designed to run from it, so I would assume it handles its
root drive with care. Perhaps you can disable verbose logging and such.

> If I reinstall TrueNAS on a new USB stick, will it automatically see the
> previous pools and such or do I have to set everything up again fresh?

Pools and their metadata are stored inside the pools. In Linux, you don’t
even need to set up fstab. The pool stores its mount point internally. So
you just start the zfs daemon and it does everything magically.

> In other words, will I lose data?

You won’t lose data, of course. But I think you meant settings(?). Probably
about users, shares and such. Perhaps it has an export feature which can be
run periodically.

> This also includes if it is encrypted.

Encryption is a built-in ZFS feature. So yes, it will remember that. Not
sure about the decryption process (keyfile).

> 2:  Hardware change.  The Dell comes with a 100MB network card.  I
> ordered a 1GB card.  I plan to put it in when it gets here.  Will it see
> the new card and work automatically or will it take some work to get the
> network going?

I assume the kernel is built like many general-purpose-distros: with
everything in it you may need for the purpose. But since it is BSD, it may
have driver issues (availability and stability for certain cards).
Sometimes, when I read news about a new product, people complain that the
NIC is not Intel and will thus cause problems with BSD, especially with
niche stuff like the Killer-brand ethernet cards.

> and recompile.  I'm not sure about BSD tho.  Since it is sort of a
> binary thing, does TrueNAS handle hardware changes such as a network
> card well? 

I don’t see a connection between being a “binary thing” and hardware change.
Your gentoo is also a binary thing once it is compiled. ;-)

> I also found out something power wise.  The Dell when booted and sitting
> idle consumes about 120 watts monitor and all.

I figured as much when you mentioned its 100 Mbps card. It must be old then,
and back then, idle power was a non-issue.

> My main rig consumes just under 200 watts.  Not to bad

That’s a very lot for my taste. With a lower mid-range GPU (110 W Radeon R7
370) and one spinning rust, my 8-year-old PC used to idle at 50 W. Without
the HDD and with Intel graphics it is now at 27 W. Still not a good number
when compared with today’s hardware.

> but a Raspberry Pi would likely consume 15, 20 watts max according to what
> I've read.

My 3B idles at 5 W tops, I think. It cannot be much more under load since it
comes without a built-in heat spreader.

> Given the number of hard drives, it could pull 25 or 30 watts max but
> doubtful it would get that high.  I'm looking at 4 bays but also found a 6
> bay.  I think 6 is overkill tho. 

My four-bay NAS has four 6 TB drives and it draws around 50 W at idle. But
that’s because it is a server board, incuding IPMI chip (and—interestingly—
an internal USB-A for an OS stick). And it’s Haswell generation, so almost a
decade old design. For this reason I switch it on only every few weeks or
even months and only keep it running for a short time.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

Death is a permanent damage.


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Dale wrote:
> Howdy,
>
> <<< SNIP >>>
>
> Thoughts?  Info to share?  Ideas on a best path forward?  Buy already
> built or build?
>
> Thanks.
>
> Dale
>
> :-)  :-) 
>


I have a couple questions.  I currently have the NAS thingy on a older
Dell machine.  It has a 4 core CPU and 8GBs of ram so it is acceptable,
for the time being at least.  Bad thing is, only two drive bays.  :/  I
have a few questions that I can't quite find answers to with google. 

1:  I have the OS on a USB stick.  From what I've read, they do fail due
to wear at some point.  If I reinstall TrueNAS on a new USB stick, will
it automatically see the previous pools and such or do I have to set
everything up again fresh?  In other words, will I lose data?  This also
includes if it is encrypted.  Right now it is not, but I plan to restart
and set it up as encrypted shortly.  I suspect that it will work like
LVM does.  I just can't see a OS failure causing a loss of all data. 

2:  Hardware change.  The Dell comes with a 100MB network card.  I
ordered a 1GB card.  I plan to put it in when it gets here.  Will it see
the new card and work automatically or will it take some work to get the
network going?  On my Gentoo rig, I have to enable drivers in the kernel
and recompile.  I'm not sure about BSD tho.  Since it is sort of a
binary thing, does TrueNAS handle hardware changes such as a network
card well? 

I also found out something power wise.  The Dell when booted and sitting
idle consumes about 120 watts monitor and all.  My main rig consumes
just under 200 watts.  Not to bad but a Raspberry Pi would likely
consume 15, 20 watts max according to what I've read.  Given the number
of hard drives, it could pull 25 or 30 watts max but doubtful it would
get that high.  I'm looking at 4 bays but also found a 6 bay.  I think 6
is overkill tho. 

Eventually, I plan to build a Raspberry Pi NAS.  When I do, I'll post
everything major I needed, boards, case etc for everyone to look at. 
I'll even try to upload some pics, or share as attachments if there is
interest.  Unless I find one heck of a deal on a used NAS that is. 
Still may build one even then.  ;-)

Thanks.

Dale

:-)  :-) 

RE: [OT] Re: [gentoo-user] NAS and replacing with larger drives

[Laurence Perkins]

> -Original Message-
> From: Peter Humphrey  
> Sent: Sunday, December 11, 2022 3:35 AM
> To: gentoo-user@lists.gentoo.org
> Subject: [OT] Re: [gentoo-user] NAS and replacing with larger drives
> 
> On Friday, 9 December 2022 10:34:00 GMT I wrote:
> 
> > in the 1970s the national grid was monitored and analysed with a 
> > Ferranti Argus 500 machine with 24KB RAM and a 2MB disk. It was common 
> > for American visitors to believe that was just driving the control 
> > engineers'
> > displays, and where was the main computer?
> 
> Er... There was no RAM in those days, not of the type we know today. In fact 
> it was 2-microsecond core store. Each tiny ferromagnetic toroid was threaded 
> with one X wire, one Y wire and (I think it was) a sync pulse wire. A 
> remarkable labour of love to build such a thing.
> 
> --
> Regards,
> Peter.
> 
Well, it wasn't built with transistors, but it was Random Access Memory.  As 
opposed to Sequential Access Memory like mercury delay lines.  And it was 
periodic refresh, just like most modern RAM.

That 24KB though would have been literally 196,608 ferrite cores (assuming it 
was an 8 bit byte on that system), and they were probably hand-soldered.

Although it looks like the original Argus line used 12 bit words.  So it was 
probably a 6 bit byte.  Still, a lot of soldering.

Interestingly, the Argus 400 and 500 series was one of the first systems to use 
multilayer PCBs and the company had to develop a lot of the techniques for 
creating those themselves.

LMP

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sun, Dec 11, 2022 at 6:55 PM Dale  > wrote:
> >
> > Dale wrote:
> > >
> > > Interesting info.  Since this is a duplicate copy already, I'm not to
> > > worried about RAID stuff.  I'd rather have two separate backups
> myself.
> > > Store them in different places for even more safety.  Still, one of
> > > these days.  ;-)
> > >
> > > I'm still getting this error.
> > >
> > > root@fireball ~ # mkdir /mnt/Backup/Videos
> > > mkdir: cannot create directory ‘/mnt/Backup/Videos’: Permission denied
> > > root@fireball ~ #
> > >
> > > I've tried every permission in every place I can find.  I have a user
> > > set up, set permissions under storage and pools, all the little
> > > directory thingys under it too.  It mounts so I'd think I got
> everything
> > > set up correctly in the Share section.  I actually followed a
> guide and
> > > I don't think I missed anything.  Still, I can't write anything to the
> > > thing.  It mounts fine, even shows it is mounted rw.  I can't find
> > > anything wrong on the puter or NAS ends.  This reminds me of the last
> > > time I played with BSD.  It works so different, it just throws a
> person
> > > upside down and shakes them.
> > >
> > > I did switch to TrueNAS tho.  Thing is, I got the same result from
> both,
> > > exact same error.  Can't be a bug.  It has to be me.  No idea what I
> > > missed but I bet I did.  lol  Just gonna keep banging on it.  :-D
>  I do
> > > like the GUI part.  That's pretty neat.
> > >
> > > Dale
> > >
> > > :-) :-)
> > >
> >
> >
> > Update.  I thought about just using Dolphin to play with the directory
> > that's actually on the NAS.  I could create folders and files just fine
> > with Dolphin.  Well, isn't that interesting.  Finally I found a comment
> > with google that gave me a clue.  I needed to change the options I use
> > with rsync plus it appears on my computer, I need to su to dale, same
> > user as on NAS.  Now it works.  I can rsync my files over.
> >
> > Then I noticed something else.  The network card in the NAS box, it's a
> > old 100MB card.  Has anyone ever poured cold molasses before?  Does
> > waiting on leap year sound familiar?  ROFL  Just saying.
> >
> > Hey, at least I got the silly thing to work, slowly, but works.  :/
> >
> > Dale
> >
> > :-)  :-)
>
> Congrats on making progress.
>
> Is this still FreeNAS or did you switch to TrueNAS Core?
>
> Yeah, 100Mb/S, or say 12MB/S takes days to move 
> multiple Terrabytes. I did it inside of a screen session so that
> I could disconnect and leave it running in the background
> without having to watch cold molasses flow. I'm looking
> to upgrade everything to 2.5Gb/S or higher one of these 
> days but once the initial backup is done regular backups
> are reasonably fast.
>
> I was disappointed in the info Frank found about not being
> able to bond Pools, but it still makes me wonder if someone
> could create a 14TB RAID0 outside of the pool and then bond 
> that RAID0 with a 14TB drive to make a 14TB ZFS RAID1. 
>
> Not looking to do it myself though... ;-)
>
> - Mark

Well, when I ran into the permission problem, I was going to start over
anyway.  Figured if I was going to start over, may as well switch to
TrueNAS while at it.  So, I switched.  I only used FreeNAS because it
was the first one I found.  It was put on the USB stick ages ago. I'm
keeping a eye out for a small hard drive, 250GB or something to use as
the OS drive in the NAS.  I've read it wears out USB sticks pretty fast. 

At first, I couldn't get both drives to add at the same time.  To work
around that, I set up a pool with one drive.  I then went back and added
the second drive.  Then it was both drives added together, like I do in
LVM.  Then I did the file system thing, dataset I think they call it??? 

After a while, I shutdown the NAS.  I got on Ebay and ordered a 1GB
network card.  Everything I have is 1GB so no need getting anything
faster.  It should be a lot faster and may be about all the NAS rig can
handle anyway.

I haven't figured out how to encrypt it yet tho.  I need to research that. 

Still, progress.

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 11, 2022 at 6:55 PM Dale  wrote:
>
> Dale wrote:
> >
> > Interesting info.  Since this is a duplicate copy already, I'm not to
> > worried about RAID stuff.  I'd rather have two separate backups myself.
> > Store them in different places for even more safety.  Still, one of
> > these days.  ;-)
> >
> > I'm still getting this error.
> >
> > root@fireball ~ # mkdir /mnt/Backup/Videos
> > mkdir: cannot create directory ‘/mnt/Backup/Videos’: Permission denied
> > root@fireball ~ #
> >
> > I've tried every permission in every place I can find.  I have a user
> > set up, set permissions under storage and pools, all the little
> > directory thingys under it too.  It mounts so I'd think I got everything
> > set up correctly in the Share section.  I actually followed a guide and
> > I don't think I missed anything.  Still, I can't write anything to the
> > thing.  It mounts fine, even shows it is mounted rw.  I can't find
> > anything wrong on the puter or NAS ends.  This reminds me of the last
> > time I played with BSD.  It works so different, it just throws a person
> > upside down and shakes them.
> >
> > I did switch to TrueNAS tho.  Thing is, I got the same result from both,
> > exact same error.  Can't be a bug.  It has to be me.  No idea what I
> > missed but I bet I did.  lol  Just gonna keep banging on it.  :-D  I do
> > like the GUI part.  That's pretty neat.
> >
> > Dale
> >
> > :-) :-)
> >
>
>
> Update.  I thought about just using Dolphin to play with the directory
> that's actually on the NAS.  I could create folders and files just fine
> with Dolphin.  Well, isn't that interesting.  Finally I found a comment
> with google that gave me a clue.  I needed to change the options I use
> with rsync plus it appears on my computer, I need to su to dale, same
> user as on NAS.  Now it works.  I can rsync my files over.
>
> Then I noticed something else.  The network card in the NAS box, it's a
> old 100MB card.  Has anyone ever poured cold molasses before?  Does
> waiting on leap year sound familiar?  ROFL  Just saying.
>
> Hey, at least I got the silly thing to work, slowly, but works.  :/
>
> Dale
>
> :-)  :-)

Congrats on making progress.

Is this still FreeNAS or did you switch to TrueNAS Core?

Yeah, 100Mb/S, or say 12MB/S takes days to move
multiple Terrabytes. I did it inside of a screen session so that
I could disconnect and leave it running in the background
without having to watch cold molasses flow. I'm looking
to upgrade everything to 2.5Gb/S or higher one of these
days but once the initial backup is done regular backups
are reasonably fast.

I was disappointed in the info Frank found about not being
able to bond Pools, but it still makes me wonder if someone
could create a 14TB RAID0 outside of the pool and then bond
that RAID0 with a 14TB drive to make a 14TB ZFS RAID1.

Not looking to do it myself though... ;-)

- Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Dale wrote:
>
> Interesting info.  Since this is a duplicate copy already, I'm not to
> worried about RAID stuff.  I'd rather have two separate backups myself. 
> Store them in different places for even more safety.  Still, one of
> these days.  ;-) 
>
> I'm still getting this error. 
>
> root@fireball ~ # mkdir /mnt/Backup/Videos
> mkdir: cannot create directory ‘/mnt/Backup/Videos’: Permission denied
> root@fireball ~ #
>
> I've tried every permission in every place I can find.  I have a user
> set up, set permissions under storage and pools, all the little
> directory thingys under it too.  It mounts so I'd think I got everything
> set up correctly in the Share section.  I actually followed a guide and
> I don't think I missed anything.  Still, I can't write anything to the
> thing.  It mounts fine, even shows it is mounted rw.  I can't find
> anything wrong on the puter or NAS ends.  This reminds me of the last
> time I played with BSD.  It works so different, it just throws a person
> upside down and shakes them. 
>
> I did switch to TrueNAS tho.  Thing is, I got the same result from both,
> exact same error.  Can't be a bug.  It has to be me.  No idea what I
> missed but I bet I did.  lol  Just gonna keep banging on it.  :-D  I do
> like the GUI part.  That's pretty neat. 
>
> Dale
>
> :-) :-) 
>


Update.  I thought about just using Dolphin to play with the directory
that's actually on the NAS.  I could create folders and files just fine
with Dolphin.  Well, isn't that interesting.  Finally I found a comment
with google that gave me a clue.  I needed to change the options I use
with rsync plus it appears on my computer, I need to su to dale, same
user as on NAS.  Now it works.  I can rsync my files over. 

Then I noticed something else.  The network card in the NAS box, it's a
old 100MB card.  Has anyone ever poured cold molasses before?  Does
waiting on leap year sound familiar?  ROFL  Just saying. 

Hey, at least I got the silly thing to work, slowly, but works.  :/

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Frank Steinmetzger wrote:
> Am Sun, Dec 11, 2022 at 08:44:42AM -0700 schrieb Mark Knecht:
>
>> Also, I think there are ways for you to build complex pools like a RAID0
>> from your 6TB and 8TB drives, and then a RAID1 using the RAID0 and your
>> 14TB drive but I've never tried it because mine don't have enough drive
>> slots for that.
> After a longer fruitless search on the interwebs (I ddidn’t want to start up
> my NAS just to check this) I finally found the right search keywords and
> found a reddit thread about that. And it even throws LVM into the
> discussion. ^^
> https://www.reddit.com/r/zfs/comments/fitc73/raidz_with_nested_vdevs/
>
> Also :
> “Here's a definitive answer from the man page for zpool.
>
> Virtual devices cannot be nested, so a mirror or raidz virtual device can
> only contain files or disks. Mirrors of mirrors (or other combinations) are
> not allowed.”
>
>
> I would advise against a JBOD pool anyways. Because if one drive dies, the
> whole JBOD is gone. That goes for ZFS and probably for LVM, too (though I am
> not sure how writes are distributed across JBOD disks). If the goal is
> redundancy, you could buy a second drive to match the size of an existing
> one and build a mirror. If redundancy is not a goal, then use the drives
> separately like you do now. If one fails, then only its content is gone (or
> even just the files sitting on the broken sector).
>
>> Also, turn on compression. It saves me between 15-20% so 14TB becomes 16TB
>> storage. YMMV. Video files don't compress, at least not much. Data files
>> generally do.
> It doesn’t hurt to switch it on, especially with lzo. But with video, the
> benefit will be negligible. When storing a block of data (a “record” in ZFS
> speak), it is passed through the compressor and only if the compression gain
> is above a given threshold (10 % methinks), the block is written to disk
> with compression.
>
> What is more relevant in filesystems for big files (i.e. videos): set the
> record size to 1 MB. The default is 64 kB, IIRC. Each record requires one
> block of metadata (which includes the record checksum). So bigger records →
> fewer meta blocks → better storage efficiency.
>
> If you use big records for small files, then efficiency goes down a little.
> It’s a similar (but a little more complicated) principle as when you write a
> 100 byte text file to a file system that uses 4 kB clusters. That file will
> still use up 4 kB on disk.
>
> The record size can be set per-dataset. So in your pool you could create a
> dataset with a smaller record size for office documents, images and music,
> and another dataset just for videos.
>
>> Hope this helps. I think you'll find TrueNAS fun actually but there is a
>> learning curve. I've used it for about a year and barely scratched the
>> surface.
> The main reason for me why I would wanna use it as opposed to a standard
> Gentoo install: the OOTB web interface to manage all sorts of accounts,
> access and permissions under one nice hood.
>


Interesting info.  Since this is a duplicate copy already, I'm not to
worried about RAID stuff.  I'd rather have two separate backups myself. 
Store them in different places for even more safety.  Still, one of
these days.  ;-) 

I'm still getting this error. 

root@fireball ~ # mkdir /mnt/Backup/Videos
mkdir: cannot create directory ‘/mnt/Backup/Videos’: Permission denied
root@fireball ~ #

I've tried every permission in every place I can find.  I have a user
set up, set permissions under storage and pools, all the little
directory thingys under it too.  It mounts so I'd think I got everything
set up correctly in the Share section.  I actually followed a guide and
I don't think I missed anything.  Still, I can't write anything to the
thing.  It mounts fine, even shows it is mounted rw.  I can't find
anything wrong on the puter or NAS ends.  This reminds me of the last
time I played with BSD.  It works so different, it just throws a person
upside down and shakes them. 

I did switch to TrueNAS tho.  Thing is, I got the same result from both,
exact same error.  Can't be a bug.  It has to be me.  No idea what I
missed but I bet I did.  lol  Just gonna keep banging on it.  :-D  I do
like the GUI part.  That's pretty neat. 

Dale

:-) :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sun, Dec 11, 2022 at 08:44:42AM -0700 schrieb Mark Knecht:

> Also, I think there are ways for you to build complex pools like a RAID0
> from your 6TB and 8TB drives, and then a RAID1 using the RAID0 and your
> 14TB drive but I've never tried it because mine don't have enough drive
> slots for that.

After a longer fruitless search on the interwebs (I ddidn’t want to start up
my NAS just to check this) I finally found the right search keywords and
found a reddit thread about that. And it even throws LVM into the
discussion. ^^
https://www.reddit.com/r/zfs/comments/fitc73/raidz_with_nested_vdevs/

Also :
“Here's a definitive answer from the man page for zpool.

Virtual devices cannot be nested, so a mirror or raidz virtual device can
only contain files or disks. Mirrors of mirrors (or other combinations) are
not allowed.”


I would advise against a JBOD pool anyways. Because if one drive dies, the
whole JBOD is gone. That goes for ZFS and probably for LVM, too (though I am
not sure how writes are distributed across JBOD disks). If the goal is
redundancy, you could buy a second drive to match the size of an existing
one and build a mirror. If redundancy is not a goal, then use the drives
separately like you do now. If one fails, then only its content is gone (or
even just the files sitting on the broken sector).

> Also, turn on compression. It saves me between 15-20% so 14TB becomes 16TB
> storage. YMMV. Video files don't compress, at least not much. Data files
> generally do.

It doesn’t hurt to switch it on, especially with lzo. But with video, the
benefit will be negligible. When storing a block of data (a “record” in ZFS
speak), it is passed through the compressor and only if the compression gain
is above a given threshold (10 % methinks), the block is written to disk
with compression.

What is more relevant in filesystems for big files (i.e. videos): set the
record size to 1 MB. The default is 64 kB, IIRC. Each record requires one
block of metadata (which includes the record checksum). So bigger records →
fewer meta blocks → better storage efficiency.

If you use big records for small files, then efficiency goes down a little.
It’s a similar (but a little more complicated) principle as when you write a
100 byte text file to a file system that uses 4 kB clusters. That file will
still use up 4 kB on disk.

The record size can be set per-dataset. So in your pool you could create a
dataset with a smaller record size for office documents, images and music,
and another dataset just for videos.

> Hope this helps. I think you'll find TrueNAS fun actually but there is a
> learning curve. I've used it for about a year and barely scratched the
> surface.

The main reason for me why I would wanna use it as opposed to a standard
Gentoo install: the OOTB web interface to manage all sorts of accounts,
access and permissions under one nice hood.

-- 

Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

A fermata comes to the doctor: “I can’t hold it any longer...”


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sun, Dec 11, 2022 at 8:01 AM Dale  wrote:

> I think I'm going to switch.  I need to start over anyway.  I set up a
user account and a large pool but while I can mount it, I can't put
anything in it yet.  I get a permission error.  I likely missed a step or
something.  Starting over will help correct that.  lol
>
> By the way, when I got it installed, it did update to a newer version.  I
didn't look to see if it was dated in any way but updates seem to be
available for FreeNAS.  I dunno.
>
> Thanks for the info.
>
> Dale
>
> :-)  :-)

At this point I think you're wise to just plug around in it for a little
while. Learn it a little bit. Build a few pools and get used to how it
works. It's a bit different than Linux.

In my case everything is NFS mounts and NFS exports work differently on
BSD. Assume you have a pool:

/mnt/MyPool/mark/Backups

and under that you want to have 3 directories exported to different
machines for backups, so

/mnt/MyPool/mark/Backups/science
/mnt/MyPool/mark/Backups/sciene2
/mnt/MyPool/mark/Backups/StellarMate

where each user machine has a place to put things, and hence you can find
it, but no LVM, it's just a big pool of storage. Note there are all the
standard problems about permissions when you first set these directories
up, like making sure you own them, that they are writable, etc.

In Linux NFS I would likely export all three separately, while in TrueNAS
BSD I export

/mnt/MyPool/mark --alldirs

If you cared about science mucking with science2's backups there are ways
to stop that, but I don't care because each machine on my network has a
bash scripts that points it where I want it to go:

mark@science2:~$ cat ./bin/DoTrueNAS
#rsync -avx -n --port=873
--exclude={000_NOT_BACKED_UP,RIPS,.cache,.nv,'google-chrome*',DiskImages,Current}
/home/mark mark@truenas1:/mnt/MyPool/mark/Backups/science2/.

rsync -avx --port=873
--exclude={000_NOT_BACKED_UP,RIPS,.cache,.nv,'google-chrome*',DiskImages,Current}
/home/mark mark@truenas1:/mnt/MyPool/mark/Backups/science2/.
mark@science2:~$

where the first one is a test config and the second is a real transfer.
Because it's rsync if something doesn't finish then I can pick up again
with little time lost.

Also, I think there are ways for you to build complex pools like a RAID0
from your 6TB and 8TB drives, and then a RAID1 using the RAID0 and your
14TB drive but I've never tried it because mine don't have enough drive
slots for that.

Also, turn on compression. It saves me between 15-20% so 14TB becomes 16TB
storage. YMMV. Video files don't compress, at least not much. Data files
generally do.

Hope this helps. I think you'll find TrueNAS fun actually but there is a
learning curve. I've used it for about a year and barely scratched the
surface.

Good luck,
Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sat, Dec 10, 2022 at 9:35 PM Dale  > wrote:
> >
> > Mark Knecht wrote:
> > > 
> > > >
> > > > I got a old rig I can use.  I actually burned OpenNAS, TrueNAS or
> > > FreeNAS on a USB stick.  I can't recall which one I put on it tho.  I
> > > downloaded all three.  lol  If you know that one is better than the
> > > others, feel free to share.  Also, I'd like to keep using LVM if I
> > > can.  If nothing else, I already got the data on the drives and won't
> > > have to reformat and copy again.  It took almost 100 hours to copy to
> > > the new 16TB drive.  Using LVM would make that easier, and faster.
> > > >
> > > > I'll have to work with what I got for now but I really like the
> > > Raspberry option for its size and good options to upgrade later.  I'll
> > > just make do with something else until that option is doable.  Maybe
> > > it won't be to long.
> > > >
> > > > Dale
> > > >
> > > > :-)  :-)
> > >
> > > TrueNAS Core. It's the free one. Works great. Very stable, but it is
> > > BSD, not Linux so you'll be frustrated sometimes. None the less it
> > > works very well.
> >
> >
> > Well, I booted it and it is FreeNAS.  I got it on a USB stick tho.
> > Well, I put the installer on one stick and then installed on a second
> > stick.  Kinda odd but I get it.  I also noticed it is BSD based.  I
> > played with BSD once before.  One thing I can say, it's secure.  Big
> time.
> >
>
> I'm not clear exactly but FreeNAS _BECAME_ TrueNAS Core and TrueNAS
> (all 3 versions) are the ones being worked on.
>
> Installing from USB is pretty standard. Installing to a USB flash drive
> is not unheard of in home NAS servers but be careful of machine
> placement because people talk about USB sockets being unreliable
> long term. I'm sure you'll figure it out, but make sure you're using
> TrueNAS Core. 
>
> > I see it uses ZFS or something.  No mention of LVM.  I figured that.  Oh
> > well.
>
> I see LVM as something that belongs on your machine, not your NAS
> device. Your LVM volumes will just be directories on the NAS. You will
> make your pools as large as you can afford and the NAS will just store
> your data. You don't really need to worry about that much. My NAS
> stores backups from 3 different machine, but all the backup data
> is in a single ZFS RAID1 pool located in directories which macth the 
> name of the machine that wrote them.
>  
> >
> > If I can't hammer FreeNAS into shape, I'll try TrueNAS next.  If it
> > works, that's fine too.  ;-)
>
> My input for the third time. Move to TrueNAS Core. That's the one
> that is being developed and getting support.
>  
> Mark


I think I'm going to switch.  I need to start over anyway.  I set up a
user account and a large pool but while I can mount it, I can't put
anything in it yet.  I get a permission error.  I likely missed a step
or something.  Starting over will help correct that.  lol 

By the way, when I got it installed, it did update to a newer version. 
I didn't look to see if it was dated in any way but updates seem to be
available for FreeNAS.  I dunno. 

Thanks for the info.

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sat, Dec 10, 2022 at 9:35 PM Dale  wrote:
>
> Mark Knecht wrote:
> > 
> > >
> > > I got a old rig I can use.  I actually burned OpenNAS, TrueNAS or
> > FreeNAS on a USB stick.  I can't recall which one I put on it tho.  I
> > downloaded all three.  lol  If you know that one is better than the
> > others, feel free to share.  Also, I'd like to keep using LVM if I
> > can.  If nothing else, I already got the data on the drives and won't
> > have to reformat and copy again.  It took almost 100 hours to copy to
> > the new 16TB drive.  Using LVM would make that easier, and faster.
> > >
> > > I'll have to work with what I got for now but I really like the
> > Raspberry option for its size and good options to upgrade later.  I'll
> > just make do with something else until that option is doable.  Maybe
> > it won't be to long.
> > >
> > > Dale
> > >
> > > :-)  :-)
> >
> > TrueNAS Core. It's the free one. Works great. Very stable, but it is
> > BSD, not Linux so you'll be frustrated sometimes. None the less it
> > works very well.
>
>
> Well, I booted it and it is FreeNAS.  I got it on a USB stick tho.
> Well, I put the installer on one stick and then installed on a second
> stick.  Kinda odd but I get it.  I also noticed it is BSD based.  I
> played with BSD once before.  One thing I can say, it's secure.  Big time.
>

I'm not clear exactly but FreeNAS _BECAME_ TrueNAS Core and TrueNAS
(all 3 versions) are the ones being worked on.

Installing from USB is pretty standard. Installing to a USB flash drive
is not unheard of in home NAS servers but be careful of machine
placement because people talk about USB sockets being unreliable
long term. I'm sure you'll figure it out, but make sure you're using
TrueNAS Core.

> I see it uses ZFS or something.  No mention of LVM.  I figured that.  Oh
> well.

I see LVM as something that belongs on your machine, not your NAS
device. Your LVM volumes will just be directories on the NAS. You will
make your pools as large as you can afford and the NAS will just store
your data. You don't really need to worry about that much. My NAS
stores backups from 3 different machine, but all the backup data
is in a single ZFS RAID1 pool located in directories which macth the
name of the machine that wrote them.

>
> If I can't hammer FreeNAS into shape, I'll try TrueNAS next.  If it
> works, that's fine too.  ;-)

My input for the third time. Move to TrueNAS Core. That's the one
that is being developed and getting support.

Mark

[OT] Re: [gentoo-user] NAS and replacing with larger drives

[Peter Humphrey]

On Friday, 9 December 2022 10:34:00 GMT I wrote:

> in the 1970s the national grid was monitored and analysed with a Ferranti
> Argus 500 machine with 24KB RAM and a 2MB disk. It was common for
> American visitors to believe that was just driving the control engineers'
> displays, and where was the main computer?

Er... There was no RAM in those days, not of the type we know today. In fact 
it was 2-microsecond core store. Each tiny ferromagnetic toroid was threaded 
with one X wire, one Y wire and (I think it was) a sync pulse wire. A 
remarkable labour of love to build such a thing.

-- 
Regards,
Peter.

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Thanks

Dave

On Sat, Dec 10, 2022, 11:19 AM Frank Steinmetzger  wrote:

> Am Sat, Dec 10, 2022 at 09:20:17AM + schrieb Wols Lists:
>
> > > > Depending on the PVR make/model I've seen 1080p resolution
> recordings with
> > > > .m2ts and .ts file extensions, while the codecs inside them are the
> same.
> -^^^
> >
> > > I wasn’t aware that ts could contain h264. But then again—I never
> really
> -^^^
> > > bothered with live TV recordings in recent years.
>
> > I think this is confusing CONTAINER and CODEC.
>
> Where do we confuse those two? We specifically talked of codecs and
> “contain”.
>
> > .ts is a container format, h264 is a codec. I don't understand it myself,
> > either but think of ts as your directory structure and h264 as your file
> > structure.
>
> Now you are confusing me. You say you don’t understand it, but then explain
> it. TS is like AVI and MKV: a file structure for the payload data. And
> payload data can be all kinds of stuff, from ASS plaintext subtitles, over
> opus audio to mpeg2 or h264 video.
>
> > Incidentally, sticking this stuff in a .tar is probably okay - that's
> just
> > another container, but sticking it in a .tar.gz is not, the gz is your
> codec
> > and will make the file BIGGER in all probability.
>
> Tar does not compress, it simply puts all inputs in a 1:1 stream. It does
> add some metadata (filename and so on). Packers reduce data volume by
> increasing information-per-byte. So if the total information stays the same
> (for lossless coding), the number of bytes decreases. Encoded video data
> ideally has even entropy. It is indistinguishable from random noise. That’s
> why compressing it again does not yield anything, or even adds some volume
> again.
>
> --
> Grüße | Greetings | Salut | Qapla’
> Please do not share anything from, with or about me on any social network.
>
> “Mankind must put an end to war or war will put an end to mankind.”
>  – John F. Kennedy
>

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Can I get sum help with privacy an control of my ph.

David

On Sat, Dec 10, 2022, 9:49 PM David Rosenbaum 
wrote:

> Tanks
>
> Dave
>
> On Sat, Dec 10, 2022, 9:46 PM David Rosenbaum 
> wrote:
>
>>
>>
>> Dave
>>
>> On Sat, Dec 10, 2022, 4:28 PM Mark Knecht  wrote:
>>
>>>
>>>
>>> On Sat, Dec 10, 2022 at 1:42 PM Dale  wrote:
>>> 
>>> > It does appear that several people are making it so NAS boxes can be
>>> > easily built by us nerdy types and not be huge.  Things are a bit
>>> > interesting right now for hardware and such.  Some parts are expensive,
>>> > hard to find or just plain unavailable.  Still, I suspect that this
>>> will
>>> > get better later on.  The good thing, people are working on this. There
>>> > is interest in having a option.
>>> >
>>>
>>> I know I've said this before but yes, people are working on it and it
>>> is buildable by people like us.
>>>
>>> https://www.truenas.com/truenas-core/
>>>
>>> Any old x64 PC and a few disks will get you up and running. It's
>>> open source as much as BSD is open source. It's not Linux
>>> so there was a little learning to do but it wasn't bad.
>>>
>>> Mine has a small SSD as the boot drive and then RAID1 pairs
>>> running OpenZFS for storage. It's inexpensive if you have an
>>> old computer to build on.
>>>
>>> Good luck,
>>> Mark
>>>
>>

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
> 
> >
> > I got a old rig I can use.  I actually burned OpenNAS, TrueNAS or
> FreeNAS on a USB stick.  I can't recall which one I put on it tho.  I
> downloaded all three.  lol  If you know that one is better than the
> others, feel free to share.  Also, I'd like to keep using LVM if I
> can.  If nothing else, I already got the data on the drives and won't
> have to reformat and copy again.  It took almost 100 hours to copy to
> the new 16TB drive.  Using LVM would make that easier, and faster.
> >
> > I'll have to work with what I got for now but I really like the
> Raspberry option for its size and good options to upgrade later.  I'll
> just make do with something else until that option is doable.  Maybe
> it won't be to long.
> >
> > Dale
> >
> > :-)  :-)
>
> TrueNAS Core. It's the free one. Works great. Very stable, but it is
> BSD, not Linux so you'll be frustrated sometimes. None the less it
> works very well.


Well, I booted it and it is FreeNAS.  I got it on a USB stick tho. 
Well, I put the installer on one stick and then installed on a second
stick.  Kinda odd but I get it.  I also noticed it is BSD based.  I
played with BSD once before.  One thing I can say, it's secure.  Big time.

I see it uses ZFS or something.  No mention of LVM.  I figured that.  Oh
well. 

If I can't hammer FreeNAS into shape, I'll try TrueNAS next.  If it
works, that's fine too.  ;-) 

Thanks.

Dale

:-)  :-) 

P. S.  When I first booted, I didn't have the ethernet plugged in.  It
wasn't happy about that.  Given it is NAS software, I should have known
better.  ROFL 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

>
> I got a old rig I can use.  I actually burned OpenNAS, TrueNAS or FreeNAS
on a USB stick.  I can't recall which one I put on it tho.  I downloaded
all three.  lol  If you know that one is better than the others, feel free
to share.  Also, I'd like to keep using LVM if I can.  If nothing else, I
already got the data on the drives and won't have to reformat and copy
again.  It took almost 100 hours to copy to the new 16TB drive.  Using LVM
would make that easier, and faster.
>
> I'll have to work with what I got for now but I really like the Raspberry
option for its size and good options to upgrade later.  I'll just make do
with something else until that option is doable.  Maybe it won't be to
long.
>
> Dale
>
> :-)  :-)

TrueNAS Core. It's the free one. Works great. Very stable, but it is BSD,
not Linux so you'll be frustrated sometimes. None the less it works very
well.

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Tanks

Dave

On Sat, Dec 10, 2022, 9:46 PM David Rosenbaum 
wrote:

>
>
> Dave
>
> On Sat, Dec 10, 2022, 4:28 PM Mark Knecht  wrote:
>
>>
>>
>> On Sat, Dec 10, 2022 at 1:42 PM Dale  wrote:
>> 
>> > It does appear that several people are making it so NAS boxes can be
>> > easily built by us nerdy types and not be huge.  Things are a bit
>> > interesting right now for hardware and such.  Some parts are expensive,
>> > hard to find or just plain unavailable.  Still, I suspect that this will
>> > get better later on.  The good thing, people are working on this. There
>> > is interest in having a option.
>> >
>>
>> I know I've said this before but yes, people are working on it and it
>> is buildable by people like us.
>>
>> https://www.truenas.com/truenas-core/
>>
>> Any old x64 PC and a few disks will get you up and running. It's
>> open source as much as BSD is open source. It's not Linux
>> so there was a little learning to do but it wasn't bad.
>>
>> Mine has a small SSD as the boot drive and then RAID1 pairs
>> running OpenZFS for storage. It's inexpensive if you have an
>> old computer to build on.
>>
>> Good luck,
>> Mark
>>
>

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Dave

On Sat, Dec 10, 2022, 4:28 PM Mark Knecht  wrote:

>
>
> On Sat, Dec 10, 2022 at 1:42 PM Dale  wrote:
> 
> > It does appear that several people are making it so NAS boxes can be
> > easily built by us nerdy types and not be huge.  Things are a bit
> > interesting right now for hardware and such.  Some parts are expensive,
> > hard to find or just plain unavailable.  Still, I suspect that this will
> > get better later on.  The good thing, people are working on this. There
> > is interest in having a option.
> >
>
> I know I've said this before but yes, people are working on it and it
> is buildable by people like us.
>
> https://www.truenas.com/truenas-core/
>
> Any old x64 PC and a few disks will get you up and running. It's
> open source as much as BSD is open source. It's not Linux
> so there was a little learning to do but it wasn't bad.
>
> Mine has a small SSD as the boot drive and then RAID1 pairs
> running OpenZFS for storage. It's inexpensive if you have an
> old computer to build on.
>
> Good luck,
> Mark
>

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Mark Knecht wrote:
>
>
> On Sat, Dec 10, 2022 at 1:42 PM Dale  > wrote:
> 
> > It does appear that several people are making it so NAS boxes can be
> > easily built by us nerdy types and not be huge.  Things are a bit
> > interesting right now for hardware and such.  Some parts are expensive,
> > hard to find or just plain unavailable.  Still, I suspect that this will
> > get better later on.  The good thing, people are working on this. There
> > is interest in having a option.
> >
>
> I know I've said this before but yes, people are working on it and it
> is buildable by people like us.
>
> https://www.truenas.com/truenas-core/
>
> Any old x64 PC and a few disks will get you up and running. It's 
> open source as much as BSD is open source. It's not Linux
> so there was a little learning to do but it wasn't bad.
>
> Mine has a small SSD as the boot drive and then RAID1 pairs
> running OpenZFS for storage. It's inexpensive if you have an 
> old computer to build on.
>
> Good luck,
> Mark

I got a old rig I can use.  I actually burned OpenNAS, TrueNAS or
FreeNAS on a USB stick.  I can't recall which one I put on it tho.  I
downloaded all three.  lol  If you know that one is better than the
others, feel free to share.  Also, I'd like to keep using LVM if I can. 
If nothing else, I already got the data on the drives and won't have to
reformat and copy again.  It took almost 100 hours to copy to the new
16TB drive.  Using LVM would make that easier, and faster.

I'll have to work with what I got for now but I really like the
Raspberry option for its size and good options to upgrade later.  I'll
just make do with something else until that option is doable.  Maybe it
won't be to long. 

Dale

:-)  :-) 

Re: [gentoo-user] NAS and replacing with larger drives

[Mark Knecht]

On Sat, Dec 10, 2022 at 1:42 PM Dale  wrote:

> It does appear that several people are making it so NAS boxes can be
> easily built by us nerdy types and not be huge.  Things are a bit
> interesting right now for hardware and such.  Some parts are expensive,
> hard to find or just plain unavailable.  Still, I suspect that this will
> get better later on.  The good thing, people are working on this. There
> is interest in having a option.
>

I know I've said this before but yes, people are working on it and it
is buildable by people like us.

https://www.truenas.com/truenas-core/

Any old x64 PC and a few disks will get you up and running. It's
open source as much as BSD is open source. It's not Linux
so there was a little learning to do but it wasn't bad.

Mine has a small SSD as the boot drive and then RAID1 pairs
running OpenZFS for storage. It's inexpensive if you have an
old computer to build on.

Good luck,
Mark

Re: [gentoo-user] NAS and replacing with larger drives

[Dale]

Dale wrote:
> Howdy,
>
> I've pretty much reached a limit on my backups.  I'm up to a 16TB hard
> drive for one and even that won't last long.  Larger drives are much
> more costly.  A must have NAS is quickly approaching.  I've been
> searching around and find some things confusing.  I'm hoping someone can
> clear up that confusion.  I'm also debating what path to travel down. 
> I'd also like to keep costs down as well.  That said, I don't mind
> paying a little more for one that would offer a much better option. 
>
> Path one, buy a NAS, possibly used, that has no drives.  If possible, I
> may even replace the OS that comes on it or upgrade if I can.  I'm not
> looking for fancy, or even RAID.  Just looking for a two bay NAS that
> will work.  First, what is a DAS?  Is that totally different than a
> NAS?  From what I've found, a DAS is not what I'm looking for since I
> want a ethernet connection and the ability to control things over the
> network.  It seems DAS lacks that feature but not real sure.  I'm not
> sure I can upgrade the software/OS on a DAS either. 
>
> Next thing.  Let's say a NAS comes with two 4TB drives for a total of
> 8TB of capacity from the factory, using LVM or similar software I
> assume.  Is that limited to that capacity or can I for example replace
> one or both drives with for example 14TB drives for a total of 28TBs of
> capacity?  If one does that, let's say it uses LVM, can I somehow move
> data as well or is that beyond the abilities of a NAS?  Could it be done
> inside my computer for example?  Does this vary by brand or even model? 
>
> Path two, I've researched building a NAS using a Raspberry Pi 4 8GB as
> another option.  They come as parts, cases too, but the newer and faster
> models of Raspberry Pi 4 with more ram seem to work pretty well.  The
> old slower models with small amounts of ram don't fair as well.  While I
> want a descent speed, I'm not looking for or expecting it to be
> blazingly fast.  I just wonder, if from a upgrade and expansion point of
> view, if building a NAS would be better.  I've also noticed, it seems
> all Raspberry things come with a display port.  That means I could hook
> up a monitor and mouse/keyboard when needed.  That could be a bonus. 
> Heck, I may can even put some sort of Gentoo on that thing.  :-D
>
> One reason I'm wanting to go this route, I'm trying to keep it small and
> able to fit inside my fire safe.  I plan to buy a media type safe that
> is larger but right now, it needs to fit inside my current safe.  Most
> of the 2 bay NAS or a Raspberry Pi based NAS are fairly small.  They not
> much bigger than the three external hard drives and a couple bare drives
> that currently occupy my safe. 
>
> One thing I'd like to have no matter what path I go down, the ability to
> encrypt the data.  My current backup drives are encrypted and I'd like
> to keep it that way.  If that is possible to do.  I suspect the
> Raspberry option would since I'd control the OS/software placed on it. 
> I could be wrong tho. 
>
> One last thing.  Are there any NAS type boxes that I should absolutely
> avoid if I go that route?  Maybe it is a model that has serious
> limitations or has other problems.  I think the DAS thing may be one for
> me to avoid but I'm not for sure what limits it has.  Google didn't help
> a lot. It also could be as simple as, avoid any model that says this in
> the description or uses some type of software that is bad or limits
> options. 
>
> Thoughts?  Info to share?  Ideas on a best path forward?  Buy already
> built or build?
>
> Thanks.
>
> Dale
>
> :-)  :-) 
>

It does appear that several people are making it so NAS boxes can be
easily built by us nerdy types and not be huge.  Things are a bit
interesting right now for hardware and such.  Some parts are expensive,
hard to find or just plain unavailable.  Still, I suspect that this will
get better later on.  The good thing, people are working on this. There
is interest in having a option. 

I may in the meantime have to split up my large directory and the
resulting backup.  Split it in half or something.  I just bought a 16TB
hard drive.  It's over 90% full already.  That said, my downloading is
slowing down quite a lot.  It will last a while.  I may setup a old
system as a NAS and just keep it in a outbuilding for the time being. 
Should offer me some protection at least.

If anyone runs up on some info that might relate to this, please share. 
Maybe something new will come out that we don't know about now. If I do
build something, I'll likely post and share what I used, how much effort
was involved and the end results. Maybe this will help others as well.

Thanks.

Dale

:-)  :-)

P. S.  I currently have a spare 14TB, 8TB and 6TB hard drive not in
use.  That's 28TBs available.  That's a good start on a NAS as far as
drives go.  Currently in use in external enclosures for backups, 16Tb,
8TB and a 6TB hard drive. 

Re: [gentoo-user] NAS and replacing with larger drives

[David Rosenbaum]

Someone has hacked my ph.im 44 years old an pay for every thing.house car
an wifi

Dave

On Sat, Dec 10, 2022, 12:28 PM Michael  wrote:

> On Saturday, 10 December 2022 16:30:03 GMT Wols Lists wrote:
> > On 10/12/2022 16:19, Frank Steinmetzger wrote:
> > > Where do we confuse those two? We specifically talked of codecs and
> > > “contain”.
> >
> > "I didn't know .ts could contain h264".
> >
> > If .ts is the container, then surely the assumption is it can contain
> > any codec? If not, why not?
>
> Not any codec.  Some container formats are only compatible with certain
> codecs, or rather the other way around.  Have a look here:
>
> https://en.wikipedia.org/wiki/Comparison_of_video_container_formats
>
> I suppose the answer to 'why not' boils down to the whatever structure and
> data the container format is designed to be compatible with, but I don't
> know
> more than this.
>
>
> https://en.wikipedia.org/wiki/File:Informatik-Containerformate-Beispiele.svg
>
>

Re: [gentoo-user] NAS and replacing with larger drives

[Michael]

On Saturday, 10 December 2022 16:30:03 GMT Wols Lists wrote:
> On 10/12/2022 16:19, Frank Steinmetzger wrote:
> > Where do we confuse those two? We specifically talked of codecs and
> > “contain”.
> 
> "I didn't know .ts could contain h264".
> 
> If .ts is the container, then surely the assumption is it can contain
> any codec? If not, why not?

Not any codec.  Some container formats are only compatible with certain 
codecs, or rather the other way around.  Have a look here:

https://en.wikipedia.org/wiki/Comparison_of_video_container_formats

I suppose the answer to 'why not' boils down to the whatever structure and 
data the container format is designed to be compatible with, but I don't know 
more than this.

https://en.wikipedia.org/wiki/File:Informatik-Containerformate-Beispiele.svg



signature.asc
Description: This is a digitally signed message part.

Re: [gentoo-user] NAS and replacing with larger drives

[Wols Lists]

On 10/12/2022 16:19, Frank Steinmetzger wrote:

Where do we confuse those two? We specifically talked of codecs and
“contain”.


"I didn't know .ts could contain h264".

If .ts is the container, then surely the assumption is it can contain 
any codec? If not, why not?


(Yes I do get the impression I didn't read the OP properly. But then, 
the OP didn't make sense properly so I'm not surprised I got it wrong :-)


Cheers,
Wol

Re: [gentoo-user] NAS and replacing with larger drives

[Frank Steinmetzger]

Am Sat, Dec 10, 2022 at 09:20:17AM + schrieb Wols Lists:

> > > Depending on the PVR make/model I've seen 1080p resolution recordings with
> > > .m2ts and .ts file extensions, while the codecs inside them are the same.
-^^^
> 
> > I wasn’t aware that ts could contain h264. But then again—I never really
-^^^
> > bothered with live TV recordings in recent years.

> I think this is confusing CONTAINER and CODEC.

Where do we confuse those two? We specifically talked of codecs and
“contain”.

> .ts is a container format, h264 is a codec. I don't understand it myself,
> either but think of ts as your directory structure and h264 as your file
> structure.

Now you are confusing me. You say you don’t understand it, but then explain
it. TS is like AVI and MKV: a file structure for the payload data. And
payload data can be all kinds of stuff, from ASS plaintext subtitles, over
opus audio to mpeg2 or h264 video.

> Incidentally, sticking this stuff in a .tar is probably okay - that's just
> another container, but sticking it in a .tar.gz is not, the gz is your codec
> and will make the file BIGGER in all probability.

Tar does not compress, it simply puts all inputs in a 1:1 stream. It does
add some metadata (filename and so on). Packers reduce data volume by
increasing information-per-byte. So if the total information stays the same
(for lossless coding), the number of bytes decreases. Encoded video data
ideally has even entropy. It is indistinguishable from random noise. That’s
why compressing it again does not yield anything, or even adds some volume
again.

-- 
Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

“Mankind must put an end to war or war will put an end to mankind.”
 – John F. Kennedy


signature.asc
Description: PGP signature

Re: [gentoo-user] NAS and replacing with larger drives

[Wols Lists]

On 09/12/2022 13:38, Frank Steinmetzger wrote:

Depending on the PVR make/model I've seen 1080p resolution recordings with
.m2ts and .ts file extensions, while the codecs inside them are the same.



I wasn’t aware that ts could contain h264. But then again—I never really
bothered with live TV recordings in recent years. These days, if I find
something interesting, I download the show form the TV channel’s website
(called Mediathek in Germany, a word play on Bibliothek, meaning library).
Interestingly though, the picture quality is noticably worse than what I
receive via DVB-T.


I think this is confusing CONTAINER and CODEC.

.ts is a container format, h264 is a codec. I don't understand it 
myself, either, but think of ts as your directory structure and h264 as 
your file structure.


Incidentally, sticking this stuff in a .tar is probably okay - that's 
just another container, but sticking it in a .tar.gz is not, the gz is 
your codec and will make the file BIGGER in all probability.


Cheers,
Wol

Re: [OT] Re: [gentoo-user] NAS and replacing with larger drives

[Peter Humphrey]

On Friday, 9 December 2022 14:38:14 GMT Frank Steinmetzger wrote:
> Am Fri, Dec 09, 2022 at 02:27:07PM + schrieb Peter Humphrey:
> > 1.  Mind you, UK TV adverts are nowhere near as gross as the screeching
> > horrors I was subjected to in Minneapolis 30 years ago.
> 
> I can only imagine.

Actually, I doubt you can unless you've experienced something like it - in 
which case I sympathise.   :)

-- 
Regards,
Peter.

Re: [gentoo-user] NAS and replacing with larger drives

[Paul Colquhoun]

On Friday, December 9, 2022 12:58:38 A.M. AEDT Dale wrote:


> I was thinking DAS was not a good option.  It seems like a feature
> removed and cheaper version of NAS. 

Maybe get the DAS, then connect it to the Rasberry Pi 4, to make a DIY NAS.

That way you get a propper encolsure for your drives, without needing to cobble 
something together.


-- 
Reverend Paul Colquhoun, ULC. http://andor.dropbear.id.au/
  Asking for technical help in newsgroups?  Read this first:
 http://catb.org/~esr/faqs/smart-questions.html#intro