Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-12 Thread Dr. Axel Stammler via GLLUG
Hi, And thanks again, I have followed your advice, creating an 8TB mirrored logical volume on my two new drives, i.e. using 1 mirror = 2 copies. On Mon 2020-05-11 13.15.55, Greater London Linux User Group wrote: Hi, What size are the partitions on the old 8TB disks? Is it a single partition

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-12 Thread Dr. Axel Stammler via GLLUG
Hi, On Mon 2020-05-11 22.31.44, James Courtier-Dutton wrote: Which filesystem are you using on the old 8TB disk? For example, if it is btrfs, you don't have to copy anything about. btrfs does its own raid 0. You can just add more disks as you need them and btrfs just uses them. Interesting.

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread James Courtier-Dutton via GLLUG
Hi, I forgot another obvious question. Which filesystem are you using on the old 8TB disk? For example, if it is btrfs, you don't have to copy anything about. btrfs does its own raid 0. You can just add more disks as you need them and btrfs just uses them. Kind Regards James -- GLLUG mailing

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread John Winters via GLLUG
On 11/05/2020 20:14, Dr. Axel Stammler via GLLUG wrote: [snip] I feel rather nervous as I am about to do all this, and I do have some questions (see below). [snip detailed steps] I wouldn't do it that way. Possibly someone else can tell us a reason why it's worth moving the RAID

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread Dr. Axel Stammler via GLLUG
Hi, And thank you for all contributions. On Mon 2020-05-11 19.40.15, Greater London Linux User Group wrote: On Mon, May 11, 2020 at 01:15:55PM +0100, James Courtier-Dutton via GLLUG wrote: If you have a separate data from the OS partition: you could "rsync -avpP" the

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread Dr. Axel Stammler via GLLUG
Hi, On Mon 2020-05-11 10.58.13, Greater London Linux User Group wrote: I believe modern mdadm can reshape a RAID-1 into a RAID-0 then a RAID-0 into a RAID-10 and then add extra devices. https://www.berthon.eu/2017/converting-raid1-to-raid10-online/ There will be a scary time when it is

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread John Edwards via GLLUG
Hi On Mon, May 11, 2020 at 01:15:55PM +0100, James Courtier-Dutton via GLLUG wrote: > If you have a separate data from the OS partition: > you could "rsync -avpP" the data/image/picture/whatever files over to > the new disks on top of LVM. > You could handle the OS partition offline. > You

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread Dr. Axel Stammler via GLLUG
Hi, On Mon 2020-05-11 10.02.00, Greater London Linux User Group wrote: On 10/05/2020 21:35, Andy Smith via GLLUG wrote: Hello, On Sun, May 10, 2020 at 10:03:32PM +0200, Dr. Axel Stammler via GLLUG wrote: On Sun 2020-05-10 08.53.16, James Courtier-Dutton wrote: So, I think moving to an "LVM

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread Dr. Axel Stammler via GLLUG
Hi, Andy, On Sun 2020-05-10 20.35.20, Greater London Linux User Group wrote: On Sun, May 10, 2020 at 10:03:32PM +0200, Dr. Axel Stammler via GLLUG wrote: On Sun 2020-05-10 08.53.16, James Courtier-Dutton wrote: >So, I think moving to an "LVM mirror" solution is your best bet for >future

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread Dr. Axel Stammler via GLLUG
Hi, On Mon 2020-05-11 13.15.55, Greater London Linux User Group wrote: What size are the partitions on the old 8TB disks? Is it a single partition for all 8TB ? Yes, it is. The system is on a separate hard disk drive. If you have a separate data from the OS partition: you could "rsync

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread James Roberts via GLLUG
On 11/05/2020 11:58, Andy Smith via GLLUG wrote: ... Yes I actually think it is possible and is a reasonable plan, though backups will still be advised. I didn't suggest this at first because initially we thought there were unequal-sized devices (4T and 8T). Same here. I believe modern

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread James Courtier-Dutton via GLLUG
Hi, What size are the partitions on the old 8TB disks? Is it a single partition for all 8TB ? If you have a separate data from the OS partition: you could "rsync -avpP" the data/image/picture/whatever files over to the new disks on top of LVM. You could handle the OS partition offline. You can

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread Andy Smith via GLLUG
Hello, On Mon, May 11, 2020 at 10:22:46AM +0100, John Winters via GLLUG wrote: > On 11/05/2020 10:02, James Roberts via GLLUG wrote: > >I haven't reviewed all the recent replies, but is there any reason why you > >can't add the the two new disks of the same size and migrate from RAID 1 > >to RAID

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-11 Thread James Roberts via GLLUG
On 10/05/2020 21:35, Andy Smith via GLLUG wrote: Hello, On Sun, May 10, 2020 at 10:03:32PM +0200, Dr. Axel Stammler via GLLUG wrote: On Sun 2020-05-10 08.53.16, James Courtier-Dutton wrote: So, I think moving to an "LVM mirror" solution is your best bet for future extensibility. I haven't

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-10 Thread Andy Smith via GLLUG
Hello, On Sun, May 10, 2020 at 10:03:32PM +0200, Dr. Axel Stammler via GLLUG wrote: > On Sun 2020-05-10 08.53.16, James Courtier-Dutton wrote: > >So, I think moving to an "LVM mirror" solution is your best bet for > >future extensibility. > > After reviewing all options, this indeed seems to be

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-10 Thread Dr. Axel Stammler via GLLUG
On Sun 2020-05-10 08.53.16, James Courtier-Dutton wrote: So, there is a solution that uses tiled RAID. LVM has a "mirror" option. https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/4/html/cluster_logical_volume_manager/mirrored_volumes If you used that, you would not need a

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-10 Thread John Edwards via GLLUG
Hi On Sun, May 10, 2020 at 03:12:54PM +0200, Dr. Axel Stammler via GLLUG wrote: > Hmm. How long would it take to copy (nearly) 8 TB? Depends a lot of the size and type of the data. If large video files then those will copy fast, but if the files are all small or are hard links then there is

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-10 Thread John Winters via GLLUG
On 10/05/2020 14:12, Dr. Axel Stammler via GLLUG wrote: [snip] One thing which might work for you is to make your two new drives into a RAID1 set and then use resulting device as your first Physical Volume. Create a large logical volume within it, copy all your existing files over (boring),

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-10 Thread Dr. Axel Stammler via GLLUG
Thank you. On Sun 2020-05-10 07.39.31, Greater London Linux User Group wrote: On 09/05/2020 20:32, Dr. Axel Stammler via GLLUG wrote: On Sat 2020-05-09 11.24.15, Greater London Linux User Group wrote: How do you intend to combine them? You won't be able to put your existing array into the

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-10 Thread James Courtier-Dutton via GLLUG
On Sat, 9 May 2020 at 12:03, Dr. Axel Stammler wrote: > > Hi, > > Thank you for your detailed look at possible setups. I remembered my old > setup incorrectly, though, so that I am not sure everything is applicable. My > original (2016) setup included two hard disk drives of not 4 TB but 8 TB

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-09 Thread Andy Smith via GLLUG
On Sat, May 09, 2020 at 11:24:15AM +, Andy Smith via GLLUG wrote: > How do you intend to combine them? You won't be able to put your > existing array into the LVM without destroying its contents. Forgot to mention; this sort of conundrum is why it's often useful to put things in LVM to begin

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-09 Thread Andy Smith via GLLUG
Hi Axel, On Sat, May 09, 2020 at 01:03:37PM +0200, Dr. Axel Stammler via GLLUG wrote: > My original (2016) setup included two hard disk drives of not 4 TB > but 8 TB capacity in a RAID-1 that has reached 92 per cent > capacity. […] > I have ordered two more […] my first idea was to create a new

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-09 Thread Dr. Axel Stammler via GLLUG
Hi, Thank you for your detailed look at possible setups. I remembered my old setup incorrectly, though, so that I am not sure everything is applicable. My original (2016) setup included two hard disk drives of not 4 TB but 8 TB capacity in a RAID-1 that has reached 92 per cent capacity. On

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-02 Thread James Courtier-Dutton via GLLUG
Hi, Regarding which are SMR. Here is a good place to start: https://hardware.slashdot.org/story/20/04/29/2119250/toshiba-publishes-full-list-of-its-drives-using-slower-smr-technology TOSHIBA: https://toshiba.semicon-storage.com/ap-en/company/news/news-topics/2020/04/storage-20200428-1.html WD:

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-02 Thread Dr. Axel Stammler via GLLUG
Hi, On Tue 2020-04-28 16.10.42, Greater London Linux User Group wrote: Next up, if your drives don't support SCTERC timeout facility then this is not ideal for a Linux RAID system but can be worked around Thanks. This is another great tip. Is there any way to find out if a drive has that

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-02 Thread Mike Brodbelt via GLLUG
On 02/05/2020 13:48, Dr. Axel Stammler via GLLUG wrote: Hi, Thanks for these valuable tips, especially the one about SMR. I have looked at the topic in more detail and I am really glad I did. Could you suggest a way of finding non-SMR hard disk drives, especially at decent prices? Cheap is

Re: [GLLUG] Link two RAIDs in one LVM?

2020-05-02 Thread Dr. Axel Stammler via GLLUG
On Tue 2020-04-28 13.19.10, James Courtier-Dutton wrote: First for RAID, avoid SMR HDDs. (Shingled magnetic recording) Hi, Thanks for these valuable tips, especially the one about SMR. I have looked at the topic in more detail and I am really glad I did. Could you suggest a way of finding

Re: [GLLUG] Link two RAIDs in one LVM?

2020-04-28 Thread Andy Smith via GLLUG
Hi, On Tue, Apr 28, 2020 at 01:18:08PM +0200, Dr. Axel Stammler via GLLUG wrote: > I have a 4 TB RAID system (two identical hard disks combined in a > RAID-1, created using mdadm). Now, after a few years, this has > reached 90% capacity, and I am thinking about first adding another > similar 8 TB

Re: [GLLUG] Link two RAIDs in one LVM?

2020-04-28 Thread James Courtier-Dutton via GLLUG
On Tue, 28 Apr 2020 at 12:18, Dr. Axel Stammler via GLLUG wrote: > > Hi, > > I have a 4 TB RAID system (two identical hard disks combined in a RAID-1, > created using mdadm). Now, after a few years, this has reached 90% capacity, > and I am thinking about first adding another similar 8 TB RAID

[GLLUG] Link two RAIDs in one LVM?

2020-04-28 Thread Dr. Axel Stammler via GLLUG
Hi, I have a 4 TB RAID system (two identical hard disks combined in a RAID-1, created using mdadm). Now, after a few years, this has reached 90% capacity, and I am thinking about first adding another similar 8 TB RAID system and then combining them into one 12 GB RAID 1+0 filesystem. I should