Re: [ceph-users] JBOD question
Satish, Yes, that card support 'both'. You have to flash the IR firmware (IT Firmware = JBOD only) and then you are able to create RAID1 sets in the BIOS of the card and any ununsed disks will be seen by the OS as 'jbod' Kind regards, Caspar Smit 2018-07-23 20:43 GMT+02:00 Satish Patel : > I am planning to buy "LSI SAS 9207-8i" does anyone know it support > both RAID & JBOD mode together so i can do RAID-1 on OS disk and other > disk for JBOD > > On Sat, Jul 21, 2018 at 11:16 AM, Willem Jan Withagen > wrote: > > On 21/07/2018 01:45, Oliver Freyermuth wrote: > >> > >> Hi Satish, > >> > >> that really completely depends on your controller. > >> > > > > This is what I get on an older AMCC 9550 controller. > > Note that the disk type is set to JBOD. But the disk descriptors are > hidden. > > And you'll never know what more is not done right. > > > > Geom name: da6 > > Providers: > > 1. Name: da6 > >Mediasize: 1000204886016 (932G) > >Sectorsize: 512 > >Mode: r1w1e2 > >descr: AMCC 9550SXU-8L DISK > >lunname: AMCCZ1N00KBD > >lunid: AMCCZ1N00KBD > >ident: Z1N00KBD > >rotationrate: unknown > >fwsectors: 63 > >fwheads: 255 > > > > This is an LSI 9802 controller in IT mode: > > (And that gives me a bit more faith) > > Geom name: da7 > > Providers: > > 1. Name: da7 > >Mediasize: 3000592982016 (2.7T) > >Sectorsize: 512 > >Mode: r1w1e1 > >descr: WDC WD30EFRX-68AX9N0 > >lunid: 0004d927f870 > >ident: WD-WMC1T4088693 > >rotationrate: unknown > >fwsectors: 63 > >fwheads: 255 > > > > --WjW > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] JBOD question
I am planning to buy "LSI SAS 9207-8i" does anyone know it support both RAID & JBOD mode together so i can do RAID-1 on OS disk and other disk for JBOD On Sat, Jul 21, 2018 at 11:16 AM, Willem Jan Withagen wrote: > On 21/07/2018 01:45, Oliver Freyermuth wrote: >> >> Hi Satish, >> >> that really completely depends on your controller. >> > > This is what I get on an older AMCC 9550 controller. > Note that the disk type is set to JBOD. But the disk descriptors are hidden. > And you'll never know what more is not done right. > > Geom name: da6 > Providers: > 1. Name: da6 >Mediasize: 1000204886016 (932G) >Sectorsize: 512 >Mode: r1w1e2 >descr: AMCC 9550SXU-8L DISK >lunname: AMCCZ1N00KBD >lunid: AMCCZ1N00KBD >ident: Z1N00KBD >rotationrate: unknown >fwsectors: 63 >fwheads: 255 > > This is an LSI 9802 controller in IT mode: > (And that gives me a bit more faith) > Geom name: da7 > Providers: > 1. Name: da7 >Mediasize: 3000592982016 (2.7T) >Sectorsize: 512 >Mode: r1w1e1 >descr: WDC WD30EFRX-68AX9N0 >lunid: 0004d927f870 >ident: WD-WMC1T4088693 >rotationrate: unknown >fwsectors: 63 >fwheads: 255 > > --WjW ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] JBOD question
On 21/07/2018 01:45, Oliver Freyermuth wrote: Hi Satish, that really completely depends on your controller. This is what I get on an older AMCC 9550 controller. Note that the disk type is set to JBOD. But the disk descriptors are hidden. And you'll never know what more is not done right. Geom name: da6 Providers: 1. Name: da6 Mediasize: 1000204886016 (932G) Sectorsize: 512 Mode: r1w1e2 descr: AMCC 9550SXU-8L DISK lunname: AMCCZ1N00KBD lunid: AMCCZ1N00KBD ident: Z1N00KBD rotationrate: unknown fwsectors: 63 fwheads: 255 This is an LSI 9802 controller in IT mode: (And that gives me a bit more faith) Geom name: da7 Providers: 1. Name: da7 Mediasize: 3000592982016 (2.7T) Sectorsize: 512 Mode: r1w1e1 descr: WDC WD30EFRX-68AX9N0 lunid: 0004d927f870 ident: WD-WMC1T4088693 rotationrate: unknown fwsectors: 63 fwheads: 255 --WjW ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] JBOD question
On Fri, Jul 20, 2018 at 4:01 PM, Satish Patel wrote: > Folks, > > I never used JBOD mode before and now i am planning so i have stupid > question if i switch RAID controller to JBOD mode in that case how > does my OS disk will get mirror? > > Do i need to use software raid for OS disk when i use JBOD mode? > ___ I have recently deployed a couple of Proxmox nodes with ZFS RAID1 boot disk and it seems to work quite well. This is a link on how to replace a failed disk: https://pve.proxmox.com/wiki/ZFS:_Tips_and_Tricks#Replacing_a_failed_disk_in_the_root_pool I like the fact that a failed drive will be reported to the OS, which is not always the case with hardware RAID controllers. -- Alex Gorbachev Storcium ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] JBOD question
Hi Satish, that really completely depends on your controller. For what it's worth: We have AVAGO MegaRAID controllers (9361 series). They can be switched to a "JBOD personality". After doing so and reinitializing (poewrcycling), the cards change PCI-ID and run a different firmware, optimized for JBOD mode (with different caching etc.). Also, the block devices are ordered differently. In that mode, new disks will be exported as JBOD by default, but you can still do RAID1 and RAID0. I think RAID5 and RAID6 are disabled, though. We are using those to have a RAID 1 for our OS and export the rest as JBOD for CephFS. So there surely are controllers which can only do JBOD in addition (without a special controller mode / "personality"), controllers which can be switched, but simple RAID levels are still possible, and I'm also sure there are controllers out there which can be switched to JBOD mode and can't do anything RAID anymore in that mode. If that's the case, just go with software RAID for the OS, or install your servers with a good deployment tool so you can just reinstall them if the OS breaks (we also do that for some Ceph servers with simpler RAID controllers). With a good deployment tool, reinstalling takes 1 click and waiting 40 minutes - but of course, the server will still be down until a broken OS HDD is replaced physically. But Ceph has redundancy for that :-). Cheers, Oliver Am 20.07.2018 um 23:52 schrieb Satish Patel: > Thanks Brian, > > That make sense because i was reading document and found you can > either choose RAID or JBOD > > On Fri, Jul 20, 2018 at 5:33 PM, Brian : wrote: >> Hi Satish >> >> You should be able to choose different modes of operation for each >> port / disk. Most dell servers will let you do RAID and JBOD in >> parallel. >> >> If you can't do that and can only either turn RAID on or off then you >> can use SW RAID for your OS >> >> >> On Fri, Jul 20, 2018 at 9:01 PM, Satish Patel wrote: >>> Folks, >>> >>> I never used JBOD mode before and now i am planning so i have stupid >>> question if i switch RAID controller to JBOD mode in that case how >>> does my OS disk will get mirror? >>> >>> Do i need to use software raid for OS disk when i use JBOD mode? >>> ___ >>> ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > smime.p7s Description: S/MIME Cryptographic Signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] JBOD question
Thanks Brian, That make sense because i was reading document and found you can either choose RAID or JBOD On Fri, Jul 20, 2018 at 5:33 PM, Brian : wrote: > Hi Satish > > You should be able to choose different modes of operation for each > port / disk. Most dell servers will let you do RAID and JBOD in > parallel. > > If you can't do that and can only either turn RAID on or off then you > can use SW RAID for your OS > > > On Fri, Jul 20, 2018 at 9:01 PM, Satish Patel wrote: >> Folks, >> >> I never used JBOD mode before and now i am planning so i have stupid >> question if i switch RAID controller to JBOD mode in that case how >> does my OS disk will get mirror? >> >> Do i need to use software raid for OS disk when i use JBOD mode? >> ___ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] JBOD question
Hi Satish You should be able to choose different modes of operation for each port / disk. Most dell servers will let you do RAID and JBOD in parallel. If you can't do that and can only either turn RAID on or off then you can use SW RAID for your OS On Fri, Jul 20, 2018 at 9:01 PM, Satish Patel wrote: > Folks, > > I never used JBOD mode before and now i am planning so i have stupid > question if i switch RAID controller to JBOD mode in that case how > does my OS disk will get mirror? > > Do i need to use software raid for OS disk when i use JBOD mode? > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] JBOD question
Folks, I never used JBOD mode before and now i am planning so i have stupid question if i switch RAID controller to JBOD mode in that case how does my OS disk will get mirror? Do i need to use software raid for OS disk when i use JBOD mode? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
