Re: [ceph-users] Replacing OSD drive without rempaping pg's

[Lindsay Mathieson]

On 02/03/16 02:41, Robert LeBlanc wrote:

With a fresh disk, you will need to remove the old key in ceph (ceph
auth del osd.X) and the old osd (ceph osd rm X), but I think you can
leave the CRUSH map alone (don't do ceph osd crush rm osd.X) so that
there isn't any additional data movement (if there aren't any
available OSD numbers less than the OSD being replaced, it will get
the same ID.


Thanks Robert, tried out that procedure last night, it worked the best.

--
Lindsay Mathieson

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Replacing OSD drive without rempaping pg's

[Lindsay Mathieson]

On 02/03/16 02:41, Robert LeBlanc wrote:

With a fresh disk, you will need to remove the old key in ceph (ceph
auth del osd.X) and the old osd (ceph osd rm X), but I think you can
leave the CRUSH map alone (don't do ceph osd crush rm osd.X) so that
there isn't any additional data movement (if there aren't any
available OSD numbers less than the OSD being replaced, it will get
the same ID. There may also be a way to specify an ID, but I haven't
used it). Then when you add the new disk in, it only backfills what
the previous disk had, unless the size is different, then it will take
on more or less and shuffle some things around the cluster.



Thanks Robert, that makes sense. I'll try it out tonight.

--
Lindsay Mathieson

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Replacing OSD drive without rempaping pg's

[Robert LeBlanc]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

With a fresh disk, you will need to remove the old key in ceph (ceph
auth del osd.X) and the old osd (ceph osd rm X), but I think you can
leave the CRUSH map alone (don't do ceph osd crush rm osd.X) so that
there isn't any additional data movement (if there aren't any
available OSD numbers less than the OSD being replaced, it will get
the same ID. There may also be a way to specify an ID, but I haven't
used it). Then when you add the new disk in, it only backfills what
the previous disk had, unless the size is different, then it will take
on more or less and shuffle some things around the cluster.
-BEGIN PGP SIGNATURE-
Version: Mailvelope v1.3.6
Comment: https://www.mailvelope.com

wsFcBAEBCAAQBQJW1cZBCRDmVDuy+mK58QAAm9EQAMVOnCOrBkqGaczy5+ds
yplotd9kKt/eyhp1nSgPJD+4RdOVQjoL4VVLtCfApXcMfxHkW/vBjpOWD1Bh
l14NDjCzpkXM5HpHqQkiel/7thcN45u/Z7wSX8T+x9ontYn1Bv0CfI/6qaFb
DmIYdAGjdLgWKpORyeN1WjgrU5DzUbCMHw/3sLfieVpoYsh91dMuxt33366z
mcMQ6RYIE/5xpm8LkTsjYkmnl7Xes5fGsIAlx6kJDHpAoBBWEfstjgtCXIBt
PgDnBJ/SwisAQKXuQOZg87/3OE+qFQUyILwFE3USD3ugx8xvo1aUGnerY/mT
8rUNfFLCPLhdiAp1fr2kkQW/SfV7spkNkZ/v99J/9dEwSj2pgJ7iHMGNr/Em
K3oLezrm7NO2RHsMrn/pz82bO1CSzHrRQ5Aq7Re2r48zYeFxSgvcbMk6Ogzh
rDPb2q+QEw/UbIuotl09ab3OGCjzXxhfDIQ44iEUEj0l2Cl5MQQcakdYakoC
WCPaqIN7ocqiWnQPY/RnSXuhUgsd8uTBtxcXtHp+y0feAf/80nxc3dFWDfiK
8sKmt+rHoBQKQz0yhc0A0YqM8vnWYatVrVh1+SZe7iJE3/qyglNFmbJQ0O54
au/AJ7OqEy1MnJ06fIaLbSIQMXXMWdEqcib2gIKeunhLDkwoUbi+JRJLBY5X
ITts
=yIjM
-END PGP SIGNATURE-

Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1


On Mon, Feb 29, 2016 at 10:29 PM, Lindsay Mathieson
 wrote:
> I was looking at replacing an osd drive in place as per the procedure here:
>
> http://www.spinics.net/lists/ceph-users/msg05959.html
>
> "If you are going to replace the drive immediately, set the “noout” flag.
> Take the OSD “down” and replace drive.  Assuming it is mounted in the same
> place as the bad drive, bring the OSD back up.  This will replicate exactly
> the same PGs the bad drive held back to the replacement drive."
>
>
>
> But the new drive mount will be blank - what happens with the journal,
> keyring etc? does starting the OSD process recreate them automatically?
>
>
> thanks,
>
> --
> Lindsay Mathieson
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com