); do chown
ceph: $l; done
OSD start flawlessy.
There's something i can do? Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078
twork worked correctly at the time?
Not completely sure, but i've redirected syslog of switches, to a
server, and i've not catch main errors/failures signs.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostr
how to 'correlate' various logs, and
so (try to) understand what happens?
Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito
em. So, if a node
reboot with a clock skew more than (AFAI Remember well) 5 seconds, OSD
does not start.
Provide a stable NTP server for all your OSDs and MONs, and restart
OSDs after clock are in sync.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazi
uld strongly suggest avoiding all of this and
> just using the new way of doing OSDs with LVM
Ahem... i'm still on hammer... ;-)))
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia
htly) tell you that you need enough
> capacity to at the very least deal with a single OSD loss.
Super clear. Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - V
r non-GPT
partition, clearly even, if needed, destroying it?
I've tried also to create a GPT partition in a DOS partition (eg, in a
/dev/sda5), and seems that GPT partition get correctly created, but
still (sub) partition have no PARTUUID...
--
dott. Marco Gaiarin
gt; new OSDs?
> http://docs.ceph.com/docs/master/rados/operations/add-or-rm-osds/#rados-replacing-an-osd
I'm using proxmox, so 'pveceph' helper, but i've trouble with journal
lables, indeed, not main filesystem labels...
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
LV).
> From what I briefly researched it is not possible to add a GPT label
> on a non-gpt partition without losing data.
Ahem, how can i add a GPT label to a non-GPT partition (even loosing
data)?
Seems the culprit around my 'Proxmox 4.4, Ceph hammer, OSD cache
link...' thread...
Thanks
intra-host OSD
rebalancing?
Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN)
marco.gaiarin
sion
-rw-r--r-- 1 root root 53 nov 21 23:08 superblock
-rw-r--r-- 1 root root0 nov 21 23:08 sysvinit
-rw-r--r-- 1 root root3 nov 21 23:08 whoami
Ahem, i've no 'journal_uuid' file on OSD...
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Ass
urnal
/var/lib/ceph/osd/ceph-6/journal for object store /var/lib/ceph/osd/ceph-6
So seems that effectively journal partition get 'tagged' in someway.
But i'm still confused... using ID link in journal partitions works
only for GPO partitioning?
Thanks.
--
dott. Marco Gaiarin
ceph osd crush reweight osd. X
(with 0 <= X <= ); in this way you can 'deweight' the
OSD in crushmap until 0, then you can safely remove.
I hope i've not sayed too much blasphemy... ;-)
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione
e, unexpected result.
I'm missing something? Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN)
t of OSD for node vedovanera and i've no more degraded
object.
I think i'm starting to understand how concretely the crush algorithm
work. ;-)
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamig
1 active+remapped+backfilling
client io 9725 kB/s rd, 772 kB/s wr, 153 op/s
eg, 2 object 'degraded'. This really puzzled me.
Why?! Thanks.
[1] some Marvel Comics heros got translated in Italian, so 'vedovanera'
is 'black widow' and 'capitanamerica' clearly 'Captain America'.
--
dott. Marc
.
'hosts' mean 'hosts with OSDs', right?
Because my cluster have 5 hosts, 2 are only MONs.
Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 -
perfectly sense: overral data scattering have better
performance and safety.
But... there's some way to se to crush 'don't rebalance in the same node, go
in degradated mode'?
Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra
reweight') with small steps to slowly rebalance data
> onto
> new OSDs.
For now i'm putting in the new disks with 'ceph osd reweight',
probably when i'm on 50% of new disks i'll start to use 'ceph osd crush
reweight'
against the old one.
Thanks.
--
dott. Marco Gaiarin
second is 'permanent' and
expressed, normally, as disk terabyte.
You are saying that insted the first modify only the disk occupation,
while only the latter alter the crush map.
Right?
This is true only for 'straw' algorithm? Or is general? Thanks.
--
dott. Marco Gaiarin
cts misplaced (0.442%)
761 active+clean
6 active+remapped
1 active+clean+scrubbing
client io 13476 B/s rd, 654 kB/s wr, 95 op/s
Why pgs that are in state 'stuck unclean'?
--
dott. Marco Gaiarin GNUPG Key
'staw2'...
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN)
marco.gaiarin(at)lanostrafamiglia.it t +39-0434-8427
.04999 1.0
OSD 12-15 are the new OSD; after creating it with 'noin' i've
reweighted them to '0.05' (to make a test).
Crush map attached. Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia''
, rebalance happen, and
using percentage of rebalance 'weighted' to the size of new disk (eg,
i've had 18TB circa of space, i've added a 2TB disks and roughly 10% of
data start to rebalance).
Why? Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
ache battery in the controller.
I've no battery in the controller... ;-)
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tag
are corrupted.
hammer use filestore, so practically i need to shrunk an xfs
filesystem, that is not supported by XFS.
Clearly i can do 'xfsdump' of disks in some scratch space and rebuild
filesystem but...
I've some escape path?
Thanks.
--
dott. Marco Gaiarin GNUPG
e disk in raid-0) without the (expensive!)
cache module.
I've found digging around references to alternative firmwares that
enable JBOD/HBA, but never walked that way...
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia''
Mandi! David Turner
In chel di` si favelave...
> Snapshots are not a free action.
Thanks to all for the info!
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG -
Mandi! Lindsay Mathieson
In chel di` si favelave...
> Have you tried restoring a snapshot? I found it unusablly slow - as in hours
No, still no; i've never restored a snapshot...
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nos
lar things (eg, a restore from a backup) i've to expect some
similar result?
Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 -
> The switches your using can they stack?
> If so you could spread the LACP across the two switches.
And:
> Just use balance-alb, this will do a trick with no stack switches
Thanks for the answers, i'll do some tests! ;-)
--
dott. Marco Gaiarin
and ceph documentations, but with no luck.
Thanks.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN
decent
hardware is not a trouble at al.
So, no, i've no benchmark at all. ;)
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San V
ower on test again...
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN)
marco.gaiarin(at)lanostrafamiglia.it t +
34 matches
Mail list logo