[ceph-users] FileStore OSD, journal direct symlinked, permission troubles.

2019-08-29 Thread Marco Gaiarin
); do chown ceph: $l; done OSD start flawlessy. There's something i can do? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078

Re: [ceph-users] Post-mortem analisys?

2019-05-13 Thread Marco Gaiarin
twork worked correctly at the time? Not completely sure, but i've redirected syslog of switches, to a server, and i've not catch main errors/failures signs. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostr

[ceph-users] Post-mortem analisys?

2019-05-13 Thread Marco Gaiarin
how to 'correlate' various logs, and so (try to) understand what happens? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito

Re: [ceph-users] HW failure cause client IO drops

2019-04-16 Thread Marco Gaiarin
em. So, if a node reboot with a clock skew more than (AFAI Remember well) 5 seconds, OSD does not start. Provide a stable NTP server for all your OSDs and MONs, and restart OSDs after clock are in sync. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazi

Re: [ceph-users] OSD after OS reinstallation.

2019-02-25 Thread Marco Gaiarin
uld strongly suggest avoiding all of this and > just using the new way of doing OSDs with LVM Ahem... i'm still on hammer... ;-))) -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia

Re: [ceph-users] Prevent rebalancing in the same host?

2019-02-22 Thread Marco Gaiarin
htly) tell you that you need enough > capacity to at the very least deal with a single OSD loss. Super clear. Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - V

Re: [ceph-users] OSD after OS reinstallation.

2019-02-22 Thread Marco Gaiarin
r non-GPT partition, clearly even, if needed, destroying it? I've tried also to create a GPT partition in a DOS partition (eg, in a /dev/sda5), and seems that GPT partition get correctly created, but still (sub) partition have no PARTUUID... -- dott. Marco Gaiarin

Re: [ceph-users] OSD after OS reinstallation.

2019-02-20 Thread Marco Gaiarin
gt; new OSDs? > http://docs.ceph.com/docs/master/rados/operations/add-or-rm-osds/#rados-replacing-an-osd I'm using proxmox, so 'pveceph' helper, but i've trouble with journal lables, indeed, not main filesystem labels... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66

Re: [ceph-users] OSD after OS reinstallation.

2019-02-20 Thread Marco Gaiarin
LV). > From what I briefly researched it is not possible to add a GPT label > on a non-gpt partition without losing data. Ahem, how can i add a GPT label to a non-GPT partition (even loosing data)? Seems the culprit around my 'Proxmox 4.4, Ceph hammer, OSD cache link...' thread... Thanks

[ceph-users] Prevent rebalancing in the same host?

2019-02-19 Thread Marco Gaiarin
intra-host OSD rebalancing? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN) marco.gaiarin

Re: [ceph-users] Proxmox 4.4, Ceph hammer, OSD cache link...

2019-02-12 Thread Marco Gaiarin
sion -rw-r--r-- 1 root root 53 nov 21 23:08 superblock -rw-r--r-- 1 root root0 nov 21 23:08 sysvinit -rw-r--r-- 1 root root3 nov 21 23:08 whoami Ahem, i've no 'journal_uuid' file on OSD... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Ass

Re: [ceph-users] Proxmox 4.4, Ceph hammer, OSD cache link...

2019-02-06 Thread Marco Gaiarin
urnal /var/lib/ceph/osd/ceph-6/journal for object store /var/lib/ceph/osd/ceph-6 So seems that effectively journal partition get 'tagged' in someway. But i'm still confused... using ID link in journal partitions works only for GPO partitioning? Thanks. -- dott. Marco Gaiarin

Re: [ceph-users] Decommissioning cluster - rebalance questions

2018-12-04 Thread Marco Gaiarin
ceph osd crush reweight osd. X (with 0 <= X <= ); in this way you can 'deweight' the OSD in crushmap until 0, then you can safely remove. I hope i've not sayed too much blasphemy... ;-) -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione

[ceph-users] Proxmox 4.4, Ceph hammer, OSD cache link...

2018-12-03 Thread Marco Gaiarin
e, unexpected result. I'm missing something? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN)

Re: [ceph-users] Degraded objects afte: ceph osd in $osd

2018-11-29 Thread Marco Gaiarin
t of OSD for node vedovanera and i've no more degraded object. I think i'm starting to understand how concretely the crush algorithm work. ;-) -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamig

Re: [ceph-users] Degraded objects afte: ceph osd in $osd

2018-11-26 Thread Marco Gaiarin
1 active+remapped+backfilling client io 9725 kB/s rd, 772 kB/s wr, 153 op/s eg, 2 object 'degraded'. This really puzzled me. Why?! Thanks. [1] some Marvel Comics heros got translated in Italian, so 'vedovanera' is 'black widow' and 'capitanamerica' clearly 'Captain America'. -- dott. Marc

Re: [ceph-users] Disable intra-host replication?

2018-11-26 Thread Marco Gaiarin
. 'hosts' mean 'hosts with OSDs', right? Because my cluster have 5 hosts, 2 are only MONs. Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 -

[ceph-users] Disable intra-host replication?

2018-11-23 Thread Marco Gaiarin
perfectly sense: overral data scattering have better performance and safety. But... there's some way to se to crush 'don't rebalance in the same node, go in degradated mode'? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra

Re: [ceph-users] New OSD with weight 0, rebalance still happen...

2018-11-23 Thread Marco Gaiarin
reweight') with small steps to slowly rebalance data > onto > new OSDs. For now i'm putting in the new disks with 'ceph osd reweight', probably when i'm on 50% of new disks i'll start to use 'ceph osd crush reweight' against the old one. Thanks. -- dott. Marco Gaiarin

Re: [ceph-users] New OSD with weight 0, rebalance still happen...

2018-11-23 Thread Marco Gaiarin
second is 'permanent' and expressed, normally, as disk terabyte. You are saying that insted the first modify only the disk occupation, while only the latter alter the crush map. Right? This is true only for 'straw' algorithm? Or is general? Thanks. -- dott. Marco Gaiarin

Re: [ceph-users] New OSD with weight 0, rebalance still happen...

2018-11-22 Thread Marco Gaiarin
cts misplaced (0.442%) 761 active+clean 6 active+remapped 1 active+clean+scrubbing client io 13476 B/s rd, 654 kB/s wr, 95 op/s Why pgs that are in state 'stuck unclean'? -- dott. Marco Gaiarin GNUPG Key

Re: [ceph-users] New OSD with weight 0, rebalance still happen...

2018-11-22 Thread Marco Gaiarin
'staw2'... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN) marco.gaiarin(at)lanostrafamiglia.it t +39-0434-8427

Re: [ceph-users] New OSD with weight 0, rebalance still happen...

2018-11-22 Thread Marco Gaiarin
.04999 1.0 OSD 12-15 are the new OSD; after creating it with 'noin' i've reweighted them to '0.05' (to make a test). Crush map attached. Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia''

[ceph-users] New OSD with weight 0, rebalance still happen...

2018-11-22 Thread Marco Gaiarin
, rebalance happen, and using percentage of rebalance 'weighted' to the size of new disk (eg, i've had 18TB circa of space, i've added a 2TB disks and roughly 10% of data start to rebalance). Why? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66

Re: [ceph-users] Hammer and a (little) disk/partition shrink...

2018-08-29 Thread Marco Gaiarin
ache battery in the controller. I've no battery in the controller... ;-) -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tag

[ceph-users] Hammer and a (little) disk/partition shrink...

2018-08-29 Thread Marco Gaiarin
are corrupted. hammer use filestore, so practically i need to shrunk an xfs filesystem, that is not supported by XFS. Clearly i can do 'xfsdump' of disks in some scratch space and rebuild filesystem but... I've some escape path? Thanks. -- dott. Marco Gaiarin GNUPG

Re: [ceph-users] RAID question for Ceph

2018-07-19 Thread Marco Gaiarin
e disk in raid-0) without the (expensive!) cache module. I've found digging around references to alternative firmwares that enable JBOD/HBA, but never walked that way... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia''

Re: [ceph-users] Snapshot removed, cluster thrashed...

2017-06-27 Thread Marco Gaiarin
Mandi! David Turner In chel di` si favelave... > Snapshots are not a free action. Thanks to all for the info! -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG -

Re: [ceph-users] Snapshot removed, cluster thrashed...

2017-06-26 Thread Marco Gaiarin
Mandi! Lindsay Mathieson In chel di` si favelave... > Have you tried restoring a snapshot? I found it unusablly slow - as in hours No, still no; i've never restored a snapshot... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nos

[ceph-users] Snapshot removed, cluster thrashed...

2017-06-26 Thread Marco Gaiarin
lar things (eg, a restore from a backup) i've to expect some similar result? Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 -

Re: [ceph-users] Network redundancy...

2017-05-30 Thread Marco Gaiarin
> The switches your using can they stack? > If so you could spread the LACP across the two switches. And: > Just use balance-alb, this will do a trick with no stack switches Thanks for the answers, i'll do some tests! ;-) -- dott. Marco Gaiarin

[ceph-users] Network redundancy...

2017-05-29 Thread Marco Gaiarin
and ceph documentations, but with no luck. Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN

Re: [ceph-users] Limit bandwidth on RadosGW?

2017-05-04 Thread Marco Gaiarin
decent hardware is not a trouble at al. So, no, i've no benchmark at all. ;) -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San V

Re: [ceph-users] Power Failure

2017-04-26 Thread Marco Gaiarin
ower on test again... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN) marco.gaiarin(at)lanostrafamiglia.it t +