Hi,

Context:
Firefly 0.80.9
8 storage nodes
176 osds : 14*8 sas and 8*8 ssd
3 monitors

I create an alternate crushmap in order to fulfill tiering requirement i.e. 
select ssd or sas.
I created specific buckets "host-ssd" and "host-sas" and regroup them in 
"tier-ssd" and "tier-sas" under a "tier-root"
E.g. I want to select 1 ssd in 3 distinct hosts

I don't understand why the placement rule for sas is working and not for ssd.
Sas are selected even if ,according to the crushmap,  they are not in the right 
tree.
When sometimes 3 ssd are selected, the pgs stay stuck but active

I attached the crushmap and ceph osd tree.

Can someone have a look and tell me where the default is?

Bgrds
- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/IMT/OLPS/ASE/DAPI/CSE
Architecte de services d'infrastructure de stockage
Sofware-Defined Storage Architect
+33299124432
+33788624370
[email protected]<mailto:[email protected]>
P Pensez à l'Environnement avant d'imprimer ce message !


_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

# begin crush map
tunable choose_local_tries 0
tunable choose_local_fallback_tries 0
tunable choose_total_tries 50
tunable chooseleaf_descend_once 1
tunable straw_calc_version 1

# devices
device 0 osd.0
device 1 osd.1
device 2 osd.2
device 3 osd.3
device 4 osd.4
device 5 osd.5
device 6 osd.6
device 7 osd.7
device 8 osd.8
device 9 osd.9
device 10 osd.10
device 11 osd.11
device 12 osd.12
device 13 osd.13
device 14 osd.14
device 15 osd.15
device 16 osd.16
device 17 osd.17
device 18 osd.18
device 19 osd.19
device 20 osd.20
device 21 osd.21
device 22 osd.22
device 23 osd.23
device 24 osd.24
device 25 osd.25
device 26 osd.26
device 27 osd.27
device 28 osd.28
device 29 osd.29
device 30 osd.30
device 31 osd.31
device 32 osd.32
device 33 osd.33
device 34 osd.34
device 35 osd.35
device 36 osd.36
device 37 osd.37
device 38 osd.38
device 39 osd.39
device 40 osd.40
device 41 osd.41
device 42 osd.42
device 43 osd.43
device 44 osd.44
device 45 osd.45
device 46 osd.46
device 47 osd.47
device 48 osd.48
device 49 osd.49
device 50 osd.50
device 51 osd.51
device 52 osd.52
device 53 osd.53
device 54 osd.54
device 55 osd.55
device 56 osd.56
device 57 osd.57
device 58 osd.58
device 59 osd.59
device 60 osd.60
device 61 osd.61
device 62 osd.62
device 63 osd.63
device 64 osd.64
device 65 osd.65
device 66 osd.66
device 67 osd.67
device 68 osd.68
device 69 osd.69
device 70 osd.70
device 71 osd.71
device 72 osd.72
device 73 osd.73
device 74 osd.74
device 75 osd.75
device 76 osd.76
device 77 osd.77
device 78 osd.78
device 79 osd.79
device 80 osd.80
device 81 osd.81
device 82 osd.82
device 83 osd.83
device 84 osd.84
device 85 osd.85
device 86 osd.86
device 87 osd.87
device 88 osd.88
device 89 osd.89
device 90 osd.90
device 91 osd.91
device 92 osd.92
device 93 osd.93
device 94 osd.94
device 95 osd.95
device 96 osd.96
device 97 osd.97
device 98 osd.98
device 99 osd.99
device 100 osd.100
device 101 osd.101
device 102 osd.102
device 103 osd.103
device 104 osd.104
device 105 osd.105
device 106 osd.106
device 107 osd.107
device 108 osd.108
device 109 osd.109
device 110 osd.110
device 111 osd.111
device 112 osd.112
device 113 osd.113
device 114 osd.114
device 115 osd.115
device 116 osd.116
device 117 osd.117
device 118 osd.118
device 119 osd.119
device 120 osd.120
device 121 osd.121
device 122 osd.122
device 123 osd.123
device 124 osd.124
device 125 osd.125
device 126 osd.126
device 127 osd.127
device 128 osd.128
device 129 osd.129
device 130 osd.130
device 131 osd.131
device 132 osd.132
device 133 osd.133
device 134 osd.134
device 135 osd.135
device 136 osd.136
device 137 osd.137
device 138 osd.138
device 139 osd.139
device 140 osd.140
device 141 osd.141
device 142 osd.142
device 143 osd.143
device 144 osd.144
device 145 osd.145
device 146 osd.146
device 147 osd.147
device 148 osd.148
device 149 osd.149
device 150 osd.150
device 151 osd.151
device 152 osd.152
device 153 osd.153
device 154 osd.154
device 155 osd.155
device 156 osd.156
device 157 osd.157
device 158 osd.158
device 159 osd.159
device 160 osd.160
device 161 osd.161
device 162 osd.162
device 163 osd.163
device 164 osd.164
device 165 osd.165
device 166 osd.166
device 167 osd.167
device 168 osd.168
device 169 osd.169
device 170 osd.170
device 171 osd.171
device 172 osd.172
device 173 osd.173
device 174 osd.174
device 175 osd.175

# types
type 0 osd
type 1 host
type 2 chassis
type 3 rack
type 4 row
type 5 pdu
type 6 pod
type 7 room
type 8 datacenter
type 9 region
type 10 root
type 100 host-ssd
type 200 host-sas
type 1000 tier

# buckets
host node-18 {
        id -18          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.0 weight 0.180
        item osd.5 weight 0.180
        item osd.6 weight 1.080
        item osd.10 weight 1.080
        item osd.11 weight 1.080
        item osd.12 weight 1.080
        item osd.16 weight 1.080
        item osd.18 weight 1.080
        item osd.20 weight 0.180
        item osd.25 weight 0.180
        item osd.28 weight 1.080
        item osd.30 weight 1.080
        item osd.36 weight 0.180
        item osd.39 weight 0.180
        item osd.42 weight 1.080
        item osd.45 weight 1.080
        item osd.49 weight 1.080
        item osd.51 weight 1.080
        item osd.54 weight 1.080
        item osd.57 weight 0.180
        item osd.60 weight 0.180
        item osd.63 weight 1.080
}
host node-20 {
        id -20          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.2 weight 1.080
        item osd.3 weight 0.180
        item osd.7 weight 0.180
        item osd.13 weight 1.080
        item osd.15 weight 1.080
        item osd.19 weight 1.080
        item osd.21 weight 1.080
        item osd.23 weight 0.180
        item osd.27 weight 1.080
        item osd.29 weight 0.180
        item osd.33 weight 1.080
        item osd.35 weight 0.180
        item osd.38 weight 1.080
        item osd.40 weight 1.080
        item osd.46 weight 1.080
        item osd.47 weight 1.080
        item osd.50 weight 1.080
        item osd.52 weight 0.180
        item osd.56 weight 1.080
        item osd.58 weight 1.080
        item osd.61 weight 0.180
        item osd.64 weight 0.180
}
host node-21 {
        id -21          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.1 weight 1.080
        item osd.4 weight 0.180
        item osd.8 weight 0.180
        item osd.9 weight 1.080
        item osd.14 weight 1.080
        item osd.17 weight 1.080
        item osd.22 weight 1.080
        item osd.24 weight 0.180
        item osd.26 weight 1.080
        item osd.31 weight 1.080
        item osd.32 weight 1.080
        item osd.34 weight 0.180
        item osd.37 weight 0.180
        item osd.41 weight 1.080
        item osd.43 weight 1.080
        item osd.44 weight 1.080
        item osd.48 weight 1.080
        item osd.53 weight 0.180
        item osd.55 weight 0.180
        item osd.59 weight 1.080
        item osd.62 weight 0.180
        item osd.65 weight 1.080
}
host node-22 {
        id -22          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.69 weight 1.080
        item osd.72 weight 0.180
        item osd.75 weight 1.080
        item osd.80 weight 0.180
        item osd.85 weight 1.080
        item osd.90 weight 0.180
        item osd.93 weight 0.180
        item osd.97 weight 1.080
        item osd.101 weight 1.080
        item osd.105 weight 1.080
        item osd.108 weight 1.080
        item osd.116 weight 1.080
        item osd.120 weight 1.080
        item osd.124 weight 0.180
        item osd.127 weight 1.080
        item osd.130 weight 1.080
        item osd.131 weight 0.180
        item osd.135 weight 1.080
        item osd.139 weight 0.180
        item osd.145 weight 1.080
        item osd.148 weight 1.080
        item osd.151 weight 0.180
}
room lodz-1 {
        id -71          # do not change unnecessarily
        # weight 66.240
        alg straw
        hash 0  # rjenkins1
        item node-18 weight 16.560
        item node-20 weight 16.560
        item node-21 weight 16.560
        item node-22 weight 16.560
}
host node-23 {
        id -23          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.70 weight 0.180
        item osd.76 weight 1.080
        item osd.78 weight 1.080
        item osd.83 weight 1.080
        item osd.84 weight 1.080
        item osd.88 weight 0.180
        item osd.91 weight 1.080
        item osd.95 weight 1.080
        item osd.99 weight 0.180
        item osd.104 weight 0.180
        item osd.107 weight 0.180
        item osd.109 weight 1.080
        item osd.112 weight 0.180
        item osd.114 weight 1.080
        item osd.119 weight 1.080
        item osd.126 weight 1.080
        item osd.134 weight 0.180
        item osd.138 weight 1.080
        item osd.142 weight 1.080
        item osd.146 weight 1.080
        item osd.150 weight 0.180
        item osd.152 weight 1.080
}
host node-24 {
        id -24          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.154 weight 1.080
        item osd.155 weight 0.180
        item osd.156 weight 1.080
        item osd.157 weight 0.180
        item osd.158 weight 1.080
        item osd.159 weight 1.080
        item osd.160 weight 1.080
        item osd.161 weight 1.080
        item osd.162 weight 0.180
        item osd.163 weight 1.080
        item osd.164 weight 0.180
        item osd.165 weight 1.080
        item osd.166 weight 1.080
        item osd.167 weight 0.180
        item osd.168 weight 0.180
        item osd.169 weight 1.080
        item osd.170 weight 1.080
        item osd.171 weight 0.180
        item osd.172 weight 1.080
        item osd.173 weight 1.080
        item osd.174 weight 0.180
        item osd.175 weight 1.080
}
host node-25 {
        id -25          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.66 weight 1.080
        item osd.68 weight 0.180
        item osd.73 weight 0.180
        item osd.77 weight 1.080
        item osd.81 weight 1.080
        item osd.86 weight 0.180
        item osd.89 weight 1.080
        item osd.92 weight 1.080
        item osd.98 weight 1.080
        item osd.102 weight 1.080
        item osd.106 weight 0.180
        item osd.111 weight 0.180
        item osd.115 weight 0.180
        item osd.118 weight 1.080
        item osd.122 weight 1.080
        item osd.128 weight 1.080
        item osd.132 weight 1.080
        item osd.137 weight 0.180
        item osd.140 weight 1.080
        item osd.144 weight 1.080
        item osd.149 weight 0.180
        item osd.153 weight 1.080
}
host node-26 {
        id -26          # do not change unnecessarily
        # weight 16.560
        alg straw
        hash 0  # rjenkins1
        item osd.67 weight 1.080
        item osd.71 weight 1.080
        item osd.74 weight 1.080
        item osd.79 weight 1.080
        item osd.82 weight 0.180
        item osd.87 weight 1.080
        item osd.94 weight 1.080
        item osd.96 weight 0.180
        item osd.100 weight 0.180
        item osd.103 weight 1.080
        item osd.110 weight 1.080
        item osd.113 weight 1.080
        item osd.117 weight 1.080
        item osd.121 weight 1.080
        item osd.123 weight 0.180
        item osd.125 weight 0.180
        item osd.129 weight 1.080
        item osd.133 weight 1.080
        item osd.136 weight 1.080
        item osd.141 weight 0.180
        item osd.143 weight 0.180
        item osd.147 weight 0.180
}
room lodz-2 {
        id -72          # do not change unnecessarily
        # weight 66.240
        alg straw
        hash 0  # rjenkins1
        item node-23 weight 16.560
        item node-24 weight 16.560
        item node-25 weight 16.560
        item node-26 weight 16.560
}
root default {
        id -1           # do not change unnecessarily
        # weight 132.480
        alg straw
        hash 0  # rjenkins1
        item lodz-1 weight 66.240
        item lodz-2 weight 66.240
}
host-ssd node-18-ssd {
        id -181         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.0 weight 0.180
        item osd.5 weight 0.180
        item osd.20 weight 0.180
        item osd.25 weight 0.180
        item osd.36 weight 0.180
        item osd.39 weight 0.180
        item osd.57 weight 0.180
        item osd.60 weight 0.180
}
host-sas node-18-sas {
        id -182         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.6 weight 1.080
        item osd.10 weight 1.080
        item osd.11 weight 1.080
        item osd.12 weight 1.080
        item osd.16 weight 1.080
        item osd.18 weight 1.080
        item osd.28 weight 1.080
        item osd.30 weight 1.080
        item osd.42 weight 1.080
        item osd.45 weight 1.080
        item osd.49 weight 1.080
        item osd.51 weight 1.080
        item osd.54 weight 1.080
        item osd.63 weight 1.080
}
host-ssd node-20-ssd {
        id -201         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.3 weight 0.180
        item osd.7 weight 0.180
        item osd.23 weight 0.180
        item osd.29 weight 0.180
        item osd.35 weight 0.180
        item osd.52 weight 0.180
        item osd.61 weight 0.180
        item osd.64 weight 0.180
}
host-sas node-20-sas {
        id -202         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.2 weight 1.080
        item osd.13 weight 1.080
        item osd.15 weight 1.080
        item osd.19 weight 1.080
        item osd.21 weight 1.080
        item osd.27 weight 1.080
        item osd.33 weight 1.080
        item osd.38 weight 1.080
        item osd.40 weight 1.080
        item osd.46 weight 1.080
        item osd.47 weight 1.080
        item osd.50 weight 1.080
        item osd.56 weight 1.080
        item osd.58 weight 1.080
}
host-ssd node-21-ssd {
        id -211         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.4 weight 0.180
        item osd.8 weight 0.180
        item osd.24 weight 0.180
        item osd.34 weight 0.180
        item osd.37 weight 0.180
        item osd.53 weight 0.180
        item osd.55 weight 0.180
        item osd.62 weight 0.180
}
host-sas node-21-sas {
        id -212         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.1 weight 1.080
        item osd.9 weight 1.080
        item osd.14 weight 1.080
        item osd.17 weight 1.080
        item osd.22 weight 1.080
        item osd.26 weight 1.080
        item osd.31 weight 1.080
        item osd.32 weight 1.080
        item osd.41 weight 1.080
        item osd.43 weight 1.080
        item osd.44 weight 1.080
        item osd.48 weight 1.080
        item osd.59 weight 1.080
        item osd.65 weight 1.080
}
host-ssd node-22-ssd {
        id -221         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.72 weight 0.180
        item osd.80 weight 0.180
        item osd.90 weight 0.180
        item osd.93 weight 0.180
        item osd.124 weight 0.180
        item osd.131 weight 0.180
        item osd.139 weight 0.180
        item osd.151 weight 0.180
}
host-sas node-22-sas {
        id -222         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.69 weight 1.080
        item osd.75 weight 1.080
        item osd.85 weight 1.080
        item osd.97 weight 1.080
        item osd.101 weight 1.080
        item osd.105 weight 1.080
        item osd.108 weight 1.080
        item osd.116 weight 1.080
        item osd.120 weight 1.080
        item osd.127 weight 1.080
        item osd.130 weight 1.080
        item osd.135 weight 1.080
        item osd.145 weight 1.080
        item osd.148 weight 1.080
}
host-ssd node-23-ssd {
        id -231         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.70 weight 0.180
        item osd.88 weight 0.180
        item osd.99 weight 0.180
        item osd.104 weight 0.180
        item osd.107 weight 0.180
        item osd.112 weight 0.180
        item osd.134 weight 0.180
        item osd.150 weight 0.180
}
host-sas node-23-sas {
        id -232         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.76 weight 1.080
        item osd.78 weight 1.080
        item osd.83 weight 1.080
        item osd.84 weight 1.080
        item osd.91 weight 1.080
        item osd.95 weight 1.080
        item osd.109 weight 1.080
        item osd.114 weight 1.080
        item osd.119 weight 1.080
        item osd.126 weight 1.080
        item osd.138 weight 1.080
        item osd.142 weight 1.080
        item osd.146 weight 1.080
        item osd.152 weight 1.080
}
host-ssd node-24-ssd {
        id -241         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.155 weight 0.180
        item osd.157 weight 0.180
        item osd.162 weight 0.180
        item osd.164 weight 0.180
        item osd.167 weight 0.180
        item osd.168 weight 0.180
        item osd.171 weight 0.180
        item osd.174 weight 0.180
}
host-sas node-24-sas {
        id -242         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.154 weight 1.080
        item osd.156 weight 1.080
        item osd.158 weight 1.080
        item osd.159 weight 1.080
        item osd.160 weight 1.080
        item osd.161 weight 1.080
        item osd.163 weight 1.080
        item osd.165 weight 1.080
        item osd.166 weight 1.080
        item osd.169 weight 1.080
        item osd.170 weight 1.080
        item osd.172 weight 1.080
        item osd.173 weight 1.080
        item osd.175 weight 1.080
}
host-ssd node-25-ssd {
        id -251         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.68 weight 0.180
        item osd.73 weight 0.180
        item osd.86 weight 0.180
        item osd.106 weight 0.180
        item osd.111 weight 0.180
        item osd.115 weight 0.180
        item osd.137 weight 0.180
        item osd.149 weight 0.180
}
host-sas node-25-sas {
        id -252         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.66 weight 1.080
        item osd.77 weight 1.080
        item osd.81 weight 1.080
        item osd.89 weight 1.080
        item osd.92 weight 1.080
        item osd.98 weight 1.080
        item osd.102 weight 1.080
        item osd.118 weight 1.080
        item osd.122 weight 1.080
        item osd.128 weight 1.080
        item osd.132 weight 1.080
        item osd.140 weight 1.080
        item osd.144 weight 1.080
        item osd.153 weight 1.080
}
host-ssd node-26-ssd {
        id -261         # do not change unnecessarily
        # weight 1.440
        alg straw
        hash 0  # rjenkins1
        item osd.82 weight 0.180
        item osd.96 weight 0.180
        item osd.100 weight 0.180
        item osd.123 weight 0.180
        item osd.125 weight 0.180
        item osd.141 weight 0.180
        item osd.143 weight 0.180
        item osd.147 weight 0.180
}
host-sas node-26-sas {
        id -262         # do not change unnecessarily
        # weight 15.120
        alg straw
        hash 0  # rjenkins1
        item osd.67 weight 1.080
        item osd.71 weight 1.080
        item osd.74 weight 1.080
        item osd.79 weight 1.080
        item osd.87 weight 1.080
        item osd.94 weight 1.080
        item osd.103 weight 1.080
        item osd.110 weight 1.080
        item osd.113 weight 1.080
        item osd.117 weight 1.080
        item osd.121 weight 1.080
        item osd.129 weight 1.080
        item osd.133 weight 1.080
        item osd.136 weight 1.080
}
tier tier-ssd {
        id -1100                # do not change unnecessarily
        # weight 11.520
        alg straw
        hash 0  # rjenkins1
        item node-18-ssd weight 1.440
        item node-20-ssd weight 1.440
        item node-21-ssd weight 1.440
        item node-22-ssd weight 1.440
        item node-23-ssd weight 1.440
        item node-24-ssd weight 1.440
        item node-25-ssd weight 1.440
        item node-26-ssd weight 1.440
}
tier tier-sas {
        id -1200                # do not change unnecessarily
        # weight 120.960
        alg straw
        hash 0  # rjenkins1
        item node-18-sas weight 15.120
        item node-20-sas weight 15.120
        item node-21-sas weight 15.120
        item node-22-sas weight 15.120
        item node-23-sas weight 15.120
        item node-24-sas weight 15.120
        item node-25-sas weight 15.120
        item node-26-sas weight 15.120
}
root tier-root {
        id -1010                # do not change unnecessarily
        # weight 132.480
        alg straw
        hash 0  # rjenkins1
        item tier-ssd weight 11.520
        item tier-sas weight 120.960
}

# rules
rule replicated_ruleset {
        ruleset 0
        type replicated
        min_size 1
        max_size 10
        step take default
        step chooseleaf firstn 0 type host
        step emit
}
rule ssd_ruleset {
        ruleset 76
        type replicated
        min_size 1
        max_size 10
        step take tier-ssd
        step chooseleaf firstn 0 type host-ssd
        step emit
}
rule sas_ruleset {
        ruleset 176
        type replicated
        min_size 1
        max_size 10
        step take tier-sas
        step chooseleaf firstn 0 type host-sas
        step emit
}

# end crush map
# id    weight  type name       up/down reweight
-1010   132.5   root tier-root
-1100   11.52           tier tier-ssd
-181    1.44                    host-ssd node-18-ssd
0       0.18                            osd.0   up      0.2281  
5       0.18                            osd.5   up      0.2434  
20      0.18                            osd.20  up      0.2524  
25      0.18                            osd.25  up      0.2571  
36      0.18                            osd.36  up      0.2414  
39      0.18                            osd.39  up      0.2436  
57      0.18                            osd.57  up      0.2555  
60      0.18                            osd.60  up      0.2569  
-201    1.44                    host-ssd node-20-ssd
3       0.18                            osd.3   up      0.2506  
7       0.18                            osd.7   up      0.2441  
23      0.18                            osd.23  up      0.2482  
29      0.18                            osd.29  up      0.2595  
35      0.18                            osd.35  up      0.2456  
52      0.18                            osd.52  up      0.2553  
61      0.18                            osd.61  up      0.2455  
64      0.18                            osd.64  up      0.257   
-211    1.44                    host-ssd node-21-ssd
4       0.18                            osd.4   up      0.2405  
8       0.18                            osd.8   up      0.2502  
24      0.18                            osd.24  up      0.2511  
34      0.18                            osd.34  up      0.246   
37      0.18                            osd.37  up      0.2433  
53      0.18                            osd.53  up      0.2537  
55      0.18                            osd.55  up      0.2571  
62      0.18                            osd.62  up      0.2462  
-221    1.44                    host-ssd node-22-ssd
72      0.18                            osd.72  up      0.2509  
80      0.18                            osd.80  up      0.2562  
90      0.18                            osd.90  up      0.2484  
93      0.18                            osd.93  up      0.2537  
124     0.18                            osd.124 up      0.2526  
131     0.18                            osd.131 up      0.2538  
139     0.18                            osd.139 up      0.2527  
151     0.18                            osd.151 up      0.2553  
-231    1.44                    host-ssd node-23-ssd
70      0.18                            osd.70  up      0.2544  
88      0.18                            osd.88  up      0.2492  
99      0.18                            osd.99  up      0.2514  
104     0.18                            osd.104 up      0.2528  
107     0.18                            osd.107 up      0.2527  
112     0.18                            osd.112 up      0.254   
134     0.18                            osd.134 up      0.2536  
150     0.18                            osd.150 up      0.2562  
-241    1.44                    host-ssd node-24-ssd
155     0.18                            osd.155 up      0.2551  
157     0.18                            osd.157 up      0.2545  
162     0.18                            osd.162 up      0.2554  
164     0.18                            osd.164 up      0.2557  
167     0.18                            osd.167 up      0.2566  
168     0.18                            osd.168 up      0.2567  
171     0.18                            osd.171 up      0.256   
174     0.18                            osd.174 up      0.2533  
-251    1.44                    host-ssd node-25-ssd
68      0.18                            osd.68  up      0.259   
73      0.18                            osd.73  up      0.2606  
86      0.18                            osd.86  up      0.2635  
106     0.18                            osd.106 up      0.2539  
111     0.18                            osd.111 up      0.2543  
115     0.18                            osd.115 up      0.2536  
137     0.18                            osd.137 up      0.255   
149     0.18                            osd.149 up      0.2564  
-261    1.44                    host-ssd node-26-ssd
82      0.18                            osd.82  up      0.2495  
96      0.18                            osd.96  up      0.2522  
100     0.18                            osd.100 up      0.2519  
123     0.18                            osd.123 up      0.2549  
125     0.18                            osd.125 up      0.2556  
141     0.18                            osd.141 up      0.2555  
143     0.18                            osd.143 up      0.2559  
147     0.18                            osd.147 up      0.257   
-1200   121             tier tier-sas
-182    15.12                   host-sas node-18-sas
6       1.08                            osd.6   up      1       
10      1.08                            osd.10  up      1       
11      1.08                            osd.11  up      1       
12      1.08                            osd.12  up      1       
16      1.08                            osd.16  up      1       
18      1.08                            osd.18  up      1       
28      1.08                            osd.28  up      1       
30      1.08                            osd.30  up      1       
42      1.08                            osd.42  up      1       
45      1.08                            osd.45  up      1       
49      1.08                            osd.49  up      1       
51      1.08                            osd.51  up      1       
54      1.08                            osd.54  up      1       
63      1.08                            osd.63  up      1       
-202    15.12                   host-sas node-20-sas
2       1.08                            osd.2   up      1       
13      1.08                            osd.13  up      1       
15      1.08                            osd.15  up      1       
19      1.08                            osd.19  up      1       
21      1.08                            osd.21  up      1       
27      1.08                            osd.27  up      1       
33      1.08                            osd.33  up      1       
38      1.08                            osd.38  up      1       
40      1.08                            osd.40  up      1       
46      1.08                            osd.46  up      1       
47      1.08                            osd.47  up      1       
50      1.08                            osd.50  up      1       
56      1.08                            osd.56  up      1       
58      1.08                            osd.58  up      1       
-212    15.12                   host-sas node-21-sas
1       1.08                            osd.1   up      1       
9       1.08                            osd.9   up      1       
14      1.08                            osd.14  up      1       
17      1.08                            osd.17  up      1       
22      1.08                            osd.22  up      1       
26      1.08                            osd.26  up      1       
31      1.08                            osd.31  up      1       
32      1.08                            osd.32  up      1       
41      1.08                            osd.41  up      1       
43      1.08                            osd.43  up      1       
44      1.08                            osd.44  up      1       
48      1.08                            osd.48  up      1       
59      1.08                            osd.59  up      1       
65      1.08                            osd.65  up      1       
-222    15.12                   host-sas node-22-sas
69      1.08                            osd.69  up      1       
75      1.08                            osd.75  up      1       
85      1.08                            osd.85  up      1       
97      1.08                            osd.97  up      1       
101     1.08                            osd.101 up      1       
105     1.08                            osd.105 up      1       
108     1.08                            osd.108 up      1       
116     1.08                            osd.116 up      1       
120     1.08                            osd.120 up      1       
127     1.08                            osd.127 up      1       
130     1.08                            osd.130 up      1       
135     1.08                            osd.135 up      1       
145     1.08                            osd.145 up      1       
148     1.08                            osd.148 up      1       
-232    15.12                   host-sas node-23-sas
76      1.08                            osd.76  up      1       
78      1.08                            osd.78  up      1       
83      1.08                            osd.83  up      1       
84      1.08                            osd.84  up      1       
91      1.08                            osd.91  up      1       
95      1.08                            osd.95  up      1       
109     1.08                            osd.109 up      1       
114     1.08                            osd.114 up      1       
119     1.08                            osd.119 up      1       
126     1.08                            osd.126 up      1       
138     1.08                            osd.138 up      1       
142     1.08                            osd.142 up      1       
146     1.08                            osd.146 up      1       
152     1.08                            osd.152 up      1       
-242    15.12                   host-sas node-24-sas
154     1.08                            osd.154 up      1       
156     1.08                            osd.156 up      1       
158     1.08                            osd.158 up      1       
159     1.08                            osd.159 up      1       
160     1.08                            osd.160 up      1       
161     1.08                            osd.161 up      1       
163     1.08                            osd.163 up      1       
165     1.08                            osd.165 up      1       
166     1.08                            osd.166 up      1       
169     1.08                            osd.169 up      1       
170     1.08                            osd.170 up      1       
172     1.08                            osd.172 up      1       
173     1.08                            osd.173 up      1       
175     1.08                            osd.175 up      1       
-252    15.12                   host-sas node-25-sas
66      1.08                            osd.66  up      1       
77      1.08                            osd.77  up      1       
81      1.08                            osd.81  up      1       
89      1.08                            osd.89  up      1       
92      1.08                            osd.92  up      1       
98      1.08                            osd.98  up      1       
102     1.08                            osd.102 up      1       
118     1.08                            osd.118 up      1       
122     1.08                            osd.122 up      1       
128     1.08                            osd.128 up      1       
132     1.08                            osd.132 up      1       
140     1.08                            osd.140 up      1       
144     1.08                            osd.144 up      1       
153     1.08                            osd.153 up      1       
-262    15.12                   host-sas node-26-sas
67      1.08                            osd.67  up      1       
71      1.08                            osd.71  up      1       
74      1.08                            osd.74  up      1       
79      1.08                            osd.79  up      1       
87      1.08                            osd.87  up      1       
94      1.08                            osd.94  up      1       
103     1.08                            osd.103 up      1       
110     1.08                            osd.110 up      1       
113     1.08                            osd.113 up      1       
117     1.08                            osd.117 up      1       
121     1.08                            osd.121 up      1       
129     1.08                            osd.129 up      1       
133     1.08                            osd.133 up      1       
136     1.08                            osd.136 up      1       
-1      132.5   root default
-71     66.24           room lodz-1
-18     16.56                   host node-18
0       0.18                            osd.0   up      0.2281  
5       0.18                            osd.5   up      0.2434  
6       1.08                            osd.6   up      1       
10      1.08                            osd.10  up      1       
11      1.08                            osd.11  up      1       
12      1.08                            osd.12  up      1       
16      1.08                            osd.16  up      1       
18      1.08                            osd.18  up      1       
20      0.18                            osd.20  up      0.2524  
25      0.18                            osd.25  up      0.2571  
28      1.08                            osd.28  up      1       
30      1.08                            osd.30  up      1       
36      0.18                            osd.36  up      0.2414  
39      0.18                            osd.39  up      0.2436  
42      1.08                            osd.42  up      1       
45      1.08                            osd.45  up      1       
49      1.08                            osd.49  up      1       
51      1.08                            osd.51  up      1       
54      1.08                            osd.54  up      1       
57      0.18                            osd.57  up      0.2555  
60      0.18                            osd.60  up      0.2569  
63      1.08                            osd.63  up      1       
-20     16.56                   host node-20
2       1.08                            osd.2   up      1       
3       0.18                            osd.3   up      0.2506  
7       0.18                            osd.7   up      0.2441  
13      1.08                            osd.13  up      1       
15      1.08                            osd.15  up      1       
19      1.08                            osd.19  up      1       
21      1.08                            osd.21  up      1       
23      0.18                            osd.23  up      0.2482  
27      1.08                            osd.27  up      1       
29      0.18                            osd.29  up      0.2595  
33      1.08                            osd.33  up      1       
35      0.18                            osd.35  up      0.2456  
38      1.08                            osd.38  up      1       
40      1.08                            osd.40  up      1       
46      1.08                            osd.46  up      1       
47      1.08                            osd.47  up      1       
50      1.08                            osd.50  up      1       
52      0.18                            osd.52  up      0.2553  
56      1.08                            osd.56  up      1       
58      1.08                            osd.58  up      1       
61      0.18                            osd.61  up      0.2455  
64      0.18                            osd.64  up      0.257   
-21     16.56                   host node-21
1       1.08                            osd.1   up      1       
4       0.18                            osd.4   up      0.2405  
8       0.18                            osd.8   up      0.2502  
9       1.08                            osd.9   up      1       
14      1.08                            osd.14  up      1       
17      1.08                            osd.17  up      1       
22      1.08                            osd.22  up      1       
24      0.18                            osd.24  up      0.2511  
26      1.08                            osd.26  up      1       
31      1.08                            osd.31  up      1       
32      1.08                            osd.32  up      1       
34      0.18                            osd.34  up      0.246   
37      0.18                            osd.37  up      0.2433  
41      1.08                            osd.41  up      1       
43      1.08                            osd.43  up      1       
44      1.08                            osd.44  up      1       
48      1.08                            osd.48  up      1       
53      0.18                            osd.53  up      0.2537  
55      0.18                            osd.55  up      0.2571  
59      1.08                            osd.59  up      1       
62      0.18                            osd.62  up      0.2462  
65      1.08                            osd.65  up      1       
-22     16.56                   host node-22
69      1.08                            osd.69  up      1       
72      0.18                            osd.72  up      0.2509  
75      1.08                            osd.75  up      1       
80      0.18                            osd.80  up      0.2562  
85      1.08                            osd.85  up      1       
90      0.18                            osd.90  up      0.2484  
93      0.18                            osd.93  up      0.2537  
97      1.08                            osd.97  up      1       
101     1.08                            osd.101 up      1       
105     1.08                            osd.105 up      1       
108     1.08                            osd.108 up      1       
116     1.08                            osd.116 up      1       
120     1.08                            osd.120 up      1       
124     0.18                            osd.124 up      0.2526  
127     1.08                            osd.127 up      1       
130     1.08                            osd.130 up      1       
131     0.18                            osd.131 up      0.2538  
135     1.08                            osd.135 up      1       
139     0.18                            osd.139 up      0.2527  
145     1.08                            osd.145 up      1       
148     1.08                            osd.148 up      1       
151     0.18                            osd.151 up      0.2553  
-72     66.24           room lodz-2
-23     16.56                   host node-23
70      0.18                            osd.70  up      0.2544  
76      1.08                            osd.76  up      1       
78      1.08                            osd.78  up      1       
83      1.08                            osd.83  up      1       
84      1.08                            osd.84  up      1       
88      0.18                            osd.88  up      0.2492  
91      1.08                            osd.91  up      1       
95      1.08                            osd.95  up      1       
99      0.18                            osd.99  up      0.2514  
104     0.18                            osd.104 up      0.2528  
107     0.18                            osd.107 up      0.2527  
109     1.08                            osd.109 up      1       
112     0.18                            osd.112 up      0.254   
114     1.08                            osd.114 up      1       
119     1.08                            osd.119 up      1       
126     1.08                            osd.126 up      1       
134     0.18                            osd.134 up      0.2536  
138     1.08                            osd.138 up      1       
142     1.08                            osd.142 up      1       
146     1.08                            osd.146 up      1       
150     0.18                            osd.150 up      0.2562  
152     1.08                            osd.152 up      1       
-24     16.56                   host node-24
154     1.08                            osd.154 up      1       
155     0.18                            osd.155 up      0.2551  
156     1.08                            osd.156 up      1       
157     0.18                            osd.157 up      0.2545  
158     1.08                            osd.158 up      1       
159     1.08                            osd.159 up      1       
160     1.08                            osd.160 up      1       
161     1.08                            osd.161 up      1       
162     0.18                            osd.162 up      0.2554  
163     1.08                            osd.163 up      1       
164     0.18                            osd.164 up      0.2557  
165     1.08                            osd.165 up      1       
166     1.08                            osd.166 up      1       
167     0.18                            osd.167 up      0.2566  
168     0.18                            osd.168 up      0.2567  
169     1.08                            osd.169 up      1       
170     1.08                            osd.170 up      1       
171     0.18                            osd.171 up      0.256   
172     1.08                            osd.172 up      1       
173     1.08                            osd.173 up      1       
174     0.18                            osd.174 up      0.2533  
175     1.08                            osd.175 up      1       
-25     16.56                   host node-25
66      1.08                            osd.66  up      1       
68      0.18                            osd.68  up      0.259   
73      0.18                            osd.73  up      0.2606  
77      1.08                            osd.77  up      1       
81      1.08                            osd.81  up      1       
86      0.18                            osd.86  up      0.2635  
89      1.08                            osd.89  up      1       
92      1.08                            osd.92  up      1       
98      1.08                            osd.98  up      1       
102     1.08                            osd.102 up      1       
106     0.18                            osd.106 up      0.2539  
111     0.18                            osd.111 up      0.2543  
115     0.18                            osd.115 up      0.2536  
118     1.08                            osd.118 up      1       
122     1.08                            osd.122 up      1       
128     1.08                            osd.128 up      1       
132     1.08                            osd.132 up      1       
137     0.18                            osd.137 up      0.255   
140     1.08                            osd.140 up      1       
144     1.08                            osd.144 up      1       
149     0.18                            osd.149 up      0.2564  
153     1.08                            osd.153 up      1       
-26     16.56                   host node-26
67      1.08                            osd.67  up      1       
71      1.08                            osd.71  up      1       
74      1.08                            osd.74  up      1       
79      1.08                            osd.79  up      1       
82      0.18                            osd.82  up      0.2495  
87      1.08                            osd.87  up      1       
94      1.08                            osd.94  up      1       
96      0.18                            osd.96  up      0.2522  
100     0.18                            osd.100 up      0.2519  
103     1.08                            osd.103 up      1       
110     1.08                            osd.110 up      1       
113     1.08                            osd.113 up      1       
117     1.08                            osd.117 up      1       
121     1.08                            osd.121 up      1       
123     0.18                            osd.123 up      0.2549  
125     0.18                            osd.125 up      0.2556  
129     1.08                            osd.129 up      1       
133     1.08                            osd.133 up      1       
136     1.08                            osd.136 up      1       
141     0.18                            osd.141 up      0.2555  
143     0.18                            osd.143 up      0.2559  
147     0.18                            osd.147 up      0.257   
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to