ure out how to
distribute balanced data in an unbalanced way. You will probably want
to look at primary affinity. This talks about SSD, but the same
principle applies
http://www.sebastien-han.fr/blog/2015/08/06/ceph-get-the-best-of-your-ssd-with-primary-affinity/
-
Robert LeBlanc
P
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
If I recall, there was a bug or two that was found with cache tiers
and snapshots and were fixed. I hope it is being backported to Hammer.
I don't know if this exactly fixes your issue.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4
.
Thanks,
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Sun, Sep 20, 2015 at 9:03 AM, Robert LeBlanc wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA256
>
> We had another incident of 100 long blocked I/O this mo
Fl4/+MZS1T3qNlKEMk+jWRC5nYwE7e1aomABY0QbHHGxgPK
pFl9sm9cOKfWCRXQX4w7mMRspiMosW1X1WbmLe2cU17xtudc0rsEZycPOt3n
XCwin7/+yxKwp/MSWCk/vR/pY7Q/73Pi4kKRzXpFHLpJnteZ3moATTmuSSQm
3Ggb
=SJmS
-END PGP SIGNATURE-
--------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62
r rbd"
- --------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Sun, Sep 20, 2015 at 9:36 PM, Wang, Zhiqiang wrote:
> I remember previously I can delete the cache pool without flushing/evicting
> all the objects first. The way I did it is to remov
/ciuiD2d8HgaOaC04a4dhfPq4vxTsJk940qxo0HHUCwckC9XXbwefuUicz
9R2C6/GTi7RmbfyPJcAZcxFSxSHsWcr5fYO0ZQC2bS0eknw/RV7nrTttiPO7
Jd3lMyzfB3561sbrpEMwuWgnfFWK8ptqdUxcWf+aiUPLdf11Jeh0vEmjS831
n2sbuAhgHBJajerPi4PClE0mCXmCZMNdI1BXDD7E7c4Mnr3/1tWQeqwQLq4V
pF/+
=q3c/
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
On Sun, Sep 20, 2015 at 9:49 PM, Wang, Zhiqiang wrote:
>> -Original Message-
>> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of
>> Robert LeBlanc
>> Sent: Saturday, September 19, 2015 12
[stat,set-alloc-hint
object_size 8388608 write_size 8388608,write 3235840~4096] 17.118f0c67
ack+ondisk+write+known_if_redirected e57590) currently waiting for rw
locks
----
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Sun, Sep 20, 2015 at 7
the blocked I/O and then it was fine after rejoining the
cluster. Increasing what logs and to what level would be most
beneficial in this case for troubleshooting?
I hope this makes sense, it has been a long day.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654
. Then set the
old disk to 'out'. This will keep the OSD participating in the
backfills until it is empty. Once the backfill is done, stop the old
OSD and remove it from the cluster.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Sat, Sep 19
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Sat, Sep 19, 2015 at 12:54 PM, Wouter De Borger <w.debor...@gmail.com> wrote:
> Ok, so if I understand correctly, for replication level 3 or 4 I would have
> to use the r
to test a high
number of clones.
Thanks,
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP SIGNATURE-
Version: Mailvelope v1.1.0
Comment: https://www.mailvelope.com
wsFcBAEBCAAQBQJV/FISCRDmVDuy+mK58QAAsgsP/1WSFOHSkcVy6O582ECf
9JN6
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Created request http://tracker.ceph.com/issues/13163
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Sep 18, 2015 at 12:06 PM, John Spray wrote:
> On Fri, Sep 18, 2015 at 7:04
in this case. My strongest recommendation
is not to have swap if it is a pure OSD node.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Sep 18, 2015 at 8:15 PM, 张冬卯 wrote:
> yes, a raid1 system disk is necessary, from my perspect
the necessary ceph config items (ceph.conf and the OSD bootstrap
keys).
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Sep 18, 2015 at 9:06 AM, Martin Palma wrote:
> Hi,
>
> Is it a good idea to use a software raid for the sy
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
What are your iptable rules?
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Sep 17, 2015 at 1:01 AM, Stefan Eriksson wrote:
> hi here is the info, I have added "ceph osd pool
, it seems to not increment.
What am I missing that causes the pgmap to change? Do these pgmap
changes have to be computed by the monitors and distributed to the
clients? Does the pgmap change constitute a CRUSH algorithm change?
Thanks,
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
I was out of the office for a few days. We have some more hosts to
add. I'll send some logs for examination.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Sep 11, 2015 at 12:45 AM
+5d8b7dYTU5mbqKe59yEPq3yjAOIZPL9PWn1jHfgjylvOMyMw
hihd
=GGct
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Sep 16, 2015 at 10:12 AM, John-Paul Robinson <j...@uab.edu> wrote:
> Christian,
>
> Thanks for the feedback.
>
>
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
My notes show that it should have landed in 4.1, but I also have
written down that it wasn't merged yet. Just trying to get a
confirmation on the version that it did land in.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Has straw2 landed in the kernel and if so which version?
Thanks,
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP SIGNATURE-
Version: Mailvelope v1.0.2
Comment: https
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Do the recovery options kick in when there is only backfill going on?
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Sep 10, 2015 at 3:01 PM, Somnath Roy wrote:
> Try
, but there would have to be
some logic if the obect was changed as it was being replicated. Maybe
just a log in the journal that the objects are starting restore and
finished restore, then the journal flush knows if it needs to commit
the write?
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4
he journal?
Thanks,
- --------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP SIGNATURE-
Version: Mailvelope v1.0.2
Comment: https://www.mailvelope.com
wsFcBAEBCAAQBQJV8e5qCRDmVDuy+mK58QAAaIwQAMN5DJlhrZkqwqsVXaKB
nnegQjG6Y02ObLRrg9
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
I would check that the /var/lib/ceph/osd/ceph-0/ is mounted and has
the file structure for Ceph.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Mon, Sep 7, 2015 at 2:16 AM, Aaron wrote
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Just about how funny "ceph problems" are fixed by changing network
configurations.
- --------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Sep 3, 2015 at 11:16 AM, Ian Colle wro
GbqS4v3mWk
ge1qukr9et0Su0llUb8Rz3hCDqD6PfMJpquBTAB/kaanS+t0pi+00wxu7zzB
zVQ/
=v4sY
-END PGP SIGNATURE-
--------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Sep 2, 2015 at 3:21 AM, Nick Fisk <n...@fisk.me.uk> wrote:
> I think this may b
more work to do, but wanted to share my findings.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Sep 2, 2015 at 9:50 AM, Robert LeBlanc wrote:
- -BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Thanks for the responses.
I forgot
vcziO4s/edQ1koOQm1Fcj5VnbouSqmsHpB5nHeJbGmiKNTBA
9pE/hTph56YRqOE3bq3X/ohjtziL7/e/MVF3VUisDJieaLxV9weLxKIf0W9t
L7NMhX7iUIMps5ulA9qzd8qJK6yBa65BVXtk5M0A5oTA/VvxHQT6e5nSZS+Z
WLjavMnmSSJT1BQZ5GkVbVqo4UVjndcXEvkBm3+McaGKliO2xvxP+U3nCKpZ
js+h
=4WAa
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
I'm not convinced that a backing pool can be removed from a caching
tier. I just haven't been able to get around to trying it.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Sep 1, 2015
SSDs with an 8
core Atom (Intel(R) Atom(TM) CPU C2750 @ 2.40GHz) and size=1 and fio
with 8 jobs and QD=8 sync,direct 4K read/writes produced 2,600 IOPs.
Don't get me wrong, it will help, but don't expect spectacular
results.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Accelio and Ceph are still in heavy development and not ready for production.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Sep 1, 2015 at 10:31 AM, German Anders wrote:
Hi cephers
in a cluster, you are doing that
for performance, in which case I would say it is not enough.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Sep 1, 2015 at 5:19 AM, gjprabu wrote:
Hi Robert,
We are going to use ceph with ocfs2
in that pool yet, that may not be
feasible for you.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Sep 1, 2015 at 6:19 AM, Jan Schermer wrote:
Hi,
we're in the process of changing 480G drives for 1200G drives, which
should cut the number
. With the Intels, it don't cause that
much pain so I'm just going to leave it on. It would be nice for btrfs
to get all the bugs shook out to be able to detect bit rot and have a
modern file system overall.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
My next thing would be to turn up debugging on all the monitors and
see if the survivors are having a problem forming a quorum.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Aug 27
on
the CRUSH map.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Aug 28, 2015 at 3:02 AM, Loic Dachary wrote:
Hi,
Is there a way to modify a ruleset in crush map, without decompiling
and recompiling it with crush tool?
There are a few
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
The OSDs should be marked down within about 30 seconds. Can you
provide additional information such as ceph version and the ceph.conf
file.
Thanks,
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62
they are coming from in that regard, but having Ceph kick out a
misbehaving node quickly is appealing as well (there would have to be
a way to specify that only so many nodes could be kicked out).
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Aug
if it will be implemented although I do love this
idea to help against tail latency.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Aug 27, 2015 at 12:48 PM, Jan Schermer wrote:
Don't kick out the node, just deal with it gracefully and without
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
+1
:)
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Aug 27, 2015 at 1:16 PM, Jan Schermer wrote:
Well, there's no other way to get reliable performance and SLAs
compared
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
On Thu, Aug 27, 2015 at 1:13 PM, Jan Schermer wrote:
On 27 Aug 2015, at 20:57, Robert LeBlanc wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
On Thu, Aug 27, 2015 at 10:25 AM, Jan Schermer wrote:
Some comments inline.
A lot
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
SCSI9 (0,7,0) (sdk) - 3.0 TB SEAGATE ST3000NM0023 (Pool-SATA)
SCSI9 (0,8,0) (sdl) - 3.0 TB SEAGATE ST3000NM0023 (Pool-SATA)
SCSI9 (0,9,0) (sdm) - 3.0 TB SEAGATE ST3000NM0023 (Pool-SATA
/94vCCApAgqoHiatpFeKY7cEd6x0V3YOA+j8MDbr5YWJ
PCWXWyFpClyp9h9LW0uqlwE3LtYBD0ec3d4nJmqNy5v2sszWJo4UWptRhEdi
XOwoda3DNnqoj5G7dmKkSrvXJqSRXA784gIMD0rO7JfXlahjCOsVaYQdo76v
U+bQtxGRTXTAV+1ygOL7rElXMyc4Wo6IyUkpE6dnhFPGsi0lZnOih+kM0Wmt
wt/B
=mSex
-END PGP SIGNATURE-
Robert LeBlanc
PGP
barriers disabled, but
since we don't have battery backed controllers we backed that setting
out. Are you suggesting disabling barriers in all cases? I'd like to
discuss the pros/cons of this option.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
in the middle of the write with no EXT4 journal, the file
system would be repaired and then Ceph would rewrite the last
transaction that didn't complete? I'm sure I'm missing something
here...
Thanks,
[1] http://www.spinics.net/lists/ceph-users/msg20839.html
Robert LeBlanc
PGP
and pulling servers to replace fixed disks, so we
are looking at hot swap options.
I'll try and do some testing in our lab, but I won't be able to get a
very good spread of data due to clock and core limitations in the
existing hardware.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Shouldn't this already be possible with HTTP Range requests? I don't
work with RGW or S3 so please ignore me if I'm talking crazy.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Aug 21
to our performance.
Our current processors are Intel(R) Xeon(R) CPU E5-2640 v2 @ 2.00GHz
[1] http://www.spinics.net/lists/ceph-users/msg19305.html
[2] http://article.gmane.org/gmane.comp.file-systems.ceph.user/22713
Thanks,
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904
/Z0HxDx1mjjJMQdzM+q9+D0m/EYfUpe/DxMqqMI
4t8hD5UPBhkv1sgLYSWyJ5vxLnNOZP7roe2Jp0KwwlSADM9DJb4MEx/1nNcb
6emts8KUhhtb1jsH8gu9Z0tzHcaqNE8N1z9JiveaNCjs6wTp8xbtmDB7p9k4
uZzzoIXTJWrIN/Qqukza+/+8D+WAJ618uwXCCpWi/k83RKt7iy2iv5w4EDTx
25cQ
=a+24
-END PGP SIGNATURE-
Robert LeBlanc
PGP
SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Aug 19, 2015 at 8:20 AM, Logan Barfield lbarfi...@tqhosting.com wrote:
Hi,
We are currently using 2 OSD hosts with SSDs to provide RBD backed volumes
for KVM hypervisors
and found that the average request
size was ~12K/~18K (read/write) and ~30%/70% (it looks like I didn't
save that spreadsheet to get exact numbers).
So, any optimization in smaller I/O sizes would really benefit us
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654
into Ceph. The monitor can
correlate failures and help determine if the problem is related to one
host from the CRUSH map.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Jul 30, 2015 at 11:27 PM, Stijn De Weirdt wrote:
wouldn't
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Fri, Jul 31, 2015 at 1:15 AM, Mallikarjun Biradar
mallikarjuna.bira...@gmail.com wrote:
Hi,
I had 27 OSD's in my cluster. I removed two of the OSD from (osd.20)
host-3 (osd.22) host-6
+HWBQTZgLi0bxIyBEo7Pg75+f8yzawTpWWx5tM4JR
yKkADT8+hid8PK6YwUrsaYnRhdRunAZv9BdvOulXyJ9azcCHSzlJWeYWHEwq
krdm
=m+W6
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Jul 30, 2015 at 7:54 AM, Sage Weil sw...@redhat.com wrote:
As time
JGoj01YM60Ul1XJPWatMoM+435hcHrGd0rJ3bi91DOrZmT55X4jjdUA8z/3Y
xMZE
=Tqaw
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Jul 29, 2015 at 9:21 PM, van chaofa...@owtware.com wrote:
Hi, list,
Ceph cache tier seems very promising
.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Jul 30, 2015 at 12:41 PM, Peter Hinman wrote:
For the record, I have been able to recover. Thank you very much for the
guidance.
I hate searching the web and finding only partial
+Zws6
ZWriDFal0ztd0BNEQlCqtlo4hyY/AVies9qB6V4sUL0UuEL/+iTj71/VNh09
RJIURK6KySwxtW97pMGGafw5xPOjpxnm75D6AmovZ6WV68GSxlNpTY/V7CPH
dW/U
=h5n5
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Jul 29, 2015 at 11:32 PM
and start it up.
I haven't actually done this, so there still may be some bumps.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Jul 29, 2015 at 3:44 PM, Peter Hinman wrote:
Thanks Robert -
Where would that monitor data (database
to be rejoined.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Jul 29, 2015 at 2:46 PM, Peter Hinman wrote:
Hi Greg -
So at the moment, I seem to be trying to resolve a permission error.
=== osd.3 ===
Mounting xfs on stor-2:/var/lib
. Just make sure you have the
correct journal in the same host with the matching OSD disk, udev
should do the magic.
The OSD logs are your friend if they don't start properly.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Jul 29, 2015
deal with that later if needed.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, Jul 29, 2015 at 4:40 PM, Peter Hinman wrote:
Ok - that is encouraging. I've believe I've got data from a previous
monitor. I see files in a store.db dated
/cCuRMR0eXL44H
Or2sbJRwwM2+9kItGOskYjZLX/ELdWV+fpmy/BeJB92U+1pxOWBB2Wv11SY0
uBX2
=zbAW
-END PGP SIGNATURE-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Mon, Jul 27, 2015 at 8:22 AM, Konstantin Danilov
kdani...@mirantis.com wrote:
Hi all
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Did you kill the OSD process, you are still showing 28 OSD up. I'm not
sure that should stop you from removing it though. You can also try
ceph osd crush rm osd.21
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E
Sorry, autocorrect. Decompiled crush map.
Robert LeBlanc
Sent from a mobile device please excuse any typos.
On Jul 24, 2015 9:44 AM, Robert LeBlanc rob...@leblancnet.us wrote:
Please provide the recompiled crush map.
Robert LeBlanc
Sent from a mobile device please excuse any typos.
On Jul
are designed to have
multiple discrete machines access the file system at the same time. As
long as you use a clustered file system on RBD, you will be OK.
Now, if that performs better than CephFS, is a question you will have
to answer through testing.
-
Robert LeBlanc
PGP
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Yes you will need to change osd to host as you thought so that copies
will be separated between hosts. You will run into problems you see
until that is changed. It will cause data movement.
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4
and report back to the list.
Thank you,
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP SIGNATURE-
Version: Mailvelope v0.13.1
Comment: https://www.mailvelope.com
wsFcBAEBCAAQBQJVpUQtCRDmVDuy+mK58QAA3d8P/3tSSFXInMDLde9IZFfE
You could also create two roots and two rules and have the primary osd be
the 10k drives so that the 7.2k are used primarily for writes. I believe
that recipe is on the CRUSH page in the documentation.
Robert LeBlanc
Sent from a mobile device please excuse any typos.
On Jul 9, 2015 10:03 PM
You may not want to set your heartbeat grace so high, it will make I/O
block for a long time in the case of a real failure. You may want to look
at increasing down reporters instead.
Robert LeBlanc
Sent from a mobile device please excuse any typos.
On Jul 2, 2015 9:39 PM, Tuomas Juntunen
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Did you see what the effect of just restarting the OSDs before using
tcmalloc? I've noticed that there is usually a good drop for us just
by restarting them. I don't think it is usually this drastic.
-
Robert LeBlanc
GPG
memory) and they try much
harder to reuse dirty free pages so memory stays within the thread
again reducing locking for memory allocations.
I would do some more testing along with what Ben Hines mentioned about
overall client performance.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Have you configured and enabled the epel repo?
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Jun 11, 2015 at 6:26 AM, Shambhu Rajak wrote:
I am trying to install ceph gaint on rhel
/SYEh0164HunDuAb1KjEM
tI0dly7JNGPagz3VAsBXaAoxoKXB1wfkdo0I59OmFTDGwoYOLQi5jhQd7csl
A7Am
=1XtM
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Jun 9, 2015 at 8:35 AM, Vickey Singh vickey.singh22...@gmail.com
wrote
+F0Uvs3xWAxxaIR9r83wMj9qQeBZTKVzQ
1aFIi15KqAwOp12yWCmrqKTeXhjwYQNd8viCQCGN7AQyPglmzfbuEHalVjz4
oSJX
=k281
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Jun 9, 2015 at 6:02 AM, Alexandre DERUMIER aderum...@odiso.com wrote
(in the same host) or 1 host
without data loss, but I/O will block until Ceph can replicate at
least one more copy (assuming the min_size 2 stated above).
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, Jun 9, 2015 at 9:53 AM, kevin
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
When copying to the primary OSD, a deep-scrub has worked for me, but
I've not done this exact scenario. Did you try bouncing the OSD
process?
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Did you try to deep-scrub the PG after copying it to 29?
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Jun 4, 2015 at 10:26 PM, Aaron Ten Clay wrote:
Hi Cephers,
I recently had
i1L0kfNU7eCI4GBdjYkyGINZno1DYG3VrS1u04UIzbp6vS8J6TkZoouh2Vv0
Gp6YzCerc4QjkM4N/4Huy+HhgSjG3aNt5VHGp9/xMGqT6ihzsAHOcPcnx+zp
BLT4
=cnp+
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Jun 4, 2015 at 12:23 PM, Lars Marowsky-Bree l
ceph | wc
lsof: WARNING: can't stat() tmpfs file system /run
Output information may be incomplete.
10109090 125240
[root@compute3 ~]# virsh list | wc
13 34 558
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN
. It will be a good test as to what to do in
this situation as I have a feeling this will most likely happen again.
Please post back when you have a result, I'd like to know the outcome.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
TCP
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, May 28, 2015 at 2:00 PM, Garg, Pankaj wrote:
Hi,
Does ceph typically use TCP or UDP or something else for data path
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
I've got some more tests running right now. Once those are done, I'll
find a couple of tests that had extreme difference and gather some
perf data for them.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
The workload is on average, 17KB per read request and 13KB per write
request with 73% read abd 27% write. This is a web hosting workload.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed
/spreadsheets/d/1n12IqAOuH2wH-A7Sq5boU8kSEYg_Pl20sPmM0idjj00/edit?usp=sharing
Test script is multitest. The real world test is based off of the disk
stats of about 100 of our servers which have uptimes of many months.
- -
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654
can
determine if jemalloc is something that would be worth switching to
eventually.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
-BEGIN PGP SIGNATURE-
Version: Mailvelope v0.13.1
Comment: https://www.mailvelope.com
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
What version of Ceph are you using? I seem to remember an enhancement
of ceph-disk for Hammer that is more aggressive in reusing previous
partition.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
like there was some discussion
about this on the devel list recently.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, May 26, 2015 at 4:06 AM, Xavier Serrano wrote:
Hello,
Thanks for your detailed explanation, and for the pointer
/7A1vlqbisa+iedxaNrqG+wNY0
Q5fT44s+JTWZxCcxadhka0HQ4tguEvTXg83D/PGAkjo6BX7avUv5uiyDGMOw
HBWS9/Cy98EH2gDKvWOq2DMDiSvIY+aLZ5W8tFX+D+rsE6DwrvN8fUDxyG6C
dsN2
=u7g4
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, May 26
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Not supported at the moment, but it is in the eventual plans and I
think some of the code has been written such that it will help
facilitate the development.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2
RPMs
As to where to find the SRPMs, I'm not really sure, I come from a
Debian background where access to source packages is really easy.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, May 19, 2015 at 3:47 PM, Georgios Dimitrakakis wrote
of packages.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, May 19, 2015 at 12:33 PM, Georgios Dimitrakakis wrote:
I am trying to build the packages manually and I was wondering
is the flag --enable-rbd enough to have full Ceph
+2Rouz4f8uu5irmDjz0ivKL6QCIzBwZbBTdLIwqhf9vCl1ACDWq4U3
DMorcafZbMArdOqlkVhQJiMioZEQ8U/ThY2bInkNdhii/2A35CToyOfMKyfq
FLAK5lCiM6gRfCkEBPTwkDR6GNAfgY7khz34adsBRlZPB6a3MeucAGtTjyWt
AJIV
=bcYd
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, May 14, 2015
, never
to be fixed.
-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, May 13, 2015 at 10:29 AM, Vasiliy Angapov wrote:
Thanks, Sage!
In the meanwhile I asked the same question in #Ceph IRC channel and
Be_El gave me exactly the same answer
=c0TU
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Wed, May 13, 2015 at 2:32 PM, Vasiliy Angapov anga...@gmail.com wrote:
Robert, thank you very much for sharing your wisdom with me! Much
appreciated.
I think
+yWjykKqZUCBdkMNu4ZC6M8tVFynbqyqxMof
RqsFbVRm+6quen5UiWTJoZvxVJjT5iSmd52RZ06n3e7II5VQwpFgr2qDzW+A
spN8nLBzJFKnUbNMqPXvutaf/458yW2bE3ARgs5g+DQjeKy1Nj7Cu5n5H135
Y0ry
=xvWE
-END PGP SIGNATURE-
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Tue, May 12, 2015 at 2:12 PM
disks and mount points, but it is much
easier than I anticipated once I used ceph-disk.
Robert LeBlanc
Sent from a mobile device please excuse any typos.
On May 11, 2015 5:32 AM, Georgios Dimitrakakis gior...@acmac.uoc.gr
wrote:
Hi Robert,
just to make sure I got it correctly:
Do you mean
with an error. The idea
is to keep rsyncing until the deep-scrub is clean. Be warned that you may
be aiming your gun at your foot with this!
Robert LeBlanc
GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Mon, May 11, 2015 at 2:09 AM, Christian Eichelmann
On Thu, May 7, 2015 at 5:20 AM, Wido den Hollander w...@42on.com wrote:
Aren't snapshots something that should protect you against removal? IF
snapshots work properly in CephFS you could create a snapshot every hour.
Unless the file is created and removed between snapshots, then the Recycle
You may also be able to use `ceph-disk list`.
On Thu, May 7, 2015 at 3:56 AM, Francois Lafont flafdiv...@free.fr wrote:
Hi,
Patrik Plank wrote:
i cant remember on which drive I install which OSD journal :-||
Is there any command to show this?
It's probably not the answer you hope, but
201 - 300 of 466 matches
Mail list logo
