Re: [ceph-users] SSL for tracker.ceph.com

2015-07-16 Thread Wido den Hollander
On 07/15/2015 05:12 AM, Ken Dreyer wrote: On 07/14/2015 04:14 PM, Wido den Hollander wrote: Hi, Curently tracker.ceph.com doesn't have SSL enabled. Every time I log in I'm sending my password over plain text which I'd rather not. Can we get SSL enabled on tracker.ceph.com? And while we

Re: [ceph-users] RGW Malformed Headers

2015-07-16 Thread Wido den Hollander
On 16-07-15 15:52, Simon Murray wrote: I've spotted an issue with radosgw on Giant and I'm hoping someone can shed any light on if it's known or been fixed. Google and #ceph weren't particularly useful sadly. Long story short when probing S3's admin API to get user quotas it's returning

Re: [ceph-users] rados-java issue tracking and release

2015-07-15 Thread Wido den Hollander
and publish a new version with various fixes in it. Bump the version number and that should then be uploaded to the repo so that the binary matches the source. Wido Best regards, Laszlo On Tue, Jul 14, 2015 at 11:58 AM, Wido den Hollander w...@42on.com mailto:w...@42on.com wrote: Hi

Re: [ceph-users] rados-java issue tracking and release

2015-07-14 Thread Wido den Hollander
Hi, On 14-07-15 11:05, Mingfai wrote: hi, does anyone know who is maintaining rados-java and perform release to the Maven central? In May, there was a release to Maven central *[1], but the release version is not based on the latest code base from: https://github.com/ceph/rados-java I

[ceph-users] SSL for tracker.ceph.com

2015-07-14 Thread Wido den Hollander
Hi, Curently tracker.ceph.com doesn't have SSL enabled. Every time I log in I'm sending my password over plain text which I'd rather not. Can we get SSL enabled on tracker.ceph.com? And while we are at it, can we enable IPv6 as well? :) -- Wido den Hollander 42on B.V. Ceph trainer

Re: [ceph-users] VM with rbd volume hangs on write during load

2015-07-14 Thread Wido den Hollander
] ? flush_kthread_worker+0xb0/0xb0 Thanks, Jeyaganesh. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700

Re: [ceph-users] All pgs with - up [0] acting [0], new cluster installation

2015-07-13 Thread Wido den Hollander
On 13-07-15 14:07, alberto ayllon wrote: On 13-07-15 13:12, alberto ayllon wrote: Maybe this can help to get the origin of the problem. If I run ceph pg dump, and the end of the response i get: What does 'ceph osd tree' tell you? It seems there is something wrong with your

Re: [ceph-users] Firefly 0.80.10 ready to upgrade to?

2015-07-13 Thread Wido den Hollander
On 13-07-15 12:25, Kostis Fardelas wrote: Hello, it seems that new packages for firefly have been uploaded to repo. However, I can't find any details in Ceph Release notes. There is only one thread in ceph-devel [1], but it is not clear what this new version is about. Is it safe to upgrade

Re: [ceph-users] All pgs with - up [0] acting [0], new cluster installation

2015-07-13 Thread Wido den Hollander
On 13-07-15 13:12, alberto ayllon wrote: Maybe this can help to get the origin of the problem. If I run ceph pg dump, and the end of the response i get: What does 'ceph osd tree' tell you? It seems there is something wrong with your CRUSHMap. Wido osdstatkbusedkbavailkbhb inhb out

[ceph-users] Ruby bindings for Librados

2015-07-13 Thread Wido den Hollander
://github.com/netskin/ceph-ruby The last commit for desperados was in March 2013 and ceph-ruby in April 2015. Anybody out there using Ruby bindings? If so, which one and what are the experiences? -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Ruby bindings for Librados

2015-07-13 Thread Wido den Hollander
be worth looking at. I'll give the current bindings a try btw! Best Corin Am 13.07.2015 um 21:24 schrieb Wido den Hollander: Hi, I have an Ruby application which currently talks S3, but I want to have the application talk native RADOS. Now looking online I found various Ruby bindings

Re: [ceph-users] Configuring Ceph without DNS

2015-07-13 Thread Wido den Hollander
On 13-07-15 09:13, Abhishek Varshney wrote: Hi Peter and Nigel, I have tries /etc/hosts and it works perfectly fine! But I am looking for an alternative (if any) to do away completely with hostnames and just use IP addresses instead. It's just that ceph-deploy wants DNS, but if you go

Re: [ceph-users] replace OSD disk without removing the osd from crush

2015-07-09 Thread Wido den Hollander
hard copies or electronically stored copies). ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype

Re: [ceph-users] Problems to expect with newer point release rgw vs. older MONs/OSDs

2015-07-08 Thread Wido den Hollander
On 08-07-15 12:20, Daniel Schneller wrote: Hi! Just a quick question regarding mixed versions. So far a cluster is running on 0.94.1-1trusty without Rados Gateway. Since the packets have been updated in the meantime, installing radosgw now would entail bringing a few updated dependencies

Re: [ceph-users] Client - Server Version Dependencies

2015-07-08 Thread Wido den Hollander
On 07-07-15 19:45, Eino Tuominen wrote: Hello, I tried to find documentation about version dependencies. I understand that a newer client (librados) should always be able to talk to an older server, but how about the other way round? For example a Firefly (0.80.X) client can talk to a

Re: [ceph-users] FW: Ceph data locality

2015-07-07 Thread Wido den Hollander
On 07-07-15 14:42, Dmitry Meytin wrote: Hi Christian, Thanks for the thorough explanation. My case is Elastic Map Reduce on top of OpenStack with Ceph backend for everything (block, object, images). With default configuration, performance is 300% worse than bare metal. I did a few

Re: [ceph-users] Ceph FS - MDS problem

2015-07-03 Thread Wido den Hollander
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Where does 130IOPS come from?

2015-07-02 Thread Wido den Hollander
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph

Re: [ceph-users] Round-trip time for monitors

2015-07-01 Thread Wido den Hollander
, and to monitor that value. Any idea on how to do it ? Thank you. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone

Re: [ceph-users] straw to straw2 migration

2015-06-24 Thread Wido den Hollander
this by fetching you crushmap from the cluster and perform tests on it with 'crushtool'. That will tell you what the differences will be between straw and straw2. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Ceph User Committee Vote

2015-05-13 Thread Wido den Hollander
://community.redhat.com @scuttlemonkey || @ceph -- Eric Mourgaya, Respectons la planete! Luttons contre la mediocrite! -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list

Re: [ceph-users] Dataflow/path Client --- OSD

2015-05-07 Thread Wido den Hollander
/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] How to backup hundreds or thousands of TB

2015-05-07 Thread Wido den Hollander
mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users

Re: [ceph-users] How to estimate whether putting a journal on SSD will help with performance?

2015-05-01 Thread Wido den Hollander
On 01-05-15 11:42, Nick Fisk wrote: Yeah, that’s your problem, doing a single thread rsync when you have quite poor write latency will not be quick. SSD journals should give you a fair performance boost, otherwise you need to coalesce the writes at the client so that Ceph is given bigger IOs

[ceph-users] RBD storage pool support in Libvirt not enabled on CentOS

2015-04-29 Thread Wido den Hollander
libvirt (1.2.8-16.el7) isn't build with RBD storage pool support, which is required by CloudStack. Any ideas? Would be great to have. Librados and librbd are available, so that's not the issue. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype

Re: [ceph-users] RBD storage pool support in Libvirt not enabled on CentOS

2015-04-29 Thread Wido den Hollander
On 04/29/2015 12:34 PM, Wido den Hollander wrote: Hi, While working with some CentOS machines I found out that Libvirt currently is not build with RBD storage pool support. While that support has been upstream for a very long time and enabled in Ubuntu as well I was wondering if anybody

Re: [ceph-users] RBD storage pool support in Libvirt not enabled on CentOS

2015-04-29 Thread Wido den Hollander
would like to see this enabled in both RHEL and CentOS. Wido Thanks Regards Somnath -Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Wido den Hollander Sent: Wednesday, April 29, 2015 12:22 PM To: ceph-users@lists.ceph.com Subject: Re

Re: [ceph-users] RBD storage pool support in Libvirt not enabled on CentOS

2015-04-29 Thread Wido den Hollander
-7-1-with-rbd-storage-pool-support/ The specfile shows that since Fedora 16 it's enabled, but for RHEL and CentOS it is disabled by default. I would like to see that enabled as well. On Wed, Apr 29, 2015 at 4:34 AM, Wido den Hollander w...@42on.com wrote: Hi, While working with some CentOS

Re: [ceph-users] Heads up: libvirt produces unusable images from RBD pool on Ubuntu trusty

2015-04-22 Thread Wido den Hollander
On 04/22/2015 03:20 PM, Florian Haas wrote: On Wed, Apr 22, 2015 at 1:02 PM, Wido den Hollander w...@42on.com wrote: On 04/22/2015 12:07 PM, Florian Haas wrote: Hi everyone, I don't think this has been posted to this list before, so just writing it up so it ends up in the archives. tl;dr

Re: [ceph-users] Powering down a ceph cluster

2015-04-22 Thread Wido den Hollander
Op 22 apr. 2015 om 16:54 heeft 10 minus t10te...@gmail.com het volgende geschreven: Hi, Is there a recommended way of powering down a ceph cluster and bringing it back up ? I have looked thru the docs and cannot find anything wrt it. Best way would be: - Stop all client I/O -

Re: [ceph-users] Heads up: libvirt produces unusable images from RBD pool on Ubuntu trusty

2015-04-22 Thread Wido den Hollander
On 04/22/2015 03:38 PM, Wido den Hollander wrote: On 04/22/2015 03:20 PM, Florian Haas wrote: On Wed, Apr 22, 2015 at 1:02 PM, Wido den Hollander w...@42on.com wrote: On 04/22/2015 12:07 PM, Florian Haas wrote: Hi everyone, I don't think this has been posted to this list before, so just

Re: [ceph-users] ceph-crush-location + SSD detection ?

2015-04-22 Thread Wido den Hollander
I've used that a couple of times. Wido Thanks ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20

Re: [ceph-users] cephfs ... show_layout deprecated ?

2015-04-22 Thread Wido den Hollander
68 20 98/ ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Heads up: libvirt produces unusable images from RBD pool on Ubuntu trusty

2015-04-22 Thread Wido den Hollander
-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph.com

2015-04-17 Thread Wido den Hollander
On 16-04-15 19:31, Ferber, Dan wrote: Thanks for working on this Patrick. I have looked for a mirror that I can point all the ceph.com references to in /usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/install.py. So I can get ceph-deploy to work. I tried eu.ceph.com but it

Re: [ceph-users] Ceph repo - RSYNC?

2015-04-16 Thread Wido den Hollander
is that the repo doesn't include Hammer. Is there someone who can get that added to the mirror? thanks very much Paul ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den

Re: [ceph-users] Is ceph.com down?

2015-04-15 Thread Wido den Hollander
, Australia. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Ceph site is very slow

2015-04-15 Thread Wido den Hollander
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users

Re: [ceph-users] Understanding High Availability - iSCSI/CIFS/NFS

2015-04-04 Thread Wido den Hollander
! ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] running Qemu / Hypervisor AND Ceph on the same nodes

2015-03-26 Thread Wido den Hollander
On 26-03-15 12:04, Stefan Priebe - Profihost AG wrote: Hi Wido, Am 26.03.2015 um 11:59 schrieb Wido den Hollander: On 26-03-15 11:52, Stefan Priebe - Profihost AG wrote: Hi, in the past i rwad pretty often that it's not a good idea to run ceph and qemu / the hypervisors on the same nodes

Re: [ceph-users] running Qemu / Hypervisor AND Ceph on the same nodes

2015-03-26 Thread Wido den Hollander
which might give you problems. Stefan ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] PHP Rados failed in read operation if object size is large (say more than 10 MB )

2015-03-16 Thread Wido den Hollander
; ? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing

Re: [ceph-users] Does ceph zero out RBD volumes when deleted?

2015-03-13 Thread Wido den Hollander
On 13-03-15 07:44, Sreenath BH wrote: When a RBD volume is deleted, does Ceph fill used 4 MB chunks with zeros? No, it does not. It simply deletes the RADOS objects on the background. Wido thanks, Sreenath ___ ceph-users mailing list

Re: [ceph-users] Turning on SCRUB back on - any suggestion ?

2015-03-13 Thread Wido den Hollander
:16, Andrija Panic andrija.pa...@gmail.com mailto:andrija.pa...@gmail.com wrote: Thanks Wido - I will do that. On 13 March 2015 at 09:46, Wido den Hollander w...@42on.com mailto:w...@42on.com wrote: On 13-03-15 09:42, Andrija Panic wrote: Hi all

Re: [ceph-users] Turning on SCRUB back on - any suggestion ?

2015-03-13 Thread Wido den Hollander
On 13-03-15 09:42, Andrija Panic wrote: Hi all, I have set nodeep-scrub and noscrub while I had small/slow hardware for the cluster. It has been off for a while now. Now we are upgraded with hardware/networking/SSDs and I would like to activate - or unset these flags. Since I now

Re: [ceph-users] Doesn't Support Qcow2 Disk images

2015-03-12 Thread Wido den Hollander
On 12-03-15 13:00, Lindsay Mathieson wrote: On Thu, 12 Mar 2015 12:49:51 PM Vieresjoki, Juha wrote: But there's really no point, block storage is the only viable option for virtual machines performance-wise. With images you're dealing with multiple filesystem layers on top of the actual

Re: [ceph-users] Duplication name Container

2015-03-11 Thread Wido den Hollander
= 0.87-1precise Thank you for your help -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph

Re: [ceph-users] New eu.ceph.com mirror machine

2015-03-09 Thread Wido den Hollander
, Cambridge Alcatel-Lucent t: +44 1223 435893 m: +44 7985327353 From: ceph-users [ceph-users-boun...@lists.ceph.com] on behalf of Wido den Hollander [w...@42on.com] Sent: 09 March 2015 11:15 To: ceph-users Subject: [ceph-users] New eu.ceph.com

Re: [ceph-users] New eu.ceph.com mirror machine

2015-03-09 Thread Wido den Hollander
, Cambridge Alcatel-Lucent t: +44 1223 435893 m: +44 7985327353 From: Wido den Hollander [w...@42on.com] Sent: 09 March 2015 13:43 To: HEWLETT, Paul (Paul)** CTR **; ceph-users Subject: Re: [ceph-users] New eu.ceph.com mirror machine On 03/09/2015 02

Re: [ceph-users] New eu.ceph.com mirror machine

2015-03-09 Thread Wido den Hollander
Systems Engineer Velocix, Cambridge Alcatel-Lucent t: +44 1223 435893 m: +44 7985327353 From: Wido den Hollander [w...@42on.com] Sent: 09 March 2015 12:15 To: HEWLETT, Paul (Paul)** CTR **; ceph-users Subject: Re: [ceph-users] New eu.ceph.com

[ceph-users] New eu.ceph.com mirror machine

2015-03-09 Thread Wido den Hollander
is dedicated for running eu.ceph.com, so hopefully rsync won't fail anymore. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http

Re: [ceph-users] Ceph repo - RSYNC?

2015-03-05 Thread Wido den Hollander
ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http

Re: [ceph-users] Implement replication network with live cluster

2015-03-04 Thread Wido den Hollander
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi

Re: [ceph-users] [URGENT-HELP] - Ceph rebalancing again after taking OSD out of CRUSH map

2015-03-02 Thread Wido den Hollander
list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com

Re: [ceph-users] who is using radosgw with civetweb?

2015-02-26 Thread Wido den Hollander
On 25-02-15 20:31, Sage Weil wrote: Hey, We are considering switching to civetweb (the embedded/standalone rgw web server) as the primary supported RGW frontend instead of the current apache + mod-fastcgi or mod-proxy-fcgi approach. Supported here means both the primary platform the upstream

Re: [ceph-users] does ceph auth caps support multiple pools?

2015-02-16 Thread Wido den Hollander
/user-management/ regards, mingfai ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Introducing Learning Ceph : The First ever Book on Ceph

2015-02-13 Thread Wido den Hollander
://www.csc.fi/ ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902

Re: [ceph-users] Selecting between multiple public networks

2015-02-02 Thread Wido den Hollander
/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] about command ceph osd map can display non-existent object

2015-01-26 Thread Wido den Hollander
​ ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Consumer Grade SSD Clusters

2015-01-24 Thread Wido den Hollander
Op 24 jan. 2015 om 10:13 heeft Quenten Grasso qgra...@onq.com.au het volgende geschreven: Hi Everyone, Just wondering if anyone has had any experience in using consumer grade SSD’s for a Ceph cluster? I came across this article

Re: [ceph-users] MDS aborted after recovery and active, FAILED assert (r =0)

2015-01-16 Thread Wido den Hollander
unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph

Re: [ceph-users] Recovering some data with 2 of 2240 pg in remapped+peering

2015-01-14 Thread Wido den Hollander
/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Different disk usage on different OSDs

2015-01-05 Thread Wido den Hollander
On 05-01-15 11:04, ivan babrou wrote: Hi! I have a cluster with 106 osds and disk usage is varying from 166gb to 316gb. Disk usage is highly correlated to number of pg per osd (no surprise here). Is there a reason for ceph to allocate more pg on some nodes? The biggest osds are 30, 42 and 69

Re: [ceph-users] Different disk usage on different OSDs

2015-01-05 Thread Wido den Hollander
/ ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph

[ceph-users] Marking a OSD a new in the OSDMap

2014-12-31 Thread Wido den Hollander
filesystem. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Marking a OSD a new in the OSDMap

2014-12-31 Thread Wido den Hollander
On 12/31/2014 05:54 PM, Andrey Korolyov wrote: On Wed, Dec 31, 2014 at 7:34 PM, Wido den Hollander w...@42on.com wrote: Hi, Is there a way to set a OSD to exists,new in the OSDMap? I want to re-install a OSD and re-use the ID and it's key. I know I can remove the OSD and re-add

Re: [ceph-users] cephfs usable or not?

2014-12-28 Thread Wido den Hollander
at this point? Is it possible to say production ready at any time anyway? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0

Re: [ceph-users] shared rbd ?

2014-12-23 Thread Wido den Hollander
-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Wido den Hollander
to understand the waiting_for_osdmap better to fully understand what is happening there. [0]: https://www.mail-archive.com/ceph-users@lists.ceph.com/msg12754.html -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Wido den Hollander
On 12/22/2014 07:04 PM, Gregory Farnum wrote: On Mon, Dec 22, 2014 at 8:20 AM, Wido den Hollander w...@42on.com wrote: Hi, While investigating slow requests on a Firefly (0.80.7) I looked at the historic ops from the admin socket. On a OSD which just spitted out some slow requests I noticed

Re: [ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Wido den Hollander
On 12/22/2014 07:42 PM, Gregory Farnum wrote: On Mon, Dec 22, 2014 at 10:30 AM, Wido den Hollander w...@42on.com wrote: For example, two ops: #1: { description: osd_sub_op(client.2433432.0:61603164 20.424 19038c24\/rbd_data.d7c912ae8944a.08b6\/head\/\/20 [] v 63283'8301089

[ceph-users] How stable is a Hot Standby (Standby Replay) MDS?

2014-12-19 Thread Wido den Hollander
is there. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] When is the rctime updated in CephFS?

2014-12-18 Thread Wido den Hollander
the rstats, but one hour is quite long, isn't it? Ceph version 0.89 Linux 3.18 kernel client Ceph fuse client 0.89 -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users

Re: [ceph-users] When is the rctime updated in CephFS?

2014-12-18 Thread Wido den Hollander
On 12/18/2014 03:37 PM, Sage Weil wrote: On Thu, 18 Dec 2014, Wido den Hollander wrote: Hi, I've been playing around a bit with the recursive statistics for CephFS today and I'm seeing some behavior with the rstats what I don't understand. I /A/B/C in my CephFS. I changed a file in 'C

Re: [ceph-users] When is the rctime updated in CephFS?

2014-12-18 Thread Wido den Hollander
. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] File System stripping data

2014-12-17 Thread Wido den Hollander
ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http

Re: [ceph-users] File System stripping data

2014-12-17 Thread Wido den Hollander
On 12/17/2014 12:35 PM, John Spray wrote: On Wed, Dec 17, 2014 at 10:25 AM, Wido den Hollander w...@42on.com wrote: I just tried something similar on Giant (0.87) and I saw this in the logs: parse_layout_vxattr name layout.pool value 'cephfs_svo' invalid data pool 3 reply request -22 I

Re: [ceph-users] Ceph Block device and Trim/Discard

2014-12-12 Thread Wido den Hollander
/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander Ceph consultant and trainer 42on B.V. Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph Block device and Trim/Discard

2014-12-12 Thread Wido den Hollander
On 12/12/2014 01:17 PM, Max Power wrote: Wido den Hollander w...@42on.com hat am 12. Dezember 2014 um 12:53 geschrieben: It depends. Kernel RBD does not support discard/trim yet. Qemu does under certain situations and with special configuration. Ah, Thank you. So this is my problem. I use

[ceph-users] Watch for fstrim running on your Ubuntu systems

2014-12-09 Thread Wido den Hollander
should solve this. It's weird that this issue didn't come up earlier on that cluster, but after killing fstrim all problems we resolved and the cluster ran happily again. So watch out for fstrim on early Sunday mornings on Ubuntu! -- Wido den Hollander 42on B.V. Ceph trainer and consultant

Re: [ceph-users] Watch for fstrim running on your Ubuntu systems

2014-12-09 Thread Wido den Hollander
the rest. Wido On Tue, Dec 9, 2014 at 9:21 AM, Wido den Hollander w...@42on.com wrote: Hi, Last sunday I got a call early in the morning that a Ceph cluster was having some issues. Slow requests and OSDs marking each other down. Since this is a 100% SSD cluster I was a bit confused

Re: [ceph-users] Rsync mirror for repository?

2014-12-02 Thread Wido den Hollander
--contimeout=2 rsync error: timeout waiting for daemon connection (code 35) at socket.c(279) [receiver=3.0.6] ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V

Re: [ceph-users] Revisiting MDS memory footprint

2014-11-30 Thread Wido den Hollander
On 11/28/2014 03:36 PM, Florian Haas wrote: On Fri, Nov 28, 2014 at 3:29 PM, Wido den Hollander w...@42on.com wrote: On 11/28/2014 03:22 PM, Florian Haas wrote: On Fri, Nov 28, 2014 at 3:14 PM, Wido den Hollander w...@42on.com wrote: On 11/28/2014 01:04 PM, Florian Haas wrote: Hi everyone

Re: [ceph-users] Revisiting MDS memory footprint

2014-11-28 Thread Wido den Hollander
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users

Re: [ceph-users] Revisiting MDS memory footprint

2014-11-28 Thread Wido den Hollander
On 11/28/2014 03:22 PM, Florian Haas wrote: On Fri, Nov 28, 2014 at 3:14 PM, Wido den Hollander w...@42on.com wrote: On 11/28/2014 01:04 PM, Florian Haas wrote: Hi everyone, I'd like to come back to a discussion from 2012 (thread at http://marc.info/?l=ceph-develm=134808745719233

Re: [ceph-users] Creating RGW S3 User using the Admin Ops API

2014-11-16 Thread Wido den Hollander
On 16-11-14 07:05, Yehuda Sadeh wrote: On Sat, Nov 15, 2014 at 6:20 AM, Wido den Hollander w...@42on.com wrote: Hi, I'm having trouble with creating a new user using the Admin Ops API and I'm not sure where the problem lies. I'm using: http://eu.ceph.com/docs/master/radosgw/adminops/#create

Re: [ceph-users] Creating RGW S3 User using the Admin Ops API

2014-11-16 Thread Wido den Hollander
Thanks Leidong On Monday, November 17, 2014 2:39 PM, Wido den Hollander w...@42on.com wrote: On 16-11-14 07:05, Yehuda Sadeh wrote: On Sat, Nov 15, 2014 at 6:20 AM, Wido den Hollander w...@42on.com mailto:w...@42on.com wrote: Hi, I'm having trouble with creating a new user using

Re: [ceph-users] Typical 10GbE latency

2014-11-14 Thread Wido den Hollander
IFNAME should you provide that. Yes, I tested that as well. But I have to add, the other deployments I tested all run with the default settings and do get a good latency. But I turned off lro for example, that didn't help either. - Stephan -- Wido den Hollander 42on B.V. Phone: +31

Re: [ceph-users] Typical 10GbE latency

2014-11-13 Thread Wido den Hollander
On 12-11-14 21:12, Udo Lembke wrote: Hi Wido, On 12.11.2014 12:55, Wido den Hollander wrote: (back to list) Indeed, there must be something! But I can't figure it out yet. Same controllers, tried the same OS, direct cables, but the latency is 40% higher. perhaps something with pci-e

Re: [ceph-users] Typical 10GbE latency

2014-11-12 Thread Wido den Hollander
. But a basic ICMP test on a idle machine should be a baseline from where you can start with further diagnosing network latency using better tools like netperf. Wido -gary On Mon, Nov 10, 2014 at 9:22 AM, Wido den Hollander w...@42on.com wrote: On 08-11-14 02:42, Gary M wrote: Wido, Take

Re: [ceph-users] Typical 10GbE latency

2014-11-10 Thread Wido den Hollander
hosts and Arista 7050S-64 between. Both hosts were part of active ceph cluster. On Thu, Nov 6, 2014 at 5:18 AM, Wido den Hollander w...@42on.com mailto:w...@42on.com wrote: Hello, While working at a customer I've ran into a 10GbE latency which seems

[ceph-users] Typical 10GbE latency

2014-11-06 Thread Wido den Hollander
on all these networks and cards. I was wondering, others with a Ceph cluster running on 10GbE, could you perform a simple network latency test like this? I'd like to compare the results. -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] Typical 10GbE latency

2014-11-06 Thread Wido den Hollander
. No, they don't seem high, but they are about 40% higher then the values I see on other environments. 40% is a lot. This Ceph cluster is SSD-only, so the lower the latency, the more IOps the system can do. Wido On Thu, Nov 6, 2014 at 1:18 PM, Wido den Hollander w...@42on.com wrote: Hello, While

Re: [ceph-users] Typical 10GbE latency

2014-11-06 Thread Wido den Hollander
somewhere, but I can't think of anything. The systems I have access to have no special tuning and get much better latency. Wido On Thu, Nov 6, 2014 at 1:53 PM, Wido den Hollander w...@42on.com wrote: On 11/06/2014 02:38 PM, Luis Periquito wrote: Hi Wido, What is the full topology? Are you

Re: [ceph-users] tgt rbd

2014-11-05 Thread Wido den Hollander
-- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Basic Ceph Questions

2014-11-05 Thread Wido den Hollander
, ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on

Re: [ceph-users] cephfs survey results

2014-11-04 Thread Wido den Hollander
at http://vger.kernel.org/majordomo-info.html -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users

Re: [ceph-users] Negative amount of objects degraded

2014-10-30 Thread Wido den Hollander
-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users

Re: [ceph-users] Is this situation about data lost?

2014-10-30 Thread Wido den Hollander
://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users

Re: [ceph-users] Redundant Power Supplies

2014-10-30 Thread Wido den Hollander
300,00 per machine. On 54 machines that was quite a big save. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Ceph trainer and consultant

<    4   5   6   7   8   9   10   11   12   >