Re: [ceph-users] How to set mon-clock-drift-allowed tunable

2018-01-21 Thread Wido den Hollander
On 01/22/2018 08:11 AM, Hüseyin Atatür YILDIRIM wrote: Hello, How can I set mon_clock_drift_allowed  tunable;  should  I set it  at monitor nodes  /etc/ceph/ceph.conf   or   where ?  In  [global] section, or   in a [mon] section ? Both would work, but the [mon] section is the best. A

[ceph-users] How to set mon-clock-drift-allowed tunable

2018-01-21 Thread Hüseyin Atatür YILDIRIM
Hello, How can I set mon_clock_drift_allowed tunable; should I set it at monitor nodes /etc/ceph/ceph.conf or where ? In [global] section, or in a [mon] section ? All these are not clear in the documentation. After setting, should I restart the daemons, or what specific daemon ?

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-21 Thread Wido den Hollander
On 01/20/2018 02:02 PM, Marc Roos wrote: If I test my connections with sockperf via a 1Gbit switch I get around 25usec, when I test the 10Gbit connection via the switch I have around 12usec is that normal? Or should there be a differnce of 10x. No, that's normal. Tests with 8k ping packe

Re: [ceph-users] udev rule or script to auto add bcache devices?

2018-01-21 Thread Wido den Hollander
On 01/20/2018 07:56 PM, Stefan Priebe - Profihost AG wrote: Hello, bcache didn't supported partitions on the past so that a lot of our osds have their data directly on: /dev/bcache[0-9] But that means i can't give them the needed part type of 4fbd7e29-9d25-41b8-afd0-062c0ceff05d and that mean

Re: [ceph-users] Ubuntu 17.10 or Debian 9.3 + Luminous = random OS hang ?

2018-01-21 Thread Youzhong Yang
Thanks. I applied the workaround to .vmx and rebooted all VMs. No more freeze! On Sun, Jan 21, 2018 at 3:43 PM, Nick Fisk wrote: > How up to date is your VM environment? We saw something very similar last > year with Linux VM’s running newish kernels. It turns out newer kernels > supported a new

Re: [ceph-users] Fwd: Ceph team involvement in Rook (Deploying Ceph in Kubernetes)

2018-01-21 Thread Hans van den Bogert
Should I summarize this is ceph-helm being being EOL? If I'm spinning up a toy cluster for a homelab, should I invest time in Rook, or stay with ceph-helm for now? On Fri, Jan 19, 2018 at 11:55 AM, Kai Wagner wrote: > Just for those of you who are not subscribed to ceph-users. > > > For

Re: [ceph-users] Ubuntu 17.10 or Debian 9.3 + Luminous = random OS hang ?

2018-01-21 Thread Nick Fisk
How up to date is your VM environment? We saw something very similar last year with Linux VM’s running newish kernels. It turns out newer kernels supported a new feature of the vmxnet3 adapters which had a bug in ESXi. The fix was release last year some time in ESXi6.5 U1, or a workaround was to

Re: [ceph-users] Ubuntu 17.10 or Debian 9.3 + Luminous = random OS hang ?

2018-01-21 Thread Youzhong Yang
As someone suggested, I installed linux-generic-hwe-16.04 package on Ubuntu 16.04 to get kernel of 17.10, and then rebooted all VMs, here is what I observed: - ceph monitor node froze upon reboot, in another case froze after a few minutes - ceph OSD hosts easily froze - ceph admin node (which runs