[ceph-users] Stability of cephfs snapshot in nautilus

Is snapshot of cephfs in version nautilus is production ready? When I take a snapshot, what will happen if somebody change the content in that directory before the snapshot finish. Will there be any conflict or something to notice about when I take a snapshot on a busy directory (probably 20

[ceph-users] Re: Ceph deployment tool suggestions

We have had success using Foreman to deploy OS in various roles across multiple sites. It can also spin up VM on various infrastructure as part of that process. Foreman essentially generates whatever type of 'kickstart' your OS requires on the fly and boots nodes via the network. It's a fairly

[ceph-users] Re: Ceph deployment tool suggestions

can you just do a kickstart and use ceph-ansible? On Tue, Sep 17, 2019 at 9:59 AM Paul Emmerich wrote: > The best tool to automate both OS and Ceph deployment is ours: > https://croit.io/ > > Check out our demo: https://croit.io/croit-virtual-demo > > Paul > > -- > Paul Emmerich > > Looking

[ceph-users] Re: dashboard not working

ok, the hint to me was cephmgr services didn't show a URL, just the module names. This last step was all it took: Since each ceph-mgr hosts its own instance of dashboard, it may also be necessary to configure them separately. The IP address and port for a specific manager instance can be changed

[ceph-users] Re: Ceph deployment tool suggestions

The best tool to automate both OS and Ceph deployment is ours: https://croit.io/ Check out our demo: https://croit.io/croit-virtual-demo Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel:

[ceph-users] rados.py with Python3

Hi, i'm integrating ceph like glance's backend, my Openstack is stein over Ubuntu 18.04. When I try upload an image rados.py have an error when calls "run_in_thread()" function (line 238). I've tried use rados mudule from python3 interface and i have the same issue. I read that Python 3 has

[ceph-users] Ceph deployment tool suggestions

Hello, We currently have an existing 20 node Ceph cluster (17 osd nodes with 3 mon nodes).  When this was originally configured, much of the OS install was done manually and the cluster was mainly deployed using ceph-deploy. We are going to be replacing 9 of the 1st gen nodes with 6 newer

[ceph-users] Re: v14.2.4 Nautilus released

Abhishek Lekshmanan writes: > This is the fourth release in the Ceph Nautilus stable release series. Its > sole > purpose is to fix a regression that found its way into the previous release. > > Notable Changes > --- > The ceph-volume in Nautilus v14.2.3 was found to contain a

[ceph-users] v14.2.4 Nautilus released

This is the fourth release in the Ceph Nautilus stable release series. Its sole purpose is to fix a regression that found its way into the previous release. Notable Changes --- The ceph-volume in Nautilus v14.2.3 was found to contain a serious regression, described in

[ceph-users] Re: osds xxx have blocked requests > 1048.58 sec / osd.yyy has stuck requests > 67108.9 sec

Not sure which version you are on, but adding these to your /etc/ceph/ceph.conf file and restarting the OSD processes can go a long way to helping these really long blocks. It won't get rid of them completely, but should really help. osd op queue = wpq osd op queue cut off = high

[ceph-users] Re: download.ceph.com repository changes

I have been affected by few issues mentioned by Alfredo. * Version Pinning: Had to install several debs of specific version to be able to pull dependencies of the correct version. I believe that other projects resolving it by creating a virtual package that pulls all of the proper dependencies

[ceph-users] Re: download.ceph.com repository changes

The worst part about the official repository is that it lacks Debian packages Also of course it would be very convenient to be able to install any version from the repos, not just the latest one. It's certainly possible with debian repos... ___

[ceph-users] Re: download.ceph.com repository changes

Den tis 17 sep. 2019 kl 15:15 skrev Alfredo Deza : > Reviving this old thread. > * When a release is underway, the repository breaks because syncing > packages takes hours. The operation is not atomic. > Couldn't they be almost atomic? I believe both "yum" and "apt" would only consider rpms/debs

[ceph-users] Re: download.ceph.com repository changes

On 17/09/2019 14:14, Alfredo Deza wrote: > * Impossible to 'pin' to a version. User installs 14.2.0 and 4 months > later they add other nodes but version moved to 14.2.2 I dynamically generate a pin for the ceph .deb files in ansible using the tasks below. IIRC the ceph-deploy package doesn't

[ceph-users] Re: download.ceph.com repository changes

"Alfredo Deza" writes: > Reviving this old thread. > > I still think this is something we should consider as users still > experience problems: > > * Impossible to 'pin' to a version. User installs 14.2.0 and 4 months > later they add other nodes but version moved to 14.2.2 > * Impossible to use

[ceph-users] Re: cephfs and selinux

You can setup a custom SELinux module to enable access. We use the following snippet to allow sshd to access authorized keys in home directories on CephFS: module local-ceph-ssh-auth 1.0; require { type cephfs_t; type sshd_t; class file { read getattr open }; }

[ceph-users] Re: download.ceph.com repository changes

Just wanted to say we do not have any problems with current/past setup. Our ceph nodes are not even connected to the internet and we relay everything via 'our own local mirror'. -Original Message- From: Alfredo Deza [mailto:ad...@redhat.com] Sent: dinsdag 17 september 2019

[ceph-users] Re: upmap supported in SLES 12SPx

On Tue, Sep 17, 2019 at 2:54 PM Eugen Block wrote: > > Hi, > > > I have checked the installed ceph version on each client and can confirm > > that it is: > > ceph version 12.2 luminous > > > > This would drive the conclusion that the ouput of ceph daemon mon. > > sessions is pointing incorrectly

[ceph-users] Re: upmap supported in SLES 12SPx

Thomas <74cmo...@gmail.com> writes: > But I think the number of clients older than Luminous is incorrect. > > I'm running 98% of the clients with SLES 12SPx, and therefore the > question is: > Can you confirm in which SLES 12 release the function upmap is supported? I can confirm that SLE12-SP3

[ceph-users] cephfs and selinux

Hi all, I would like to have my home dir at cephfs and to keep selinux enabled at the same time. The trouble is selinux prevents sshd to access ~/.ssh/authorized_keys file. Any ideas how to fix it? ___ ceph-users mailing list --

[ceph-users] Re: download.ceph.com repository changes

Reviving this old thread. I still think this is something we should consider as users still experience problems: * Impossible to 'pin' to a version. User installs 14.2.0 and 4 months later they add other nodes but version moved to 14.2.2 * Impossible to use a version that is not what the latest

[ceph-users] Re: upmap supported in SLES 12SPx

Hi, I have checked the installed ceph version on each client and can confirm that it is: ceph version 12.2 luminous This would drive the conclusion that the ouput of ceph daemon mon. sessions is pointing incorrectly to "jewel". I have the same in an upgraded Nautilus cluster. There are a

[ceph-users] Re: Unsubscribe

on 2019/9/17 20:34, Rimma Iontel wrote: To unsubscribe send an email to ceph-users-le...@ceph.io As the signature in sent mail shows, you would send a message to ceph-users-le...@ceph.io for quitting. regards. ___ ceph-users mailing list --

[ceph-users] Unsubscribe

___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: upmap supported in SLES 12SPx

Hi, I was checking the connected sessions on all of my 3 MON nodes with this command: ceph daemon mon. sessions | grep -v luminous This returns the following 2 clients featuring 0x27018fb86aa42ada and 0x27018eb84aa42a52 This is mapping to OS / Kernel: 0x27018fb86aa42ada Debian 10.1 Kernel

[ceph-users] New lines "choose_args" in crush map

Hi! I recently noticed new lines in my crush map. Here's an extract of it: # choose_args choose_args 18446744073709551615 { { bucket_id -1 weight_set [ [ 33.839 34.159 34.041 34.768 1.810 1.832 ] ] } { bucket_id -2 weight_set [ [ 28.019 28.339 28.221 28.948 1.810 1.832 ] ] } { bucket_id -3

[ceph-users] Re: 14.2.4 Packages Avaliable

Den tis 17 sep. 2019 kl 12:52 skrev Yoann Moulin : > Hello, > > >>> Never install packages until there is an announcement. > >>> > > My reaction was not on this specific release but with this sentence : « > Never install packages until there is an announcement. » And also with > this one : « If

[ceph-users] Re: 14.2.4 Packages Avaliable

Hello, Have just noticed their is packages available for 14.2.4.. I know with the whole 14.2.3 release and the notes not going out to a good day or so later.. but this is not long after the 14.2.3 release..? Was this release even meant to have come out? Makes it

[ceph-users] Re: 14.2.4 Packages Avaliable

14.2.4 is a bug-fix release for https://tracker.ceph.com/issues/41660 There are no other changes beside this fix -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Tue, Sep

[ceph-users] Re: 14.2.4 Packages Avaliable

On 9/17/19 8:46 AM, Ronny Aasen wrote: > On 17.09.2019 06:54, Ashley Merrick wrote: >> Have just noticed their is packages available for 14.2.4.. >> >> I know with the whole 14.2.3 release and the notes not going out to a >> good day or so later.. but this is not long after the 14.2.3

[ceph-users] Re: dashboard not working

In my case the dashboard is starting & running w/o any issues. And I didn't disable ssl in config. Am 17.09.2019 um 09:23 schrieb Robert Sander: > On 17.09.19 09:21, solarflow99 wrote: >> I'm not trying to use SSL.  It seems strange how the mgr log doesn't >> even mention anything about

[ceph-users] Re: dashboard not working

On 17.09.19 09:21, solarflow99 wrote: > I'm not trying to use SSL.  It seems strange how the mgr log doesn't > even mention anything about dashboard If you do not want to use SSL, run "ceph config set mgr mgr/dashboard/ssl false" to disable it. Otherwise Dashboard may not start without a

[ceph-users] Re: 14.2.4 Packages Avaliable

On 9/17/19 8:46 AM, Ronny Aasen wrote: > Never install packages until there is an announcement. which defeats the purpose of having the repositories in the first place. > IIRC developers have asked if anyone have experience with running repos > that could assist in improving the rollout of

[ceph-users] Re: dashboard not working

I'm not trying to use SSL. It seems strange how the mgr log doesn't even mention anything about dashboard On Tue, Sep 17, 2019 at 12:19 AM Thomas <74cmo...@gmail.com> wrote: > Hi, > you should run > ceph dashboard create-self-signed-cert > as documented here

[ceph-users] Re: dashboard not working

Hi, you should run  ceph dashboard create-self-signed-cert as documented here (To get the dashboard up and running quickly, you can generate and install a self-signed certificate using the following built-in command). Regards Thomas Am 17.09.2019

[ceph-users] Re: KRBD use Luminous upmap feature.Which version of the kernel should i ues?

Thank you for your reply. so,i would like to verify this problem. i create a new VM as a client,it is kernel version: [root@localhost ~]# uname -a Linux localhost.localdomain 5.2.9-200.fc30.x86_64 #1 SMP Fri Aug 16 21:37:45 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux First of all,use command:ceph

[ceph-users] Re: 14.2.4 Packages Avaliable

On 17.09.2019 06:54, Ashley Merrick wrote: Have just noticed their is packages available for 14.2.4.. I know with the whole 14.2.3 release and the notes not going out to a good day or so later.. but this is not long after the 14.2.3 release..? Was this release even meant to have come out?

[ceph-users] osds xxx have blocked requests > 1048.58 sec / osd.yyy has stuck requests > 67108.9 sec

Hi, I have defined pool hdd which is exclusively used by virtual disks of multiple KVMs / LXCs. Yesterday I run these commands osdmaptool om --upmap out.txt --upmap-pool hdd source out.txt and Ceph started rebalancing this pool. However since then no KVM / LXC is reacting anymore. If I try to