Looks like the issue is here: https://github.com/ceph/ceph/blob/luminous/src/ceph- disk/ceph_disk/main.py#L2085
the lockbox is prepared first; and then the main data prepare tries to re-zap the disk, but /dev/<device>5 is already mounted by the first step. ** Changed in: ceph (Ubuntu) Status: Fix Released => Triaged ** Also affects: ceph (Ubuntu Bb-series) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Artful) Importance: High Status: Triaged ** Changed in: ceph (Ubuntu Bb-series) Importance: Undecided => Medium ** Changed in: ceph (Ubuntu Bb-series) Status: New => Triaged ** Changed in: ceph (Ubuntu Bb-series) Importance: Medium => High ** Changed in: ceph (Ubuntu Xenial) Importance: High => Medium ** Changed in: ceph (Ubuntu Zesty) Importance: High => Medium ** Changed in: ceph (Ubuntu Artful) Importance: High => Medium ** Changed in: ceph (Ubuntu Bb-series) Importance: High => Medium -- You received this bug notification because you are a member of नेपाली भाषा समायोजकहरुको समूह, which is subscribed to Xenial. Matching subscriptions: Ubuntu 16.04 Bugs https://bugs.launchpad.net/bugs/1604501 Title: ceph-osd fails to initialize when encrypt is enabled Status in OpenStack ceph charm: Won't Fix Status in OpenStack ceph-osd charm: Triaged Status in ceph package in Ubuntu: Triaged Status in ceph source package in Xenial: Triaged Status in ceph source package in Yakkety: Won't Fix Status in ceph source package in Zesty: Triaged Status in ceph source package in Artful: Triaged Status in ceph source package in bb-series: Triaged Status in ceph package in Juju Charms Collection: Invalid Status in ceph-osd package in Juju Charms Collection: Invalid Bug description: The config-key put command is called without a cephx user which causes the command to fail. Error log information is: 2016-07-16 05:07:14 INFO mon-relation-changed 2016-07-16 05:07:14.918436 7f67d2797700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring: (2) No such file or directory 2016-07-16 05:07:14 INFO mon-relation-changed 2016-07-16 05:07:14.919173 7f67d2797700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2016-07-16 05:07:14 INFO mon-relation-changed 2016-07-16 05:07:14.919315 7f67d2797700 0 librados: client.admin initialization error (2) No such file or directory 2016-07-16 05:07:14 INFO mon-relation-changed Error connecting to cluster: ObjectNotFound 2016-07-16 05:07:14 INFO mon-relation-changed Traceback (most recent call last): 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/sbin/ceph-disk", line 9, in <module> 2016-07-16 05:07:14 INFO mon-relation-changed load_entry_point('ceph-disk==1.0.0', 'console_scripts', 'ceph-disk')() 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 4965, in run 2016-07-16 05:07:14 INFO mon-relation-changed main(sys.argv[1:]) 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 4918, in main 2016-07-16 05:07:14 INFO mon-relation-changed main_catch(args.func, args) 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 4943, in main_catch 2016-07-16 05:07:14 INFO mon-relation-changed func(args) 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1774, in main 2016-07-16 05:07:14 INFO mon-relation-changed Prepare.factory(args).prepare() 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1762, in prepare 2016-07-16 05:07:14 INFO mon-relation-changed self.prepare_locked() 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1793, in prepare_locked 2016-07-16 05:07:14 INFO mon-relation-changed self.lockbox.prepare() 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2360, in prepare 2016-07-16 05:07:14 INFO mon-relation-changed self.populate() 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2305, in populate 2016-07-16 05:07:14 INFO mon-relation-changed self.create_key() 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2264, in create_key 2016-07-16 05:07:14 INFO mon-relation-changed base64_key, 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 439, in command_check_call 2016-07-16 05:07:14 INFO mon-relation-changed return subprocess.check_call(arguments) 2016-07-16 05:07:14 INFO mon-relation-changed File "/usr/lib/python2.7/subprocess.py", line 540, in check_call 2016-07-16 05:07:14 INFO mon-relation-changed raise CalledProcessError(retcode, cmd) 2016-07-16 05:07:14 INFO mon-relation-changed subprocess.CalledProcessError: Command '['/usr/bin/ceph', 'config-key', 'put', 'dm-crypt/osd/e4d2604d-1e38-4563-88ae-c447ffba95e9/luks', '61H4+6InRku1kvSqg23ckK0EsoFL1csn18ONWL8a+1s7r8wLzPUTrRRmuq4D1o1/GZ9UvFVxytPq4pZeA73ZtCeNPWlbIoKeAhZ/gbK6g1YXPjpICOmxx7aSckIO212faMiHG+jLbIAzeekhK7AKT+rxGWXYh2wYVX3rxn4dKik=']' returned non-zero exit status 1 2016-07-16 05:07:14 INFO worker.uniter.jujuc server.go:172 running hook tool "juju-log" ["-l" "ERROR" "Unable to initialize device: /dev/vdb"] 2016-07-16 05:07:14 DEBUG worker.uniter.jujuc server.go:173 hook context id "ceph-osd/0-mon-relation-changed-4972863589887456037"; dir "/var/lib/juju/agents/unit-ceph-osd-0/charm" 2016-07-16 05:07:14 ERROR juju-log mon:1: Unable to initialize device: /dev/vdb 2016-07-16 05:07:14 INFO mon-relation-changed Traceback (most recent call last): 2016-07-16 05:07:14 INFO mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/mon-relation-changed", line 614, in <module> 2016-07-16 05:07:14 INFO mon-relation-changed hooks.execute(sys.argv) 2016-07-16 05:07:14 INFO mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/charmhelpers/core/hookenv.py", line 715, in execute 2016-07-16 05:07:14 INFO mon-relation-changed self._hooks[hook_name]() 2016-07-16 05:07:14 INFO mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/mon-relation-changed", line 545, in mon_relation 2016-07-16 05:07:14 INFO mon-relation-changed prepare_disks_and_activate() 2016-07-16 05:07:14 INFO mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/mon-relation-changed", line 454, in prepare_disks_and_activate 2016-07-16 05:07:14 INFO mon-relation-changed config('osd-encrypt')) 2016-07-16 05:07:14 INFO mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/ceph.py", line 997, in osdize 2016-07-16 05:07:14 INFO mon-relation-changed reformat_osd, ignore_errors, encrypt) 2016-07-16 05:07:14 INFO mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/ceph.py", line 1052, in osdize_dev 2016-07-16 05:07:14 INFO mon-relation-changed raise e 2016-07-16 05:07:14 INFO mon-relation-changed subprocess.CalledProcessError: Command '['ceph-disk', 'prepare', '--dmcrypt', '--fs-type', u'xfs', u'/dev/vdb']' returned non-zero exit status 1 To manage notifications about this bug go to: https://bugs.launchpad.net/charm-ceph/+bug/1604501/+subscriptions _______________________________________________ Mailing list: https://launchpad.net/~group.of.nepali.translators Post to : group.of.nepali.translators@lists.launchpad.net Unsubscribe : https://launchpad.net/~group.of.nepali.translators More help : https://help.launchpad.net/ListHelp