Re: [ceph-users] Map RBD Image with Kernel 3.10.0+10
On Wed, Oct 12, 2016 at 10:51 PM, Mike Jacobacci wrote: > Hi Ilya, > > I tried disabling feature sets, but nothing worked... What features are > different in Format 1 that's different from Format 2? Format 1 images don't have any additional features, so there is nothing to enable or disable there. It sounds like you simply mistyped some of your commands. --format is for textual output (json, json-pretty, xml), --image-format is for on-disk format. Thanks, Ilya ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Map RBD Image with Kernel 3.10.0+10
On Wed, Oct 12, 2016 at 10:35 PM, Mike Jacobacci wrote: > Figured it out finally!! RBD images must be in format 1, I had to export > the old image and import it as format 1, trying to create format 1 image > fails, it's doesn't like the --image-format command:" > > "rbd: the argument for option '--format' is invalid" You should be able to create format 1 images with: $ rbd create --size 1G --image-format 1 $IMAGENAME That said, images mustn't be in format 1 - you just need to disable features unsupported by the kernel (or create images with the supported feature set in the first place). See http://lists.opennebula.org/pipermail/ceph-users-ceph.com/2016-May/009635.html for details. Thanks, Ilya ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Map RBD Image with Kernel 3.10.0+10
Figured it out finally!! RBD images must be in format 1, I had to export the old image and import it as format 1, trying to create format 1 image fails, it's doesn't like the --image-format command:" "rbd: the argument for option '--format' is invalid" Is there a way to create rbd images with format 1 without having to convert from format 2? Cheers Mike On Wed, Oct 12, 2016 at 12:37 PM, Mike Jacobacci wrote: > Hi all, > > I need some help yet again... With my cluster backup and running Ceph > 10.2.3, I am having problems again mounting an RBD image under Xenserver. > I had this working before I broke everything and started over (previously > on Ceph 10.1), I made sure to set tunables to legacy and disabled > chooseleaf_vary_r which is how I got it working before. Now when I try to > manually mount the image: > > echo "192.168.10.39,192.168.10.40,192.168.10.41 name=admin,secret=secret > xen vm0" > /sys/bus/rbd/add > > It fails with: > > echo: write error: No such device or address > > This is different that when I was having problems before getting this > working, something must have changed in 10.2? Below are more details, I > hope it helps. > > *Here is the trace output:* > >> execve("/usr/bin/echo", ["echo", "192.168.10.39 name=admin,secret="...], >> [/* 22 vars */]) = 0 >> brk(0) = 0x220e000 >> mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) >> = 0x7f6220ca2000 >> access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or >> directory) >> open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 >> fstat(3, {st_mode=S_IFREG|0644, st_size=34586, ...}) = 0 >> mmap(NULL, 34586, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f6220c99000 >> close(3)= 0 >> open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 >> read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 >> \34\2\0\0\0\0\0"..., 832) = 832 >> fstat(3, {st_mode=S_IFREG|0755, st_size=2107816, ...}) = 0 >> mmap(NULL, 3932736, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) >> = 0x7f62206c1000 >> mprotect(0x7f6220877000, 2097152, PROT_NONE) = 0 >> mmap(0x7f6220a77000, 24576, PROT_READ|PROT_WRITE, >> MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f6220a77000 >> mmap(0x7f6220a7d000, 16960, PROT_READ|PROT_WRITE, >> MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f6220a7d000 >> close(3)= 0 >> mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) >> = 0x7f6220c98000 >> mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) >> = 0x7f6220c96000 >> arch_prctl(ARCH_SET_FS, 0x7f6220c96740) = 0 >> mprotect(0x7f6220a77000, 16384, PROT_READ) = 0 >> mprotect(0x606000, 4096, PROT_READ) = 0 >> mprotect(0x7f6220ca3000, 4096, PROT_READ) = 0 >> munmap(0x7f6220c99000, 34586) = 0 >> brk(0) = 0x220e000 >> brk(0x222f000) = 0x222f000 >> brk(0) = 0x222f000 >> open("/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3 >> fstat(3, {st_mode=S_IFREG|0644, st_size=106065056, ...}) = 0 >> mmap(NULL, 106065056, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f621a19a000 >> close(3)= 0 >> fstat(1, {st_mode=S_IFREG|0200, st_size=4096, ...}) = 0 >> mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) >> = 0x7f6220ca1000 >> write(1, "192.168.10.39 name=admin,secret="..., 85) = -1 ENXIO (No such >> device or address) >> close(1)= 0 >> munmap(0x7f6220ca1000, 4096)= 0 >> open("/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 1 >> fstat(1, {st_mode=S_IFREG|0644, st_size=2502, ...}) = 0 >> mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) >> = 0x7f6220ca1000 >> read(1, "# Locale name alias data base.\n#"..., 4096) = 2502 >> read(1, "", 4096) = 0 >> close(1)= 0 >> munmap(0x7f6220ca1000, 4096)= 0 >> open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) >> = -1 ENOENT (No such file or directory) >> open("/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) >> = -1 ENOENT (No such file or directory) >> open("/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 >> ENOENT (No such file or directory) >> open("/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = >> -1 ENOENT (No such file or directory) >> open("/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = >> -1 ENOENT (No such file or directory) >> open("/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 >> ENOENT (No such file or directory) >> write(2, "echo: ", 6echo: ) = 6 >> write(2, "write error", 11write error) = 11 >> open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 >> ENOENT (No such file or directory) >> open("/usr/share/locale/en_US.utf8/LC_MESSAGES/li
[ceph-users] Map RBD Image with Kernel 3.10.0+10
Hi all, I need some help yet again... With my cluster backup and running Ceph 10.2.3, I am having problems again mounting an RBD image under Xenserver. I had this working before I broke everything and started over (previously on Ceph 10.1), I made sure to set tunables to legacy and disabled chooseleaf_vary_r which is how I got it working before. Now when I try to manually mount the image: echo "192.168.10.39,192.168.10.40,192.168.10.41 name=admin,secret=secret xen vm0" > /sys/bus/rbd/add It fails with: echo: write error: No such device or address This is different that when I was having problems before getting this working, something must have changed in 10.2? Below are more details, I hope it helps. *Here is the trace output:* > execve("/usr/bin/echo", ["echo", "192.168.10.39 name=admin,secret="...], > [/* 22 vars */]) = 0 > brk(0) = 0x220e000 > mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = > 0x7f6220ca2000 > access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or > directory) > open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 > fstat(3, {st_mode=S_IFREG|0644, st_size=34586, ...}) = 0 > mmap(NULL, 34586, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f6220c99000 > close(3)= 0 > open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 > read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 > \34\2\0\0\0\0\0"..., 832) = 832 > fstat(3, {st_mode=S_IFREG|0755, st_size=2107816, ...}) = 0 > mmap(NULL, 3932736, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) > = 0x7f62206c1000 > mprotect(0x7f6220877000, 2097152, PROT_NONE) = 0 > mmap(0x7f6220a77000, 24576, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f6220a77000 > mmap(0x7f6220a7d000, 16960, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f6220a7d000 > close(3)= 0 > mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = > 0x7f6220c98000 > mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = > 0x7f6220c96000 > arch_prctl(ARCH_SET_FS, 0x7f6220c96740) = 0 > mprotect(0x7f6220a77000, 16384, PROT_READ) = 0 > mprotect(0x606000, 4096, PROT_READ) = 0 > mprotect(0x7f6220ca3000, 4096, PROT_READ) = 0 > munmap(0x7f6220c99000, 34586) = 0 > brk(0) = 0x220e000 > brk(0x222f000) = 0x222f000 > brk(0) = 0x222f000 > open("/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3 > fstat(3, {st_mode=S_IFREG|0644, st_size=106065056, ...}) = 0 > mmap(NULL, 106065056, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f621a19a000 > close(3)= 0 > fstat(1, {st_mode=S_IFREG|0200, st_size=4096, ...}) = 0 > mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = > 0x7f6220ca1000 > write(1, "192.168.10.39 name=admin,secret="..., 85) = -1 ENXIO (No such > device or address) > close(1)= 0 > munmap(0x7f6220ca1000, 4096)= 0 > open("/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 1 > fstat(1, {st_mode=S_IFREG|0644, st_size=2502, ...}) = 0 > mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = > 0x7f6220ca1000 > read(1, "# Locale name alias data base.\n#"..., 4096) = 2502 > read(1, "", 4096) = 0 > close(1)= 0 > munmap(0x7f6220ca1000, 4096)= 0 > open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = > -1 ENOENT (No such file or directory) > open("/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = > -1 ENOENT (No such file or directory) > open("/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > write(2, "echo: ", 6echo: ) = 6 > write(2, "write error", 11write error) = 11 > open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT > (No such file or directory) > open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 > ENOENT (No such file or directory) > open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No > such file or directory) > write(2, ": No such device or address",