Re: [ceph-users] Problem starting RADOS Gateway
I did manage and found a solution for this thanks to the people at the
IRC channel!
Many thanks to all of them and especially to +andreask and josef_
In short the problem was due to the fact that for some reason the
hostname command was not giving out the machine's name but instead it
was producing the FQDN. Therefore, I had to change in the ceph.conf file
at the section of the gateway the host to FQDN. Furthermore, the problem
regarding the socket was solved by removing the /tmp/*.socket that was
created at some point.
Once again a million thanks to +andreask and josef_ from the IRC
channel!
Best,
G.
On Mon, 17 Feb 2014 11:44:37 +0200, Georgios Dimitrakakis wrote:
Could someone check this: http://pastebin.com/DsCh5YPm
and let me know what am I doing wrong?
Best,
G.
On Sat, 15 Feb 2014 20:27:16 +0200, Georgios Dimitrakakis wrote:
1) ceph -s is working as expected
# ceph -s
cluster c465bdb2-e0a5-49c8-8305-efb4234ac88a
health HEALTH_OK
monmap e1: 1 mons at {master=192.168.0.10:6789/0}, election
epoch 1, quorum 0 master
mdsmap e111: 1/1/1 up {0=master=up:active}
osdmap e114: 2 osds: 2 up, 2 in
pgmap v414: 1200 pgs, 14 pools, 10596 bytes data, 67 objects
500 GB used, 1134 GB / 1722 GB avail
1200 active+clean
2) In /etc/ceph I have the following files
# ls -l
total 20
-rw-r--r-- 1 root root 64 Feb 14 17:10 ceph.client.admin.keyring
-rw-r--r-- 1 root root 401 Feb 15 16:57 ceph.conf
-rw-r--r-- 1 root root 196 Feb 14 20:26 ceph.log
-rw-r--r-- 1 root root 120 Feb 15 11:08 keyring.radosgw.gateway
-rwxr-xr-x 1 root root 92 Dec 21 00:47 rbdmap
3) ceph.conf content is the following
# cat ceph.conf
[global]
auth_service_required = cephx
filestore_xattr_use_omap = true
auth_client_required = cephx
auth_cluster_required = cephx
mon_host = 192.168.0.10
mon_initial_members = master
fsid = c465bdb2-e0a5-49c8-8305-efb4234ac88a
[client.radosgw.gateway]
host = master
keyring = /etc/ceph/keyring.radosgw.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
4) And all the keys that exist are the following:
# ceph auth list
installed auth entries:
mds.master
key: xx==
caps: [mds] allow
caps: [mon] allow profile mds
caps: [osd] allow rwx
osd.0
key: xx==
caps: [mon] allow profile osd
caps: [osd] allow *
osd.1
key: xx==
caps: [mon] allow profile osd
caps: [osd] allow *
client.admin
key: xx==
caps: [mds] allow
caps: [mon] allow *
caps: [osd] allow *
client.bootstrap-mds
key: xx==
caps: [mon] allow profile bootstrap-mds
client.bootstrap-osd
key: AQBWLf5SGBAyBRAAzLwi5OXsAuR5vdo8hs+2zw==
caps: [mon] allow profile bootstrap-osd
client.radosgw.gateway
key: xx==
caps: [mon] allow rw
caps: [osd] allow rwx
I still don't get what is wrong...
G.
On Sat, 15 Feb 2014 16:27:41 +0100, Udo Lembke wrote:
Hi,
does ceph -s also stuck on missing keyring?
Do you have an keyring like:
cat /etc/ceph/keyring
[client.admin]
key = AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp==
Or do you have anothe defined keyring in ceph.conf?
global-section - keyring = /etc/ceph/keyring
The key is in ceph - see
ceph auth get-key client.admin
AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp==
or ceph auth list for all keys.
Key-genaration is doing by get-or-create key like this (but in this
case
for bootstap-osd):
ceph auth get-or-create-key client.bootstrap-osd mon allow profile
bootstrap-osd
Udo
On 15.02.2014 15:35, Georgios Dimitrakakis wrote:
Dear all,
I am following this guide
http://ceph.com/docs/master/radosgw/config/
to setup Object Storage on CentOS 6.5.
My problem is that when I try to start the service as indicated
here:
http://ceph.com/docs/master/radosgw/config/#restart-services-and-start-the-gateway
I get nothing
# service ceph-radosgw start
Starting radosgw instance(s)...
and if I check if the service is running obviously it is not!
# service ceph-radosgw status
/usr/bin/radosgw is not running.
If I try to start it manually without using the service command I
get
the following:
# /usr/bin/radosgw -d -c /etc/ceph/ceph.conf --debug_ms 10
2014-02-15 16:03:38.709235 7fb65ba64820 0 ceph version 0.72.2
(a913ded2ff138aefb8cb84d347d72164099cfd60), process radosgw, pid
24619
2014-02-15 16:03:38.709249 7fb65ba64820 -1 WARNING: libcurl
doesn't
support curl_multi_wait()
2014-02-15 16:03:38.709252 7fb65ba64820 -1 WARNING: cross zone /
region transfer performance may be affected
2014-02-15 16:03:38.713898 7fb65ba64820 10 -- :/0 ready :/0
2014-02-15 16:03:38.714323 7fb65ba64820 1 -- :/0 messenger.start
2014-02-15 16:03:38.714434 7fb65ba64820 -1
Re: [ceph-users] Problem starting RADOS Gateway
Could someone check this: http://pastebin.com/DsCh5YPm
and let me know what am I doing wrong?
Best,
G.
On Sat, 15 Feb 2014 20:27:16 +0200, Georgios Dimitrakakis wrote:
1) ceph -s is working as expected
# ceph -s
cluster c465bdb2-e0a5-49c8-8305-efb4234ac88a
health HEALTH_OK
monmap e1: 1 mons at {master=192.168.0.10:6789/0}, election
epoch 1, quorum 0 master
mdsmap e111: 1/1/1 up {0=master=up:active}
osdmap e114: 2 osds: 2 up, 2 in
pgmap v414: 1200 pgs, 14 pools, 10596 bytes data, 67 objects
500 GB used, 1134 GB / 1722 GB avail
1200 active+clean
2) In /etc/ceph I have the following files
# ls -l
total 20
-rw-r--r-- 1 root root 64 Feb 14 17:10 ceph.client.admin.keyring
-rw-r--r-- 1 root root 401 Feb 15 16:57 ceph.conf
-rw-r--r-- 1 root root 196 Feb 14 20:26 ceph.log
-rw-r--r-- 1 root root 120 Feb 15 11:08 keyring.radosgw.gateway
-rwxr-xr-x 1 root root 92 Dec 21 00:47 rbdmap
3) ceph.conf content is the following
# cat ceph.conf
[global]
auth_service_required = cephx
filestore_xattr_use_omap = true
auth_client_required = cephx
auth_cluster_required = cephx
mon_host = 192.168.0.10
mon_initial_members = master
fsid = c465bdb2-e0a5-49c8-8305-efb4234ac88a
[client.radosgw.gateway]
host = master
keyring = /etc/ceph/keyring.radosgw.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
4) And all the keys that exist are the following:
# ceph auth list
installed auth entries:
mds.master
key: xx==
caps: [mds] allow
caps: [mon] allow profile mds
caps: [osd] allow rwx
osd.0
key: xx==
caps: [mon] allow profile osd
caps: [osd] allow *
osd.1
key: xx==
caps: [mon] allow profile osd
caps: [osd] allow *
client.admin
key: xx==
caps: [mds] allow
caps: [mon] allow *
caps: [osd] allow *
client.bootstrap-mds
key: xx==
caps: [mon] allow profile bootstrap-mds
client.bootstrap-osd
key: AQBWLf5SGBAyBRAAzLwi5OXsAuR5vdo8hs+2zw==
caps: [mon] allow profile bootstrap-osd
client.radosgw.gateway
key: xx==
caps: [mon] allow rw
caps: [osd] allow rwx
I still don't get what is wrong...
G.
On Sat, 15 Feb 2014 16:27:41 +0100, Udo Lembke wrote:
Hi,
does ceph -s also stuck on missing keyring?
Do you have an keyring like:
cat /etc/ceph/keyring
[client.admin]
key = AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp==
Or do you have anothe defined keyring in ceph.conf?
global-section - keyring = /etc/ceph/keyring
The key is in ceph - see
ceph auth get-key client.admin
AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp==
or ceph auth list for all keys.
Key-genaration is doing by get-or-create key like this (but in this
case
for bootstap-osd):
ceph auth get-or-create-key client.bootstrap-osd mon allow profile
bootstrap-osd
Udo
On 15.02.2014 15:35, Georgios Dimitrakakis wrote:
Dear all,
I am following this guide
http://ceph.com/docs/master/radosgw/config/
to setup Object Storage on CentOS 6.5.
My problem is that when I try to start the service as indicated
here:
http://ceph.com/docs/master/radosgw/config/#restart-services-and-start-the-gateway
I get nothing
# service ceph-radosgw start
Starting radosgw instance(s)...
and if I check if the service is running obviously it is not!
# service ceph-radosgw status
/usr/bin/radosgw is not running.
If I try to start it manually without using the service command I
get
the following:
# /usr/bin/radosgw -d -c /etc/ceph/ceph.conf --debug_ms 10
2014-02-15 16:03:38.709235 7fb65ba64820 0 ceph version 0.72.2
(a913ded2ff138aefb8cb84d347d72164099cfd60), process radosgw, pid
24619
2014-02-15 16:03:38.709249 7fb65ba64820 -1 WARNING: libcurl doesn't
support curl_multi_wait()
2014-02-15 16:03:38.709252 7fb65ba64820 -1 WARNING: cross zone /
region transfer performance may be affected
2014-02-15 16:03:38.713898 7fb65ba64820 10 -- :/0 ready :/0
2014-02-15 16:03:38.714323 7fb65ba64820 1 -- :/0 messenger.start
2014-02-15 16:03:38.714434 7fb65ba64820 -1 monclient(hunting):
ERROR:
missing keyring, cannot use cephx for authentication
2014-02-15 16:03:38.714440 7fb65ba64820 0 librados: client.admin
initialization error (2) No such file or directory
2014-02-15 16:03:38.714463 7fb65ba64820 10 -- :/1024619 shutdown
:/1024619
2014-02-15 16:03:38.714468 7fb65ba64820 1 -- :/1024619
mark_down_all
2014-02-15 16:03:38.714477 7fb65ba64820 10 -- :/1024619 wait:
waiting
for dispatch queue
2014-02-15 16:03:38.714406 7fb64b5fe700 10 -- :/1024619
reaper_entry
start
2014-02-15 16:03:38.714506 7fb64b5fe700 10 -- :/1024619 reaper
2014-02-15 16:03:38.714522 7fb64b5fe700 10 -- :/1024619 reaper done
2014-02-15 16:03:38.714764 7fb65ba64820 10 --
[ceph-users] Problem starting RADOS Gateway
Dear all, I am following this guide http://ceph.com/docs/master/radosgw/config/ to setup Object Storage on CentOS 6.5. My problem is that when I try to start the service as indicated here: http://ceph.com/docs/master/radosgw/config/#restart-services-and-start-the-gateway I get nothing # service ceph-radosgw start Starting radosgw instance(s)... and if I check if the service is running obviously it is not! # service ceph-radosgw status /usr/bin/radosgw is not running. If I try to start it manually without using the service command I get the following: # /usr/bin/radosgw -d -c /etc/ceph/ceph.conf --debug_ms 10 2014-02-15 16:03:38.709235 7fb65ba64820 0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process radosgw, pid 24619 2014-02-15 16:03:38.709249 7fb65ba64820 -1 WARNING: libcurl doesn't support curl_multi_wait() 2014-02-15 16:03:38.709252 7fb65ba64820 -1 WARNING: cross zone / region transfer performance may be affected 2014-02-15 16:03:38.713898 7fb65ba64820 10 -- :/0 ready :/0 2014-02-15 16:03:38.714323 7fb65ba64820 1 -- :/0 messenger.start 2014-02-15 16:03:38.714434 7fb65ba64820 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2014-02-15 16:03:38.714440 7fb65ba64820 0 librados: client.admin initialization error (2) No such file or directory 2014-02-15 16:03:38.714463 7fb65ba64820 10 -- :/1024619 shutdown :/1024619 2014-02-15 16:03:38.714468 7fb65ba64820 1 -- :/1024619 mark_down_all 2014-02-15 16:03:38.714477 7fb65ba64820 10 -- :/1024619 wait: waiting for dispatch queue 2014-02-15 16:03:38.714406 7fb64b5fe700 10 -- :/1024619 reaper_entry start 2014-02-15 16:03:38.714506 7fb64b5fe700 10 -- :/1024619 reaper 2014-02-15 16:03:38.714522 7fb64b5fe700 10 -- :/1024619 reaper done 2014-02-15 16:03:38.714764 7fb65ba64820 10 -- :/1024619 wait: dispatch queue is stopped 2014-02-15 16:03:38.714786 7fb64b5fe700 10 -- :/1024619 reaper_entry done 2014-02-15 16:03:38.714819 7fb65ba64820 10 -- :/1024619 wait: closing pipes 2014-02-15 16:03:38.714826 7fb65ba64820 10 -- :/1024619 reaper 2014-02-15 16:03:38.714828 7fb65ba64820 10 -- :/1024619 reaper done 2014-02-15 16:03:38.714830 7fb65ba64820 10 -- :/1024619 wait: waiting for pipes to close 2014-02-15 16:03:38.714832 7fb65ba64820 10 -- :/1024619 wait: done. 2014-02-15 16:03:38.714833 7fb65ba64820 1 -- :/1024619 shutdown complete. 2014-02-15 16:03:38.714916 7fb65ba64820 -1 Couldn't init storage provider (RADOS) Obviously the problem is some missing keyring but which one and how can I solve this problem? Furthermore, why this is happening since I am following the guide to the letter?? Is something missing?? Best, G. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Problem starting RADOS Gateway
Hi, does ceph -s also stuck on missing keyring? Do you have an keyring like: cat /etc/ceph/keyring [client.admin] key = AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp== Or do you have anothe defined keyring in ceph.conf? global-section - keyring = /etc/ceph/keyring The key is in ceph - see ceph auth get-key client.admin AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp== or ceph auth list for all keys. Key-genaration is doing by get-or-create key like this (but in this case for bootstap-osd): ceph auth get-or-create-key client.bootstrap-osd mon allow profile bootstrap-osd Udo On 15.02.2014 15:35, Georgios Dimitrakakis wrote: Dear all, I am following this guide http://ceph.com/docs/master/radosgw/config/ to setup Object Storage on CentOS 6.5. My problem is that when I try to start the service as indicated here: http://ceph.com/docs/master/radosgw/config/#restart-services-and-start-the-gateway I get nothing # service ceph-radosgw start Starting radosgw instance(s)... and if I check if the service is running obviously it is not! # service ceph-radosgw status /usr/bin/radosgw is not running. If I try to start it manually without using the service command I get the following: # /usr/bin/radosgw -d -c /etc/ceph/ceph.conf --debug_ms 10 2014-02-15 16:03:38.709235 7fb65ba64820 0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process radosgw, pid 24619 2014-02-15 16:03:38.709249 7fb65ba64820 -1 WARNING: libcurl doesn't support curl_multi_wait() 2014-02-15 16:03:38.709252 7fb65ba64820 -1 WARNING: cross zone / region transfer performance may be affected 2014-02-15 16:03:38.713898 7fb65ba64820 10 -- :/0 ready :/0 2014-02-15 16:03:38.714323 7fb65ba64820 1 -- :/0 messenger.start 2014-02-15 16:03:38.714434 7fb65ba64820 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2014-02-15 16:03:38.714440 7fb65ba64820 0 librados: client.admin initialization error (2) No such file or directory 2014-02-15 16:03:38.714463 7fb65ba64820 10 -- :/1024619 shutdown :/1024619 2014-02-15 16:03:38.714468 7fb65ba64820 1 -- :/1024619 mark_down_all 2014-02-15 16:03:38.714477 7fb65ba64820 10 -- :/1024619 wait: waiting for dispatch queue 2014-02-15 16:03:38.714406 7fb64b5fe700 10 -- :/1024619 reaper_entry start 2014-02-15 16:03:38.714506 7fb64b5fe700 10 -- :/1024619 reaper 2014-02-15 16:03:38.714522 7fb64b5fe700 10 -- :/1024619 reaper done 2014-02-15 16:03:38.714764 7fb65ba64820 10 -- :/1024619 wait: dispatch queue is stopped 2014-02-15 16:03:38.714786 7fb64b5fe700 10 -- :/1024619 reaper_entry done 2014-02-15 16:03:38.714819 7fb65ba64820 10 -- :/1024619 wait: closing pipes 2014-02-15 16:03:38.714826 7fb65ba64820 10 -- :/1024619 reaper 2014-02-15 16:03:38.714828 7fb65ba64820 10 -- :/1024619 reaper done 2014-02-15 16:03:38.714830 7fb65ba64820 10 -- :/1024619 wait: waiting for pipes to close 2014-02-15 16:03:38.714832 7fb65ba64820 10 -- :/1024619 wait: done. 2014-02-15 16:03:38.714833 7fb65ba64820 1 -- :/1024619 shutdown complete. 2014-02-15 16:03:38.714916 7fb65ba64820 -1 Couldn't init storage provider (RADOS) Obviously the problem is some missing keyring but which one and how can I solve this problem? Furthermore, why this is happening since I am following the guide to the letter?? Is something missing?? Best, G. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Problem starting RADOS Gateway
1) ceph -s is working as expected
# ceph -s
cluster c465bdb2-e0a5-49c8-8305-efb4234ac88a
health HEALTH_OK
monmap e1: 1 mons at {master=192.168.0.10:6789/0}, election epoch
1, quorum 0 master
mdsmap e111: 1/1/1 up {0=master=up:active}
osdmap e114: 2 osds: 2 up, 2 in
pgmap v414: 1200 pgs, 14 pools, 10596 bytes data, 67 objects
500 GB used, 1134 GB / 1722 GB avail
1200 active+clean
2) In /etc/ceph I have the following files
# ls -l
total 20
-rw-r--r-- 1 root root 64 Feb 14 17:10 ceph.client.admin.keyring
-rw-r--r-- 1 root root 401 Feb 15 16:57 ceph.conf
-rw-r--r-- 1 root root 196 Feb 14 20:26 ceph.log
-rw-r--r-- 1 root root 120 Feb 15 11:08 keyring.radosgw.gateway
-rwxr-xr-x 1 root root 92 Dec 21 00:47 rbdmap
3) ceph.conf content is the following
# cat ceph.conf
[global]
auth_service_required = cephx
filestore_xattr_use_omap = true
auth_client_required = cephx
auth_cluster_required = cephx
mon_host = 192.168.0.10
mon_initial_members = master
fsid = c465bdb2-e0a5-49c8-8305-efb4234ac88a
[client.radosgw.gateway]
host = master
keyring = /etc/ceph/keyring.radosgw.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
4) And all the keys that exist are the following:
# ceph auth list
installed auth entries:
mds.master
key: xx==
caps: [mds] allow
caps: [mon] allow profile mds
caps: [osd] allow rwx
osd.0
key: xx==
caps: [mon] allow profile osd
caps: [osd] allow *
osd.1
key: xx==
caps: [mon] allow profile osd
caps: [osd] allow *
client.admin
key: xx==
caps: [mds] allow
caps: [mon] allow *
caps: [osd] allow *
client.bootstrap-mds
key: xx==
caps: [mon] allow profile bootstrap-mds
client.bootstrap-osd
key: AQBWLf5SGBAyBRAAzLwi5OXsAuR5vdo8hs+2zw==
caps: [mon] allow profile bootstrap-osd
client.radosgw.gateway
key: xx==
caps: [mon] allow rw
caps: [osd] allow rwx
I still don't get what is wrong...
G.
On Sat, 15 Feb 2014 16:27:41 +0100, Udo Lembke wrote:
Hi,
does ceph -s also stuck on missing keyring?
Do you have an keyring like:
cat /etc/ceph/keyring
[client.admin]
key = AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp==
Or do you have anothe defined keyring in ceph.conf?
global-section - keyring = /etc/ceph/keyring
The key is in ceph - see
ceph auth get-key client.admin
AQCdkHZR2NBYMBAATe/rqIwCI96LTuyS3gmMXp==
or ceph auth list for all keys.
Key-genaration is doing by get-or-create key like this (but in this
case
for bootstap-osd):
ceph auth get-or-create-key client.bootstrap-osd mon allow profile
bootstrap-osd
Udo
On 15.02.2014 15:35, Georgios Dimitrakakis wrote:
Dear all,
I am following this guide
http://ceph.com/docs/master/radosgw/config/
to setup Object Storage on CentOS 6.5.
My problem is that when I try to start the service as indicated
here:
http://ceph.com/docs/master/radosgw/config/#restart-services-and-start-the-gateway
I get nothing
# service ceph-radosgw start
Starting radosgw instance(s)...
and if I check if the service is running obviously it is not!
# service ceph-radosgw status
/usr/bin/radosgw is not running.
If I try to start it manually without using the service command I
get
the following:
# /usr/bin/radosgw -d -c /etc/ceph/ceph.conf --debug_ms 10
2014-02-15 16:03:38.709235 7fb65ba64820 0 ceph version 0.72.2
(a913ded2ff138aefb8cb84d347d72164099cfd60), process radosgw, pid
24619
2014-02-15 16:03:38.709249 7fb65ba64820 -1 WARNING: libcurl doesn't
support curl_multi_wait()
2014-02-15 16:03:38.709252 7fb65ba64820 -1 WARNING: cross zone /
region transfer performance may be affected
2014-02-15 16:03:38.713898 7fb65ba64820 10 -- :/0 ready :/0
2014-02-15 16:03:38.714323 7fb65ba64820 1 -- :/0 messenger.start
2014-02-15 16:03:38.714434 7fb65ba64820 -1 monclient(hunting):
ERROR:
missing keyring, cannot use cephx for authentication
2014-02-15 16:03:38.714440 7fb65ba64820 0 librados: client.admin
initialization error (2) No such file or directory
2014-02-15 16:03:38.714463 7fb65ba64820 10 -- :/1024619 shutdown
:/1024619
2014-02-15 16:03:38.714468 7fb65ba64820 1 -- :/1024619
mark_down_all
2014-02-15 16:03:38.714477 7fb65ba64820 10 -- :/1024619 wait:
waiting
for dispatch queue
2014-02-15 16:03:38.714406 7fb64b5fe700 10 -- :/1024619 reaper_entry
start
2014-02-15 16:03:38.714506 7fb64b5fe700 10 -- :/1024619 reaper
2014-02-15 16:03:38.714522 7fb64b5fe700 10 -- :/1024619 reaper done
2014-02-15 16:03:38.714764 7fb65ba64820 10 -- :/1024619 wait:
dispatch
queue is stopped
2014-02-15 16:03:38.714786 7fb64b5fe700 10 -- :/1024619 reaper_entry
done
2014-02-15 16:03:38.714819 7fb65ba64820 10 -- :/1024619 wait:
