Of course! [root@cephrgw01 ~]# ps -ef | grep rgw root 766 1 0 mar09 ? 00:00:00 /sbin/dhclient -H cephrgw01 -q -lf /var/lib/dhclient/dhclient--eth0.lease -pf /var/run/dhclient-eth0.pid eth0 ceph 895 1 0 mar09 ? 00:14:39 /usr/bin/radosgw -f --cluster ceph --name client.rgw.cephrgw --setuser ceph --setgroup ceph root 14332 10826 0 19:16 pts/0 00:00:00 grep --color=auto rgw Regards, I
2017-03-13 19:08 GMT+01:00 Yair Magnezi <[email protected]>: > Thank you Iban. > Can you please also send me the output of : ps -ef ! grep rgw > Many Thanks. > > On Mar 13, 2017 7:32 PM, "Iban Cabrillo" <[email protected]> wrote: > >> HI Yair, >> This is my conf: >> >> [client.rgw.cephrgw] >> host = cephrgw01 >> rgw_frontends = "civetweb port=8080s ssl_certificate=/etc/pki/tls/c >> ephrgw01.crt" >> rgw_zone = RegionOne >> keyring = /etc/ceph/ceph.client.rgw.cephrgw.keyring >> log_file = /var/log/ceph/client.rgw.cephrgw.log >> rgw_keystone_url = https://keystone.xxx,xx:5000 >> rgw_keystone_admin_user = cloud >> rgw_keystone_admin_password = XXXXXXXXXXXXXXX >> rgw_keystone_admin_tenant = service >> rgw_keystone_accepted_roles = admin member _member_ >> rgw keystone admin project = service >> rgw keystone admin domain = admin >> rgw keystone api version = 2 >> rgw_s3_auth_use_keystone = true >> nss_db_path = /var/ceph/nss/ >> rgw_keystone_verify_ssl = true >> >> Regards, I >> >> 2017-03-13 17:28 GMT+01:00 Yair Magnezi <[email protected]>: >> >>> But per the doc the client stanza should include >>> client.radosgw.instance_name >>> >>> >>> [client.rgw.ceph-rgw-02] >>> host = ceph-rgw-02 >>> keyring = /etc/ceph/ceph.client.radosgw.keyring >>> log file = /var/log/radosgw/client.radosgw.gateway.log >>> rgw_frontends = "civetweb port=8080" >>> >>> >>> "For example, if your node name is gateway-node1, add a section like >>> this after the [global] section: >>> >>> [client.rgw.gateway-node1] >>> rgw_frontends = "civetweb port=80" " >>> >>> >>> Here, {hostname} is the short hostname (output of command hostname -s) >>> of the node that is going to provide the gateway service i.e, the >>> gateway host. >>> >>> The [client.radosgw.gateway] portion of the gateway instance identifies >>> this portion of the Ceph configuration file as configuring a Ceph Storage >>> Cluster client where the client type is a Ceph Object Gateway (i.e., >>> radosgw). >>> >>> >>> Does anyone run the RGW on a different port and can share his >>> configuration ? >>> >>> Thanks >>> >>> >>> >>> >>> >>> >>> >>> On Mon, Mar 13, 2017 at 5:28 PM, Abhishek Lekshmanan <[email protected]> >>> wrote: >>> >>>> >>>> >>>> On 03/13/2017 04:06 PM, Yair Magnezi wrote: >>>> >>>>> Thank you Abhishek >>>>> >>>>> But still ... >>>>> >>>>> root@ceph-rgw-02:/var/log/ceph# ps -ef | grep rgw >>>>> ceph 1332 1 1 14:59 ? 00:00:00 /usr/bin/radosgw >>>>> --cluster=ceph --id *rgw.ceph-rgw-02* -f --setuser ceph --setgroup ceph >>>>> >>>>> >>>>> root@ceph-rgw-02:/var/log/ceph# cat /etc/ceph/ceph.conf >>>>> [global] >>>>> fsid = 00c167db-aea1-41b4-903b-69b0c86b6a0f >>>>> mon_initial_members = ceph-osd-01 ceph-osd-02 >>>>> mon_host = 10.83.1.78,10.83.1.79 >>>>> auth_cluster_required = cephx >>>>> auth_service_required = cephx >>>>> auth_client_required = cephx >>>>> public_network = 10.83.1.0/24 <http://10.83.1.0/24> >>>>> rbd default features = 3 >>>>> #debug ms = 1 >>>>> #debug rgw = 20 >>>>> >>>>> [client.radosgw.*rgw.ceph-rgw-02*] >>>>> host = ceph-rgw-02 >>>>> keyring = /etc/ceph/ceph.client.radosgw.keyring >>>>> log file = /var/log/radosgw/client.radosgw.gateway.log >>>>> rgw_frontends = "civetweb port=8080" >>>>> >>>> >>>> >>>> Try client.rgw.ceph-rgw-02 here (and similar in id), ie. basically what >>>> you pass as the id should be what the ceph.conf section should look like. >>>> >>>> >>>>> root@ceph-rgw-02:/var/log/ceph# netstat -an | grep 80 >>>>> tcp 0 0 0.0.0.0:7480 <http://0.0.0.0:7480> >>>>> 0.0.0.0:* LISTEN >>>>> tcp 0 0 10.83.1.100:56884 <http://10.83.1.100:56884> >>>>> 10.83.1.78:6800 <http://10.83.1.78:6800> ESTABLISHED >>>>> tcp 0 0 10.83.1.100:47842 <http://10.83.1.100:47842> >>>>> 10.83.1.78:6804 <http://10.83.1.78:6804> TIME_WAIT >>>>> tcp 0 0 10.83.1.100:47846 <http://10.83.1.100:47846> >>>>> 10.83.1.78:6804 <http://10.83.1.78:6804> ESTABLISHED >>>>> tcp 0 0 10.83.1.100:44791 <http://10.83.1.100:44791> >>>>> 10.83.1.80:6804 <http://10.83.1.80:6804> ESTABLISHED >>>>> tcp 0 0 10.83.1.100:44782 <http://10.83.1.100:44782> >>>>> 10.83.1.80:6804 <http://10.83.1.80:6804> TIME_WAIT >>>>> tcp 0 0 10.83.1.100:38082 <http://10.83.1.100:38082> >>>>> 10.83.1.80:6789 <http://10.83.1.80:6789> ESTABLISHED >>>>> tcp 0 0 10.83.1.100:41999 <http://10.83.1.100:41999> >>>>> 10.83.1.80:6800 <http://10.83.1.80:6800> ESTABLISHED >>>>> tcp 0 0 10.83.1.100:59681 <http://10.83.1.100:59681> >>>>> 10.83.1.79:6800 <http://10.83.1.79:6800> ESTABLISHED >>>>> tcp 0 0 10.83.1.100:37590 <http://10.83.1.100:37590> >>>>> 10.83.1.79:6804 <http://10.83.1.79:6804> ESTABLISHED >>>>> >>>>> >>>>> 2017-03-13 15:05:23.836844 7f5c2fc80900 0 starting handler: civetweb >>>>> 2017-03-13 15:05:23.838497 7f5c11379700 0 -- 10.83.1.100:0/2130438046 >>>>> <http://10.83.1.100:0/2130438046> submit_message >>>>> mon_subscribe({osdmap=48}) v2 remote, 10.83.1.78:6789/0 >>>>> <http://10.83.1.78:6789/0>, failed lossy con, dropping message >>>>> 0x7f5bfc011850 >>>>> 2017-03-13 15:05:23.842769 7f5c11379700 0 monclient: hunting for new >>>>> mon >>>>> 2017-03-13 15:05:23.846976 7f5c2fc80900 0 starting handler: fastcgi >>>>> 2017-03-13 15:05:23.849245 7f5b87a6a700 0 ERROR: no socket server >>>>> point >>>>> defined, cannot start fcgi frontend >>>>> >>>>> >>>>> >>>>> >>>>> Any more ideas >>>>> >>>>> Thanks >>>>> >>>>> >>>>> >>>>> >>>>> * >>>>> * >>>>> ** >>>>> >>>>> >>>>> >>>>> On Mon, Mar 13, 2017 at 4:34 PM, Abhishek Lekshmanan < >>>>> [email protected] >>>>> <mailto:[email protected]>> wrote: >>>>> >>>>> >>>>> >>>>> On 03/13/2017 03:26 PM, Yair Magnezi wrote: >>>>> >>>>> Hello Wido >>>>> >>>>> yes , the is my /etc/cep/ceph.conf >>>>> >>>>> and yes radosgw.ceph-rgw-02 is the running instance . >>>>> >>>>> root@ceph-rgw-02:/var/log/ceph# ps -ef | grep -i rgw >>>>> ceph 17226 1 0 14:02 ? 00:00:01 >>>>> /usr/bin/radosgw >>>>> --cluster=ceph --id rgw.ceph-rgw-02 -f --setuser ceph >>>>> --setgroup >>>>> ceph >>>>> >>>>> >>>>> The ID passed to rgw here is `rgw.ceph-rgw-02`, whereas your conf >>>>> has a section named `radosgw.ceph-rgw-02` try running this service >>>>> (systemctl start [email protected] maybe?) >>>>> >>>>> -- >>>>> Abhishek Lekshmanan >>>>> SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham >>>>> Norton, HRB 21284 (AG Nürnberg) >>>>> >>>>> >>>>> Thanks >>>>> >>>>> >>>>> >>>>> *Yair Magnezi * >>>>> *Storage & Data Protection TL // *Kenshoo* >>>>> *Office* +972 7 32862423 <tel:%2B972%207%2032862423> // >>>>> *Mobile* +972 50 575-2955 <tel:%2B972%2050%20575-2955> >>>>> __________________________________________ >>>>> * >>>>> ** >>>>> >>>>> >>>>> >>>>> On Mon, Mar 13, 2017 at 4:06 PM, Wido den Hollander >>>>> <[email protected] <mailto:[email protected]> >>>>> <mailto:[email protected] <mailto:[email protected]>>> wrote: >>>>> >>>>> >>>>> > Op 13 maart 2017 om 15:03 schreef Yair Magnezi >>>>> <[email protected] <mailto:[email protected] >>>>> > >>>>> <mailto:[email protected] >>>>> >>>>> <mailto:[email protected]>>>: >>>>> > >>>>> > >>>>> > Hello Cephers . >>>>> > >>>>> > I'm trying to modify the civetweb default port to 80 >>>>> but from some >>>>> > reason it insists on listening on the default 7480 port >>>>> > >>>>> > My configuration is quiet simple ( experimental ) and >>>>> looks like this : >>>>> > >>>>> > >>>>> > [global] >>>>> > fsid = 00c167db-aea1-41b4-903b-69b0c86b6a0f >>>>> > mon_initial_members = ceph-osd-01 ceph-osd-02 >>>>> > mon_host = 10.83.1.78,10.83.1.79 >>>>> > auth_cluster_required = cephx >>>>> > auth_service_required = cephx >>>>> > auth_client_required = cephx >>>>> > public_network = 10.83.1.0/24 <http://10.83.1.0/24> >>>>> <http://10.83.1.0/24> >>>>> > rbd default features = 3 >>>>> > #debug ms = 1 >>>>> > #debug rgw = 20 >>>>> > >>>>> > [client.radosgw.ceph-rgw-02] >>>>> > host = ceph-rgw-02 >>>>> > keyring = /etc/ceph/ceph.client.radosgw.keyring >>>>> > log file = /var/log/radosgw/client.radosgw.gateway.log >>>>> > rgw_frontends = "civetweb port=80" >>>>> > >>>>> > >>>>> >>>>> Are you sure this is in /etc/ceph/ceph.conf? >>>>> >>>>> In addition, are you also sure the RGW is running as user >>>>> 'radosgw.ceph-rgw-02' ? >>>>> >>>>> Wido >>>>> >>>>> > after restart still the same : >>>>> > >>>>> > root@ceph-rgw-02:/var/log/ceph# netstat -an | grep 80 >>>>> > *tcp 0 0 0.0.0.0:7480 <http://0.0.0.0:7480> >>>>> <http://0.0.0.0:7480> >>>>> <http://0.0.0.0:7480> >>>>> > 0.0.0.0:* LISTEN* >>>>> > tcp 0 0 10.83.1.100:56697 >>>>> <http://10.83.1.100:56697> <http://10.83.1.100:56697> >>>>> 10.83.1.79:6804 <http://10.83.1.79:6804> >>>>> <http://10.83.1.79:6804> >>>>> > ESTABLISHED >>>>> > tcp 0 0 10.83.1.100:59482 >>>>> <http://10.83.1.100:59482> <http://10.83.1.100:59482> >>>>> 10.83.1.79:6800 <http://10.83.1.79:6800> >>>>> <http://10.83.1.79:6800> >>>>> > TIME_WAIT >>>>> > tcp 0 0 10.83.1.100:33129 >>>>> <http://10.83.1.100:33129> <http://10.83.1.100:33129> >>>>> 10.83.1.78:6804 <http://10.83.1.78:6804> >>>>> <http://10.83.1.78:6804> >>>>> > ESTABLISHED >>>>> > tcp 0 0 10.83.1.100:56318 >>>>> <http://10.83.1.100:56318> <http://10.83.1.100:56318> >>>>> 10.83.1.80:6804 <http://10.83.1.80:6804> >>>>> <http://10.83.1.80:6804> >>>>> > TIME_WAIT >>>>> > tcp 0 0 10.83.1.100:56324 >>>>> <http://10.83.1.100:56324> <http://10.83.1.100:56324> >>>>> 10.83.1.80:6804 <http://10.83.1.80:6804> >>>>> <http://10.83.1.80:6804> >>>>> > ESTABLISHED >>>>> > tcp 0 0 10.83.1.100:60990 >>>>> <http://10.83.1.100:60990> <http://10.83.1.100:60990> >>>>> 10.83.1.78:6800 <http://10.83.1.78:6800> >>>>> <http://10.83.1.78:6800> >>>>> > ESTABLISHED >>>>> > tcp 0 0 10.83.1.100:60985 >>>>> <http://10.83.1.100:60985> <http://10.83.1.100:60985> >>>>> 10.83.1.78:6800 <http://10.83.1.78:6800> >>>>> <http://10.83.1.78:6800> >>>>> > TIME_WAIT >>>>> > tcp 0 0 10.83.1.100:56691 >>>>> <http://10.83.1.100:56691> <http://10.83.1.100:56691> >>>>> 10.83.1.79:6804 <http://10.83.1.79:6804> >>>>> <http://10.83.1.79:6804> >>>>> > TIME_WAIT >>>>> > tcp 0 0 10.83.1.100:33123 >>>>> <http://10.83.1.100:33123> <http://10.83.1.100:33123> >>>>> 10.83.1.78:6804 <http://10.83.1.78:6804> >>>>> <http://10.83.1.78:6804> >>>>> > TIME_WAIT >>>>> > tcp 0 0 10.83.1.100:59494 >>>>> <http://10.83.1.100:59494> <http://10.83.1.100:59494> >>>>> 10.83.1.79:6800 <http://10.83.1.79:6800> >>>>> <http://10.83.1.79:6800> >>>>> > ESTABLISHED >>>>> > tcp 0 0 10.83.1.100:55924 >>>>> <http://10.83.1.100:55924> <http://10.83.1.100:55924> >>>>> 10.83.1.80:6800 <http://10.83.1.80:6800> >>>>> <http://10.83.1.80:6800> >>>>> > ESTABLISHED >>>>> > tcp 0 0 10.83.1.100:57629 >>>>> <http://10.83.1.100:57629> <http://10.83.1.100:57629> >>>>> 10.83.1.80:6789 <http://10.83.1.80:6789> >>>>> <http://10.83.1.80:6789> >>>>> > ESTABLISHED >>>>> > >>>>> > >>>>> > Besides that it also looks like the service tries to >>>>> start the >>>>> fcgi ( >>>>> > besides the civetweb ) is there a reason for that ? ( >>>>> fastcgi & >>>>> Apache are >>>>> > not installed ) ? >>>>> > >>>>> > >>>>> > 2017-03-13 13:44:35.938897 7f05f3fd7700 1 >>>>> handle_sigterm set >>>>> alarm for 120 >>>>> > 2017-03-13 13:44:35.938916 7f06692c7900 -1 shutting down >>>>> > 2017-03-13 13:44:36.170559 7f06692c7900 1 final shutdown >>>>> > 2017-03-13 13:45:13.980814 7fbdb2e6c900 0 deferred set >>>>> uid:gid to >>>>> > 64045:64045 (ceph:ceph) >>>>> > 2017-03-13 13:45:13.980992 7fbdb2e6c900 0 ceph version >>>>> 10.2.6 >>>>> > (656b5b63ed7c43bd014bcafd81b001959d5f089f), process >>>>> radosgw, pid 16995 >>>>> > *2017-03-13 13:45:14.115639 7fbdb2e6c900 0 starting >>>>> handler: >>>>> civetweb* >>>>> > 2017-03-13 13:45:14.117003 7fbd8ffff700 0 -- >>>>> 10.83.1.100:0/3241919968 <http://10.83.1.100:0/3241919968> >>>>> <http://10.83.1.100:0/3241919968 < >>>>> http://10.83.1.100:0/3241919968>> >>>>> >>>>> > submit_message mon_subscribe({osdmap=48}) v2 remote, >>>>> 10.83.1.78:6789/0 <http://10.83.1.78:6789/0> >>>>> <http://10.83.1.78:6789/0>, >>>>> >>>>> > failed lossy con, dropping message 0x7fbd78011cc0 >>>>> > 2017-03-13 13:45:14.117644 7fbd8ffff700 0 monclient: >>>>> hunting for new mon >>>>> > *2017-03-13 13:45:14.120767 7fbdb2e6c900 0 starting >>>>> handler: fastcgi* >>>>> > *2017-03-13 13:45:14.123000 7fbd09f7b700 0 ERROR: no >>>>> socket >>>>> server point >>>>> > defined, cannot start fcgi frontend* >>>>> > >>>>> > >>>>> > Any idea what do i miss here >>>>> > >>>>> > >>>>> > ceph version --> 10.2.6 >>>>> > ceph-rgw-02 is the gateway . >>>>> > >>>>> > Many Thanks >>>>> > >>>>> > Yair >>>>> > >>>>> > -- >>>>> > This e-mail, as well as any attached document, may >>>>> contain >>>>> material which >>>>> > is confidential and privileged and may include trademark, >>>>> copyright and >>>>> > other intellectual property rights that are proprietary >>>>> to >>>>> Kenshoo >>>>> Ltd, >>>>> > its subsidiaries or affiliates ("Kenshoo"). This e-mail >>>>> and its >>>>> > attachments may be read, copied and used only by the >>>>> addressee for the >>>>> > purpose(s) for which it was disclosed herein. If you have >>>>> received >>>>> it in >>>>> > error, please destroy the message and any attachment, and >>>>> contact us >>>>> > immediately. If you are not the intended recipient, be >>>>> aware that any >>>>> > review, reliance, disclosure, copying, distribution or >>>>> use >>>>> of the >>>>> contents >>>>> > of this message without Kenshoo's express permission is >>>>> strictly >>>>> prohibited. >>>>> > _______________________________________________ >>>>> > ceph-users mailing list >>>>> > [email protected] >>>>> <mailto:[email protected]> >>>>> <mailto:[email protected] >>>>> >>>>> <mailto:[email protected]>> >>>>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> >>>>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>> >>>>> >>>>> >>>>> >>>>> This e-mail, as well as any attached document, may contain >>>>> material >>>>> which is confidential and privileged and may include trademark, >>>>> copyright and other intellectual property rights that are >>>>> proprietary to >>>>> Kenshoo Ltd, its subsidiaries or affiliates ("Kenshoo"). This >>>>> e-mail >>>>> and its attachments may be read, copied and used only by the >>>>> addressee >>>>> for the purpose(s) for which it was disclosed herein. If you >>>>> have >>>>> received it in error, please destroy the message and any >>>>> attachment, and >>>>> contact us immediately. If you are not the intended recipient, >>>>> be aware >>>>> that any review, reliance, disclosure, copying, distribution or >>>>> use of >>>>> the contents of this message without Kenshoo's express >>>>> permission is >>>>> strictly prohibited. >>>>> >>>>> >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> [email protected] <mailto:[email protected]> >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> >>>>> >>>>> >>>>> >>>>> This e-mail, as well as any attached document, may contain material >>>>> which is confidential and privileged and may include trademark, >>>>> copyright and other intellectual property rights that are proprietary >>>>> to >>>>> Kenshoo Ltd, its subsidiaries or affiliates ("Kenshoo"). This e-mail >>>>> and its attachments may be read, copied and used only by the addressee >>>>> for the purpose(s) for which it was disclosed herein. If you have >>>>> received it in error, please destroy the message and any attachment, >>>>> and >>>>> contact us immediately. If you are not the intended recipient, be aware >>>>> that any review, reliance, disclosure, copying, distribution or use of >>>>> the contents of this message without Kenshoo's express permission is >>>>> strictly prohibited. >>>>> >>>> >>>> -- >>>> Abhishek Lekshmanan >>>> SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, >>>> HRB 21284 (AG Nürnberg) >>>> >>> >>> >>> This e-mail, as well as any attached document, may contain material >>> which is confidential and privileged and may include trademark, copyright >>> and other intellectual property rights that are proprietary to Kenshoo Ltd, >>> its subsidiaries or affiliates ("Kenshoo"). This e-mail and its >>> attachments may be read, copied and used only by the addressee for the >>> purpose(s) for which it was disclosed herein. If you have received it in >>> error, please destroy the message and any attachment, and contact us >>> immediately. If you are not the intended recipient, be aware that any >>> review, reliance, disclosure, copying, distribution or use of the contents >>> of this message without Kenshoo's express permission is strictly prohibited. >>> >>> _______________________________________________ >>> ceph-users mailing list >>> [email protected] >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >>> >> >> >> -- >> ############################################################ >> ################ >> Iban Cabrillo Bartolome >> Instituto de Fisica de Cantabria (IFCA) >> Santander, Spain >> Tel: +34942200969 <+34%20942%2020%2009%2069> >> PGP PUBLIC KEY: http://pgp.mit.edu/pks/lookup?op=get&search=0xD9DF0B3D6 >> C8C08AC >> ############################################################ >> ################ >> Bertrand Russell:*"El problema con el mundo es que los estúpidos están >> seguros de todo y los inteligentes están **llenos de dudas*" >> >> > This e-mail, as well as any attached document, may contain material which > is confidential and privileged and may include trademark, copyright and > other intellectual property rights that are proprietary to Kenshoo Ltd, > its subsidiaries or affiliates ("Kenshoo"). This e-mail and its > attachments may be read, copied and used only by the addressee for the > purpose(s) for which it was disclosed herein. If you have received it in > error, please destroy the message and any attachment, and contact us > immediately. If you are not the intended recipient, be aware that any > review, reliance, disclosure, copying, distribution or use of the contents > of this message without Kenshoo's express permission is strictly prohibited. > -- ############################################################################ Iban Cabrillo Bartolome Instituto de Fisica de Cantabria (IFCA) Santander, Spain Tel: +34942200969 PGP PUBLIC KEY: http://pgp.mit.edu/pks/lookup?op=get&search=0xD9DF0B3D6C8C08AC ############################################################################ Bertrand Russell:*"El problema con el mundo es que los estúpidos están seguros de todo y los inteligentes están **llenos de dudas*"
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
