But per the doc the client stanza should include
client.radosgw.instance_name
[client.rgw.ceph-rgw-02]
host = ceph-rgw-02
keyring = /etc/ceph/ceph.client.radosgw.keyring
log file = /var/log/radosgw/client.radosgw.gateway.log
rgw_frontends = "civetweb port=8080"
"For example, if your node name is gateway-node1, add a section like this
after the [global] section:
[client.rgw.gateway-node1]
rgw_frontends = "civetweb port=80" "
Here, {hostname} is the short hostname (output of command hostname -s) of
the node that is going to provide the gateway service i.e, the gateway host.
The [client.radosgw.gateway] portion of the gateway instance identifies
this portion of the Ceph configuration file as configuring a Ceph Storage
Cluster client where the client type is a Ceph Object Gateway (i.e., radosgw
).
Does anyone run the RGW on a different port and can share his configuration
?
Thanks
On Mon, Mar 13, 2017 at 5:28 PM, Abhishek Lekshmanan <[email protected]>
wrote:
>
>
> On 03/13/2017 04:06 PM, Yair Magnezi wrote:
>
>> Thank you Abhishek
>>
>> But still ...
>>
>> root@ceph-rgw-02:/var/log/ceph# ps -ef | grep rgw
>> ceph 1332 1 1 14:59 ? 00:00:00 /usr/bin/radosgw
>> --cluster=ceph --id *rgw.ceph-rgw-02* -f --setuser ceph --setgroup ceph
>>
>>
>> root@ceph-rgw-02:/var/log/ceph# cat /etc/ceph/ceph.conf
>> [global]
>> fsid = 00c167db-aea1-41b4-903b-69b0c86b6a0f
>> mon_initial_members = ceph-osd-01 ceph-osd-02
>> mon_host = 10.83.1.78,10.83.1.79
>> auth_cluster_required = cephx
>> auth_service_required = cephx
>> auth_client_required = cephx
>> public_network = 10.83.1.0/24 <http://10.83.1.0/24>
>> rbd default features = 3
>> #debug ms = 1
>> #debug rgw = 20
>>
>> [client.radosgw.*rgw.ceph-rgw-02*]
>> host = ceph-rgw-02
>> keyring = /etc/ceph/ceph.client.radosgw.keyring
>> log file = /var/log/radosgw/client.radosgw.gateway.log
>> rgw_frontends = "civetweb port=8080"
>>
>
>
> Try client.rgw.ceph-rgw-02 here (and similar in id), ie. basically what
> you pass as the id should be what the ceph.conf section should look like.
>
>
>> root@ceph-rgw-02:/var/log/ceph# netstat -an | grep 80
>> tcp 0 0 0.0.0.0:7480 <http://0.0.0.0:7480>
>> 0.0.0.0:* LISTEN
>> tcp 0 0 10.83.1.100:56884 <http://10.83.1.100:56884>
>> 10.83.1.78:6800 <http://10.83.1.78:6800> ESTABLISHED
>> tcp 0 0 10.83.1.100:47842 <http://10.83.1.100:47842>
>> 10.83.1.78:6804 <http://10.83.1.78:6804> TIME_WAIT
>> tcp 0 0 10.83.1.100:47846 <http://10.83.1.100:47846>
>> 10.83.1.78:6804 <http://10.83.1.78:6804> ESTABLISHED
>> tcp 0 0 10.83.1.100:44791 <http://10.83.1.100:44791>
>> 10.83.1.80:6804 <http://10.83.1.80:6804> ESTABLISHED
>> tcp 0 0 10.83.1.100:44782 <http://10.83.1.100:44782>
>> 10.83.1.80:6804 <http://10.83.1.80:6804> TIME_WAIT
>> tcp 0 0 10.83.1.100:38082 <http://10.83.1.100:38082>
>> 10.83.1.80:6789 <http://10.83.1.80:6789> ESTABLISHED
>> tcp 0 0 10.83.1.100:41999 <http://10.83.1.100:41999>
>> 10.83.1.80:6800 <http://10.83.1.80:6800> ESTABLISHED
>> tcp 0 0 10.83.1.100:59681 <http://10.83.1.100:59681>
>> 10.83.1.79:6800 <http://10.83.1.79:6800> ESTABLISHED
>> tcp 0 0 10.83.1.100:37590 <http://10.83.1.100:37590>
>> 10.83.1.79:6804 <http://10.83.1.79:6804> ESTABLISHED
>>
>>
>> 2017-03-13 15:05:23.836844 7f5c2fc80900 0 starting handler: civetweb
>> 2017-03-13 15:05:23.838497 7f5c11379700 0 -- 10.83.1.100:0/2130438046
>> <http://10.83.1.100:0/2130438046> submit_message
>> mon_subscribe({osdmap=48}) v2 remote, 10.83.1.78:6789/0
>> <http://10.83.1.78:6789/0>, failed lossy con, dropping message
>> 0x7f5bfc011850
>> 2017-03-13 15:05:23.842769 7f5c11379700 0 monclient: hunting for new mon
>> 2017-03-13 15:05:23.846976 7f5c2fc80900 0 starting handler: fastcgi
>> 2017-03-13 15:05:23.849245 7f5b87a6a700 0 ERROR: no socket server point
>> defined, cannot start fcgi frontend
>>
>>
>>
>>
>> Any more ideas
>>
>> Thanks
>>
>>
>>
>>
>> *
>> *
>> **
>>
>>
>>
>> On Mon, Mar 13, 2017 at 4:34 PM, Abhishek Lekshmanan <[email protected]
>> <mailto:[email protected]>> wrote:
>>
>>
>>
>> On 03/13/2017 03:26 PM, Yair Magnezi wrote:
>>
>> Hello Wido
>>
>> yes , the is my /etc/cep/ceph.conf
>>
>> and yes radosgw.ceph-rgw-02 is the running instance .
>>
>> root@ceph-rgw-02:/var/log/ceph# ps -ef | grep -i rgw
>> ceph 17226 1 0 14:02 ? 00:00:01 /usr/bin/radosgw
>> --cluster=ceph --id rgw.ceph-rgw-02 -f --setuser ceph --setgroup
>> ceph
>>
>>
>> The ID passed to rgw here is `rgw.ceph-rgw-02`, whereas your conf
>> has a section named `radosgw.ceph-rgw-02` try running this service
>> (systemctl start [email protected] maybe?)
>>
>> --
>> Abhishek Lekshmanan
>> SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham
>> Norton, HRB 21284 (AG Nürnberg)
>>
>>
>> Thanks
>>
>>
>>
>> *Yair Magnezi *
>> *Storage & Data Protection TL // *Kenshoo*
>> *Office* +972 7 32862423 <tel:%2B972%207%2032862423> //
>> *Mobile* +972 50 575-2955 <tel:%2B972%2050%20575-2955>
>> __________________________________________
>> *
>> **
>>
>>
>>
>> On Mon, Mar 13, 2017 at 4:06 PM, Wido den Hollander
>> <[email protected] <mailto:[email protected]>
>> <mailto:[email protected] <mailto:[email protected]>>> wrote:
>>
>>
>> > Op 13 maart 2017 om 15:03 schreef Yair Magnezi
>> <[email protected] <mailto:[email protected]>
>> <mailto:[email protected]
>>
>> <mailto:[email protected]>>>:
>> >
>> >
>> > Hello Cephers .
>> >
>> > I'm trying to modify the civetweb default port to 80
>> but from some
>> > reason it insists on listening on the default 7480 port
>> >
>> > My configuration is quiet simple ( experimental ) and
>> looks like this :
>> >
>> >
>> > [global]
>> > fsid = 00c167db-aea1-41b4-903b-69b0c86b6a0f
>> > mon_initial_members = ceph-osd-01 ceph-osd-02
>> > mon_host = 10.83.1.78,10.83.1.79
>> > auth_cluster_required = cephx
>> > auth_service_required = cephx
>> > auth_client_required = cephx
>> > public_network = 10.83.1.0/24 <http://10.83.1.0/24>
>> <http://10.83.1.0/24>
>> > rbd default features = 3
>> > #debug ms = 1
>> > #debug rgw = 20
>> >
>> > [client.radosgw.ceph-rgw-02]
>> > host = ceph-rgw-02
>> > keyring = /etc/ceph/ceph.client.radosgw.keyring
>> > log file = /var/log/radosgw/client.radosgw.gateway.log
>> > rgw_frontends = "civetweb port=80"
>> >
>> >
>>
>> Are you sure this is in /etc/ceph/ceph.conf?
>>
>> In addition, are you also sure the RGW is running as user
>> 'radosgw.ceph-rgw-02' ?
>>
>> Wido
>>
>> > after restart still the same :
>> >
>> > root@ceph-rgw-02:/var/log/ceph# netstat -an | grep 80
>> > *tcp 0 0 0.0.0.0:7480 <http://0.0.0.0:7480>
>> <http://0.0.0.0:7480>
>> <http://0.0.0.0:7480>
>> > 0.0.0.0:* LISTEN*
>> > tcp 0 0 10.83.1.100:56697
>> <http://10.83.1.100:56697> <http://10.83.1.100:56697>
>> 10.83.1.79:6804 <http://10.83.1.79:6804>
>> <http://10.83.1.79:6804>
>> > ESTABLISHED
>> > tcp 0 0 10.83.1.100:59482
>> <http://10.83.1.100:59482> <http://10.83.1.100:59482>
>> 10.83.1.79:6800 <http://10.83.1.79:6800>
>> <http://10.83.1.79:6800>
>> > TIME_WAIT
>> > tcp 0 0 10.83.1.100:33129
>> <http://10.83.1.100:33129> <http://10.83.1.100:33129>
>> 10.83.1.78:6804 <http://10.83.1.78:6804>
>> <http://10.83.1.78:6804>
>> > ESTABLISHED
>> > tcp 0 0 10.83.1.100:56318
>> <http://10.83.1.100:56318> <http://10.83.1.100:56318>
>> 10.83.1.80:6804 <http://10.83.1.80:6804>
>> <http://10.83.1.80:6804>
>> > TIME_WAIT
>> > tcp 0 0 10.83.1.100:56324
>> <http://10.83.1.100:56324> <http://10.83.1.100:56324>
>> 10.83.1.80:6804 <http://10.83.1.80:6804>
>> <http://10.83.1.80:6804>
>> > ESTABLISHED
>> > tcp 0 0 10.83.1.100:60990
>> <http://10.83.1.100:60990> <http://10.83.1.100:60990>
>> 10.83.1.78:6800 <http://10.83.1.78:6800>
>> <http://10.83.1.78:6800>
>> > ESTABLISHED
>> > tcp 0 0 10.83.1.100:60985
>> <http://10.83.1.100:60985> <http://10.83.1.100:60985>
>> 10.83.1.78:6800 <http://10.83.1.78:6800>
>> <http://10.83.1.78:6800>
>> > TIME_WAIT
>> > tcp 0 0 10.83.1.100:56691
>> <http://10.83.1.100:56691> <http://10.83.1.100:56691>
>> 10.83.1.79:6804 <http://10.83.1.79:6804>
>> <http://10.83.1.79:6804>
>> > TIME_WAIT
>> > tcp 0 0 10.83.1.100:33123
>> <http://10.83.1.100:33123> <http://10.83.1.100:33123>
>> 10.83.1.78:6804 <http://10.83.1.78:6804>
>> <http://10.83.1.78:6804>
>> > TIME_WAIT
>> > tcp 0 0 10.83.1.100:59494
>> <http://10.83.1.100:59494> <http://10.83.1.100:59494>
>> 10.83.1.79:6800 <http://10.83.1.79:6800>
>> <http://10.83.1.79:6800>
>> > ESTABLISHED
>> > tcp 0 0 10.83.1.100:55924
>> <http://10.83.1.100:55924> <http://10.83.1.100:55924>
>> 10.83.1.80:6800 <http://10.83.1.80:6800>
>> <http://10.83.1.80:6800>
>> > ESTABLISHED
>> > tcp 0 0 10.83.1.100:57629
>> <http://10.83.1.100:57629> <http://10.83.1.100:57629>
>> 10.83.1.80:6789 <http://10.83.1.80:6789>
>> <http://10.83.1.80:6789>
>> > ESTABLISHED
>> >
>> >
>> > Besides that it also looks like the service tries to
>> start the
>> fcgi (
>> > besides the civetweb ) is there a reason for that ? (
>> fastcgi &
>> Apache are
>> > not installed ) ?
>> >
>> >
>> > 2017-03-13 13:44:35.938897 7f05f3fd7700 1 handle_sigterm
>> set
>> alarm for 120
>> > 2017-03-13 13:44:35.938916 7f06692c7900 -1 shutting down
>> > 2017-03-13 13:44:36.170559 7f06692c7900 1 final shutdown
>> > 2017-03-13 13:45:13.980814 7fbdb2e6c900 0 deferred set
>> uid:gid to
>> > 64045:64045 (ceph:ceph)
>> > 2017-03-13 13:45:13.980992 7fbdb2e6c900 0 ceph version
>> 10.2.6
>> > (656b5b63ed7c43bd014bcafd81b001959d5f089f), process
>> radosgw, pid 16995
>> > *2017-03-13 13:45:14.115639 7fbdb2e6c900 0 starting
>> handler:
>> civetweb*
>> > 2017-03-13 13:45:14.117003 7fbd8ffff700 0 --
>> 10.83.1.100:0/3241919968 <http://10.83.1.100:0/3241919968>
>> <http://10.83.1.100:0/3241919968 <http://10.83.1.100:0/3241919968
>> >>
>>
>> > submit_message mon_subscribe({osdmap=48}) v2 remote,
>> 10.83.1.78:6789/0 <http://10.83.1.78:6789/0>
>> <http://10.83.1.78:6789/0>,
>>
>> > failed lossy con, dropping message 0x7fbd78011cc0
>> > 2017-03-13 13:45:14.117644 7fbd8ffff700 0 monclient:
>> hunting for new mon
>> > *2017-03-13 13:45:14.120767 7fbdb2e6c900 0 starting
>> handler: fastcgi*
>> > *2017-03-13 13:45:14.123000 7fbd09f7b700 0 ERROR: no socket
>> server point
>> > defined, cannot start fcgi frontend*
>> >
>> >
>> > Any idea what do i miss here
>> >
>> >
>> > ceph version --> 10.2.6
>> > ceph-rgw-02 is the gateway .
>> >
>> > Many Thanks
>> >
>> > Yair
>> >
>> > --
>> > This e-mail, as well as any attached document, may contain
>> material which
>> > is confidential and privileged and may include trademark,
>> copyright and
>> > other intellectual property rights that are proprietary to
>> Kenshoo
>> Ltd,
>> > its subsidiaries or affiliates ("Kenshoo"). This e-mail
>> and its
>> > attachments may be read, copied and used only by the
>> addressee for the
>> > purpose(s) for which it was disclosed herein. If you have
>> received
>> it in
>> > error, please destroy the message and any attachment, and
>> contact us
>> > immediately. If you are not the intended recipient, be
>> aware that any
>> > review, reliance, disclosure, copying, distribution or use
>> of the
>> contents
>> > of this message without Kenshoo's express permission is
>> strictly
>> prohibited.
>> > _______________________________________________
>> > ceph-users mailing list
>> > [email protected]
>> <mailto:[email protected]>
>> <mailto:[email protected]
>>
>> <mailto:[email protected]>>
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>
>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>>
>>
>>
>>
>> This e-mail, as well as any attached document, may contain
>> material
>> which is confidential and privileged and may include trademark,
>> copyright and other intellectual property rights that are
>> proprietary to
>> Kenshoo Ltd, its subsidiaries or affiliates ("Kenshoo"). This
>> e-mail
>> and its attachments may be read, copied and used only by the
>> addressee
>> for the purpose(s) for which it was disclosed herein. If you have
>> received it in error, please destroy the message and any
>> attachment, and
>> contact us immediately. If you are not the intended recipient,
>> be aware
>> that any review, reliance, disclosure, copying, distribution or
>> use of
>> the contents of this message without Kenshoo's express permission
>> is
>> strictly prohibited.
>>
>>
>> _______________________________________________
>> ceph-users mailing list
>> [email protected] <mailto:[email protected]>
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>
>>
>>
>>
>> This e-mail, as well as any attached document, may contain material
>> which is confidential and privileged and may include trademark,
>> copyright and other intellectual property rights that are proprietary to
>> Kenshoo Ltd, its subsidiaries or affiliates ("Kenshoo"). This e-mail
>> and its attachments may be read, copied and used only by the addressee
>> for the purpose(s) for which it was disclosed herein. If you have
>> received it in error, please destroy the message and any attachment, and
>> contact us immediately. If you are not the intended recipient, be aware
>> that any review, reliance, disclosure, copying, distribution or use of
>> the contents of this message without Kenshoo's express permission is
>> strictly prohibited.
>>
>
> --
> Abhishek Lekshmanan
> SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB
> 21284 (AG Nürnberg)
>
--
This e-mail, as well as any attached document, may contain material which
is confidential and privileged and may include trademark, copyright and
other intellectual property rights that are proprietary to Kenshoo Ltd,
its subsidiaries or affiliates ("Kenshoo"). This e-mail and its
attachments may be read, copied and used only by the addressee for the
purpose(s) for which it was disclosed herein. If you have received it in
error, please destroy the message and any attachment, and contact us
immediately. If you are not the intended recipient, be aware that any
review, reliance, disclosure, copying, distribution or use of the contents
of this message without Kenshoo's express permission is strictly prohibited.
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
