Hi, We did a PoC at Orange and encountered some difficulties in configurating federation.
Can you check that placements targets are identical on each zone? brgds De : ceph-users [mailto:[email protected]] De la part de [email protected] Envoyé : vendredi 6 novembre 2015 03:01 À : [email protected] Cc : [email protected] Objet : Re: [ceph-users] Federated gateways Hi Craig, I am testing the federated gateway of 1 region with 2 zones. And I found only metadata is replicated, the data is NOT. According to your check list, I am sure all thinks are checked. Could you review my configuration scripts? The configuration files are similar to http://docs.ceph.com/docs/master/radosgw/federated-config/. 1. For the master zone with 5 nodes of the region (1) create keyring sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.radosgw.keyring sudo chmod +r /etc/ceph/ceph.client.radosgw.keyring sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-east-1 --gen-key sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-west-1 --gen-key sudo ceph-authtool -n client.radosgw.us-east-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring sudo ceph-authtool -n client.radosgw.us-west-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring (2) modify Ceph cluster configurations and synchronize it ceph-deploy --overwrite-conf config push node1 node2 node3 node4 node5 (3) configure Apache (4) configure region sudo apt-get install -y radosgw radosgw-agent python-pip sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-east-1 sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-west-1 sudo rados -p .us.rgw.root rm region_info.default sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-east-1 sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-west-1 sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (5) create master zone sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-west-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-west-1 sudo rados -p .rgw.root rm zone_info.default sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (6) create master zone's users sudo radosgw-admin user create --uid="us-east" --display-name="Region-us Zone-East" --name client.radosgw.us-east-1 --system --access_key=us_access_key --secret=us_secret_key sudo radosgw-admin user create --uid="us-west" --display-name="Region-us Zone-West" --name client.radosgw.us-west-1 --system --access_key=us_access_key --secret=us_secret_key (7) restart Ceph & apache2 & radosgw services 2. For the secondary zone with 5 nodes of the region (1) copy the keyring file 'ceph.client.radosgw.keyring' from master zone and import the keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring (2) modify Ceph cluster configurations and synchronize it ceph-deploy --overwrite-conf config push node1 node2 node3 node4 node5 (3) configure Apache (4) copy infile '/home/ceph/us.json' for the master zone and create 'us' region sudo apt-get install -y radosgw radosgw-agent python-pip sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-east-1 sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-west-1 sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-east-1 sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-west-1 sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (5) create secondary one sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-west-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-west-1 sudo rados -p .rgw.root rm zone_info.default sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (6) create secondary zone's users sudo radosgw-admin user create --uid="us-east" --display-name="Region-us Zone-East" --name client.radosgw.us-east-1 --system --access_key=us_access_key --secret=us_secret_key sudo radosgw-admin user create --uid="us-west" --display-name="Region-us Zone-West" --name client.radosgw.us-west-1 --system --access_key=us_access_key --secret=us_secret_key (7) restart Ceph & apache2 & radosgw services Any help would be much appreciated. Best Regards, wdhwang --------------------------------------------------------------------------------------------------------------------------------------------------------------- This email contains confidential or legally privileged information and is for the sole use of its intended recipient. Any unauthorized review, use, copying or distribution of this email or the content of this email is strictly prohibited. If you are not the intended recipient, you may reply to the sender and should delete this e-mail immediately. --------------------------------------------------------------------------------------------------------------------------------------------------------------- _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you.
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
