Hello Veselin, We’ve deploy Glusterfs on 3.9. Couple of items that may help you. We chose it CNS to be part of our existing openshift cluster, or ‘Containerized’ as described here - https://docs.openshift.org/latest/install_config/persistent_storage/persistent_storage_glusterfs.html
We create 3 nodes for ‘app’ storage. Labeled/tagged them as glusterfs nodes. So bacially we ran our scaleup playbook to add the 3 nodes. Once those nodes were on line we configured for gluster. - same link as above but to the ‘advanced install’ section - https://docs.openshift.org/latest/install_config/persistent_storage/persistent_storage_glusterfs.html#install-advanced-installer We set these for our inventory ‘roles’ glusterfs_wipe: true glusterfs_devices: [ "/dev/xvdc" ] openshift_node_labels: region: gluster zone: default and these in our OSEv3 `# Glusterfs # CNS storage for applications openshift_storage_glusterfs_namespace: app-storage openshift_storage_glusterfs_block_deploy: False openshift_storage_glusterfs_is_native: True #openshift_storage_glusterfs_timeout: 600 #openshift_storage_glusterfs_wipe: True` We made sure our playbooks matched the release-3.9 and then ran this playbook to install glusterfs: - ansible-playbook -vvv /usr/share/ansible/openshift-ansible/playbooks/byo/openshift-glusterfs/config.yml We used this page for additional roles - https://github.com/openshift/openshift-ansible/tree/master/roles/openshift_storage_glusterfs This will install gluster into namespace ‘app-storage’ and will deploy 4 pods, 1 heketi pod, and 3 gluster storage pods (1 for each storage node) Only issue we have had is adding devices. For example, we haven’t been successful adding 2nd disk device to each node to increase cluster capacity. The nodes see it, but our heketi-cli commands keep failing. Once we resolve this issue, we’ll deploy to prod. Thanks, Todd Today's Topics: 1. Container Ready/Native storage for OpenShift 3.9 (Veselin Hristov) ---------------------------------------------------------------------- Message: 1 Date: Mon, 14 May 2018 14:04:47 +0300 From: "Veselin Hristov" <[email protected]> To: <[email protected]> Subject: Container Ready/Native storage for OpenShift 3.9 Message-ID: <[email protected]> Content-Type: text/plain; charset="utf-8" Dear All, I am in a need of assistance on having Persistent Storage for our OpenShift(Origin) 3.9; Here are more details: 10 VMs in total - 3 Masters + 7 nodes. Plan is to have redundant storage solution for our containerized apps and infrastructure components such as Registry (RWX ReadWriteMany), Aggregated Logging, Metrics. For future we might need RWX also for our apps which leads me to use RedHat's GlusterFS. So far have been researching for Container-Ready Storage <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-us%2Fcontainer-native_storage%2F3.9%2F&data=01%7C01%7Ctodd_walters%40unigroup.com%7Cbe3a4520c8f04f1cea7f08d5b9a6a8f3%7C259bdc2f86d3477b8cb34eee64289142%7C1&sdata=5sN%2FXApI6qXFQikkdVL3dZlCTK54D7i9N4XG0jpr95s%3D&reserved=0 html/container-native_storage_for_openshift_container_platform/chap-document ation-introduction_crs_for_ocp> . From the docs I got that it has to be deployed on separate Origin environment for managing it. Please correct me if I am wrong. Difference with Container-Native Storage <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-us%2Fcontainer-native_storage%2F3.9%2F&data=01%7C01%7Ctodd_walters%40unigroup.com%7Cbe3a4520c8f04f1cea7f08d5b9a6a8f3%7C259bdc2f86d3477b8cb34eee64289142%7C1&sdata=5sN%2FXApI6qXFQikkdVL3dZlCTK54D7i9N4XG0jpr95s%3D&reserved=0 html/container-native_storage_for_openshift_container_platform/chap-document ation-red_hat_gluster_storage_container_native_with_openshift_platform-rhgs_ container_converged_with_os> is that here the Storage services are deployed in the same Origin cluster where our applications are. Please help me decide which of both solutions to test and go for. Also would be much of help if you can share with me reference documentation about the Container-Native/Ready storage as the one for Openshift Advanced installation. Would be helpful to see steps and considerations taken during the setup. Goal is to have everything done by automation such as Ansible or other means, so any thoughts here are also welcomed. With Regards, Veselin Hristov Cloud and Middleware Engineer at itgix.com Mobile: +359885894609 Sofia, Bulgaria Planned vacation: ######################################################################## The information contained in this message, and any attachments thereto, is intended solely for the use of the addressee(s) and may contain confidential and/or privileged material. Any review, retransmission, dissemination, copying, or other use of the transmitted information is prohibited. If you received this in error, please contact the sender and delete the material from any computer. UNIGROUP.COM ######################################################################## _______________________________________________ users mailing list [email protected] http://lists.openshift.redhat.com/openshiftmm/listinfo/users
