Hi Veselin, I don't think that allow applications to run on StorageNodes is a good practice, so the resources on this machines can be exclusive for Gluster.
I would use a different label to avoid applications to run on StorageNode instead of using schedulable=false. Regards, Rodrigo Bersa Cloud Consultant, RHCVA, RHCE Red Hat Brasil <https://www.redhat.com> [email protected] M: +55-11-99557-5841 <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo *Great Place to Work*. On Tue, May 15, 2018 at 6:06 AM, Veselin Hristov <[email protected]> wrote: > Hi Todd, > > Appreciate the answer ! > > I will definitely try it out, last question. What about the 'storage' > nodes, are they allowed to run application? Maybe they are set as > 'schedulable=False' and with 'Taints and Toleration' you allow the 3 > gluster storage pods you mentioned ? > > Regards, > Veselin > > -----Original Message----- > From: Walters, Todd [mailto:[email protected]] > Sent: Monday, May 14, 2018 6:25 PM > To: [email protected] > Cc: [email protected] > Subject: Re: Container Ready/Native storage for OpenShift 3.9 > > Hello Veselin, > > We’ve deploy Glusterfs on 3.9. Couple of items that may help you. We chose > it CNS to be part of our existing openshift cluster, or ‘Containerized’ as > described here > - https://docs.openshift.org/latest/install_config/ > persistent_storage/persistent_storage_glusterfs.html > > We create 3 nodes for ‘app’ storage. Labeled/tagged them as glusterfs > nodes. So bacially we ran our scaleup playbook to add the 3 nodes. Once > those nodes were on line we configured for gluster. > - same link as above but to the ‘advanced install’ section > - https://docs.openshift.org/latest/install_config/ > persistent_storage/persistent_storage_glusterfs.html# > install-advanced-installer > > We set these for our inventory ‘roles’ > glusterfs_wipe: true > glusterfs_devices: [ "/dev/xvdc" ] > openshift_node_labels: > region: gluster > zone: default > > and these in our OSEv3 > `# Glusterfs # CNS storage for applications > openshift_storage_glusterfs_namespace: app-storage > openshift_storage_glusterfs_block_deploy: False > openshift_storage_glusterfs_is_native: True > #openshift_storage_glusterfs_timeout: 600 > #openshift_storage_glusterfs_wipe: True` > > We made sure our playbooks matched the release-3.9 and then ran this > playbook to install glusterfs: > - ansible-playbook -vvv /usr/share/ansible/openshift- > ansible/playbooks/byo/openshift-glusterfs/config.yml > > We used this page for additional roles > - https://github.com/openshift/openshift-ansible/tree/master/ > roles/openshift_storage_glusterfs > > This will install gluster into namespace ‘app-storage’ and will deploy 4 > pods, 1 heketi pod, and 3 gluster storage pods (1 for each storage node) > > Only issue we have had is adding devices. For example, we haven’t been > successful adding 2nd disk device to each node to increase cluster > capacity. The nodes see it, but our heketi-cli commands keep failing. Once > we resolve this issue, we’ll deploy to prod. > > Thanks, > > Todd > > Today's Topics: > > 1. Container Ready/Native storage for OpenShift 3.9 > (Veselin Hristov) > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 14 May 2018 14:04:47 +0300 > From: "Veselin Hristov" <[email protected]> > To: <[email protected]> > Subject: Container Ready/Native storage for OpenShift 3.9 > Message-ID: <[email protected]> > Content-Type: text/plain; charset="utf-8" > > Dear All, > > > > I am in a need of assistance on having Persistent Storage for our > OpenShift(Origin) 3.9; Here are more details: 10 VMs in total - 3 > Masters > + 7 nodes. > > Plan is to have redundant storage solution for our containerized apps > and > infrastructure components such as Registry (RWX ReadWriteMany), > Aggregated > Logging, Metrics. > > For future we might need RWX also for our apps which leads me to use > RedHat's GlusterFS. > > > > So far have been researching for Container-Ready Storage > <https://na01.safelinks.protection.outlook.com/?url= > https%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-us% > 2Fcontainer-native_storage%2F3.9%2F&data=01%7C01%7Ctodd_ > walters%40unigroup.com%7Cbe3a4520c8f04f1cea7f08d5b9a6a8f3% > 7C259bdc2f86d3477b8cb34eee64289142%7C1&sdata=5sN% > 2FXApI6qXFQikkdVL3dZlCTK54D7i9N4XG0jpr95s%3D&reserved=0 > html/container-native_storage_for_openshift_container_ > platform/chap-document > ation-introduction_crs_for_ocp> . From the docs I got that it has to > be > deployed on separate Origin environment for managing it. Please > correct me > if I am wrong. > > > > Difference with Container-Native Storage > <https://na01.safelinks.protection.outlook.com/?url= > https%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-us% > 2Fcontainer-native_storage%2F3.9%2F&data=01%7C01%7Ctodd_ > walters%40unigroup.com%7Cbe3a4520c8f04f1cea7f08d5b9a6a8f3% > 7C259bdc2f86d3477b8cb34eee64289142%7C1&sdata=5sN% > 2FXApI6qXFQikkdVL3dZlCTK54D7i9N4XG0jpr95s%3D&reserved=0 > html/container-native_storage_for_openshift_container_ > platform/chap-document > ation-red_hat_gluster_storage_container_native_with_ > openshift_platform-rhgs_ > container_converged_with_os> is that here the Storage services are > deployed > in the same Origin cluster where our applications are. > > > Please help me decide which of both solutions to test and go for. > > Also would be much of help if you can share with me reference > documentation > about the Container-Native/Ready storage as the one for Openshift > Advanced > installation. Would be helpful to see steps and considerations taken > during > the setup. > > Goal is to have everything done by automation such as Ansible or other > means, so any thoughts here are also welcomed. > > > With Regards, > > Veselin Hristov > > Cloud and Middleware Engineer at itgix.com > > Mobile: +359885894609 > > Sofia, Bulgaria > > Planned vacation: > > > > > ######################################################################## > The information contained in this message, and any attachments thereto, is > intended solely for the use of the addressee(s) and may contain > confidential and/or privileged material. Any review, retransmission, > dissemination, copying, or other use of the transmitted information is > prohibited. If you received this in error, please contact the sender and > delete the material from any computer. UNIGROUP.COM > ######################################################################## > > > > --- > Този имейл е проверен за вируси от Avast. > https://www.avast.com/antivirus > > > _______________________________________________ > users mailing list > [email protected] > http://lists.openshift.redhat.com/openshiftmm/listinfo/users >
_______________________________________________ users mailing list [email protected] http://lists.openshift.redhat.com/openshiftmm/listinfo/users
