Re: [one-users] clusters in 4.8
As long as I can have a shared Image data store between the various clusters that is the big thing.. and from what you are saying below it looks like that will work. Will post again once I have tested and confirmed that. Thanks for the clarification. Steve Timm On Sat, 14 Feb 2015, Ruben S. Montero wrote: Hi My Fault, you are right the cluster requirements are also used for system datastores. Note that the default cluster behaves as described for VNETs. This behavior is not coherent with the documentation as you mentioned in a previous mail, so it seems a bug. I filled an issue [1] to look at this before 4.12. Thanks for the detailed feedback :) Cheers Ruben [1] http://dev.opennebula.org/issues/3597 On Sat, Feb 14, 2015 at 1:27 AM, Steven C Timm t...@fnal.gov wrote: One more followup: host 156 + vnet2 + ds 100/102, all outside the cluster, no problem host 156 + vnet2 + ds100/102, all in the cluster, no problem host 156 and vnet2 in the cluster, DS outside of the cluster, problem. SCHED_MESSAGE=Fri Feb 13 18:06:29 2015 : No system datastore meets SCHED_DS_REQUIREMENTS: CLUSTER_ID = 101 !(PUBLIC_CLOUD = YES) host 156 in the cluster, vnet2 and DS out of the cluster No error message but it never matches either. Fri Feb 13 18:24:29 2015 [Z0][HOST][D]: Discovered Hosts (enabled): 0 2 156 Fri Feb 13 18:24:29 2015 [Z0][SCHED][D]: VM 1058: Host 0 filtered out. It does not fulfill SCHED_REQUIREMENTS. Fri Feb 13 18:24:29 2015 [Z0][SCHED][D]: VM 1058: Host 2 filtered out. It does not fulfill SCHED_REQUIREMENTS. Fri Feb 13 18:24:29 2015 [Z0][SCHED][I]: Scheduling Results: Virtual Machine: 1058 PRI ID - HOSTS 1 156 PRI ID - DATASTORES 0 100 0 0 Fri Feb 13 18:24:29 2015 [Z0][SCHED][I]: VM 1058: No suitable System DS found for Host: 156. Filtering out host. Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 6:01 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 PS--if there are other vm's still launched and running from the time when the datastore used to be part of a cluster, could that confuse anything? Do I have to restart oned to clear anything up? Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 5:56 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 OK here we go: VM in question is taking an image from image store 102 (currently in no cluster), vnet 0 routable private from cluster 100 cloud worker also a number of hosts, including hosts # 0 and 2, also part of cluster cloud worker VM stays pending for ever, hold reason is below.--it is requiring that cluster ID has to be 100. Same image and same datastore and same vnet outside of the cluster, work just fine. Seems like if I require any resource from the cluster, in this case a vnet, then all resources have to be in the cluster. Am I missing something? Steve Timm [root@fclheadgpvm01 one]# onevm show 1054 | more VIRTUAL MACHINE 1054 INFORMATION ID : 1054 NAME: CLI_PRIV_SLF6Vanilla-1054 USER: oneadmin GROUP : oneadmin STATE : PENDING LCM_STATE : LCM_INIT RESCHED : No START TIME : 02/13 17:44:52 END TIME: - DEPLOY ID : - VIRTUAL MACHINE MONITORING NET_RX : 0K USED MEMORY : 0K USED CPU: 0 NET_TX : 0K PERMISSIONS OWNER : um- GROUP : --- OTHER : --- VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 0 vdaSLF6Vanilla file NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 routable-private no br1 10.128.1.9 54:52:00:02:0d:09 USER TEMPLATE NPTYPE=NPERNLM SCHED_MESSAGE=Fri Feb 13 17:46:29 2015 : No system datastore meets SCHED_DS_REQ UIREMENTS: CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) SCHED_RANK=FREE_MEM SCHED_REQUIREMENTS=HYPERVISOR=\kvm\ HOSTNAME=\cloudworker*\ VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS=CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) CONTEXT=[ CTX_USER=PFVTRVI+PElEPjA8L0lEPjxHSUQ+MDwvR0lEPjxHUk9VUFM+PElEPjA8L0lEPjwvR1JP VVBTPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+b25lYWRtaW48L05BTUU+PFBBU1NXT1JEPi9E Qz1jb20vREM9RGlnaUNlcnQtR3JpZC9PPU9wZW5cMjBTY2llbmNlXDIwR3JpZC9PVT1TZXJ2aWNlcy9D Tj1mY2xoZWFkZ3B2bTAxLmZuYWwuZ292PC9QQVNTV09SRD48QVVUSF9EUklWRVI+eDUwOTwvQVVUSF9E UklWRVI+PEVOQUJMRUQ+MTwvRU5BQkxFRD48VEVNUExBVEU+PFRPS0VOX1BBU1NXT1JEPjwhW0NEQVRB [root@fclheadgpvm01 one]# onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system0M - - 0 sys -shared 1 default
Re: [one-users] clusters in 4.8
Hi My Fault, you are right the cluster requirements are also used for system datastores. Note that the default cluster behaves as described for VNETs. This behavior is not coherent with the documentation as you mentioned in a previous mail, so it seems a bug. I filled an issue [1] to look at this before 4.12. Thanks for the detailed feedback :) Cheers Ruben [1] http://dev.opennebula.org/issues/3597 On Sat, Feb 14, 2015 at 1:27 AM, Steven C Timm t...@fnal.gov wrote: One more followup: host 156 + vnet2 + ds 100/102, all outside the cluster, no problem host 156 + vnet2 + ds100/102, all in the cluster, no problem host 156 and vnet2 in the cluster, DS outside of the cluster, problem. SCHED_MESSAGE=Fri Feb 13 18:06:29 2015 : No system datastore meets SCHED_DS_REQUIREMENTS: CLUSTER_ID = 101 !(PUBLIC_CLOUD = YES) host 156 in the cluster, vnet2 and DS out of the cluster No error message but it never matches either. Fri Feb 13 18:24:29 2015 [Z0][HOST][D]: Discovered Hosts (enabled): 0 2 156 Fri Feb 13 18:24:29 2015 [Z0][SCHED][D]: VM 1058: Host 0 filtered out. It does not fulfill SCHED_REQUIREMENTS. Fri Feb 13 18:24:29 2015 [Z0][SCHED][D]: VM 1058: Host 2 filtered out. It does not fulfill SCHED_REQUIREMENTS. Fri Feb 13 18:24:29 2015 [Z0][SCHED][I]: Scheduling Results: Virtual Machine: 1058 PRI ID - HOSTS 1 156 PRI ID - DATASTORES 0 100 0 0 Fri Feb 13 18:24:29 2015 [Z0][SCHED][I]: VM 1058: No suitable System DS found for Host: 156. Filtering out host. Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 6:01 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 PS--if there are other vm's still launched and running from the time when the datastore used to be part of a cluster, could that confuse anything? Do I have to restart oned to clear anything up? Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 5:56 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 OK here we go: VM in question is taking an image from image store 102 (currently in no cluster), vnet 0 routable private from cluster 100 cloud worker also a number of hosts, including hosts # 0 and 2, also part of cluster cloud worker VM stays pending for ever, hold reason is below.--it is requiring that cluster ID has to be 100. Same image and same datastore and same vnet outside of the cluster, work just fine. Seems like if I require any resource from the cluster, in this case a vnet, then all resources have to be in the cluster. Am I missing something? Steve Timm [root@fclheadgpvm01 one]# onevm show 1054 | more VIRTUAL MACHINE 1054 INFORMATION ID : 1054 NAME: CLI_PRIV_SLF6Vanilla-1054 USER: oneadmin GROUP : oneadmin STATE : PENDING LCM_STATE : LCM_INIT RESCHED : No START TIME : 02/13 17:44:52 END TIME: - DEPLOY ID : - VIRTUAL MACHINE MONITORING NET_RX : 0K USED MEMORY : 0K USED CPU: 0 NET_TX : 0K PERMISSIONS OWNER : um- GROUP : --- OTHER : --- VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 0 vdaSLF6Vanilla file NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 routable-private no br1 10.128.1.9 54:52:00:02:0d:09 USER TEMPLATE NPTYPE=NPERNLM SCHED_MESSAGE=Fri Feb 13 17:46:29 2015 : No system datastore meets SCHED_DS_REQ UIREMENTS: CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) SCHED_RANK=FREE_MEM SCHED_REQUIREMENTS=HYPERVISOR=\kvm\ HOSTNAME=\cloudworker*\ VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS=CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) CONTEXT=[ CTX_USER=PFVTRVI+PElEPjA8L0lEPjxHSUQ+MDwvR0lEPjxHUk9VUFM+PElEPjA8L0lEPjwvR1JP VVBTPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+b25lYWRtaW48L05BTUU+PFBBU1NXT1JEPi9E Qz1jb20vREM9RGlnaUNlcnQtR3JpZC9PPU9wZW5cMjBTY2llbmNlXDIwR3JpZC9PVT1TZXJ2aWNlcy9D Tj1mY2xoZWFkZ3B2bTAxLmZuYWwuZ292PC9QQVNTV09SRD48QVVUSF9EUklWRVI+eDUwOTwvQVVUSF9E UklWRVI+PEVOQUJMRUQ+MTwvRU5BQkxFRD48VEVNUExBVEU+PFRPS0VOX1BBU1NXT1JEPjwhW0NEQVRB [root@fclheadgpvm01 one]# onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system0M - - 0 sys -shared 1 default21.2G 85% - 0 img fs shared 2 files 21.2G 85% - 0 fil fs ssh 100 localnode - - - 0 sys -ssh 102
Re: [one-users] clusters in 4.8
Yes, you can do: Cluster A: Host_A0, Host_A1... + VNET_A0, VNET_A1... Cluster B: HostB0, HostB1... + VNET_B0, VNET_B1... Cluster Default: DS, DS_System Then a VM that uses VNET_A0 + DS would be scheduled to Cluster A. Note that using VNET_A0 constrain resources from Cluster A + Cluster Default. Cheers Ruben On Fri, Feb 13, 2015 at 10:42 PM, Steven C Timm t...@fnal.gov wrote: I know if I just take the vnet and the datastore out of the cluster, and have no clusters at all, then everything will work.. I was hoping to have a cluster structure of (host,vnet) pairings that could all share a common data store. However from the documentation, it looks like if your template requests any resource that is part of a cluster (vnet or image from datastore) then the scheduler will constrain you to resources that are part of that same cluster. Is that correct? Steve Timm From: Ruben S. Montero [rsmont...@opennebula.org] Sent: Friday, February 13, 2015 3:11 PM To: Steven C Timm Cc: users@lists.opennebula.org Subject: Re: [one-users] clusters in 4.8 Hi If both clusters has access to the same datastores, just move them out of the first cluster. When a datastore or network is not assigned to any cluster (cluster default) OpenNebula assumes it can be used with any host (no matter in which cluster is set). BTW, although you do not needed for your use case, 4.12 will come with extended VDC support to create complex provision scenarios. Basically you can define generic resource providers that aggregate any resource (cluster, host, network, datastores) more here http://opennebula.org/4-12-features-virtual-data-center-redesign/ Cheers On Fri, Feb 13, 2015 at 6:37 PM, Steven Timm t...@fnal.gov wrote: I have had my one4.8 host up for a while with a single cluster that has 150 hosts, one vnet, and a system and image datastore. I am now adding hosts from a different vnet. want to make second host + vnet cluster but still use the same system and image data stores. What's the right way to do that.. just remove the datastores from the first cluster... they can't be in more than one cluster at a time, can they? Thanks for any suggestions. Steve Timm -- Steven C. Timm, Ph.D (630) 840-8525 t...@fnal.gov http://home.fnal.gov/~timm/ Office: Wilson Hall room 804 Fermilab Scientific Computing Division, Scientific Computing Facilities Quadrant., Experimental Computing Facilities Dept., Project Lead for Virtual Facility Project. ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- Ruben S. Montero, PhD Project co-Lead and Chief Architect OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | rsmont...@opennebula.org | @OpenNebula -- Ruben S. Montero, PhD Project co-Lead and Chief Architect OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | rsmont...@opennebula.org | @OpenNebula ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] clusters in 4.8
I know if I just take the vnet and the datastore out of the cluster, and have no clusters at all, then everything will work.. I was hoping to have a cluster structure of (host,vnet) pairings that could all share a common data store. However from the documentation, it looks like if your template requests any resource that is part of a cluster (vnet or image from datastore) then the scheduler will constrain you to resources that are part of that same cluster. Is that correct? Steve Timm From: Ruben S. Montero [rsmont...@opennebula.org] Sent: Friday, February 13, 2015 3:11 PM To: Steven C Timm Cc: users@lists.opennebula.org Subject: Re: [one-users] clusters in 4.8 Hi If both clusters has access to the same datastores, just move them out of the first cluster. When a datastore or network is not assigned to any cluster (cluster default) OpenNebula assumes it can be used with any host (no matter in which cluster is set). BTW, although you do not needed for your use case, 4.12 will come with extended VDC support to create complex provision scenarios. Basically you can define generic resource providers that aggregate any resource (cluster, host, network, datastores) more here http://opennebula.org/4-12-features-virtual-data-center-redesign/ Cheers On Fri, Feb 13, 2015 at 6:37 PM, Steven Timm t...@fnal.gov wrote: I have had my one4.8 host up for a while with a single cluster that has 150 hosts, one vnet, and a system and image datastore. I am now adding hosts from a different vnet. want to make second host + vnet cluster but still use the same system and image data stores. What's the right way to do that.. just remove the datastores from the first cluster... they can't be in more than one cluster at a time, can they? Thanks for any suggestions. Steve Timm -- Steven C. Timm, Ph.D (630) 840-8525 t...@fnal.gov http://home.fnal.gov/~timm/ Office: Wilson Hall room 804 Fermilab Scientific Computing Division, Scientific Computing Facilities Quadrant., Experimental Computing Facilities Dept., Project Lead for Virtual Facility Project. ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- Ruben S. Montero, PhD Project co-Lead and Chief Architect OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | rsmont...@opennebula.org | @OpenNebula ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] clusters in 4.8
Hi If both clusters has access to the same datastores, just move them out of the first cluster. When a datastore or network is not assigned to any cluster (cluster default) OpenNebula assumes it can be used with any host (no matter in which cluster is set). BTW, although you do not needed for your use case, 4.12 will come with extended VDC support to create complex provision scenarios. Basically you can define generic resource providers that aggregate any resource (cluster, host, network, datastores) more here http://opennebula.org/4-12-features-virtual-data-center-redesign/ Cheers On Fri, Feb 13, 2015 at 6:37 PM, Steven Timm t...@fnal.gov wrote: I have had my one4.8 host up for a while with a single cluster that has 150 hosts, one vnet, and a system and image datastore. I am now adding hosts from a different vnet. want to make second host + vnet cluster but still use the same system and image data stores. What's the right way to do that.. just remove the datastores from the first cluster... they can't be in more than one cluster at a time, can they? Thanks for any suggestions. Steve Timm -- Steven C. Timm, Ph.D (630) 840-8525 t...@fnal.gov http://home.fnal.gov/~timm/ Office: Wilson Hall room 804 Fermilab Scientific Computing Division, Scientific Computing Facilities Quadrant., Experimental Computing Facilities Dept., Project Lead for Virtual Facility Project. ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- Ruben S. Montero, PhD Project co-Lead and Chief Architect OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | rsmont...@opennebula.org | @OpenNebula ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] clusters in 4.8
OK here we go: VM in question is taking an image from image store 102 (currently in no cluster), vnet 0 routable private from cluster 100 cloud worker also a number of hosts, including hosts # 0 and 2, also part of cluster cloud worker VM stays pending for ever, hold reason is below.--it is requiring that cluster ID has to be 100. Same image and same datastore and same vnet outside of the cluster, work just fine. Seems like if I require any resource from the cluster, in this case a vnet, then all resources have to be in the cluster. Am I missing something? Steve Timm [root@fclheadgpvm01 one]# onevm show 1054 | more VIRTUAL MACHINE 1054 INFORMATION ID : 1054 NAME: CLI_PRIV_SLF6Vanilla-1054 USER: oneadmin GROUP : oneadmin STATE : PENDING LCM_STATE : LCM_INIT RESCHED : No START TIME : 02/13 17:44:52 END TIME: - DEPLOY ID : - VIRTUAL MACHINE MONITORING NET_RX : 0K USED MEMORY : 0K USED CPU: 0 NET_TX : 0K PERMISSIONS OWNER : um- GROUP : --- OTHER : --- VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 0 vdaSLF6Vanilla file NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 routable-private no br1 10.128.1.9 54:52:00:02:0d:09 USER TEMPLATE NPTYPE=NPERNLM SCHED_MESSAGE=Fri Feb 13 17:46:29 2015 : No system datastore meets SCHED_DS_REQ UIREMENTS: CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) SCHED_RANK=FREE_MEM SCHED_REQUIREMENTS=HYPERVISOR=\kvm\ HOSTNAME=\cloudworker*\ VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS=CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) CONTEXT=[ CTX_USER=PFVTRVI+PElEPjA8L0lEPjxHSUQ+MDwvR0lEPjxHUk9VUFM+PElEPjA8L0lEPjwvR1JP VVBTPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+b25lYWRtaW48L05BTUU+PFBBU1NXT1JEPi9E Qz1jb20vREM9RGlnaUNlcnQtR3JpZC9PPU9wZW5cMjBTY2llbmNlXDIwR3JpZC9PVT1TZXJ2aWNlcy9D Tj1mY2xoZWFkZ3B2bTAxLmZuYWwuZ292PC9QQVNTV09SRD48QVVUSF9EUklWRVI+eDUwOTwvQVVUSF9E UklWRVI+PEVOQUJMRUQ+MTwvRU5BQkxFRD48VEVNUExBVEU+PFRPS0VOX1BBU1NXT1JEPjwhW0NEQVRB [root@fclheadgpvm01 one]# onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system0M - - 0 sys -shared 1 default21.2G 85% - 0 img fs shared 2 files 21.2G 85% - 0 fil fs ssh 100 localnode - - - 0 sys -ssh 102 cloud_images 20T 75% - 2 img fs shared [root@fclheadgpvm01 one]# onevnet list ID USERGROUPNAMECLUSTERBRIDGE LEASES 0 oneadminoneadmin routable-privatecloudworke br1 8 2 oneadminoneadmin DynamicIP - br0 13 3 oneadminoneadmin StaticIP- br0 0 [root@fclheadgpvm01 one]# onehost list | more ID NAMECLUSTER RVM ALLOCATED_CPU ALLOCATED_MEM STAT 0 cloudworker1200 cloudwork 4400 / 800 (50%) 7.4G / 15.6G (47%) on 1 cloudworker1201 cloudwork 0 - - off 2 cloudworker1202 cloudwork 0 0 / 800 (0%)0K / 15.6G (0%) on From: Ruben S. Montero [rsmont...@opennebula.org] Sent: Friday, February 13, 2015 4:49 PM To: Steven C Timm Cc: users@lists.opennebula.org Subject: Re: [one-users] clusters in 4.8 Yes, you can do: Cluster A: Host_A0, Host_A1... + VNET_A0, VNET_A1... Cluster B: HostB0, HostB1... + VNET_B0, VNET_B1... Cluster Default: DS, DS_System Then a VM that uses VNET_A0 + DS would be scheduled to Cluster A. Note that using VNET_A0 constrain resources from Cluster A + Cluster Default. Cheers Ruben On Fri, Feb 13, 2015 at 10:42 PM, Steven C Timm t...@fnal.gov wrote: I know if I just take the vnet and the datastore out of the cluster, and have no clusters at all, then everything will work.. I was hoping to have a cluster structure of (host,vnet) pairings that could all share a common data
Re: [one-users] clusters in 4.8
One more followup: host 156 + vnet2 + ds 100/102, all outside the cluster, no problem host 156 + vnet2 + ds100/102, all in the cluster, no problem host 156 and vnet2 in the cluster, DS outside of the cluster, problem. SCHED_MESSAGE=Fri Feb 13 18:06:29 2015 : No system datastore meets SCHED_DS_REQUIREMENTS: CLUSTER_ID = 101 !(PUBLIC_CLOUD = YES) host 156 in the cluster, vnet2 and DS out of the cluster No error message but it never matches either. Fri Feb 13 18:24:29 2015 [Z0][HOST][D]: Discovered Hosts (enabled): 0 2 156 Fri Feb 13 18:24:29 2015 [Z0][SCHED][D]: VM 1058: Host 0 filtered out. It does not fulfill SCHED_REQUIREMENTS. Fri Feb 13 18:24:29 2015 [Z0][SCHED][D]: VM 1058: Host 2 filtered out. It does not fulfill SCHED_REQUIREMENTS. Fri Feb 13 18:24:29 2015 [Z0][SCHED][I]: Scheduling Results: Virtual Machine: 1058 PRI ID - HOSTS 1 156 PRI ID - DATASTORES 0 100 0 0 Fri Feb 13 18:24:29 2015 [Z0][SCHED][I]: VM 1058: No suitable System DS found for Host: 156. Filtering out host. Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 6:01 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 PS--if there are other vm's still launched and running from the time when the datastore used to be part of a cluster, could that confuse anything? Do I have to restart oned to clear anything up? Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 5:56 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 OK here we go: VM in question is taking an image from image store 102 (currently in no cluster), vnet 0 routable private from cluster 100 cloud worker also a number of hosts, including hosts # 0 and 2, also part of cluster cloud worker VM stays pending for ever, hold reason is below.--it is requiring that cluster ID has to be 100. Same image and same datastore and same vnet outside of the cluster, work just fine. Seems like if I require any resource from the cluster, in this case a vnet, then all resources have to be in the cluster. Am I missing something? Steve Timm [root@fclheadgpvm01 one]# onevm show 1054 | more VIRTUAL MACHINE 1054 INFORMATION ID : 1054 NAME: CLI_PRIV_SLF6Vanilla-1054 USER: oneadmin GROUP : oneadmin STATE : PENDING LCM_STATE : LCM_INIT RESCHED : No START TIME : 02/13 17:44:52 END TIME: - DEPLOY ID : - VIRTUAL MACHINE MONITORING NET_RX : 0K USED MEMORY : 0K USED CPU: 0 NET_TX : 0K PERMISSIONS OWNER : um- GROUP : --- OTHER : --- VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 0 vdaSLF6Vanilla file NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 routable-private no br1 10.128.1.9 54:52:00:02:0d:09 USER TEMPLATE NPTYPE=NPERNLM SCHED_MESSAGE=Fri Feb 13 17:46:29 2015 : No system datastore meets SCHED_DS_REQ UIREMENTS: CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) SCHED_RANK=FREE_MEM SCHED_REQUIREMENTS=HYPERVISOR=\kvm\ HOSTNAME=\cloudworker*\ VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS=CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) CONTEXT=[ CTX_USER=PFVTRVI+PElEPjA8L0lEPjxHSUQ+MDwvR0lEPjxHUk9VUFM+PElEPjA8L0lEPjwvR1JP VVBTPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+b25lYWRtaW48L05BTUU+PFBBU1NXT1JEPi9E Qz1jb20vREM9RGlnaUNlcnQtR3JpZC9PPU9wZW5cMjBTY2llbmNlXDIwR3JpZC9PVT1TZXJ2aWNlcy9D Tj1mY2xoZWFkZ3B2bTAxLmZuYWwuZ292PC9QQVNTV09SRD48QVVUSF9EUklWRVI+eDUwOTwvQVVUSF9E UklWRVI+PEVOQUJMRUQ+MTwvRU5BQkxFRD48VEVNUExBVEU+PFRPS0VOX1BBU1NXT1JEPjwhW0NEQVRB [root@fclheadgpvm01 one]# onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system0M - - 0 sys -shared 1 default21.2G 85% - 0 img fs shared 2 files 21.2G 85% - 0 fil fs ssh 100 localnode - - - 0 sys -ssh 102 cloud_images 20T 75% - 2 img fs shared [root@fclheadgpvm01 one]# onevnet list ID USERGROUPNAMECLUSTERBRIDGE LEASES 0 oneadminoneadmin routable-privatecloudworke br1 8 2 oneadminoneadmin DynamicIP - br0 13 3 oneadminoneadmin StaticIP- br0 0 [root@fclheadgpvm01 one]# onehost list | more ID NAMECLUSTER RVM ALLOCATED_CPU ALLOCATED_MEM STAT 0 cloudworker1200
Re: [one-users] clusters in 4.8
PS--if there are other vm's still launched and running from the time when the datastore used to be part of a cluster, could that confuse anything? Do I have to restart oned to clear anything up? Steve Timm From: Steven C Timm Sent: Friday, February 13, 2015 5:56 PM To: Ruben S. Montero Cc: users@lists.opennebula.org Subject: RE: [one-users] clusters in 4.8 OK here we go: VM in question is taking an image from image store 102 (currently in no cluster), vnet 0 routable private from cluster 100 cloud worker also a number of hosts, including hosts # 0 and 2, also part of cluster cloud worker VM stays pending for ever, hold reason is below.--it is requiring that cluster ID has to be 100. Same image and same datastore and same vnet outside of the cluster, work just fine. Seems like if I require any resource from the cluster, in this case a vnet, then all resources have to be in the cluster. Am I missing something? Steve Timm [root@fclheadgpvm01 one]# onevm show 1054 | more VIRTUAL MACHINE 1054 INFORMATION ID : 1054 NAME: CLI_PRIV_SLF6Vanilla-1054 USER: oneadmin GROUP : oneadmin STATE : PENDING LCM_STATE : LCM_INIT RESCHED : No START TIME : 02/13 17:44:52 END TIME: - DEPLOY ID : - VIRTUAL MACHINE MONITORING NET_RX : 0K USED MEMORY : 0K USED CPU: 0 NET_TX : 0K PERMISSIONS OWNER : um- GROUP : --- OTHER : --- VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 0 vdaSLF6Vanilla file NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 routable-private no br1 10.128.1.9 54:52:00:02:0d:09 USER TEMPLATE NPTYPE=NPERNLM SCHED_MESSAGE=Fri Feb 13 17:46:29 2015 : No system datastore meets SCHED_DS_REQ UIREMENTS: CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) SCHED_RANK=FREE_MEM SCHED_REQUIREMENTS=HYPERVISOR=\kvm\ HOSTNAME=\cloudworker*\ VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS=CLUSTER_ID = 100 !(PUBLIC_CLOUD = YES) CONTEXT=[ CTX_USER=PFVTRVI+PElEPjA8L0lEPjxHSUQ+MDwvR0lEPjxHUk9VUFM+PElEPjA8L0lEPjwvR1JP VVBTPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+b25lYWRtaW48L05BTUU+PFBBU1NXT1JEPi9E Qz1jb20vREM9RGlnaUNlcnQtR3JpZC9PPU9wZW5cMjBTY2llbmNlXDIwR3JpZC9PVT1TZXJ2aWNlcy9D Tj1mY2xoZWFkZ3B2bTAxLmZuYWwuZ292PC9QQVNTV09SRD48QVVUSF9EUklWRVI+eDUwOTwvQVVUSF9E UklWRVI+PEVOQUJMRUQ+MTwvRU5BQkxFRD48VEVNUExBVEU+PFRPS0VOX1BBU1NXT1JEPjwhW0NEQVRB [root@fclheadgpvm01 one]# onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system0M - - 0 sys -shared 1 default21.2G 85% - 0 img fs shared 2 files 21.2G 85% - 0 fil fs ssh 100 localnode - - - 0 sys -ssh 102 cloud_images 20T 75% - 2 img fs shared [root@fclheadgpvm01 one]# onevnet list ID USERGROUPNAMECLUSTERBRIDGE LEASES 0 oneadminoneadmin routable-privatecloudworke br1 8 2 oneadminoneadmin DynamicIP - br0 13 3 oneadminoneadmin StaticIP- br0 0 [root@fclheadgpvm01 one]# onehost list | more ID NAMECLUSTER RVM ALLOCATED_CPU ALLOCATED_MEM STAT 0 cloudworker1200 cloudwork 4400 / 800 (50%) 7.4G / 15.6G (47%) on 1 cloudworker1201 cloudwork 0 - - off 2 cloudworker1202 cloudwork 0 0 / 800 (0%)0K / 15.6G (0%) on From: Ruben S. Montero [rsmont...@opennebula.org] Sent: Friday, February 13, 2015 4:49 PM To: Steven C Timm Cc: users@lists.opennebula.org Subject: Re: [one-users] clusters in 4.8 Yes, you can do: Cluster A: Host_A0, Host_A1... + VNET_A0, VNET_A1... Cluster B: HostB0, HostB1... + VNET_B0, VNET_B1... Cluster Default: DS, DS_System Then a VM that uses VNET_A0 + DS would be scheduled to Cluster A. Note that using VNET_A0 constrain resources from Cluster A + Cluster Default. Cheers Ruben On Fri, Feb 13, 2015 at 10:42 PM, Steven C Timm t...@fnal.gov wrote: I know if I just take the vnet and the datastore out of the cluster, and have no clusters at all, then everything will work.. I was hoping to have a cluster structure of (host,vnet) pairings that could all share a common data store. However from the documentation, it looks like if your template requests any resource that is part of a cluster (vnet or image from datastore) then the scheduler will constrain you to resources that are part of that same cluster. Is that correct? Steve Timm
