Re: 请问cloudstack虚拟机支持macos的系统吗？
这个跟支持的Hypervisor及版本相关。4.2支持比较新的Hypervisor（XenServer6.2，VMWare5.1），应该是新的版本里支持MacOS。 你也可以查一下DB的表看一下对应CS版本支持GuestOS的情况： cloud.hypervisor_capacities和cloud.guest_os 2013/10/15 WXR 474745...@qq.com 请问需要使用什么样的cloudstack版本，使用什么样的hypervisor才能支持虚拟机里安装macos的系统呢，安装好以后使用上会有什么问题吗？ 我之前安装4.2时发现系统模板制作选项中有macos的系统，现在用的4.1版本里面没有这个选项。 -- Gavin
RE: Upgrade from 4.0.x to 4.2.0?
谢谢，我后面测试了下直接从4.0升到4.2（参考4.1升4.2）后，上面的虚拟机各个组件都很正常，具体细小功能还待测试！ Date: Sun, 13 Oct 2013 19:07:42 +0800 Subject: Re: Upgrade from 4.0.x to 4.2.0? From: gavin@gmail.com To: users-cn@cloudstack.apache.org 我已完成4.0到4.2的升级。 首先要将4.0升级到4.1，可根据4.1的Release notes进行 【1】 然后再将4.1升级到4.2，根据4.2的Release notes进行【2】 因此你手上要有4.1和4.2的安装包，可以在我的共享里找到： 4.1: http://pan.baidu.com/s/1zJCtM 4.2: http://pan.baidu.com/s/1zLbhs 【1】： http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Release_Notes/upgrade-instructions.html#upgrade-from-4.0-to-4.1 【2】： http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Release_Notes/upgrade-instructions.html#upgrade-from-4.0-to-4.1 2013/10/8 王耀锋 wilc...@hotmail.com Hi， 在官网上只看见了4.1、3.0、2.2版本的cloudstack升级到4.2的步骤方法，但却没有4.0版本的升级方法。4.0升级到4.2可以使用4.1版本的升级方法吗？ 还是有别的方法？ -- Gavin
Re: cloudstack nat是用iptables实现的吗？怎么看不到nat的ip地址
virtual router上iptables的命令貌似是： iptables-persistent 2013/10/15 Wei ZHOU ustcweiz...@gmail.com 你是在virtual router上用的iptables？ 用iptables -L是看不到的。 要用iptables -t nat -L 或者iptables-save 2013/10/15 toudsf 18600601...@163.com 2013-10-15 toudsf -- Gavin
????RBD??????????????????????????????
?? cloudstack4.1.0 hypervisor??kvm,qemu-kvm1,2.0()??libvirt1.1.2() ceph0.67.3??yum?? 1.??rbd??windows 2003,??rbd 2.windows 2003nfsrbdrbd nfs 3.linuxnfs??rbdrbd?? 4.linux?? 5.windows0x077
Re: 使用apikey访问实例console失败
你能把你的SecretKey贴出来吗？这样我也试一下生产Signature。
encodeBase64URLSafeString应该都会调到的。
2013/10/11 yao hu huyao...@gmail.com
1. 问题现象
用apikey访问实例console时，浏览器提示无效的session或者api key，导致访问失败。
测试版本：win7+cygwin+xenserver 6.1.0+cloudstack 4.1.1
测试操作步骤：
1. 用api key和secret key构造一个访问实例console的url
http://localhost:8080/client/console?cmd=accessvm=b194369f-e0d4-45d8-a50f-09ec51095e68apikey=fmS7oyThP6MGxN5X_CgeOCxQIqgTu5QFDz46r2Pv5kLp88EYYBquSu6_3s3d9MXdbUHPpxj5qDDy1jvhEpQWvQsignature=y3dNHn580NJiCVRGwrBTR4JHImo%3D
2. 把上面构造的url粘贴到浏览器地址栏，并访问，提示如下信息
[image: 内嵌图片 1]
2. 问题分析
问题出现后，一开始是怀疑构造url的脚本有错，后面又尝试构造其它api的url来验证脚本是否正确。如构造调用listAccounts API的url
，其url如下：
http://localhost:8080/client/api?command=listAccountsapikey=fmS7oyThP6MGxN5X_CgeOCxQIqgTu5QFDz46r2Pv5kLp88EYYBquSu6_3s3d9MXdbUHPpxj5qDDy1jvhEpQWvQsignature=ALhJtw%2Bzi7Rcmo%2Bkk3xH3cTJgp4%3D
在浏览器中访问该url后，能正确返回结果，这就说明构造url的脚本是没有错的。
接着，调试了访问实例console这部分的源代码，并定位到失败的地方是在ConsoleProxyServlet.java文件的
verifyRequest函数，其主要代码如下：
private boolean verifyRequest(MapString, Object[] requestParameters) {
try {
...省略部分代码
unsignedRequest = unsignedRequest.toLowerCase();
Mac mac = Mac.getInstance(HmacSHA1);
SecretKeySpec keySpec = new SecretKeySpec(secretKey.getBytes(),
HmacSHA1);
mac.init(keySpec);
mac.update(unsignedRequest.getBytes());
byte[] encryptedBytes = mac.doFinal();
String computedSignature =
Base64.encodeBase64URLSafeString(encryptedBytes);
boolean equalSig = signature.equals(computedSignature);
if (!equalSig) {
s_logger.debug(User signature: + signature + is not
equaled to computed signature: + computedSignature);
}
... 省略部分代码
return equalSig;
} catch (Exception ex) {
s_logger.error(unable to verifty request signature, ex);
}
return false;
}
这个函数中红色字体部分在验证签名时失败。其中，signature是客户端url中传进来的参数，computedSignature是服务端根据api
key和secret key计算出来的。signature与computedSignature比较时不相同，导致函数返回false。
由于用api key调用其它api时是能正确得到结果的，故又调试了其它api的调用流程，并定位到其验证signature的代码，在文件
ApiServer.java的verifyRequest函数中，其主要代码如下：
public boolean verifyRequest(MapString, Object[] requestParameters, Long
userId) throws ServerApiException {
try {
...省略部分代码
unsignedRequest = unsignedRequest.toLowerCase();
Mac mac = Mac.getInstance(HmacSHA1);
SecretKeySpec keySpec = new
SecretKeySpec(secretKey.getBytes(), HmacSHA1);
mac.init(keySpec);
mac.update(unsignedRequest.getBytes());
byte[] encryptedBytes = mac.doFinal();
String computedSignature =
Base64.encodeBase64String(encryptedBytes);
boolean equalSig = signature.equals(computedSignature);
if (!equalSig) {
s_logger.debug(User signature: + signature + is
not equaled to computed signature: + computedSignature);
}
...省略部分代码
return equalSig;
} catch (Exception ex) {
s_logger.error(unable to verifty request signature, ex);
}
return false;
}
这个函数的红色部分对signature进行了验证，signature与computedSignature进行比较时相同，故能通过验证，函数返回
true。
仔细比较这两个verifyRequest函数验证signature部分的代码，我们可以发现前面的verifyRequest函数在计算
computedSignature时，使用的是Base64.encodeBase64URLSafeString
函数，而后面那个使用的是Base64.encodeBase64String，就这说明，客户端生成的signature可以通过
Base64.encodeBase64String的验证。接着，把Base64.encodeBase64URLSafeString
替换为Base64.encodeBase64String，重新编译源代码并部署，再次通过api key来访问实例console，这次是能成功访问的。
为何这两个verifyRequest函数中使用两个不同的encode方法？是bug？还是用
Base64.encodeBase64URLSafeString有特别的意义？
--
Gavin
NullPointerException on agent while remounting primary storage
Hi all. I'm using CS 4.2.0 / CentOS 6.4/KVM and I faced the following problem: -no new virtalmachines are created on one of hypervisor servers -there are NullPointerExceptions in agent log on problem server -virsh shows no pools After doing some debugging I was able to repeat this bug manually(see below), but still have no idea how it occured initially. I've filed it to https://issues.apache.org/jira/browse/CLOUDSTACK-4867 Here are steps to reproduce this bug: I have two primary storages mounted via NFS: 10.6.20.1:/GIGO1/p1 7.2T 90G 7.1T 2% /mnt/c59065c8-4d4c-3276-9d12-f170e4cd445e 10.6.20.2:/GIGO2/p2 7.3T 31G 7.3T 1% /mnt/bd32f762-a1f0-3a65-b9bc-fdb6d1d681b5 You should have at least one VM running from NFS storage to reproduce this issue. [root@ad111 libvirt]# virsh pool-list Name State Autostart - 63cacc3d-185f-45f0-981c-5c4d9d79d665 active no bd32f762-a1f0-3a65-b9bc-fdb6d1d681b5 active no c59065c8-4d4c-3276-9d12-f170e4cd445e active no for now all is ok, I can see localstorage and two NFS shares in pool-list Let's restart libvirtd: [root@ad111 ~]# /etc/init.d/libvirtd restart Stopping libvirtd daemon: [ OK ] Starting libvirtd daemon: [ OK ] And pools are gone: [root@ad111 ~]# virsh pool-list Name State Autostart - [root@ad111 ~]# According to agent log it tries to add pool to libvirt but it fails because libvirt tries to mount share (which is already mounted) upon adding it: [root@ad111 ~]# cat _EOF pool.xml pool type='netfs' namec59065c8-4d4c-3276-9d12-f170e4cd445e/name uuidc59065c8-4d4c-3276-9d12-f170e4cd445e/uuid capacity unit='bytes'7869416079360/capacity allocation unit='bytes'95770640384/allocation available unit='bytes'7773645438976/available source host name='10.6.20.1'/ dir path='/GIGO1/p1'/ format type='auto'/ /source target path/mnt/c59065c8-4d4c-3276-9d12-f170e4cd445e/path permissions mode0755/mode owner-1/owner group-1/group /permissions /target /pool _EOF [root@ad111 ~]# virsh pool-create pool.xml error: Failed to create pool from pool.xml error: Requested operation is not valid: Target '/mnt/c59065c8-4d4c-3276-9d12-f170e4cd445e' is already mounted Agent loops in java.lang.NullPointerExceptions, restart does not help. As a result, no new VMs could be created on this host. I was able to resolve this issue next way: -migrated all vms to another node -switched on maintenance mode on the problem host -umount all NFS shares -switched off maintenance mode on the problem host Logs: 2013-10-14 15:25:29,770 DEBUG [cloud.agent.Agent] (agentRequest-Handler-3:null) Processing command: com.cloud.agent.api.GetVmStatsCommand 2013-10-14 15:25:29,771 DEBUG [kvm.resource.LibvirtConnection] (agentRequest-Handler-3:null) Connection with libvirtd is broken, due to Cannot write data: Broken pipe 2013-10-14 15:25:33,091 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Processing command: com.cloud.agent.api.GetHostStatsCommand 2013-10-14 15:25:33,092 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-4:null) Executing: /bin/bash -c idle=$(top -b -n 1|grep Cpu\(s\):|cut -d% -f4|cut -d, -f2);echo $idle 2013-10-14 15:25:33,224 DEBUG [cloud.agent.Agent] (agentRequest-Handler-5:null) Processing command: com.cloud.agent.api.GetStorageStatsCommand 2013-10-14 15:25:33,228 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-5:null) can't get storage pool org.libvirt.LibvirtException: Storage pool not found: no pool with matching uuid at org.libvirt.ErrorHandler.processError(Unknown Source) at org.libvirt.Connect.processError(Unknown Source) at org.libvirt.Connect.storagePoolLookupByUUIDString(Unknown Source) at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePool(LibvirtStorageAdaptor.java:363) at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePool(KVMStoragePoolManager.java:104) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2466) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1230) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:679) 2013-10-14 15:25:33,236 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-5:null) createStoragePool didn't find existing running pool: org.libvirt.LibvirtException:
incorrect cpu usage values in dashboard
Hi all. I'm using CS 4.2.0 / CentOS 6.4/KVM and I faced the following problem: If cpu.overprovisioning.factor for cluster is being changed, dashboard reports incorrect values, unless all vms are restarted (stop/start). I.e. I configured cluster and set cpu.overprovisioning.factor to 6 and started a number of VMS: http://thesuki.org/temp/ss/2013-10-15_10-59-43.png http://thesuki.org/temp/ss/2013-10-15_11-00-05.png http://thesuki.org/temp/ss/2013-10-15_11-00-40.png Current usage is reported correctly. Further steps to reproduce bug: change cpu.overprovisioning.factor to 12 at cluster settings: http://thesuki.org/temp/ss/2013-10-15_11-01-06.png You will see that cpu current usage hasn't changed. http://thesuki.org/temp/ss/2013-10-15_11-01-25.png Wait for 5-10 minutes and you will see that cpu usage was doubled(in this test case some VMs were shut down, so the values do not differ at exactly 2х. : http://thesuki.org/temp/ss/2013-10-15_11-06-03.png If vm is stopped and started, then it's consumed CPU is reported correctly. If you will stop/start all vms (including system vms/virtual routers), then you will see true CPU usage in dashboard. I've submitted a bug at https://issues.apache.org/jira/browse/CLOUDSTACK-4868 -- Regards, Valery http://protocol.by/slayer
Re: incorrect cpu usage values in dashboard
Hi Valery, you will see incorrect values until the capacity checker runs again. By default i think it runs every 5 min. you can change the interval at which capacity checker runs by changing the capacity.check.period global config. -Bharat. On Oct 15, 2013, at 1:56 PM, Valery Ciareszka valery.teres...@gmail.com wrote: Hi all. I'm using CS 4.2.0 / CentOS 6.4/KVM and I faced the following problem: If cpu.overprovisioning.factor for cluster is being changed, dashboard reports incorrect values, unless all vms are restarted (stop/start). I.e. I configured cluster and set cpu.overprovisioning.factor to 6 and started a number of VMS: http://thesuki.org/temp/ss/2013-10-15_10-59-43.png http://thesuki.org/temp/ss/2013-10-15_11-00-05.png http://thesuki.org/temp/ss/2013-10-15_11-00-40.png Current usage is reported correctly. Further steps to reproduce bug: change cpu.overprovisioning.factor to 12 at cluster settings: http://thesuki.org/temp/ss/2013-10-15_11-01-06.png You will see that cpu current usage hasn't changed. http://thesuki.org/temp/ss/2013-10-15_11-01-25.png Wait for 5-10 minutes and you will see that cpu usage was doubled(in this test case some VMs were shut down, so the values do not differ at exactly 2х. : http://thesuki.org/temp/ss/2013-10-15_11-06-03.png If vm is stopped and started, then it's consumed CPU is reported correctly. If you will stop/start all vms (including system vms/virtual routers), then you will see true CPU usage in dashboard. I've submitted a bug at https://issues.apache.org/jira/browse/CLOUDSTACK-4868 -- Regards, Valery http://protocol.by/slayer
Re: incorrect cpu usage values in dashboard
Hi, Bharat No, I see incorrect values AFTER the capacity checker runs again. During first 5 minutes after changes values are correct. On Tue, Oct 15, 2013 at 12:29 PM, Bharat Kumar bharat.ku...@citrix.comwrote: Hi Valery, you will see incorrect values until the capacity checker runs again. By default i think it runs every 5 min. you can change the interval at which capacity checker runs by changing the capacity.check.period global config. -Bharat. On Oct 15, 2013, at 1:56 PM, Valery Ciareszka valery.teres...@gmail.com wrote: Hi all. I'm using CS 4.2.0 / CentOS 6.4/KVM and I faced the following problem: If cpu.overprovisioning.factor for cluster is being changed, dashboard reports incorrect values, unless all vms are restarted (stop/start). I.e. I configured cluster and set cpu.overprovisioning.factor to 6 and started a number of VMS: http://thesuki.org/temp/ss/2013-10-15_10-59-43.png http://thesuki.org/temp/ss/2013-10-15_11-00-05.png http://thesuki.org/temp/ss/2013-10-15_11-00-40.png Current usage is reported correctly. Further steps to reproduce bug: change cpu.overprovisioning.factor to 12 at cluster settings: http://thesuki.org/temp/ss/2013-10-15_11-01-06.png You will see that cpu current usage hasn't changed. http://thesuki.org/temp/ss/2013-10-15_11-01-25.png Wait for 5-10 minutes and you will see that cpu usage was doubled(in this test case some VMs were shut down, so the values do not differ at exactly 2х. : http://thesuki.org/temp/ss/2013-10-15_11-06-03.png If vm is stopped and started, then it's consumed CPU is reported correctly. If you will stop/start all vms (including system vms/virtual routers), then you will see true CPU usage in dashboard. I've submitted a bug at https://issues.apache.org/jira/browse/CLOUDSTACK-4868 -- Regards, Valery http://protocol.by/slayer -- Regards, Valery http://protocol.by/slayer
[EVENT] Call For Participation - Open Source India, Nov 11/13
[Apologies for cross-posting] Hi Guys, There is an invitation for the CloudStack community to participate at Open Source India event which is happening on Nov 11-13 at NIMHANS, Bangalore. Slots are available for: - Tutorial sessions - Mini Conf / Meetup - Speaking Slots If anyone would like to participate in the event, please reply at the earliest. Event details at http://osidays.com/osidays/ -- @shankerbalan M: +91 98860 60539 | O: +91 (80) 67935867 shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, Bangalore - 560 055 CloudStack Bootcamp Training on 27/28 November, Bangalore http://www.shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Cloudstack 4.2 training
We've been working hard and now have updated our CloudStack Bootcamp Course to version 4.2. We also now have an online (instructor led) version of the course, running across 5 days (8-12am PST, 12-3pm EST) Details and booking are here: http://www.shapeblue.com/cloudstack-training/ I am VERY conscious that this list is not for any form of promotion, etc and never usually put things like this on the list, but there's been some discussions recently about the need for ACS training etc so I thought I'd update everybody that this is now available Kind Regards Giles Giles Sirett CEO [Description: Mail Logo Bottom Align] D: +44 20 3603 0541 | S: +44 20 3603 0540 | M: +44 796 111 2055 giles.sir...@shapeblue.commailto:giles.sir...@shapeblue.com | www.shapeblue.comhttp://www.shapeblue.com/ | Twitter:@shapeBluehttps://twitter.com/#!/shapeblue ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS Apache CloudStack Bootcamp training courses: **NEW!** CloudStack 4.2 traininghttp://www.shapeblue.com/cloudstack-bootcamp-training-course/ 13/14 November, Londonhttp://www.shapeblue.com/cloudstack-bootcamp-training-course/ 09-13 December, GLOBAL. Instructor led, On-linehttp://www.shapeblue.com/cloudstack-bootcamp-training-course/ 27/28 November, Bangalorehttp://www.shapeblue.com/cloudstack-bootcamp-training-course/ 08/09 January 2014, Londonhttp://www.shapeblue.com/cloudstack-bootcamp-training-course/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Is this how we should be building debian packages for a vmware centric cloudstack?
Hi All, Since I'm trying to build the non-oss version from the most recent 4.2 Installation Guide on http://jenkins.buildacloud.org I followed these steps: $ sudo apt-get update $ sudo apt-get install python-software-properties $ sudo add-apt-repository ppa:natecarlson/maven3 $ sudo apt-get update $ sudo apt-get install ant debhelper openjdk-6-jdk tomcat6 libws-commons-util-java genisoimage python-mysqldb libcommons-codec-java libcommons-httpclient-java liblog4j1.2-java maven3 $ mvn3 -P deps $ dpkg-buildpackage -uc -us The docs state these packages will be generated: cloud-agent_4.0.0-incubating_amd64.deb cloud-agent-deps_4.0.0-incubating_amd64.deb cloud-agent-libs_4.0.0-incubating_amd64.deb cloud-awsapi_4.0.0-incubating_amd64.deb cloud-cli_4.0.0-incubating_amd64.deb cloud-client_4.0.0-incubating_amd64.deb cloud-client-ui_4.0.0-incubating_amd64.deb cloud-core_4.0.0-incubating_amd64.deb cloud-deps_4.0.0-incubating_amd64.deb cloud-python_4.0.0-incubating_amd64.deb cloud-scripts_4.0.0-incubating_amd64.deb cloud-server_4.0.0-incubating_amd64.deb cloud-setup_4.0.0-incubating_amd64.deb cloud-system-iso_4.0.0-incubating_amd64.deb cloud-usage_4.0.0-incubating_amd64.deb cloud-utils_4.0.0-incubating_amd64.deb But, in fact the only packages that are generated are ../cloudstack-agent_4.2.0_all.deb ../cloudstack-awsapi_4.2.0_all.deb ../cloudstack-cli_4.2.0_all.deb ../cloudstack-common_4.2.0_all.deb ../cloudstack-docs_4.2.0_all.deb ../cloudstack-management_4.2.0_all.deb ../cloudstack-usage_4.2.0_all.deb And by the way, this is after I followed the instructions on https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack# for updating the deps directory with respect to vhdutil and others like vim25_51 etc. Is this expected? Second point...After it's all daid and done and I follow the rest of the installation enstructions, I still end up getting a recurring exception: 2013-10-15 14:32:55,586 WARN [agent.manager.AgentManagerImpl] (ClusteredAgentManager Timer:null) Unable to find class com.cloud.hypervisor.vmware.resource.VmwareResource java.lang.ClassNotFoundException: com.cloud.hypervisor.vmware.resource.VmwareResource at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1680) at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:188) at com.cloud.agent.manager.AgentManagerImpl.loadResourcesWithoutHypervisor(AgentManagerImpl.java:667) at com.cloud.agent.manager.AgentManagerImpl.loadDirectlyConnectedHost(AgentManagerImpl.java:741) Management-server.log file attached. Thanks in advance to anyone who can provide insights; I'be been battling this dragon for a week. I tried including my log file, but I think it's too big; the apache mailer barfed.
Traffic Type : public gone when using SG and advanced network
The traffic type public is gone when using SG and advanced network in 4.2 How I'm supposed to use the cloudstack loadbalancing (VR) in this constellation ? Bjoern
Upgrade from 4.1.1 to 4.2 failed. Could not restart system VMs. Roll back to 4.1.1 backup initially failed: could not start management service. Finally got it to work. I hope this helps someone else a
I upgraded my 4 host private dev cloud running on CentOS 6.4 x86_64 from
version 4.1.1 to 4.2 per upgrade instructions. I'm just using 4 HP Z 600
workstations (box 1 has two nics, the cloudstack-management server, the
mysql db, primary and secondary storage and a cloudstack-agent, and boxes 2
- 4 each just have primary storage and a cloudstack-agent). It's nothing
fancy, but it's been working perfectly now for months. All seemed to go
very smoothly except for the very last step:
{code}
nohup cloudstack-sysvmadm -d cs-east-dev1 -u root -p support -a sysvm.log
21
{code}
It could not restart the system vms for some reason. (I do not have the
original sysvm.log as I've now been playing with this failed upgrade for
two days). However, here is the sysvm.log from the very last attempt:
{code}
nohup: ignoring input
Stopping and starting 1 secondary storage vm(s)...
curl: (7) couldn't connect to host
ERROR: Failed to stop secondary storage vm with id 14
Done stopping and starting secondary storage vm(s)
Stopping and starting 0 console proxy vm(s)...
No running console proxy vms found
Stopping and starting 1 running routing vm(s)...
curl: (7) couldn't connect to host
2
Done restarting router(s).
{code}
As I mentioned above, I've been playing around with this for 2 days now and
actually got the 4.2 management server to finally start, but none of the
System VMs worked. I even restarted all of the CentOS hosts (which was a
huge hassle), but that didn't seem to help at all. I eventually found this
bug: https://issues.apache.org/jira/browse/CLOUDSTACK-4826 which seemed
similar to my issues.
I was also experiencing a strange issue where all 10 of my private
Management IP Addresses were used for some reason. Every time I restarted
the cloudstack-management service, 2 more IPs were taken up, but none ever
got released. Also since the System VMs would not start, my secondary
storage wouldn't start up either.
About an hour ago I gave up on 4.2 and I decided to roll back to 4.1.1 on
all 4 workstations. First I shutdown all VM instances, then stopped all
cloudstack-* services on all 4 workstations, and then ran a yum downgrade
cloudstack-* on all 4 workstations:
{code}
[root@cs-east-dev1 yum.repos.d]# yum downgrade cloudstack-*
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Downgrade Process
Loading mirror speeds from cached hostfile
* base: centos.mirror.nac.net
* extras: mirror.trouble-free.net
* rpmforge: mirror.us.leaseweb.net
* updates: mirror.cogentco.com
Resolving Dependencies
-- Running transaction check
--- Package cloudstack-agent.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-agent.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-awsapi.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-awsapi.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-cli.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-cli.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-common.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-common.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-management.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-management.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-usage.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-usage.x86_64 0:4.2.0-1.el6 will be erased
-- Finished Dependency Resolution
Dependencies Resolved
=
Package Arch
Version Repository
Size
=
Downgrading:
cloudstack-agent x86_64
4.1.1-0.el6 cloudstack
37 M
cloudstack-awsapi x86_64
4.1.1-0.el6 cloudstack
56 M
cloudstack-clix86_64
4.1.1-0.el6 cloudstack
32 k
cloudstack-common x86_64
4.1.1-0.el6 cloudstack
92 M
cloudstack-management x86_64
4.1.1-0.el6 cloudstack
55 M
cloudstack-usage x86_64
4.1.1-0.el6 cloudstack
37 M
Transaction Summary
=
Downgrade 6 Package(s)
Total download size: 278 M
Is this ok [y/N]: y
Downloading Packages:
(1/6): cloudstack-agent-4.1.1-0.el6.x86_64.rpm
| 37 MB
00:13
(2/6):
client issue - no tomcat deployment
Hi I thought I had meticulously followed the instructions here http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Quick_Install_Guide/chap-qig-Config.html But when I get to the last step about launching the client over http:// hostname:8080/client Nothing is listening on the port. A guess is port 8080 is tomcat thus I tried service tomcat6 starts and tomcat listens on the port. In webapps or work nothing is deployed. In conf/Catalina/localhost there is no reference to an external context. So somehow seems to me a step is missing in the instructions (or I missed it) which 1. launches something on port 8080 - which is probably the tomcat 2. deploys the app or otherwise configures tomcat to reference the client. Any clues gratefully received. Thanks in advance. Kevin
Re: ICMP to system VMs?
Yeah your right. I got ICMP opened on the firewall and it didn't fix my problem. Turned out the load balancing from SSVM to CS server had a short TCP timeout and was causing havoc. Thanks! Best regards, David Comerford Tel: +353 87 1238295 Email: davest...@gmail.com Website: http://dave.ie GPG key: http://gpg.dave.ie On 14 October 2013 17:30, Clayton Weise cwe...@keyinfo.com wrote: What CS considers a ping isn't just ICMP from my understanding. It also entails a few other healthchecks related to the agent. There's a nifty document here and CloudStack starts on page 3. http://support.citrix.com/servlet/KbServlet/download/2389-102-654859/CitrixPorts_by_Port_1103.pdf -Clayton -Original Message- From: David Comerford [mailto:davest...@gmail.com] Sent: Friday, October 11, 2013 9:18 AM To: users@cloudstack.apache.org Subject: ICMP to system VMs? Hi, Does CS need to be able to ping the system vm's? I'm noticing a lot of this in the logs but everything is working fine. [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-14:null) PingInvestigator was able to determine host 61 is in Disconnected [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) The state determined is Disconnected [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Agent is disconnected but the host is still up: 61-s-400-VM Regards, David Comerford Tel: +353 87 1238295 Email: davest...@gmail.com Website: http://dave.ie GPG key: http://gpg.dave.ie
RE: CloudStack Bay Area Meetup
Adding the users mailing list too -Original Message- From: Amogh Vasekar [mailto:amogh.vase...@citrix.com] Sent: Monday, October 14, 2013 11:08 AM To: d...@cloudstack.apache.org Subject: CloudStack Bay Area Meetup Hi All, The CloudStack Bay Area meet-up will be held tomm. (10/15) with Juniper doing a Contrail integration demo, followed by a DevCloud intro session to help new CloudStack developers. More details on http://www.meetup.com/CloudStack-SF-Bay-Area-Users- Group/events/141814852/ Do join in if around! Thanks, Amogh
FW: [ACS43] QA and Test Tasks
Forwarded from Dev community ML -Original Message- From: Sudha Ponnaganti [mailto:sudha.ponnaga...@citrix.com] Sent: Tuesday, October 15, 2013 4:09 PM To: d...@cloudstack.apache.org Subject: [ACS43] QA and Test Tasks Hi All, 43 is getting started now and it is great opportunity to participate and contribute towards ACS 43 Validation if you have interest in testing and automation related areas. Below are the tasks and I have posted a task sheet to sign up. Pl review and see if you would like to sign up. There are several areas that we need contributors and I have listed them below. Pl review and sign up if you are interested in any of these activities *Feature validation List https://issues.apache.org/jira/issues/?jql=project%20%3D%20CLOUDSTACK%20AND%20issuetype%20in%20%28Improvement%2C%20%22New%20Feature%22%29%20AND%20fixVersion%20%3D%20%224.3.0%22 * Upgrade validation - will publish compatibility matrix but below are basic upgrades 4.0-4.3 (P3) 4.0.x-4.3(P3) 4.1-4.3 (P3) 4.1.x - 4.3 (P2) 4.2-4.3 (P1) 4.2.1-4.3 (P1) *Defect validation for ACS 4.3 ( there are already resolved defects pending for validation and one can get started right away on these *Automation ( Any 4.2 + features can be picked up for automation) If you are interested, Pl do sign up for these tasks @ https://cwiki.apache.org/confluence/display/CLOUDSTACK/QA+4.3+Test+Plan Appreciate your help Thanks /Sudha
Re: Doc Updates
Thanks for updating it. Without knowing what to look for in the prepare system vm template section I would not have known that it was updated. Would it make sense to have a date in the header or footer with the last content update date for a page? Also do you know if the upgrade notes in the Release Notes doc was updated? On Mon, Oct 14, 2013 at 11:07 AM, David Nalley da...@gnsa.us wrote: And just as a heads up, thanks for help from Prasanna and Travis, I've published an updated version of the IG for 4.2, hopefully that at least gets us 'installable'. --David On Thu, Oct 10, 2013 at 2:10 PM, David Nalley da...@gnsa.us wrote: On Thu, Oct 10, 2013 at 1:53 PM, Travis Graham tgra...@tgraham.us wrote: What's an acceptable/expected timeframe for rolling out the published fixes once a patch has made it's way in? Is that something that can be automated after a successful Jenkins run? Travis It depends on the scope of changes. For a document like the release notes, assuming someone already has an updated SVN tree, it shouldn't take more than 30 minutes to update, and it could happen pretty regularly. If it's every document in a single release, that's historically taken the better part of a day. I don't think we'll get away with getting it to happen in an automated fashion, simply because it requires commit access to SVN, which is tied to an individual, which means someone would need to expose their creds, which would be a bad thing. --David
Re: Creating advanced network
Wow, all user@cloudstack mails got catched in my spam filter, so sorry for the late response. After tinkering the whole day I gave up using a tagged VLAN for the storage traffic, seems not to work. It ignores the VID and doesn't create the VLAN on the hypervisor. I added the vlan to the hypervisor now and bound cloudbr1 to it and using it untagged in cloudstack. Finally all is up. :-) Now I was looking how to use a load balancer like the internal cloudstack one or even the F5 and it seems it's not supported. No cloudstack support for internal LB (the VR one) or F5 ? Really !!! According to the advanced network and security groups specification ( https://cwiki.apache.org/confluence/display/CLOUDSTACK/Isolation+based+on+Security+Groups+in+Advance+zone) AddF5LoadBalancerCmd api commands will just fail in SG enabled zone. That's just a joke. I'm really close to end the cloudstack adventure and move on with open stack. Having a shared network with SG and loadbalancer is not really a uncommon solution Thanks, Bjoern On 10/14/2013 11:09 AM, motty cruz wrote: Hello Bjoern, I'm not an expert with Cloudstack, but I will share my limited knowledge. Guest traffic This is the network traffic generated by the communication between the guest VMs. This traffic flows over the guest network and it can be shared or isolated. I have Cloudstack 4.1 installed configured with Advance networking, my hypervisor has two network interfaces on for private (management/storage) one for public (public/guest) network private interface eth1 bridge to cloudbr1 public interface eth0 bridge to cloudbr0 guest vlan eth0.100 (10.1.1.0/24 CIDR) my setup is partially working, I can create instances but can't ping my virtual router, I'm in the process as well, Thanks, On Mon, Oct 14, 2013 at 10:45 AM, Bjoern Teipel bjoern.tei...@internetbrands.com wrote: Who can help me here ? Right now the biggest issue for me are the last questions. On 10/14/2013 01:03 AM, Bjoern Teipel wrote: Hi Guys, I wanted to setup a advanced zone with security groups and saw this exceptions in the log while I was configuring the networks. What does that mean, what are the limitations from a advanced zone + SG ? ERROR [cloud.async.**AsyncJobManagerImpl] (Job-Executor-23:job-23 = [ 7c7e4264-721d-448b-8a75-**b68ffeb52d56 ]) Unexpected exception while executing org.apache.cloudstack.api.**command.admin.network.** UpdatePhysicalNetworkCmd com.cloud.exception.**InvalidParameterValueException**: Can't add vnet range to the physical network in the zone that supports Advanced network, Security Group enabled: true at com.cloud.network.**NetworkServiceImpl.** updatePhysicalNetwork(**NetworkServiceImpl.java:2527) at com.cloud.utils.component.**ComponentInstantiationPostProc** essor$InterceptorDispatcher.**intercept(**ComponentInstantiationPostProc* *essor.java:125) at org.apache.cloudstack.api.**command.admin.network.** UpdatePhysicalNetworkCmd.**execute(**UpdatePhysicalNetworkCmd.java:**98) at com.cloud.api.ApiDispatcher.**dispatch(ApiDispatcher.java:** 158) at com.cloud.async.**AsyncJobManagerImpl$1.run(** AsyncJobManagerImpl.java:531) at java.util.concurrent.**Executors$RunnableAdapter.** call(Executors.java:471) at java.util.concurrent.**FutureTask$Sync.innerRun(** FutureTask.java:334) at java.util.concurrent.**FutureTask.run(FutureTask.**java:166) at java.util.concurrent.**ThreadPoolExecutor.runWorker(** ThreadPoolExecutor.java:1146) at java.util.concurrent.**ThreadPoolExecutor$Worker.run(** ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.**java:679) Also I tagged the cloudstack storage network (specified Vlan ID in the wizard) but I see the interfaces are bound to cloudbr0 oppose to brxxx-VLANID Does the storage network need to be untagged ? Also is it true the guest network is the public network ? That confuses me a little bit since I configured a internal IP range but now I can't see how/where to configure the external/public IP. Thanks in advance, Bjoern
[cloudmonkey] username / password support
Hi folks, I modified cloudmonkey to work off of username and password. Feedback and testing required. The code is in the branch username_password_support http://goo.gl/5xTgo5 Thanks -- Chiradeep
Re: [cloudmonkey] username / password support
I was unable to run cloudmonkey after applying your update. My commands were: $ git checkout username_password_support $ git pull $ python setup.py build $ python setup.py install $ cloudmonkey Then I got this import error: Import error in cloudmonkey.requester : No module named requests Switching back to master branch runs fine, however. --- Yu-Heng (Ryan) Lei, Associate Researcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.twhttps://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SWYpVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mailto%3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Wed, Oct 16, 2013 at 11:23 AM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Hi folks, I modified cloudmonkey to work off of username and password. Feedback and testing required. The code is in the branch username_password_support http://goo.gl/5xTgo5 Thanks -- Chiradeep
Re: [cloudmonkey] username / password support
I fixed this temporarily by adding the requests as a dependency. But may be we could do the login using urllib2 itself to avoid the requests dependency. +1 to username,password login. I need to add that to marvin too. On Wed, Oct 16, 2013 at 11:38:40AM +0800, Ryan Lei wrote: I was unable to run cloudmonkey after applying your update. My commands were: $ git checkout username_password_support $ git pull $ python setup.py build $ python setup.py install $ cloudmonkey Then I got this import error: Import error in cloudmonkey.requester : No module named requests Switching back to master branch runs fine, however. --- Yu-Heng (Ryan) Lei, Associate Researcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.twhttps://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SWYpVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mailto%3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Wed, Oct 16, 2013 at 11:23 AM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Hi folks, I modified cloudmonkey to work off of username and password. Feedback and testing required. The code is in the branch username_password_support http://goo.gl/5xTgo5 Thanks -- Chiradeep -- Prasanna., Powered by BigRock.com
Re: [cloudmonkey] username / password support
Aha, thanks. Can you 'pip install requests' ? On 10/15/13 8:38 PM, Ryan Lei ryan...@cht.com.tw wrote: I was unable to run cloudmonkey after applying your update. My commands were: $ git checkout username_password_support $ git pull $ python setup.py build $ python setup.py install $ cloudmonkey Then I got this import error: Import error in cloudmonkey.requester : No module named requests Switching back to master branch runs fine, however. -- - Yu-Heng (Ryan) Lei, Associate Researcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.twhttps://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SWY pVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mailto %3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Wed, Oct 16, 2013 at 11:23 AM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Hi folks, I modified cloudmonkey to work off of username and password. Feedback and testing required. The code is in the branch username_password_support http://goo.gl/5xTgo5 Thanks -- Chiradeep
RE: CloudStack Bangalore Meetup On Oct 17th
Thanks, Shankar. Here is the updated Agenda: Agenda: 4:00 PM - 4:15 PM: Registration Social Networking 4:15 PM - 5:00 PM: Beginners Guide To CloudStack (Iliyas Shirol, InMobi) 5:00 PM - 5:45 PM: Apache CloudStack 4.2: A First Look (Shanker Balan, ShapeBlue) 5:45 PM - 6:30 PM: Cisco UCS CloudStack (Deepak Natraj, Cisco) Regards -Radhika -Original Message- From: Shanker Balan [mailto:shanker.ba...@shapeblue.com] Sent: Friday, September 27, 2013 12:55 AM To: CloudStack-Users Subject: CloudStack Bangalore Meetup On Oct 17th Hi Bangalore CloudStackers, It has been a few months since we last did a meetup and in the meantime, the group is fast approaching 500 members. I hope we can get as many people as we can to participate in the upcoming meetup. The agenda is still being finalised. It would be a good opportunity for you to present CloudStack success stories, tips and tricks, tutorials and HOWTOs. Vendors are also welcome to talk about their cloud products which have CloudStack integration. Please feel free to contact me for a slot at the earliest. A special thanks to InMobi who have kindly offered to host the October CloudStack meetup at their premises. Please RSVP at http://www.meetup.com/CloudStack-Bangalore-Group/events/142128492/ -- @shankerbalan M: +91 98860 60539 | O: +91 (80) 67935867 shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, Bangalore - 560 055 This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: [cloudmonkey] username / password support
Sorry, urllib2 and cookiejar looked just too painful. On 10/15/13 9:26 PM, Prasanna Santhanam t...@apache.org wrote: I fixed this temporarily by adding the requests as a dependency. But may be we could do the login using urllib2 itself to avoid the requests dependency. +1 to username,password login. I need to add that to marvin too. On Wed, Oct 16, 2013 at 11:38:40AM +0800, Ryan Lei wrote: I was unable to run cloudmonkey after applying your update. My commands were: $ git checkout username_password_support $ git pull $ python setup.py build $ python setup.py install $ cloudmonkey Then I got this import error: Import error in cloudmonkey.requester : No module named requests Switching back to master branch runs fine, however. - -- Yu-Heng (Ryan) Lei, Associate Researcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.twhttps://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SW YpVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mail to%3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Wed, Oct 16, 2013 at 11:23 AM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Hi folks, I modified cloudmonkey to work off of username and password. Feedback and testing required. The code is in the branch username_password_support http://goo.gl/5xTgo5 Thanks -- Chiradeep -- Prasanna., Powered by BigRock.com
Re: [cloudmonkey] username / password support
I prefer requests too. May be we can later switch over all of cloudmonkey to use requests just like marvin. I tested out the changes with a user account and everything works fine. But startup of cloudmonkey seems to force one to put in the username, passwd in cloudmonkey/config. On Wed, Oct 16, 2013 at 04:51:23AM +, Chiradeep Vittal wrote: Sorry, urllib2 and cookiejar looked just too painful. On 10/15/13 9:26 PM, Prasanna Santhanam t...@apache.org wrote: I fixed this temporarily by adding the requests as a dependency. But may be we could do the login using urllib2 itself to avoid the requests dependency. +1 to username,password login. I need to add that to marvin too. On Wed, Oct 16, 2013 at 11:38:40AM +0800, Ryan Lei wrote: I was unable to run cloudmonkey after applying your update. My commands were: $ git checkout username_password_support $ git pull $ python setup.py build $ python setup.py install $ cloudmonkey Then I got this import error: Import error in cloudmonkey.requester : No module named requests Switching back to master branch runs fine, however. - -- Yu-Heng (Ryan) Lei, Associate Researcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.twhttps://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SW YpVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mail to%3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Wed, Oct 16, 2013 at 11:23 AM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Hi folks, I modified cloudmonkey to work off of username and password. Feedback and testing required. The code is in the branch username_password_support http://goo.gl/5xTgo5 Thanks -- Chiradeep -- Prasanna., Powered by BigRock.com -- Prasanna., Powered by BigRock.com
Re: Management IP address pool exhausted - SOLVED
I think I've seen a suggestion earlier about adding the world solved in the subject whenever someone finds a solution for its problem. So, regarding this management IP pool issue, I'm not sure that's the definitive solution but it did work for me. Having all management IPs used, CloudStack was failing to start the console proxy VM. I created a dump of cloud DB and start looking for my management IPs. I found a table called op_dc_ip_address_alloc with references to all my management IPs. Long story short, 2 of the 4 IP addresses were still showing as reserved so I simply run this: mysql update op_dc_ip_address_alloc set nic_id=NULL,reservation_id=NULL,taken=NULL where id=1; The id in the command above was the id corresponding to the IPs that were still showing as reserved. In the next 30 seconds CloudStack started also the console proxy VM and everything came back to normal. I suggest creating a full backup of the database before changing anything though. Daniel On Thu, Sep 26, 2013 at 2:24 AM, Daniel Hertanu d...@unixmob.com wrote: I posted here: http://pastebin.com/uJ6jR73D the logs, maybe someone else have seen this behavior before. Just to remind the issue, CS 4.1, XenServer 6.1, when the only existing host is rebooted without being in maintenance mode (and stays down for a while), all the management IPs get used (in this case there were 171 management IPs, all show as in use now). Thanks, Daniel On Wed, Sep 25, 2013 at 8:56 PM, Musayev, Ilya imusa...@webmd.net wrote: Dan, Ping me on IRC, nick serverchief Regards ilya -Original Message- From: Daniel Hertanu [mailto:d...@unixmob.com] Sent: Wednesday, September 25, 2013 6:44 AM To: users@cloudstack.apache.org Subject: Re: Management IP address pool exhausted Hi So I re-installed CS, reboot Xen host without entering it first in Maintenace Mode, then got the management IP pool fully used. I followed again your indications but to no avail. In the meantime SSVM has reached number 112 (s-112-VM). I would really appreciate any other idea. Thanks, Daniel On Wed, Sep 25, 2013 at 9:36 AM, Daniel Hertanu d...@unixmob.com wrote: Hello Ilya I submit an issue describing the bug: https://issues.apache.org/jira/browse/CLOUDSTACK-4735 (I picked CS version 4.1.0 as 4.1.1 is reported as non existent, but I've seen this behavior before since version 3). I followed your indications but it didn't work. After changing those records in the database, CS would still give the same error. I revert back to the initial db content, but this time nothing came back (initially the SSVM was still running, it was CPVM that didn't start). After this step I tried some tricks on my own and I ended up with a botched environment. So I'll do a fresh install, reboot the host and try your suggestions again. Thanks, Daniel On Tue, Sep 24, 2013 at 10:46 PM, Musayev, Ilya imusa...@webmd.netwrote: I'm not certain if this is hypervisor specific - I've seen the same issue for vSphere - but I though it was me, I think we may need to revise the system vm ip space decommission process. Shanker and/or Daniel, Do you mind creating a ticket in issues.apache.org and write out ways to reproduce this issue. --- *NOTE* this is purely from memory and some notes I had - proceed at your own risk In the meantime, lets clean up what you have. The goal is to release the IPs that are still marked as reserved and allocated. I'd recommend installing mysql workbench There are few tables we need to review: 1) Stop cloudstack management server 2) Backup mysql db first. Note the id of management network referenced in cloud.networks Select id from cloud.networks where traffic_type=Management In my case, Management network has ID of 205 SELECT * FROM cloud.nics where network_id=205; Alter to Deallocating the ones that are marked as Reserved. Do the same for cloud.user_ip_address SELECT * FROM cloud.user_ip_address where source_network_id=205; Alter from Allocated to Free Stop any systemvms if running, and alter the state from Running to Stopped or Expunging in cloud.vm_instance table. This will recreate the systemvm from scratch. I think this should have you covered, if not, revert back the mysql db. Do mysql dump and grep for IPs that should have been released. Let me know, Regards ilya -Original Message- From: Shanker Balan [mailto:shanker.ba...@shapeblue.com] Sent: Tuesday, September 24, 2013 9:44 AM To: users@cloudstack.apache.org Subject: Re: Management IP address pool exhausted On 24-Sep-2013, at 6:37 PM, Daniel Hertanu d...@unixmob.com wrote: Hello Ilya I repeated the issue by rebooting the Xen host without having it in maintenance mode in
Re: Upgrade from 4.1.1 to 4.2 failed. Could not restart system VMs. Roll back to 4.1.1 backup initially failed: could not start management service. Finally got it to work. I hope this helps someone el
H Adam,
forgive me if I missed some important clue in your report. It seems to
me that it is the upgrade procedure that is not production ready, not
version 4.2. Am I right?
regards,
Daan
On Tue, Oct 15, 2013 at 11:10 PM, Adam adam.scarce...@gmail.com wrote:
I upgraded my 4 host private dev cloud running on CentOS 6.4 x86_64 from
version 4.1.1 to 4.2 per upgrade instructions. I'm just using 4 HP Z 600
workstations (box 1 has two nics, the cloudstack-management server, the
mysql db, primary and secondary storage and a cloudstack-agent, and boxes 2
- 4 each just have primary storage and a cloudstack-agent). It's nothing
fancy, but it's been working perfectly now for months. All seemed to go
very smoothly except for the very last step:
{code}
nohup cloudstack-sysvmadm -d cs-east-dev1 -u root -p support -a sysvm.log
21
{code}
It could not restart the system vms for some reason. (I do not have the
original sysvm.log as I've now been playing with this failed upgrade for
two days). However, here is the sysvm.log from the very last attempt:
{code}
nohup: ignoring input
Stopping and starting 1 secondary storage vm(s)...
curl: (7) couldn't connect to host
ERROR: Failed to stop secondary storage vm with id 14
Done stopping and starting secondary storage vm(s)
Stopping and starting 0 console proxy vm(s)...
No running console proxy vms found
Stopping and starting 1 running routing vm(s)...
curl: (7) couldn't connect to host
2
Done restarting router(s).
{code}
As I mentioned above, I've been playing around with this for 2 days now and
actually got the 4.2 management server to finally start, but none of the
System VMs worked. I even restarted all of the CentOS hosts (which was a
huge hassle), but that didn't seem to help at all. I eventually found this
bug: https://issues.apache.org/jira/browse/CLOUDSTACK-4826 which seemed
similar to my issues.
I was also experiencing a strange issue where all 10 of my private
Management IP Addresses were used for some reason. Every time I restarted
the cloudstack-management service, 2 more IPs were taken up, but none ever
got released. Also since the System VMs would not start, my secondary
storage wouldn't start up either.
About an hour ago I gave up on 4.2 and I decided to roll back to 4.1.1 on
all 4 workstations. First I shutdown all VM instances, then stopped all
cloudstack-* services on all 4 workstations, and then ran a yum downgrade
cloudstack-* on all 4 workstations:
{code}
[root@cs-east-dev1 yum.repos.d]# yum downgrade cloudstack-*
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Downgrade Process
Loading mirror speeds from cached hostfile
* base: centos.mirror.nac.net
* extras: mirror.trouble-free.net
* rpmforge: mirror.us.leaseweb.net
* updates: mirror.cogentco.com
Resolving Dependencies
-- Running transaction check
--- Package cloudstack-agent.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-agent.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-awsapi.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-awsapi.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-cli.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-cli.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-common.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-common.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-management.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-management.x86_64 0:4.2.0-1.el6 will be erased
--- Package cloudstack-usage.x86_64 0:4.1.1-0.el6 will be a downgrade
--- Package cloudstack-usage.x86_64 0:4.2.0-1.el6 will be erased
-- Finished Dependency Resolution
Dependencies Resolved
=
Package Arch
Version Repository
Size
=
Downgrading:
cloudstack-agent x86_64
4.1.1-0.el6 cloudstack
37 M
cloudstack-awsapi x86_64
4.1.1-0.el6 cloudstack
56 M
cloudstack-clix86_64
4.1.1-0.el6 cloudstack
32 k
cloudstack-common x86_64
4.1.1-0.el6 cloudstack
92 M
cloudstack-management x86_64
4.1.1-0.el6 cloudstack
55 M
cloudstack-usage x86_64
4.1.1-0.el6 cloudstack
37 M
Transaction Summary
