Re: Can we still use DevCloud VM Image ?
Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* *I have started to create a google document to define step-by-step what do do.* On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.comwrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the point when I restart it, also the default sd card (it's storage, think hdd) is small (4GB) and the disk io is very small re-flashing it every time consumes a lot of my time, ordered a 16GB class10 sd card for better disk io, will keep you posted how this experiment went, I've a gut feeling though this won't work given the resource constraints. Regards. Regards, Charles On Sun, Nov 11, 2012 at 5:50 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Not really, in my setup I want eth0 to be host-only which is causing some issues; another problem is I'm making it x86 only, so I see few crashes. Will update when I'm done. From: Charles Moulliard [ch0...@gmail.com] Sent: Sunday, November 11, 2012 9:06 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Did you succeed it to fix the routing issues ? On Sat, Nov 10, 2012 at 1:53 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, it won't work as the vms inside host only network can only access the host os and other vms on it. Therefore devcloud inside host-only network won't be able to reach the Internet. I'm actually trying to create a new devcloud image with two network adapters, one NAT (eth1, so devcloud is able to reach the Internet) and one host-only adapter (eth0, so we can run mgmt server etc.) and it will be only 300-350MB (archived). I was trying not the share the image, having some routing issues when I do that, will share as soon I fix those issues. -- Rohit PS. the base system is ubuntu x86 precise and the untouched stripped down vm is available here: http://bhaisaab.org/vms From: Charles Moulliard [ch0...@gmail.com] Sent: Saturday, November 10, 2012 4:46 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Hi, I have been able to setup the bridged adapter on virtualbox to allow the guest machine to get an IP address (from my DHCP server runinng in this lan : 192.168.1x). The guest is configured like this : root@devcloud:/home/devcloud/download# more /etc/network/interfaces # The loopback network interface auto lo iface lo inet loopback # The primary network interface auto xenbr0 iface xenbr0 inet static gateway 192.168.56.1 address 192.168.56.2 netmask 255.255.255.0 bridge_ports eth0 auto eth0
cloudstack installation WAS RE: [jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed
Hi Kevin, I am changing the subject of your email, as you appear to have commented in a bug not related to your question. You can get the source code release of Apache CloudStack 4.0 at: http://incubator.apache.org/cloudstack/downloads.html You will also find some links to convenience binaries hosted by the community, as well as installation documentation. If you have additional questions please post to the cloudstack-users mailing list. Cheers, -Sebastien On Nov 15, 2012, at 1:48 AM, 조점식[Cloud구축팀] (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/CLOUDSTACK-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13497657#comment-13497657 ] 조점식[Cloud구축팀] commented on CLOUDSTACK-464: -- Hello there. I'd like to install and test cloudstack(cloudplatform) 4.x. Where can I download installation package? Do I have to install manually? Please, let me know. Thank you in advance. Regression in AWSAPI docs, entire sections removed -- Key: CLOUDSTACK-464 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-464 Project: CloudStack Issue Type: Bug Components: Doc Affects Versions: 4.0.0, 4.1.0 Reporter: sebastien goasguen Assignee: Jessica Tomechak Commit 22b5c0cddd798829788b4e630b8ae77b81a05c2f on 10/17: Overwrites some of the documentation contributed previously on the AWSAPI. The commit introduces a few errors (e.g mention of CloudPlatform ) and overwrites additional documentation submitted by me and committed on Sept 23rd By D. Nalley with commit: 56b4ac184f712f54868af83b5e8110af93b72e83 While the commit does correct some typos, it basically reverts to the old documentation which I had worked on towards improvement. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed
[ https://issues.apache.org/jira/browse/CLOUDSTACK-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13497844#comment-13497844 ] sebastien goasguen commented on CLOUDSTACK-464: --- Hi Kevin, I am changing the subject of your email, as you appear to have commented in a bug not related to your question. You can get the source code release of Apache CloudStack 4.0 at: http://incubator.apache.org/cloudstack/downloads.html You will also find some links to convenience binaries hosted by the community, as well as installation documentation. If you have additional questions please post to the cloudstack-users mailing list. Cheers, -Sebastien Regression in AWSAPI docs, entire sections removed -- Key: CLOUDSTACK-464 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-464 Project: CloudStack Issue Type: Bug Components: Doc Affects Versions: 4.0.0, 4.1.0 Reporter: sebastien goasguen Assignee: Jessica Tomechak Commit 22b5c0cddd798829788b4e630b8ae77b81a05c2f on 10/17: Overwrites some of the documentation contributed previously on the AWSAPI. The commit introduces a few errors (e.g mention of CloudPlatform ) and overwrites additional documentation submitted by me and committed on Sept 23rd By D. Nalley with commit: 56b4ac184f712f54868af83b5e8110af93b72e83 While the commit does correct some typos, it basically reverts to the old documentation which I had worked on towards improvement. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Can we still use DevCloud VM Image ?
Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* *I have started to create a google document to define step-by-step what do do.* On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.comwrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the point when I restart it, also the default sd card (it's storage, think hdd) is small (4GB) and the disk io is very small re-flashing it every time consumes a lot of my time, ordered a 16GB class10 sd card for better disk io, will keep you posted how this experiment went, I've a gut feeling though this won't work given the resource constraints. Regards. Regards, Charles On Sun, Nov 11, 2012 at 5:50 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Not really, in my setup I want eth0 to be host-only which is causing some issues; another problem is I'm making it x86 only, so I see few crashes. Will update when I'm done. From: Charles Moulliard [ch0...@gmail.com] Sent: Sunday, November 11, 2012 9:06 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Did you succeed it to fix the routing issues ? On Sat, Nov 10, 2012 at 1:53 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, it won't work as the vms inside host only network can only access the host os and other vms on it. Therefore devcloud inside host-only network won't be able to reach the Internet. I'm actually trying to create a new devcloud image with two network adapters, one NAT (eth1, so devcloud is able to reach the Internet) and one host-only adapter (eth0, so we can run mgmt server etc.) and it will be only 300-350MB (archived). I was trying not the share the image, having some routing issues when I do that, will share as soon I fix those issues. -- Rohit PS. the base system is ubuntu x86 precise and the untouched stripped down vm is available here: http://bhaisaab.org/vms From: Charles Moulliard [ch0...@gmail.com] Sent: Saturday, November 10, 2012 4:46 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Hi, I have been able to setup the bridged adapter on virtualbox to allow the guest machine to get an IP address (from my DHCP server runinng in this lan : 192.168.1x). The guest is configured like this : root@devcloud:/home/devcloud/download# more /etc/network/interfaces
RE: cloudstack installation WAS RE: [jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed
Hi Sebastien. Thank you for your kind answer.:) Have a nice day. Kevin. -Original Message- From: Sebastien Goasguen [mailto:run...@gmail.com] Sent: Thursday, November 15, 2012 5:39 PM To: cloudstack-dev@incubator.apache.org; cloudstack-us...@incubator.apache.org Subject: cloudstack installation WAS RE: [jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed Hi Kevin, I am changing the subject of your email, as you appear to have commented in a bug not related to your question. You can get the source code release of Apache CloudStack 4.0 at: http://incubator.apache.org/cloudstack/downloads.html You will also find some links to convenience binaries hosted by the community, as well as installation documentation. If you have additional questions please post to the cloudstack-users mailing list. Cheers, -Sebastien On Nov 15, 2012, at 1:48 AM, 조점식[Cloud구축팀] (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/CLOUDSTACK-464?page=com.atlassia n.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId= 13497657#comment-13497657 ] 조점식[Cloud구축팀] commented on CLOUDSTACK-464: -- Hello there. I'd like to install and test cloudstack(cloudplatform) 4.x. Where can I download installation package? Do I have to install manually? Please, let me know. Thank you in advance. Regression in AWSAPI docs, entire sections removed -- Key: CLOUDSTACK-464 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-464 Project: CloudStack Issue Type: Bug Components: Doc Affects Versions: 4.0.0, 4.1.0 Reporter: sebastien goasguen Assignee: Jessica Tomechak Commit 22b5c0cddd798829788b4e630b8ae77b81a05c2f on 10/17: Overwrites some of the documentation contributed previously on the AWSAPI. The commit introduces a few errors (e.g mention of CloudPlatform ) and overwrites additional documentation submitted by me and committed on Sept 23rd By D. Nalley with commit: 56b4ac184f712f54868af83b5e8110af93b72e83 While the commit does correct some typos, it basically reverts to the old documentation which I had worked on towards improvement. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed
[ https://issues.apache.org/jira/browse/CLOUDSTACK-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13497848#comment-13497848 ] 조점식[Cloud구축팀] commented on CLOUDSTACK-464: -- Hi Sebastien. Thank you for your kind answer.:) Have a nice day. Kevin. Regression in AWSAPI docs, entire sections removed -- Key: CLOUDSTACK-464 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-464 Project: CloudStack Issue Type: Bug Components: Doc Affects Versions: 4.0.0, 4.1.0 Reporter: sebastien goasguen Assignee: Jessica Tomechak Commit 22b5c0cddd798829788b4e630b8ae77b81a05c2f on 10/17: Overwrites some of the documentation contributed previously on the AWSAPI. The commit introduces a few errors (e.g mention of CloudPlatform ) and overwrites additional documentation submitted by me and committed on Sept 23rd By D. Nalley with commit: 56b4ac184f712f54868af83b5e8110af93b72e83 While the commit does correct some typos, it basically reverts to the old documentation which I had worked on towards improvement. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: CLI for CloudStack: cloudmonkey
Hi Rohit, I've been using cloudmonkey to script my CloudStack setup process in dev, and had one question. How do we pass complex (MAP) parameters to cloudmonkey? For example, when setting up a networkoffering, there's a serviceProviderList parameter which is a list of items, each of which has several key value pairs. I tried a couple of syntaxes to pass this parameter, but didn't come across the correct one yet - can you enlighten me? ;) Thanks for your work on this, very useful. Thanks, Dave. On Mon, Nov 12, 2012 at 7:01 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, Karaf seems nice, and no worries I don't see any suggestions as flames or war. I would anytime throw away any code for something better, so feel free to start writing your own client and share with us. Patches welcome! Let me share why I wrote it in Python: - First of all the CLI is not even a client to start with, I mean I've totally based it off marvin. It's a small wrapper I would say around marvin. - Python because, the environment is preinstalled on Macs and almost all Linux distros. - Scripting environment that Python provides so one can fork and edit their own versions of cloudmonkey CLI, this saves the user from hack-compile-build-run loop; one can just hack and run. - The best part again is marvin as dependency, you write javadocs etc. in your java code, apidocs gets interface definition and requirements from the java code, the commands.xml created in the process is used by marvin's codegenerator which generates api modules with Cmd and Response classes. The generated cloudstackAPI is used by both marvin clients and the CLI. The CLI which is about 400 lines of Python, in turn loads these modules and generates grammar and command handlers on the fly using some functional magic (injects functions into the classes), I don't think this kind of programming is even possible with Java, they don't have functions as first class citizens. What does the last statement mean for the developers: So, if a developer simply adds a new API which is java code, with required docs etc. apidocs will pick it up automatically and in turn marvin (and it's test clients) will get new cloudstackAPI and CLI too gets the new APIs on the fly. The functional closures in CLI will make sure the new APIs and its handlers are created with grammar rules. The developer won't need to change apidocs, marvin or CLI. I think this is one of my best hacks [0] which leverages on existing code and I think it would be very maintainable in future. Sorry everyone, I'm caught up with some other issues, I want to post a screencast and blog explaining the CLI but only after I finalize the specs for the CLI. Thanks for the feedback so far. The top TODOs left now are: - Reverse search - Bash/zsh completion Regards. PS. Just in case you're curious: [0] https://github.com/bhaisaab/hacktools From: Charles Moulliard [ch0...@gmail.com] Sent: Monday, November 12, 2012 12:49 PM To: cloudstack-dev Subject: Re: CLI for CloudStack: cloudmonkey Hi, I don't want to create a developer war or position a technology against another (python against java) but we could leverage Apache Karaf (OSGI runtime container) project to provide the cloudmonkey client. This work has already be done for jclouds (http://www.youtube.com/watch?v=EKVkm6AV19U, https://github.com/jclouds/jclouds-karaf) and could be easily created created for cloudmonkey. Karaf which is a shell environment proposes a lot of by default features (http://karaf.apache.org/ : ssh, jaas, provisioning, administration, history, config files support, ... - http://karaf.apache.org/manual/latest-2.3.x/developers-guide/index.html) that we could extend with cloudmonkey commands ( http://karaf.apache.org/manual/latest-2.3.x/developers-guide/extending-console.html ) and rebrand Karaf into a cloudmonkey karaf container. Regards, Charles On Fri, Nov 9, 2012 at 10:53 PM, Musayev, Ilya imusa...@webmd.net wrote: I guess mine got wiped somehow... -Original Message- From: Musayev, Ilya [mailto:imusa...@webmd.net] Sent: Friday, November 09, 2012 4:51 PM To: cloudstack-dev@incubator.apache.org Subject: RE: CLI for CloudStack: cloudmonkey Rohit History seems to retain only last session and not previous - is this by design? Thanks ilya -Original Message- From: sebgoa [mailto:run...@gmail.com] Sent: Friday, November 09, 2012 4:52 AM To: cloudstack-dev@incubator.apache.org Subject: Re: CLI for CloudStack: cloudmonkey Using lower case commands solved the issue thanks, and happy Diwali -Sebastien On Nov 8, 2012, at 8:14 PM, Rohit Yadav wrote: Oh, forgot to see that. Yes, now all the cmds are lowercase (except for few params liks isAsync=) and tab completion is advised. Regards. From: Kishan Kavala
[jira] [Created] (CLOUDSTACK-488) can't register awsapi user
sebastien goasguen created CLOUDSTACK-488: - Summary: can't register awsapi user Key: CLOUDSTACK-488 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-488 Project: CloudStack Issue Type: Bug Components: AWSAPI Affects Versions: 4.0.1 Environment: OSX 10.8.1 mysql55 maven3 devcloud Reporter: sebastien goasguen Running devcloud host-only environment as described in: https://cwiki.apache.org/CLOUDSTACK/cloudstack-devcloud-environment-setup.html Run the awsapi server with: https://cwiki.apache.org/CLOUDSTACK/cloudstack-devcloud-environment-setup.html Then tried to register a user: air-2:setup sebastiengoasguen$ python ./cloudstack-aws-api-register -a 2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw -s GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbw -c ~/.ssh/cert.pem -u http://localhost:7080/awsapi/ User registration failed with http error code: 401 Jetty logs show: EC2RestServlet.doGetOrPost: javax.servlet.forward.query_string: AWSAccessKeyId=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwAction=SetUserKeysSignatureMethod=HmacSHA1SignatureVersion=2Timestamp=2012-11-15T11:10:12ZVersion=2010-11-15accesskey=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwsecretkey=GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbwSignature=lOgFvzNy0t2%2FCBzfKZB3W84lx38%3D Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: EC2 Request method: GET Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request contextPath: /awsapi Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request pathInfo: / Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request pathTranslated: /Users/sebastiengoasguen/Documents/incubator-cloudstack/awsapi/target/cloud-awsapi-4.1.0-SNAPSHOT Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request queryString: AWSAccessKeyId=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwAction=SetUserKeysSignatureMethod=HmacSHA1SignatureVersion=2Timestamp=2012-11-15T11:10:12ZVersion=2010-11-15accesskey=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwsecretkey=GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbwSignature=lOgFvzNy0t2%2FCBzfKZB3W84lx38%3D Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request requestURI: /awsapi/rest/AmazonEC2/ Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request requestURL: http://localhost:7080/awsapi/rest/AmazonEC2/ Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request servletPath: /rest/AmazonEC2 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Accept-Encoding:identity Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Host:localhost:7080 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Connection:close Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header User-Agent:Python-urllib/2.7 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Action:SetUserKeys Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter SignatureMethod:HmacSHA1 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter AWSAccessKeyId:2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Version:2010-11-15 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter SignatureVersion:2 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Signature:lOgFvzNy0t2/CBzfKZB3W84lx38= Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter secretkey:GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter accesskey:2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Timestamp:2012-11-15T11:10:12Z Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.core.ec2.EC2Engine
[jira] [Updated] (CLOUDSTACK-488) can't register awsapi user
[ https://issues.apache.org/jira/browse/CLOUDSTACK-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sebastien goasguen updated CLOUDSTACK-488: -- Description: Running devcloud host-only environment as described in: https://cwiki.apache.org/CLOUDSTACK/cloudstack-devcloud-environment-setup.html Run the awsapi server with: mvn -pl :cloud-awsapi jetty:run Then tried to register a user: air-2:setup sebastiengoasguen$ python ./cloudstack-aws-api-register -a 2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw -s GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbw -c ~/.ssh/cert.pem -u http://localhost:7080/awsapi/ User registration failed with http error code: 401 Jetty logs show: EC2RestServlet.doGetOrPost: javax.servlet.forward.query_string: AWSAccessKeyId=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwAction=SetUserKeysSignatureMethod=HmacSHA1SignatureVersion=2Timestamp=2012-11-15T11:10:12ZVersion=2010-11-15accesskey=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwsecretkey=GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbwSignature=lOgFvzNy0t2%2FCBzfKZB3W84lx38%3D Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: EC2 Request method: GET Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request contextPath: /awsapi Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request pathInfo: / Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request pathTranslated: /Users/sebastiengoasguen/Documents/incubator-cloudstack/awsapi/target/cloud-awsapi-4.1.0-SNAPSHOT Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request queryString: AWSAccessKeyId=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwAction=SetUserKeysSignatureMethod=HmacSHA1SignatureVersion=2Timestamp=2012-11-15T11:10:12ZVersion=2010-11-15accesskey=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwsecretkey=GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbwSignature=lOgFvzNy0t2%2FCBzfKZB3W84lx38%3D Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request requestURI: /awsapi/rest/AmazonEC2/ Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request requestURL: http://localhost:7080/awsapi/rest/AmazonEC2/ Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request servletPath: /rest/AmazonEC2 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Accept-Encoding:identity Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Host:localhost:7080 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Connection:close Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header User-Agent:Python-urllib/2.7 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Action:SetUserKeys Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter SignatureMethod:HmacSHA1 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter AWSAccessKeyId:2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Version:2010-11-15 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter SignatureVersion:2 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Signature:lOgFvzNy0t2/CBzfKZB3W84lx38= Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter secretkey:GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter accesskey:2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Timestamp:2012-11-15T11:10:12Z Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.core.ec2.EC2Engine loadConfigValues SEVERE: ec2-service.properties not found Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.controller.s3.ServiceProvider initialize INFO: Initializing ServiceProvider... Configure log4j with default properties Nov 15, 2012 11:10:13 AM
Re: Can we still use DevCloud VM Image ?
On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.comwrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the point when I restart it, also the default sd card (it's storage, think hdd) is small (4GB) and the disk io is very small re-flashing it every time consumes a lot of my time, ordered a 16GB class10 sd card for better disk io, will keep you posted how this experiment went, I've a gut feeling though this won't work given the resource constraints. Regards. Regards, Charles On Sun, Nov 11, 2012 at 5:50 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Not really, in my setup I want eth0 to be host-only which is causing some issues; another problem is I'm making it x86 only, so I see few crashes. Will update when I'm done. From: Charles Moulliard [ch0...@gmail.com] Sent: Sunday, November 11, 2012 9:06 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Did you succeed it to fix the routing issues ? On Sat, Nov 10, 2012 at 1:53 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, it won't work as the vms inside host only network can only access the host os and other vms on it. Therefore devcloud inside host-only network won't be able to reach the Internet. I'm actually trying to create a new devcloud image with two network adapters, one NAT (eth1, so devcloud is able to reach the Internet) and one host-only adapter (eth0, so we can run mgmt server etc.) and it will be only 300-350MB (archived). I was trying not the share the image, having some routing issues when I do that, will share as soon I fix those issues. -- Rohit PS. the base system is ubuntu x86 precise and the untouched stripped down vm is available here: http://bhaisaab.org/vms From: Charles Moulliard [ch0...@gmail.com] Sent: Saturday, November 10, 2012 4:46 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Hi, I have been able to setup the bridged adapter on
[jira] [Updated] (CLOUDSTACK-424) Updated userdata not propagating to the VR.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav updated CLOUDSTACK-424: --- Fix Version/s: 4.1.0 Updated userdata not propagating to the VR. Key: CLOUDSTACK-424 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-424 Project: CloudStack Issue Type: Bug Components: KVM, VMware, Xen Affects Versions: pre-4.0.0 Reporter: Nick Wales Labels: kvm, userdata, vr Fix For: 4.1.0 Updating the userdata does not update the VR even after the VR has been stopped and started. This is on a KVM setup. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CLOUDSTACK-424) Updated userdata not propagating to the VR.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav updated CLOUDSTACK-424: --- Component/s: Xen VMware Updated userdata not propagating to the VR. Key: CLOUDSTACK-424 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-424 Project: CloudStack Issue Type: Bug Components: KVM, VMware, Xen Affects Versions: pre-4.0.0 Reporter: Nick Wales Labels: kvm, userdata, vr Fix For: 4.1.0 Updating the userdata does not update the VR even after the VR has been stopped and started. This is on a KVM setup. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CLOUDSTACK-479) UpdateVirtualMachine api fails to propagate userdata to domr
[ https://issues.apache.org/jira/browse/CLOUDSTACK-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav resolved CLOUDSTACK-479. Resolution: Duplicate Duplicate of: https://issues.apache.org/jira/browse/CLOUDSTACK-424 UpdateVirtualMachine api fails to propagate userdata to domr Key: CLOUDSTACK-479 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-479 Project: CloudStack Issue Type: Bug Components: API Affects Versions: 4.0.0 Reporter: Rohit Yadav Assignee: Rohit Yadav Fix For: 4.1.0 If we pass base64 encoded userdata to updateVirtualMachine api, it fails to propagate the decoded data on to its /var/www/html/userdata/user-vm-ip/user-data. This data can be useful while mass deploying vms that take conf. from domr, use cases can be chef/puppet controlled deployments etc. On cloudmonkey cli, for some test vm id: $ update virtualmachine id=903e3b3f-37e4-4263-ba26-ceb9f06da19f displayname=myvm 123 userdata=QSBxdWljayBicm93biBmb3gganVtcHMgb3ZlciBhIGxhenkgZG9nCg== After successful execution, one should be able to GET the data from domr-ip/userdata/10.147.28.237/user-data which is the decoded data: A quick brown fox jumps over a lazy dog -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CLOUDSTACK-424) Updated userdata not propagating to the VR.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13497981#comment-13497981 ] Rohit Yadav commented on CLOUDSTACK-424: Close a duplicate, additional info on this bug on the closed issue: https://issues.apache.org/jira/browse/CLOUDSTACK-479 Affects Xen, VMWare too. Updated userdata not propagating to the VR. Key: CLOUDSTACK-424 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-424 Project: CloudStack Issue Type: Bug Components: KVM, VMware, Xen Affects Versions: pre-4.0.0 Reporter: Nick Wales Labels: kvm, userdata, vr Fix For: 4.1.0 Updating the userdata does not update the VR even after the VR has been stopped and started. This is on a KVM setup. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: git commit: add storage motion interface
Is this a reshuffling of the current storage motion or is there
something new planned for here?
--David
On Wed, Nov 14, 2012 at 8:47 PM, edi...@apache.org wrote:
Updated Branches:
refs/heads/javelin b38d9b82b - cad75e722
add storage motion interface
Project: http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/commit/cad75e72
Tree:
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/tree/cad75e72
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/diff/cad75e72
Branch: refs/heads/javelin
Commit: cad75e7220a85c03891b0708e11a59297f5a8007
Parents: b38d9b8
Author: Edison Su sudi...@gmail.com
Authored: Wed Nov 14 17:47:09 2012 -0800
Committer: Edison Su sudi...@gmail.com
Committed: Wed Nov 14 17:47:24 2012 -0800
--
.../com/cloud/template/VirtualMachineTemplate.java |1 -
.../engine/cloud/entity/api/TemplateEntity.java|2 +-
.../storage/StorageOrchestratorImpl.java |2 +-
.../datastore/DefaultPrimaryDataStoreImpl.java | 20 +---
.../storage/datastore/PrimaryDataStore.java|2 +
.../storage/image/ImageMotionService.java | 24 -
.../storage/image/ImageMotionServiceImpl.java | 35 -
.../cloudstack/storage/image/TemplateObject.java |8 +++
.../image/motion/DefaultImageMotionProvider.java | 23 +
.../storage/image/motion/ImageMotionProvider.java | 26 ++
.../storage/image/motion/ImageMotionService.java | 27 ++
.../image/motion/ImageMotionServiceImpl.java | 38 +++
12 files changed, 139 insertions(+), 69 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/blob/cad75e72/api/src/com/cloud/template/VirtualMachineTemplate.java
--
diff --git a/api/src/com/cloud/template/VirtualMachineTemplate.java
b/api/src/com/cloud/template/VirtualMachineTemplate.java
index 27f5871..00a4143 100755
--- a/api/src/com/cloud/template/VirtualMachineTemplate.java
+++ b/api/src/com/cloud/template/VirtualMachineTemplate.java
@@ -92,6 +92,5 @@ public interface VirtualMachineTemplate extends
ControlledEntity {
Long getSourceTemplateId();
String getTemplateTag();
-
Map getDetails();
}
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/blob/cad75e72/engine/api/src/org/apache/cloudstack/engine/cloud/entity/api/TemplateEntity.java
--
diff --git
a/engine/api/src/org/apache/cloudstack/engine/cloud/entity/api/TemplateEntity.java
b/engine/api/src/org/apache/cloudstack/engine/cloud/entity/api/TemplateEntity.java
index 5978cc7..ac01bde 100755
---
a/engine/api/src/org/apache/cloudstack/engine/cloud/entity/api/TemplateEntity.java
+++
b/engine/api/src/org/apache/cloudstack/engine/cloud/entity/api/TemplateEntity.java
@@ -23,5 +23,5 @@ import
org.apache.cloudstack.engine.entity.api.CloudStackEntity;
import com.cloud.template.VirtualMachineTemplate;
public interface TemplateEntity extends CloudStackEntity,
VirtualMachineTemplate {
-
+
}
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/blob/cad75e72/engine/storage/src/org/apache/cloudstack/storage/StorageOrchestratorImpl.java
--
diff --git
a/engine/storage/src/org/apache/cloudstack/storage/StorageOrchestratorImpl.java
b/engine/storage/src/org/apache/cloudstack/storage/StorageOrchestratorImpl.java
index eb3b1e0..356190f 100644
---
a/engine/storage/src/org/apache/cloudstack/storage/StorageOrchestratorImpl.java
+++
b/engine/storage/src/org/apache/cloudstack/storage/StorageOrchestratorImpl.java
@@ -348,7 +348,7 @@ public class StorageOrchestratorImpl implements
StorageOrchestrator {
PrimaryDataStore pd =
primaryStorageMgr.getPrimaryDataStore(dataStoreId);
boolean existsOnPrimaryStorage =
pd.templateExists(template.getId());
if (!existsOnPrimaryStorage) {
-
+ pd.installTemplate(template);
}
return false;
}
http://git-wip-us.apache.org/repos/asf/incubator-cloudstack/blob/cad75e72/engine/storage/src/org/apache/cloudstack/storage/datastore/DefaultPrimaryDataStoreImpl.java
--
diff --git
a/engine/storage/src/org/apache/cloudstack/storage/datastore/DefaultPrimaryDataStoreImpl.java
b/engine/storage/src/org/apache/cloudstack/storage/datastore/DefaultPrimaryDataStoreImpl.java
index bafd280..a87b195 100644
---
[jira] [Closed] (CLOUDSTACK-479) UpdateVirtualMachine api fails to propagate userdata to domr
[ https://issues.apache.org/jira/browse/CLOUDSTACK-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav closed CLOUDSTACK-479. -- Closing as it's a duplicate issue. UpdateVirtualMachine api fails to propagate userdata to domr Key: CLOUDSTACK-479 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-479 Project: CloudStack Issue Type: Bug Components: API Affects Versions: 4.0.0 Reporter: Rohit Yadav Assignee: Rohit Yadav Fix For: 4.1.0 If we pass base64 encoded userdata to updateVirtualMachine api, it fails to propagate the decoded data on to its /var/www/html/userdata/user-vm-ip/user-data. This data can be useful while mass deploying vms that take conf. from domr, use cases can be chef/puppet controlled deployments etc. On cloudmonkey cli, for some test vm id: $ update virtualmachine id=903e3b3f-37e4-4263-ba26-ceb9f06da19f displayname=myvm 123 userdata=QSBxdWljayBicm93biBmb3gganVtcHMgb3ZlciBhIGxhenkgZG9nCg== After successful execution, one should be able to GET the data from domr-ip/userdata/10.147.28.237/user-data which is the decoded data: A quick brown fox jumps over a lazy dog -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CLOUDSTACK-424) Updated userdata not propagating to the VR.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav resolved CLOUDSTACK-424. Resolution: Fixed Fixed on master: commit 4c86b1545dda53b74c534d479133692331e12a28 Author: Rohit Yadav bhais...@apache.org Date: Thu Nov 15 17:53:33 2012 +0530 Updated userdata not propagating to the VR. Key: CLOUDSTACK-424 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-424 Project: CloudStack Issue Type: Bug Components: KVM, VMware, Xen Affects Versions: pre-4.0.0 Reporter: Nick Wales Assignee: Rohit Yadav Labels: kvm, userdata, vr Fix For: 4.1.0 Updating the userdata does not update the VR even after the VR has been stopped and started. This is on a KVM setup. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CLOUDSTACK-424) Updated userdata not propagating to the VR.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav reassigned CLOUDSTACK-424: -- Assignee: Rohit Yadav Updated userdata not propagating to the VR. Key: CLOUDSTACK-424 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-424 Project: CloudStack Issue Type: Bug Components: KVM, VMware, Xen Affects Versions: pre-4.0.0 Reporter: Nick Wales Assignee: Rohit Yadav Labels: kvm, userdata, vr Fix For: 4.1.0 Updating the userdata does not update the VR even after the VR has been stopped and started. This is on a KVM setup. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CLOUDSTACK-489) Document how to use userdata feature for user vms
Rohit Yadav created CLOUDSTACK-489:
--
Summary: Document how to use userdata feature for user vms
Key: CLOUDSTACK-489
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-489
Project: CloudStack
Issue Type: Bug
Components: Doc
Affects Versions: pre-4.0.0
Environment: KVM, Xen, VMWare etc.
Reporter: Rohit Yadav
Fix For: 4.1.0
The userdata should be a base64 encoded string upto 2KB which is put on domr's
html directory and using HTTP GET the userdata information can be obtained from
the domr. The operation does not require the VM to be in stopped state, though
it is advised to stop and call this api in case the user vm has a script
which gets the userdata information from domr while starting.
It is fixed with 4c86b1545dda53b74c534d479133692331e12a28. We need to document
it, how to use userdata, for example, this script can be used to fetch the data:
server_ip=$(grep dhcp-server-identifier /var/lib/dhclient-eth0.leases |
tail -1 | awk '{print $NF}' | tr '\;' ' ')
wget http://${server_ip}/latest/user-data
This feature can be useful, for example to use into puppet facts [1], or to do
automation and horizontal scaling etc. based on userdata.
[0]
http://incubator.apache.org/cloudstack/docs/api/apidocs-4.0.0/domain_admin/updateVirtualMachine.html
[1]
http://geek.jasonhancock.com/2011/11/09/cloudstack-userdata-into-puppet-facts/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Can we still use DevCloud VM Image ?
And this point means what -- Preseed a systemvm template ? On Thu, Nov 15, 2012 at 12:08 PM, Rohit Yadav rohit.ya...@citrix.comwrote: On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.com wrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the point when I restart it, also the default sd card (it's storage, think hdd) is small (4GB) and the disk io is very small re-flashing it every time consumes a lot of my time, ordered a 16GB class10 sd card for better disk io, will keep you posted how this experiment went, I've a gut feeling though this won't work given the resource constraints. Regards. Regards, Charles On Sun, Nov 11, 2012 at 5:50 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Not really, in my setup I want eth0 to be host-only which is causing some issues; another problem is I'm making it x86 only, so I see few crashes. Will update when I'm done. From: Charles Moulliard [ch0...@gmail.com] Sent: Sunday, November 11, 2012 9:06 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Did you succeed it to fix the routing issues ? On Sat, Nov 10, 2012 at 1:53 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, it won't work as the vms inside host only network can only access the host os and other vms on it. Therefore devcloud inside host-only network won't be able to reach the Internet. I'm actually trying to create a new devcloud image with two network adapters, one NAT (eth1, so devcloud is able to reach the Internet) and one host-only adapter (eth0, so we can run mgmt server etc.) and it will be only 300-350MB (archived). I was trying not the share the image, having some routing issues when I do that, will share as soon I fix those issues. -- Rohit PS. the base system is ubuntu x86 precise and the untouched stripped down vm is available here: http://bhaisaab.org/vms
Re: Can we still use DevCloud VM Image ?
As of ubuntu-11 is configured use xen, As of Ubuntu 11.10 (Oneiric), the default kernel included in Ubuntu can be used directly with the Xen hypervisor as the management (or control) domain (Dom0 or Domain0 in Xen terminology). why don't you create an image using it ? On Thu, Nov 15, 2012 at 12:08 PM, Rohit Yadav rohit.ya...@citrix.comwrote: On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.com wrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the point when I restart it, also the default sd card (it's storage, think hdd) is small (4GB) and the disk io is very small re-flashing it every time consumes a lot of my time, ordered a 16GB class10 sd card for better disk io, will keep you posted how this experiment went, I've a gut feeling though this won't work given the resource constraints. Regards. Regards, Charles On Sun, Nov 11, 2012 at 5:50 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Not really, in my setup I want eth0 to be host-only which is causing some issues; another problem is I'm making it x86 only, so I see few crashes. Will update when I'm done. From: Charles Moulliard [ch0...@gmail.com] Sent: Sunday, November 11, 2012 9:06 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Did you succeed it to fix the routing issues ? On Sat, Nov 10, 2012 at 1:53 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, it won't work as the vms inside host only network can only access the host os and other vms on it. Therefore devcloud inside host-only network won't be able to reach the Internet. I'm actually trying to create a new devcloud image with two network adapters, one NAT (eth1, so devcloud is able to reach the Internet) and one host-only adapter (eth0, so we can run mgmt server etc.) and it will be only 300-350MB (archived). I was trying not the share the image, having some
Re: CLI for CloudStack: cloudmonkey
On 15-Nov-2012, at 3:26 PM, Dave Cahill dcah...@midokura.jp wrote: Hi Rohit, I've been using cloudmonkey to script my CloudStack setup process in dev, and had one question. How do we pass complex (MAP) parameters to cloudmonkey? For example, when setting up a networkoffering, there's a serviceProviderList parameter which is a list of items, each of which has several key value pairs. I tried a couple of syntaxes to pass this parameter, but didn't come across the correct one yet - can you enlighten me? ;) Hi Dave, thanks for catching the bug. The way maps are handled in url are very different than how cloudmonkey parses and passing key,values. This actually needs to be fixed in Marvin, I've figured out a way but it may cause issues with marvin, will discuss with Prasanna and fix it soon. You may file an issues if you want to. Regards. Thanks for your work on this, very useful. Thanks, Dave. On Mon, Nov 12, 2012 at 7:01 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, Karaf seems nice, and no worries I don't see any suggestions as flames or war. I would anytime throw away any code for something better, so feel free to start writing your own client and share with us. Patches welcome! Let me share why I wrote it in Python: - First of all the CLI is not even a client to start with, I mean I've totally based it off marvin. It's a small wrapper I would say around marvin. - Python because, the environment is preinstalled on Macs and almost all Linux distros. - Scripting environment that Python provides so one can fork and edit their own versions of cloudmonkey CLI, this saves the user from hack-compile-build-run loop; one can just hack and run. - The best part again is marvin as dependency, you write javadocs etc. in your java code, apidocs gets interface definition and requirements from the java code, the commands.xml created in the process is used by marvin's codegenerator which generates api modules with Cmd and Response classes. The generated cloudstackAPI is used by both marvin clients and the CLI. The CLI which is about 400 lines of Python, in turn loads these modules and generates grammar and command handlers on the fly using some functional magic (injects functions into the classes), I don't think this kind of programming is even possible with Java, they don't have functions as first class citizens. What does the last statement mean for the developers: So, if a developer simply adds a new API which is java code, with required docs etc. apidocs will pick it up automatically and in turn marvin (and it's test clients) will get new cloudstackAPI and CLI too gets the new APIs on the fly. The functional closures in CLI will make sure the new APIs and its handlers are created with grammar rules. The developer won't need to change apidocs, marvin or CLI. I think this is one of my best hacks [0] which leverages on existing code and I think it would be very maintainable in future. Sorry everyone, I'm caught up with some other issues, I want to post a screencast and blog explaining the CLI but only after I finalize the specs for the CLI. Thanks for the feedback so far. The top TODOs left now are: - Reverse search - Bash/zsh completion Regards. PS. Just in case you're curious: [0] https://github.com/bhaisaab/hacktools From: Charles Moulliard [ch0...@gmail.com] Sent: Monday, November 12, 2012 12:49 PM To: cloudstack-dev Subject: Re: CLI for CloudStack: cloudmonkey Hi, I don't want to create a developer war or position a technology against another (python against java) but we could leverage Apache Karaf (OSGI runtime container) project to provide the cloudmonkey client. This work has already be done for jclouds (http://www.youtube.com/watch?v=EKVkm6AV19U, https://github.com/jclouds/jclouds-karaf) and could be easily created created for cloudmonkey. Karaf which is a shell environment proposes a lot of by default features (http://karaf.apache.org/ : ssh, jaas, provisioning, administration, history, config files support, ... - http://karaf.apache.org/manual/latest-2.3.x/developers-guide/index.html) that we could extend with cloudmonkey commands ( http://karaf.apache.org/manual/latest-2.3.x/developers-guide/extending-console.html ) and rebrand Karaf into a cloudmonkey karaf container. Regards, Charles On Fri, Nov 9, 2012 at 10:53 PM, Musayev, Ilya imusa...@webmd.net wrote: I guess mine got wiped somehow... -Original Message- From: Musayev, Ilya [mailto:imusa...@webmd.net] Sent: Friday, November 09, 2012 4:51 PM To: cloudstack-dev@incubator.apache.org Subject: RE: CLI for CloudStack: cloudmonkey Rohit History seems to retain only last session and not previous - is this by design? Thanks ilya -Original Message- From: sebgoa [mailto:run...@gmail.com] Sent: Friday, November 09, 2012 4:52 AM To: cloudstack-dev@incubator.apache.org
Re: Can we still use DevCloud VM Image ?
On 15-Nov-2012, at 7:12 PM, Charles Moulliard ch0...@gmail.com wrote: As of ubuntu-11 is configured use xen, As of Ubuntu 11.10 (Oneiric), the default kernel included in Ubuntu can be used directly with the Xen hypervisor as the management (or control) domain (Dom0 or Domain0 in Xen terminology). why don't you create an image using it ? Yes, I'm using this only. apt-get install xen-hypervisor and you're done. To use xen, one just need to select the kernel with xen during booting on grub. If you're keep, hack ~/.bash_history from the DevCloud image, the history will tell you what was performed to create devcloud. About pre-seeding systemvm template, see this: http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template You need to pre-seed, i.e. put a systemvm template on nfs with which your systemvm, cpvm and domr are created. Regards. On Thu, Nov 15, 2012 at 12:08 PM, Rohit Yadav rohit.ya...@citrix.comwrote: On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.com wrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the point when I restart it, also the default sd card (it's storage, think hdd) is small (4GB) and the disk io is very small re-flashing it every time consumes a lot of my time, ordered a 16GB class10 sd card for better disk io, will keep you posted how this experiment went, I've a gut feeling though this won't work given the resource constraints. Regards. Regards, Charles On Sun, Nov 11, 2012 at 5:50 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Not really, in my setup I want eth0 to be host-only which is causing some issues; another problem is I'm making it x86 only, so I see few crashes. Will update when I'm done. From: Charles Moulliard [ch0...@gmail.com] Sent: Sunday, November 11, 2012 9:06 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Did you succeed it to fix the
same vlan on different nics
https://issues.apache.org/jira/browse/CLOUDSTACK-226 It looks like this was fixed (11fe086adab8e790018343252ed08aac9a27b1c6) by making sure that a particular vlan range can only exist on one physical network. Is there any technical reason for this? It looks like the fix worked around the unique key restriction in the database schema, is that the only limiting factor? We recently changed the naming scheme of KVM bridges to allow the same vlan to be used on different physical networks, so I can make the solution KVM specific. I'm just not sure why this limitation was created in the first place (the schema, not the fix) and want to gather some info before doing too much. I'd rather just make the key unique to vlan on physical network and let the individual doing the implementation decide if they want to do multiple layer2 domains to their boxes or not.
RE: Integrating autoscale branch to master?
Any thoughts? Unless we hear otherwise would like to push the patches. This feature had been code complete for a very long time. If there are still concerns/opinions let us know and we can take steps to correct them. Thanks, Ram -Original Message- From: Ram Ganesh [mailto:ram.gan...@citrix.com] Sent: 15 November 2012 07:09 To: cloudstack-dev@incubator.apache.org Subject: RE: Integrating autoscale branch to master? David, Can we go ahead with merge of AutoScale code into master? Are there any more open questions? Thanks, Ram -Original Message- From: Vijay Venkatachalam [mailto:vijay.venkatacha...@citrix.com] Sent: 13 November 2012 12:34 To: cloudstack-dev@incubator.apache.org Subject: RE: Integrating autoscale branch to master? My replies inline Thanks, Vijay V. -Original Message- From: David Nalley [mailto:da...@gnsa.us] Sent: Monday, October 15, 2012 7:42 PM To: cloudstack-dev@incubator.apache.org Subject: Re: Integrating autoscale branch to master? On Fri, Oct 12, 2012 at 11:54 AM, Vijay Venkatachalam vijay.venkatacha...@citrix.com wrote: Ok I will keep changes ready, and will merge once 4.0's news is declared. -Vijay V. Vijay, I haven't kept up with this recently so a couple of questions/assumptions: 1. Autoscale code will require NetScaler libraries right? There are 2 parts to autoscale code. A. AutoScale Manager and its services, This is part of the core. And has no No Netscaler jar dependency; This part is coded like any other NetworkServiceManager, meaning any network element can provide autoscale service. So this part does not have compile time dependency with NetScaler jar. If an autoscale provider (which is most likely already an LB provider) does not exist in that network an error is thrown at run time. So for all oss builds (where Netscaler is not packaged and cannot be added to the infrastructure) we should get a run-time error when configuring autoscale. B. NetScaler Element and Netscaler Resource (which is part of non-oss build today) has been enhanced to provide autoscale capability. Today only NetScaler does this, in future any network element can he enhanced to provide autoscale. This part already has NetScaler jar dependency (and is considered non-oss today) and will continue to have NetScaler jar dependency. 2. Is autoscale functionality modular enough that we can turn building it on/off at will? Short Answer, No. Since AutoScale is like an addon to LB there are touch- points. For example, when a LoadBalancerRule is deleted the AutoScale entities created for it also should be deleted, hence the dependency. Basically there is code in LB core to delete autoscale entities on the loadbalancer rule's delete path. Hence Part (A.) could not be modularized. Is there an alternative here? Also, in the UI autoscale will appear as part of LB to the user and if he attempts to configure AutoScale in a network which does not have NetScaler; he will get a run-time error. 3. Has there been any change to the netscaler java library licensing? I know there was work underway, but I never heard about a conclusion. I am still chasing the legal team on this, but for the moment, we should continue to treat NetScaler as non-oss. --David
[jira] [Commented] (CLOUDSTACK-226) UpdatePhysicalNetworkcommand failed due to java.sql.BatchUpdateException ; Tried to extend the existing Guest VLAN Range of one physical network into the Guest VLA
[
https://issues.apache.org/jira/browse/CLOUDSTACK-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498125#comment-13498125
]
Marcus Sorensen commented on CLOUDSTACK-226:
Any reason why we don't just remove the unique key on vnet/data_center_id,
perhaps replace it with vnet/physical_network_id?
UpdatePhysicalNetworkcommand failed due to java.sql.BatchUpdateException ;
Tried to extend the existing Guest VLAN Range of one physical network into
the Guest VLAN range of the other physical network
-
Key: CLOUDSTACK-226
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-226
Project: CloudStack
Issue Type: Bug
Components: Management Server
Affects Versions: pre-4.0.0
Reporter: Chandan Purushothama
Assignee: Alena Prokharchyk
Fix For: 4.1.0
===
Steps to Reproduce:
===
1. Deploy an Advanced Zone setup with two Physical Networks where Physical
Network 1 carries management,storage,public and guest traffic while Physical
Network 2 carries only guest traffic.
2. Provide Guest VLAN Range 2480 to 2500 on Physical Network 1 during
deployment of the setup.
3. Provide Guest VLAN Range 2501 to 2520 on Physical Network 2 during
deployment of the setup.
4. Once the deployment is done, edit the guest network details of Physical
Network 1 such that the End Guest VLAN is edited from 2500 to 2510.
5. Click on Apply and observe the observation mentioned below.
==
Before Extending the Guest VLAN Range of Physical Network:
==
mysql select * from physical_network \G
*** 1. row ***
id: 200
uuid: 6c5c0857-ca27-4e6d-97ad-64d82230db24
name: Physical Network 1
data_center_id: 1
vnet: 2481-2500
speed: NULL
domain_id: NULL
broadcast_domain_range: ZONE
state: Enabled
created: 2012-09-26 01:51:55
removed: NULL
*** 2. row ***
id: 201
uuid: 01736ead-fbf2-49b5-8e23-754db2e8afa1
name: Physical Network 2
data_center_id: 1
vnet: 2501-2520
speed: NULL
domain_id: NULL
broadcast_domain_range: ZONE
state: Enabled
created: 2012-09-26 01:51:55
removed: NULL
2 rows in set (0.00 sec)
=
UpdatePhysicalNetworkCmd Job:
=
2012-09-27 14:15:18,835 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-16:null) submit async job-70, details: AsyncJobVO {id:70,
userId: 2, accountId: 2, sessionKey: null, instanceType: PhysicalNetwork,
instanceId: null, cmd: com.cloud.api.commands.UpdatePhysicalNetworkCmd,
cmdOriginator: null, cmdInfo:
{tags:guest1,response:json,id:6c5c0857-ca27-4e6d-97ad-64d82230db24,sessionkey:zXjqIlsgiABR8Ty4cYpLI+hNitE\u003d,ctxUserId:2,vlan:2481-2510,_:1348780808027,ctxAccountId:2,ctxStartEventId:294},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 7471666038533,
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2012-09-27 14:15:18,840 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-47:job-70) Executing
com.cloud.api.commands.UpdatePhysicalNetworkCmd for job-70
2012-09-27 14:15:18,852 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-47:job-70) ISOLATION METHODS:[VLAN]
2012-09-27 14:15:18,861 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-47:job-70) Adding vnet range 2501-2510 for the physicalNetwork
id= 200 and zone id=1 as a part of updatePhysicalNetwork call
2012-09-27 14:15:18,885 DEBUG [db.Transaction.Transaction]
(Job-Executor-47:job-70) Rolling back the transaction: Time = 23 Name =
-AsyncJobManagerImpl$1.run:398-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRun:334-FutureTask.run:166-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679;
called by
[jira] [Commented] (CLOUDSTACK-183) hitting exception and system VM are not coming up
[
https://issues.apache.org/jira/browse/CLOUDSTACK-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498136#comment-13498136
]
Gaetan Allart commented on CLOUDSTACK-183:
--
Having the exact same issue with latest CloudStack for Debian (from apt repo).
hitting exception and system VM are not coming up
-
Key: CLOUDSTACK-183
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-183
Project: CloudStack
Issue Type: Bug
Components: Install and Setup
Affects Versions: pre-4.0.0
Environment: build:
Git Revision: 0699d65ef155aeff60aab294987815251cc94900
Git URL: https://git-wip-us.apache.org/repos/asf/incubator-cloudstack.git
Reporter: shweta agarwal
Priority: Blocker
Fix For: pre-4.0.0
Attachments: management-server.log, SMlog
I have xen6.0.2
I am trying to use build
http://jenkins.cloudstack.org/job/build-4.0-rhel63/55/artifact/CloudStack-oss-4.0.0-55.tar.bz2
hitting Exception MY MS log shows
2012-09-21 15:38:14,357 DEBUG [cloud.storage.StorageManagerImpl]
(consoleproxy-1:null) Checking if we need to prepare 1 volumes for
VM[ConsoleProxy|v-2-VM]
2012-09-21 15:38:14,370 DEBUG [cloud.storage.StorageManagerImpl]
(consoleproxy-1:null) Creating volume: Vol[2|vm=2|ROOT]
2012-09-21 15:38:14,370 DEBUG [cloud.storage.StorageManagerImpl]
(consoleproxy-1:null) Trying to create in Pool[200|NetworkFilesystem]
2012-09-21 15:38:14,393 DEBUG [cloud.template.TemplateManagerImpl]
(consoleproxy-1:null) Downloading template 1 to pool 200
2012-09-21 15:38:14,408 DEBUG [cloud.template.TemplateManagerImpl]
(consoleproxy-1:null) Downloading 1 via 1
2012-09-21 15:38:14,415 DEBUG [agent.transport.Request] (consoleproxy-1:null)
Seq 1-1277493258: Sending { Cmd , MgmtId: 59793358248320, via: 1, Ver: v1,
Flags: 100111,
[{storage.PrimaryStorageDownloadCommand:{localPath:/mnt/6ce86454-a33f-3551-a1df-bf9cf191dded,poolUuid:6ce86454-a33f-3551-a1df-bf9cf191dded,poolId:200,secondaryStorageUrl:nfs://10.147.28.7/export/home/shweta/asfsecondary,primaryStorageUrl:nfs://10.147.28.7/export/home/shweta/asfprimary,url:nfs://10.147.28.7/export/home/shweta/asfsecondary/template/tmpl/1/1/,format:VHD,accountId:1,name:routing-1,wait:10800}}]
}
2012-09-21 15:38:14,416 DEBUG [agent.transport.Request] (consoleproxy-1:null)
Seq 1-1277493258: Executing: { Cmd , MgmtId: 59793358248320, via: 1, Ver:
v1, Flags: 100111,
[{storage.PrimaryStorageDownloadCommand:{localPath:/mnt/6ce86454-a33f-3551-a1df-bf9cf191dded,poolUuid:6ce86454-a33f-3551-a1df-bf9cf191dded,poolId:200,secondaryStorageUrl:nfs://10.147.28.7/export/home/shweta/asfsecondary,primaryStorageUrl:nfs://10.147.28.7/export/home/shweta/asfprimary,url:nfs://10.147.28.7/export/home/shweta/asfsecondary/template/tmpl/1/1/,format:VHD,accountId:1,name:routing-1,wait:10800}}]
}
2012-09-21 15:38:14,416 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-5:null) Seq 1-1277493258: Executing request
2012-09-21 15:38:16,666 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-5:null) destoryVDIbyNameLabel failed due to there are 0 VDIs
with name cloud-4dd59ba5-e791-4289-9048-c925b28310ad
2012-09-21 15:38:16,666 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-5:null) can not create vdi in sr
7978e087-b632-8349-78e7-d3c6e7effeef
2012-09-21 15:38:16,667 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-5:null) Catch Exception
com.cloud.utils.exception.CloudRuntimeException on
host:186c239f-392e-4088-b5b2-03a4efc3c432 for template:
nfs://10.147.28.7/export/home/shweta/asfsecondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
7978e087-b632-8349-78e7-d3c6e7effeef
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
7978e087-b632-8349-78e7-d3c6e7effeef
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2672)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2694)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:481)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
[jira] [Updated] (CLOUDSTACK-487) HttpClient in multithreaded environment
[ https://issues.apache.org/jira/browse/CLOUDSTACK-487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hiroaki Kawai updated CLOUDSTACK-487: - Description: Running cloudstack with nicira nvp plugin, I got following error. It seems that HttpClient in servlet must use MultiThreadedHttpConnectionManager explicitly. Patch will be submitted in reviewboard. 2012-11-14 18:21:51,576 WARN [commons.httpclient.SimpleHttpConnectionManager] (DirectAgent-62:null) SimpleHttpConnectionManager being used incorrectly. Be sure that HttpMethod.releaseConnection() is always called and that only one thread and/or method is using this connection manager at a time. 2012-11-14 18:21:52,017 WARN [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 5-847183891: Exception Caught while executing command java.lang.IllegalStateException: Connection is not open at org.apache.commons.httpclient.HttpConnection.assertOpen(HttpConnection.java:1277) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:974) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:943) at org.apache.commons.httpclient.HttpConnection.print(HttpConnection.java:1033) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2187) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2060) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at com.cloud.network.nicira.NiciraNvpApi.executeMethod(NiciraNvpApi.java:344) at com.cloud.network.nicira.NiciraNvpApi.executeDeleteObject(NiciraNvpApi.java:294) at com.cloud.network.nicira.NiciraNvpApi.deleteLogicalSwitchPort(NiciraNvpApi.java:172) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:286) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:192) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:172) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) was: Running cloudstack with nicira nvp plugin, I got following error. It seems that HttpClient in servlet must use MultiThreadedHttpConnectionManager explicitly. Patch will be submitted in reviewboard. https://reviews.apache.org/r/8075/ 2012-11-14 18:21:51,576 WARN [commons.httpclient.SimpleHttpConnectionManager] (DirectAgent-62:null) SimpleHttpConnectionManager being used incorrectly. Be sure that HttpMethod.releaseConnection() is always called and that only one thread and/or method is using this connection manager at a time. 2012-11-14 18:21:52,017 WARN [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 5-847183891: Exception Caught while executing command java.lang.IllegalStateException: Connection is not open at org.apache.commons.httpclient.HttpConnection.assertOpen(HttpConnection.java:1277) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:974) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:943) at org.apache.commons.httpclient.HttpConnection.print(HttpConnection.java:1033) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2187) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2060) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at
[jira] [Comment Edited] (CLOUDSTACK-226) UpdatePhysicalNetworkcommand failed due to java.sql.BatchUpdateException ; Tried to extend the existing Guest VLAN Range of one physical network into the Gues
[
https://issues.apache.org/jira/browse/CLOUDSTACK-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498125#comment-13498125
]
Marcus Sorensen edited comment on CLOUDSTACK-226 at 11/15/12 5:14 PM:
--
Any reason why we don't just remove the unique key on vnet,data_center_id,
perhaps replace it with vnet,physical_network_id,data_center_id?
was (Author: mlsorensen):
Any reason why we don't just remove the unique key on vnet/data_center_id,
perhaps replace it with vnet/physical_network_id?
UpdatePhysicalNetworkcommand failed due to java.sql.BatchUpdateException ;
Tried to extend the existing Guest VLAN Range of one physical network into
the Guest VLAN range of the other physical network
-
Key: CLOUDSTACK-226
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-226
Project: CloudStack
Issue Type: Bug
Components: Management Server
Affects Versions: pre-4.0.0
Reporter: Chandan Purushothama
Assignee: Alena Prokharchyk
Fix For: 4.1.0
===
Steps to Reproduce:
===
1. Deploy an Advanced Zone setup with two Physical Networks where Physical
Network 1 carries management,storage,public and guest traffic while Physical
Network 2 carries only guest traffic.
2. Provide Guest VLAN Range 2480 to 2500 on Physical Network 1 during
deployment of the setup.
3. Provide Guest VLAN Range 2501 to 2520 on Physical Network 2 during
deployment of the setup.
4. Once the deployment is done, edit the guest network details of Physical
Network 1 such that the End Guest VLAN is edited from 2500 to 2510.
5. Click on Apply and observe the observation mentioned below.
==
Before Extending the Guest VLAN Range of Physical Network:
==
mysql select * from physical_network \G
*** 1. row ***
id: 200
uuid: 6c5c0857-ca27-4e6d-97ad-64d82230db24
name: Physical Network 1
data_center_id: 1
vnet: 2481-2500
speed: NULL
domain_id: NULL
broadcast_domain_range: ZONE
state: Enabled
created: 2012-09-26 01:51:55
removed: NULL
*** 2. row ***
id: 201
uuid: 01736ead-fbf2-49b5-8e23-754db2e8afa1
name: Physical Network 2
data_center_id: 1
vnet: 2501-2520
speed: NULL
domain_id: NULL
broadcast_domain_range: ZONE
state: Enabled
created: 2012-09-26 01:51:55
removed: NULL
2 rows in set (0.00 sec)
=
UpdatePhysicalNetworkCmd Job:
=
2012-09-27 14:15:18,835 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-16:null) submit async job-70, details: AsyncJobVO {id:70,
userId: 2, accountId: 2, sessionKey: null, instanceType: PhysicalNetwork,
instanceId: null, cmd: com.cloud.api.commands.UpdatePhysicalNetworkCmd,
cmdOriginator: null, cmdInfo:
{tags:guest1,response:json,id:6c5c0857-ca27-4e6d-97ad-64d82230db24,sessionkey:zXjqIlsgiABR8Ty4cYpLI+hNitE\u003d,ctxUserId:2,vlan:2481-2510,_:1348780808027,ctxAccountId:2,ctxStartEventId:294},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 7471666038533,
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2012-09-27 14:15:18,840 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-47:job-70) Executing
com.cloud.api.commands.UpdatePhysicalNetworkCmd for job-70
2012-09-27 14:15:18,852 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-47:job-70) ISOLATION METHODS:[VLAN]
2012-09-27 14:15:18,861 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-47:job-70) Adding vnet range 2501-2510 for the physicalNetwork
id= 200 and zone id=1 as a part of updatePhysicalNetwork call
2012-09-27 14:15:18,885 DEBUG [db.Transaction.Transaction]
(Job-Executor-47:job-70) Rolling back the transaction: Time = 23 Name =
-AsyncJobManagerImpl$1.run:398-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRun:334-FutureTask.run:166-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679;
called by
RE: [DISCUSS] OSGi framework for plugins and more?
-Original Message- From: Mohammad Nour El-Din [mailto:nour.moham...@gmail.com] Sent: Wednesday, November 14, 2012 7:11 AM To: cloudstack-dev@incubator.apache.org Subject: Re: [DISCUSS] OSGi framework for plugins and more? Hi Alex... Thanks for opening the discussion in the direction of what we need to do and how to do it, I thought no one will respond to my request :D On Wed, Nov 14, 2012 at 3:45 PM, Alex Huang alex.hu...@citrix.com wrote: Here's my two-bits on OSGi. I actually started a thread like this sometime ago to which Mohammad reference. I then did some research on what OSGi can do. The problems I looked at using OSGi for just isn't solvable by OSGi. For example, - How to contain fault within an availability zone. - How to do rolling upgrade and phase out the rolling upgrades over a span of days to deal with the time that it might take. - How to do database upgrades/downgrades for the plugins - How to scale different components differently OSGi does solve some problems - How to enable and disable plugins on a production system but I'm not quite sure how reliable that is. Even eclipse asks you to restart eclipse after adding a plugin. I know the answer that Marcel would say about this point :D I just talked to someone who says it does work reliably in their environments. I think after looking at this, then I decided that - For modularity, nothing is better than compilation boundaries. The problem with some of the plugins is that it depends on cloud-core and cloud-server. It shouldn't . All plugins must build to cloud-api only. Since all interfaces of CloudStack is in cloud-api (if you think about that then cloud-api is basically the OSGi bundle), that's sufficient to separate the plugins. - For lifecycle of plugins, it probably requires that we switch to deploy in something like Karaf before we can achieve runtime lifecycle changes. I'm not sure it's entire necessary and it doesn't take care of a plugin's database versioning problem. - To resolve the other problems, we basically need to break cloudstack into separate processes. Hence I've proposed the idea of disaggregating cloudstack. Again, I am not an OSGi expert, but from what you say it is more about compile and build time and making the separation of what one module should depend on what very clear and documented which we already do in my company as we also have a huge stack and also looked into OSGi which again a great tool but when we don't need everything it offers, we exactly needed what you explained and we manage that mostly through good usage of Maven which I know is tricky About the runtime aspects and database versioning I am afraid I am not aware about the internals and the exact requirements and hence I can't give any input On another side, as in either case we need to *disaggregate* ACS, we can make the disaggregated module OSGi ready at least as a 1st step towards assessing whether OSGi is the way we should go or not, and when it is more clear then we can either say no it is not the option we need or we will then be ready for the full move to OSGi Thoughts ? My current thoughts are the large disaggregated CloudStack Services are going to be RESTful services. I don't see any benefits for them to be OSGi components for the reasons I've already listed. However, each service still may deploy plugins. Those plugins can be converted to OSGi. It shouldn't be too difficult to do it as well. --Alex
RE: [DISCUSS] OSGi framework for plugins and more?
-Original Message- From: Alex Huang [mailto:alex.hu...@citrix.com] Sent: Thursday, November 15, 2012 9:15 AM To: cloudstack-dev@incubator.apache.org Subject: RE: [DISCUSS] OSGi framework for plugins and more? -Original Message- From: Mohammad Nour El-Din [mailto:nour.moham...@gmail.com] Sent: Wednesday, November 14, 2012 7:11 AM To: cloudstack-dev@incubator.apache.org Subject: Re: [DISCUSS] OSGi framework for plugins and more? Hi Alex... Thanks for opening the discussion in the direction of what we need to do and how to do it, I thought no one will respond to my request :D On Wed, Nov 14, 2012 at 3:45 PM, Alex Huang alex.hu...@citrix.com wrote: Here's my two-bits on OSGi. I actually started a thread like this sometime ago to which Mohammad reference. I then did some research on what OSGi can do. The problems I looked at using OSGi for just isn't solvable by OSGi. For example, - How to contain fault within an availability zone. - How to do rolling upgrade and phase out the rolling upgrades over a span of days to deal with the time that it might take. - How to do database upgrades/downgrades for the plugins - How to scale different components differently OSGi does solve some problems - How to enable and disable plugins on a production system but I'm not quite sure how reliable that is. Even eclipse asks you to restart eclipse after adding a plugin. I know the answer that Marcel would say about this point :D I just talked to someone who says it does work reliably in their environments. I think after looking at this, then I decided that - For modularity, nothing is better than compilation boundaries. The problem with some of the plugins is that it depends on cloud-core and cloud-server. It shouldn't . All plugins must build to cloud-api only. Since all interfaces of CloudStack is in cloud-api (if you think about that then cloud-api is basically the OSGi bundle), that's sufficient to separate the plugins. - For lifecycle of plugins, it probably requires that we switch to deploy in something like Karaf before we can achieve runtime lifecycle changes. I'm not sure it's entire necessary and it doesn't take care of a plugin's database versioning problem. - To resolve the other problems, we basically need to break cloudstack into separate processes. Hence I've proposed the idea of disaggregating cloudstack. Again, I am not an OSGi expert, but from what you say it is more about compile and build time and making the separation of what one module should depend on what very clear and documented which we already do in my company as we also have a huge stack and also looked into OSGi which again a great tool but when we don't need everything it offers, we exactly needed what you explained and we manage that mostly through good usage of Maven which I know is tricky About the runtime aspects and database versioning I am afraid I am not aware about the internals and the exact requirements and hence I can't give any input On another side, as in either case we need to *disaggregate* ACS, we can make the disaggregated module OSGi ready at least as a 1st step towards assessing whether OSGi is the way we should go or not, and when it is more clear then we can either say no it is not the option we need or we will then be ready for the full move to OSGi Thoughts ? My current thoughts are the large disaggregated CloudStack Services are going to be RESTful services. I don't see any benefits for them to be OSGi components for the reasons I've already listed. However, each service still may deploy plugins. Those plugins can be converted to OSGi. It shouldn't be too difficult to do it as well. And that is if we see there's a good match with OSGi. I can see for example that if people want to add more automation, background monitoring etc, deploying and undeploying those on a live system can be very helpful. That maybe one good use of it. --Alex
Re: [ASFCS41] Proposed schedule for our next release
On Mon, Nov 12, 2012 at 4:28 PM, Chip Childers chip.child...@sungard.com wrote: Taking everyone's input into consideration, I've reworked the proposed schedule (below). I've extended the feature dev period until the end of Jan, giving us a 5 month (3 for features, 2 for testing / wrap-up) schedule for this next release. Does this sound like something we can all get behind? Did I miss any significant issues raised in this or other threads? If the 4.1 schedule proposal works, I'd further propose that we shift to a 4 month schedule for feature releases afterward. IMO, we should be basically developing features outside of a release, and bringing them into master when the window is open for inclusion in the next release. This gives any developer as much time as they would like (although the longer it goes on, the harder it is to potentially integrate back into master), and the community gets a clear view of what our time-based release schedule will look like. This rhythm would set us up with the following high level dates: Proposed schedule for ongoing releases 4.1 Nov through Jan - Feature work Feb and March - Testing / Hardening / Wrap-up 4.2 April and May - Feature work June and July - Testing / Hardening / Wrap-up 4.3 August and September - Feature work October and November - Testing / Hardening / Wrap-up 4.4 Start all over in Dec ** This assumes no major version increments, but we could certainly have one! = New 4.1 detailed schedule proposal: = 2012-11-01 through 2013-01-31 Feature and documentation development (obviously ongoing, but continued during this period) 2013-01-31 Feature Freeze All new feature need to have been merged into master by this date. Release branch will be cut on this date. Jenkins updated to include new release branch builds. 2013-02-01 through 2013-02-28 Testing/Bug Fixes (testing against jenkins artifacts) Documentation Finalization 2013-02-28 Docs Freeze (except release notes and translations) Release Branch moves to limited updates only (only commits allowed in would be release blockers fixes, translation updates, etc...) 2013-03-01 through 2013-03-22 Translation Development and Integration (should be ongoing, but focused effort) Final regression testing / bug fixes / doc fixes 2013-03-22 4.1.0-RC1 is created, and project level VOTE is called Having only heard back from David and Joe on the revised proposal above, I'm going to assume that we're agreeing under a lazy consensus process here. Also, I'll throw my hat into the ring to release manage 4.1.0 (while Joe is doing the 4.0.x releases). I'm happy to step aside for anyone else that may want to do it this time around, but also more than willing to take this next feature release on. Please shout if you have an interest yourself! -chip
RE: [ASFCS41] Proposed schedule for our next release
+1 I'm fine with the proposed schedule as well, but few of my questions were not answered, if they're worth answering: 1. Number of maintenance or bug-fix releases on 4.0.x, 4.1.x etc. and the duration, timeline of the same? 2. Frequency of these rather short term bug-fix releases? 3. Are we going to do a LTS, say for a year or two? 4. Will we have branch/version maintainers, since as per proposed schedule we will have 3-4 branches by the end of next year? I'm happy to have Joe doing 4.0.x (does this mean he's the 4.0 maintainer?) and Chip helping us out once again with 4.1. Regards. From: Chip Childers [chip.child...@sungard.com] Sent: Thursday, November 15, 2012 10:53 PM To: cloudstack-dev@incubator.apache.org Subject: Re: [ASFCS41] Proposed schedule for our next release On Mon, Nov 12, 2012 at 4:28 PM, Chip Childers chip.child...@sungard.com wrote: Taking everyone's input into consideration, I've reworked the proposed schedule (below). I've extended the feature dev period until the end of Jan, giving us a 5 month (3 for features, 2 for testing / wrap-up) schedule for this next release. Does this sound like something we can all get behind? Did I miss any significant issues raised in this or other threads? If the 4.1 schedule proposal works, I'd further propose that we shift to a 4 month schedule for feature releases afterward. IMO, we should be basically developing features outside of a release, and bringing them into master when the window is open for inclusion in the next release. This gives any developer as much time as they would like (although the longer it goes on, the harder it is to potentially integrate back into master), and the community gets a clear view of what our time-based release schedule will look like. This rhythm would set us up with the following high level dates: Proposed schedule for ongoing releases 4.1 Nov through Jan - Feature work Feb and March - Testing / Hardening / Wrap-up 4.2 April and May - Feature work June and July - Testing / Hardening / Wrap-up 4.3 August and September - Feature work October and November - Testing / Hardening / Wrap-up 4.4 Start all over in Dec ** This assumes no major version increments, but we could certainly have one! = New 4.1 detailed schedule proposal: = 2012-11-01 through 2013-01-31 Feature and documentation development (obviously ongoing, but continued during this period) 2013-01-31 Feature Freeze All new feature need to have been merged into master by this date. Release branch will be cut on this date. Jenkins updated to include new release branch builds. 2013-02-01 through 2013-02-28 Testing/Bug Fixes (testing against jenkins artifacts) Documentation Finalization 2013-02-28 Docs Freeze (except release notes and translations) Release Branch moves to limited updates only (only commits allowed in would be release blockers fixes, translation updates, etc...) 2013-03-01 through 2013-03-22 Translation Development and Integration (should be ongoing, but focused effort) Final regression testing / bug fixes / doc fixes 2013-03-22 4.1.0-RC1 is created, and project level VOTE is called Having only heard back from David and Joe on the revised proposal above, I'm going to assume that we're agreeing under a lazy consensus process here. Also, I'll throw my hat into the ring to release manage 4.1.0 (while Joe is doing the 4.0.x releases). I'm happy to step aside for anyone else that may want to do it this time around, but also more than willing to take this next feature release on. Please shout if you have an interest yourself! -chip
RE: Can we still use DevCloud VM Image ?
Yes, hack and go through the .bash_history, setup systemvm template. Then you're pretty much done as long as yout network won't fail you. Rest, you have already built and run mgmt server. Won't be much help. Regards. From: Charles Moulliard [ch0...@gmail.com] Sent: Thursday, November 15, 2012 11:00 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Hi Rohit, I progress. I have been able to install xen, configure network to create a private network and also access to internet and nfs server is installed (apt-get install nfs-kernel-server). Do we have something more to do for NFS ? Regards, Charles On Thu, Nov 15, 2012 at 3:29 PM, Rohit Yadav rohit.ya...@citrix.com wrote: On 15-Nov-2012, at 7:12 PM, Charles Moulliard ch0...@gmail.com wrote: As of ubuntu-11 is configured use xen, As of Ubuntu 11.10 (Oneiric), the default kernel included in Ubuntu can be used directly with the Xen hypervisor as the management (or control) domain (Dom0 or Domain0 in Xen terminology). why don't you create an image using it ? Yes, I'm using this only. apt-get install xen-hypervisor and you're done. To use xen, one just need to select the kernel with xen during booting on grub. If you're keep, hack ~/.bash_history from the DevCloud image, the history will tell you what was performed to create devcloud. About pre-seeding systemvm template, see this: http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template You need to pre-seed, i.e. put a systemvm template on nfs with which your systemvm, cpvm and domr are created. Regards. On Thu, Nov 15, 2012 at 12:08 PM, Rohit Yadav rohit.ya...@citrix.com wrote: On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.com wrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a raspberrypi with me (a dirt cheap small single board arm 32bit computer, 4 GB sdcard, 512MB ram etc., http://www.raspberrypi.org and we know devcloud was cloud in a box, I'm trying to see if I can create a devpi or basically devcloud but in hardware and not as a vm, basically cloud in your pocket. I installed debian wheezy on it and xen pv for arm (xen cloudplaform for arm, this just blows up, even after cpvm disabled, ssvm etc. would just blow it up), and this thing fails at the
RE: [DISCUSS] OSGi framework for plugins and more?
sounds like a good plan. allow me to brief what has been said: 1- disaggregatio of ACS into a set of services which are accessed restfully 2- the components of these services can be implemented as OSGi or at least OSGi ready any missing points ? additional ones ? other insights ? Sent from my Samsung Galaxy S3 Apologies for any typos On Nov 15, 2012 6:20 PM, Alex Huang alex.hu...@citrix.com wrote: -Original Message- From: Alex Huang [mailto:alex.hu...@citrix.com] Sent: Thursday, November 15, 2012 9:15 AM To: cloudstack-dev@incubator.apache.org Subject: RE: [DISCUSS] OSGi framework for plugins and more? -Original Message- From: Mohammad Nour El-Din [mailto:nour.moham...@gmail.com] Sent: Wednesday, November 14, 2012 7:11 AM To: cloudstack-dev@incubator.apache.org Subject: Re: [DISCUSS] OSGi framework for plugins and more? Hi Alex... Thanks for opening the discussion in the direction of what we need to do and how to do it, I thought no one will respond to my request :D On Wed, Nov 14, 2012 at 3:45 PM, Alex Huang alex.hu...@citrix.com wrote: Here's my two-bits on OSGi. I actually started a thread like this sometime ago to which Mohammad reference. I then did some research on what OSGi can do. The problems I looked at using OSGi for just isn't solvable by OSGi. For example, - How to contain fault within an availability zone. - How to do rolling upgrade and phase out the rolling upgrades over a span of days to deal with the time that it might take. - How to do database upgrades/downgrades for the plugins - How to scale different components differently OSGi does solve some problems - How to enable and disable plugins on a production system but I'm not quite sure how reliable that is. Even eclipse asks you to restart eclipse after adding a plugin. I know the answer that Marcel would say about this point :D I just talked to someone who says it does work reliably in their environments. I think after looking at this, then I decided that - For modularity, nothing is better than compilation boundaries. The problem with some of the plugins is that it depends on cloud-core and cloud-server. It shouldn't . All plugins must build to cloud-api only. Since all interfaces of CloudStack is in cloud-api (if you think about that then cloud-api is basically the OSGi bundle), that's sufficient to separate the plugins. - For lifecycle of plugins, it probably requires that we switch to deploy in something like Karaf before we can achieve runtime lifecycle changes. I'm not sure it's entire necessary and it doesn't take care of a plugin's database versioning problem. - To resolve the other problems, we basically need to break cloudstack into separate processes. Hence I've proposed the idea of disaggregating cloudstack. Again, I am not an OSGi expert, but from what you say it is more about compile and build time and making the separation of what one module should depend on what very clear and documented which we already do in my company as we also have a huge stack and also looked into OSGi which again a great tool but when we don't need everything it offers, we exactly needed what you explained and we manage that mostly through good usage of Maven which I know is tricky About the runtime aspects and database versioning I am afraid I am not aware about the internals and the exact requirements and hence I can't give any input On another side, as in either case we need to *disaggregate* ACS, we can make the disaggregated module OSGi ready at least as a 1st step towards assessing whether OSGi is the way we should go or not, and when it is more clear then we can either say no it is not the option we need or we will then be ready for the full move to OSGi Thoughts ? My current thoughts are the large disaggregated CloudStack Services are going to be RESTful services. I don't see any benefits for them to be OSGi components for the reasons I've already listed. However, each service still may deploy plugins. Those plugins can be converted to OSGi. It shouldn't be too difficult to do it as well. And that is if we see there's a good match with OSGi. I can see for example that if people want to add more automation, background monitoring etc, deploying and undeploying those on a live system can be very helpful. That maybe one good use of it. --Alex
Re: [ASFCS41] Proposed schedule for our next release
On Thu, Nov 15, 2012 at 12:34 PM, Rohit Yadav rohit.ya...@citrix.com wrote: +1 I'm fine with the proposed schedule as well, but few of my questions were not answered, if they're worth answering: 1. Number of maintenance or bug-fix releases on 4.0.x, 4.1.x etc. and the duration, timeline of the same? 2. Frequency of these rather short term bug-fix releases? 3. Are we going to do a LTS, say for a year or two? 4. Will we have branch/version maintainers, since as per proposed schedule we will have 3-4 branches by the end of next year? I'm happy to have Joe doing 4.0.x (does this mean he's the 4.0 maintainer?) and Chip helping us out once again with 4.1. Purely IMO: I'd consider major version support to be the main question here. To me, our release calendar is fast enough that we can keep bug fix releases limited to critical bugs and security fixes. I'd also propose that we don't support 4.0.x bug fix releases after 4.1.0 is released. Instead, we shift to supporting 4.1.x bug fix releases until 4.2.0. And then the same thing happens. The value of semver is that the product can keep growing, but that the API remains compatible. Hence, I would push users to upgrade to the latest feature release of the major version line they are using for newer fixes. Things change when we talk about the 4.x.x series support when we eventually go to 5.0.0. IMO, we do need to continue to do the same critical bug fixes and security patches as needed, for some number of years. I'd suggest that it's somewhere in the neighborhood of 2 years after the new major version is introduced. Does that sound right to folks? As for branch/version maintainers, I'm not sure. We certainly need to have folks (thanks Joe!) managing bug-fix releases and doing the cherry-picking. We may need to make it a community effort to deal with any issues merging a fix into an older version though. -chip Regards. From: Chip Childers [chip.child...@sungard.com] Sent: Thursday, November 15, 2012 10:53 PM To: cloudstack-dev@incubator.apache.org Subject: Re: [ASFCS41] Proposed schedule for our next release On Mon, Nov 12, 2012 at 4:28 PM, Chip Childers chip.child...@sungard.com wrote: Taking everyone's input into consideration, I've reworked the proposed schedule (below). I've extended the feature dev period until the end of Jan, giving us a 5 month (3 for features, 2 for testing / wrap-up) schedule for this next release. Does this sound like something we can all get behind? Did I miss any significant issues raised in this or other threads? If the 4.1 schedule proposal works, I'd further propose that we shift to a 4 month schedule for feature releases afterward. IMO, we should be basically developing features outside of a release, and bringing them into master when the window is open for inclusion in the next release. This gives any developer as much time as they would like (although the longer it goes on, the harder it is to potentially integrate back into master), and the community gets a clear view of what our time-based release schedule will look like. This rhythm would set us up with the following high level dates: Proposed schedule for ongoing releases 4.1 Nov through Jan - Feature work Feb and March - Testing / Hardening / Wrap-up 4.2 April and May - Feature work June and July - Testing / Hardening / Wrap-up 4.3 August and September - Feature work October and November - Testing / Hardening / Wrap-up 4.4 Start all over in Dec ** This assumes no major version increments, but we could certainly have one! = New 4.1 detailed schedule proposal: = 2012-11-01 through 2013-01-31 Feature and documentation development (obviously ongoing, but continued during this period) 2013-01-31 Feature Freeze All new feature need to have been merged into master by this date. Release branch will be cut on this date. Jenkins updated to include new release branch builds. 2013-02-01 through 2013-02-28 Testing/Bug Fixes (testing against jenkins artifacts) Documentation Finalization 2013-02-28 Docs Freeze (except release notes and translations) Release Branch moves to limited updates only (only commits allowed in would be release blockers fixes, translation updates, etc...) 2013-03-01 through 2013-03-22 Translation Development and Integration (should be ongoing, but focused effort) Final regression testing / bug fixes / doc fixes 2013-03-22 4.1.0-RC1 is created, and project level VOTE is called Having only heard back from David and Joe on the revised proposal above, I'm going to assume that we're agreeing under a lazy consensus process here. Also, I'll throw my hat into the ring to release manage 4.1.0 (while Joe is doing the 4.0.x releases). I'm happy to step aside for
Re: Can we still use DevCloud VM Image ?
My question was more about -- Do I have to follow instructions here to configure NFS server ( http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#nfs-shares-on-management-server) ? On Thu, Nov 15, 2012 at 6:35 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Yes, hack and go through the .bash_history, setup systemvm template. Then you're pretty much done as long as yout network won't fail you. Rest, you have already built and run mgmt server. Won't be much help. Regards. From: Charles Moulliard [ch0...@gmail.com] Sent: Thursday, November 15, 2012 11:00 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Hi Rohit, I progress. I have been able to install xen, configure network to create a private network and also access to internet and nfs server is installed (apt-get install nfs-kernel-server). Do we have something more to do for NFS ? Regards, Charles On Thu, Nov 15, 2012 at 3:29 PM, Rohit Yadav rohit.ya...@citrix.com wrote: On 15-Nov-2012, at 7:12 PM, Charles Moulliard ch0...@gmail.com wrote: As of ubuntu-11 is configured use xen, As of Ubuntu 11.10 (Oneiric), the default kernel included in Ubuntu can be used directly with the Xen hypervisor as the management (or control) domain (Dom0 or Domain0 in Xen terminology). why don't you create an image using it ? Yes, I'm using this only. apt-get install xen-hypervisor and you're done. To use xen, one just need to select the kernel with xen during booting on grub. If you're keep, hack ~/.bash_history from the DevCloud image, the history will tell you what was performed to create devcloud. About pre-seeding systemvm template, see this: http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template You need to pre-seed, i.e. put a systemvm template on nfs with which your systemvm, cpvm and domr are created. Regards. On Thu, Nov 15, 2012 at 12:08 PM, Rohit Yadav rohit.ya...@citrix.com wrote: On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.com wrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will have only the preconfigured network, xen (kvm won't run as pv hypervisor, I knew it required hvm/intel-vt or amd-v, and I still tried just to see what happens and it did not run) and nfs server. I've already shared the base os, which is x86 ubuntu precise http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz (note: this is not devcloud, just the base system which is stripped down and archived, ~250MB) Till I do that, you may try to diy devcloud, the top level goals are to: 1. Install xen, 2. Configure network such that it's accessible to the host os and can access Internet, 3. Install and configure NFS, 4. Preseed a systemvm template and you should be good to go. (2. is the tricky one) Just skip the following, something frivolous but for fun: Around devcloud, I'm experimenting a lot (slow internet, plus every time I mess I start from a fresh copy) so not able to produce a final image; you may call me crazy for what I'm going to share next: so I've a
RE: [DISCUSS] OSGi framework for plugins and more?
1. Is each service going to be a separate process? 2. Will the component model follow the current kernel / plugin strategy? DL -Original Message- From: Mohammad Nour El-Din [mailto:nour.moham...@gmail.com] Sent: 15 November 2012 5:43 PM To: cloudstack-dev@incubator.apache.org Subject: RE: [DISCUSS] OSGi framework for plugins and more? sounds like a good plan. allow me to brief what has been said: 1- disaggregatio of ACS into a set of services which are accessed restfully 2- the components of these services can be implemented as OSGi or at least OSGi ready any missing points ? additional ones ? other insights ? Sent from my Samsung Galaxy S3 Apologies for any typos On Nov 15, 2012 6:20 PM, Alex Huang alex.hu...@citrix.com wrote: -Original Message- From: Alex Huang [mailto:alex.hu...@citrix.com] Sent: Thursday, November 15, 2012 9:15 AM To: cloudstack-dev@incubator.apache.org Subject: RE: [DISCUSS] OSGi framework for plugins and more? -Original Message- From: Mohammad Nour El-Din [mailto:nour.moham...@gmail.com] Sent: Wednesday, November 14, 2012 7:11 AM To: cloudstack-dev@incubator.apache.org Subject: Re: [DISCUSS] OSGi framework for plugins and more? Hi Alex... Thanks for opening the discussion in the direction of what we need to do and how to do it, I thought no one will respond to my request :D On Wed, Nov 14, 2012 at 3:45 PM, Alex Huang alex.hu...@citrix.com wrote: Here's my two-bits on OSGi. I actually started a thread like this sometime ago to which Mohammad reference. I then did some research on what OSGi can do. The problems I looked at using OSGi for just isn't solvable by OSGi. For example, - How to contain fault within an availability zone. - How to do rolling upgrade and phase out the rolling upgrades over a span of days to deal with the time that it might take. - How to do database upgrades/downgrades for the plugins - How to scale different components differently OSGi does solve some problems - How to enable and disable plugins on a production system but I'm not quite sure how reliable that is. Even eclipse asks you to restart eclipse after adding a plugin. I know the answer that Marcel would say about this point :D I just talked to someone who says it does work reliably in their environments. I think after looking at this, then I decided that - For modularity, nothing is better than compilation boundaries. The problem with some of the plugins is that it depends on cloud-core and cloud-server. It shouldn't . All plugins must build to cloud-api only. Since all interfaces of CloudStack is in cloud-api (if you think about that then cloud-api is basically the OSGi bundle), that's sufficient to separate the plugins. - For lifecycle of plugins, it probably requires that we switch to deploy in something like Karaf before we can achieve runtime lifecycle changes. I'm not sure it's entire necessary and it doesn't take care of a plugin's database versioning problem. - To resolve the other problems, we basically need to break cloudstack into separate processes. Hence I've proposed the idea of disaggregating cloudstack. Again, I am not an OSGi expert, but from what you say it is more about compile and build time and making the separation of what one module should depend on what very clear and documented which we already do in my company as we also have a huge stack and also looked into OSGi which again a great tool but when we don't need everything it offers, we exactly needed what you explained and we manage that mostly through good usage of Maven which I know is tricky About the runtime aspects and database versioning I am afraid I am not aware about the internals and the exact requirements and hence I can't give any input On another side, as in either case we need to *disaggregate* ACS, we can make the disaggregated module OSGi ready at least as a 1st step towards assessing whether OSGi is the way we should go or not, and when it is more clear then we can either say no it is not the option we need or we will then be ready for the full move to OSGi Thoughts ? My current thoughts are the large disaggregated CloudStack Services are going to be RESTful services. I don't see any benefits for them to be OSGi components for the reasons I've already listed. However, each service still may deploy plugins. Those plugins can be converted to OSGi. It shouldn't be too difficult to do it as well. And that is if we see there's a good match with OSGi. I can see for example that if people want to add more automation, background monitoring etc, deploying and undeploying those on a live
[jira] [Updated] (CLOUDSTACK-488) can't register awsapi user
[ https://issues.apache.org/jira/browse/CLOUDSTACK-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chip Childers updated CLOUDSTACK-488: - Affects Version/s: (was: 4.0.1) 4.1.0 Correcting effects version, since 4.1 is the current target of master. 4.0.1 is the next release from the 4.0 branch. can't register awsapi user -- Key: CLOUDSTACK-488 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-488 Project: CloudStack Issue Type: Bug Components: AWSAPI Affects Versions: 4.1.0 Environment: OSX 10.8.1 mysql55 maven3 devcloud Reporter: sebastien goasguen Running devcloud host-only environment as described in: https://cwiki.apache.org/CLOUDSTACK/cloudstack-devcloud-environment-setup.html Run the awsapi server with: mvn -pl :cloud-awsapi jetty:run Then tried to register a user: air-2:setup sebastiengoasguen$ python ./cloudstack-aws-api-register -a 2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw -s GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbw -c ~/.ssh/cert.pem -u http://localhost:7080/awsapi/ User registration failed with http error code: 401 Jetty logs show: EC2RestServlet.doGetOrPost: javax.servlet.forward.query_string: AWSAccessKeyId=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwAction=SetUserKeysSignatureMethod=HmacSHA1SignatureVersion=2Timestamp=2012-11-15T11:10:12ZVersion=2010-11-15accesskey=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwsecretkey=GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbwSignature=lOgFvzNy0t2%2FCBzfKZB3W84lx38%3D Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: EC2 Request method: GET Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request contextPath: /awsapi Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request pathInfo: / Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request pathTranslated: /Users/sebastiengoasguen/Documents/incubator-cloudstack/awsapi/target/cloud-awsapi-4.1.0-SNAPSHOT Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request queryString: AWSAccessKeyId=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwAction=SetUserKeysSignatureMethod=HmacSHA1SignatureVersion=2Timestamp=2012-11-15T11:10:12ZVersion=2010-11-15accesskey=2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuwsecretkey=GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbwSignature=lOgFvzNy0t2%2FCBzfKZB3W84lx38%3D Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request requestURI: /awsapi/rest/AmazonEC2/ Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request requestURL: http://localhost:7080/awsapi/rest/AmazonEC2/ Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request servletPath: /rest/AmazonEC2 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Accept-Encoding:identity Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Host:localhost:7080 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header Connection:close Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request header User-Agent:Python-urllib/2.7 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Action:SetUserKeys Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter SignatureMethod:HmacSHA1 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter AWSAccessKeyId:2GmlMc59ItbOE4EVbwVIqyO25nmZWOrNWRhWi-AvqCmNZ9H6FBXmpTycts5KnV6CmeCaz9yZjdnovURNWSoDuw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Version:2010-11-15 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter SignatureVersion:2 Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter Signature:lOgFvzNy0t2/CBzfKZB3W84lx38= Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet logRequest INFO: Request parameter secretkey:GKsUGz_TvdN5U7cLNQoIElmwQI7AVnFcGK0Wo7SdMkJevjmJ5TN7theFnpVqKYlGAs7n_6gODYvtIOcKZLifbw Nov 15, 2012 11:10:13 AM com.cloud.bridge.service.EC2RestServlet
[jira] [Assigned] (CLOUDSTACK-486) Clicking UI notifications for System VM or Virtual Router opens Instances page
[ https://issues.apache.org/jira/browse/CLOUDSTACK-486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sonny Chhen reassigned CLOUDSTACK-486: -- Assignee: Pranav Saxena Clicking UI notifications for System VM or Virtual Router opens Instances page -- Key: CLOUDSTACK-486 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-486 Project: CloudStack Issue Type: Bug Components: UI Affects Versions: 4.0.0 Reporter: Kirk Kosinski Assignee: Pranav Saxena Priority: Minor If you click a notification in the UI for a System VM or Virtual Router, instead of opening the relevant System VMs or Virtual Routers page, the Instances page is opened. This is not useful since System VMs and Virtual Routers do not show up on the Instances page. The relevant page should be opened instead. To reproduce: 1. Log on to the UI. 2. Navigate to Infrastructure System VMs or Virtual Routers. 3. Perform an action on one of them. For example, stop a System VM. 4. Wait for a notification to be generated. 5. Open the notifications list and click on the notification. For the example in step 3, click Stop System VM. 6. Notice that the Instances page is opened. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Cannot add secondary storage on 4.0 after upgrade from 3.0.2
Hi, If I try to add a secondary storage via the GUI to a Zone that is enabled I get: 2012-11-14 15:43:36,240 WARN [cloud.resource.ResourceManagerImpl] (catalina-exec-17:null) Unable to connect due to java.lang.IllegalArgumentException: Host 192.168.x.y sent incorrect data center: null Can anyone help me with this? Regards Tamas Monos DDI +44(0)2034687012 Chief Technical Office +44(0)2034687000 Veber: The Hosting Specialists Fax +44(0)871 522 7057 http://www.veber.co.ukhttp://www.veber.co.uk/ Follow us on Twitter: www.twitter.com/veberhosthttp://www.twitter.com/veberhost Follow us on Facebook: www.facebook.com/veberhosthttp://www.facebook.com/veberhost
RE: [ASFCS41] Proposed schedule for our next release
Great reply, I really like the idea of not supporting a long term release, so the users always get great stuff at more or less regular intervals as proposed and as long as APIs remain compatible and there are upgrade paths available users would be less resistant to upgrade. Lastly, one suggestion that we create the 4.1 branch only after code (and maybe doc) freeze so that what happened with 4.0 and to escape cherry-picking nuisances. Awesome, I think we got the process, now towards 4.1! Regards. From: Chip Childers [chip.child...@sungard.com] Sent: Thursday, November 15, 2012 11:16 PM To: cloudstack-dev@incubator.apache.org Subject: Re: [ASFCS41] Proposed schedule for our next release On Thu, Nov 15, 2012 at 12:34 PM, Rohit Yadav rohit.ya...@citrix.com wrote: +1 I'm fine with the proposed schedule as well, but few of my questions were not answered, if they're worth answering: 1. Number of maintenance or bug-fix releases on 4.0.x, 4.1.x etc. and the duration, timeline of the same? 2. Frequency of these rather short term bug-fix releases? 3. Are we going to do a LTS, say for a year or two? 4. Will we have branch/version maintainers, since as per proposed schedule we will have 3-4 branches by the end of next year? I'm happy to have Joe doing 4.0.x (does this mean he's the 4.0 maintainer?) and Chip helping us out once again with 4.1. Purely IMO: I'd consider major version support to be the main question here. To me, our release calendar is fast enough that we can keep bug fix releases limited to critical bugs and security fixes. I'd also propose that we don't support 4.0.x bug fix releases after 4.1.0 is released. Instead, we shift to supporting 4.1.x bug fix releases until 4.2.0. And then the same thing happens. The value of semver is that the product can keep growing, but that the API remains compatible. Hence, I would push users to upgrade to the latest feature release of the major version line they are using for newer fixes. Things change when we talk about the 4.x.x series support when we eventually go to 5.0.0. IMO, we do need to continue to do the same critical bug fixes and security patches as needed, for some number of years. I'd suggest that it's somewhere in the neighborhood of 2 years after the new major version is introduced. Does that sound right to folks? As for branch/version maintainers, I'm not sure. We certainly need to have folks (thanks Joe!) managing bug-fix releases and doing the cherry-picking. We may need to make it a community effort to deal with any issues merging a fix into an older version though. -chip Regards. From: Chip Childers [chip.child...@sungard.com] Sent: Thursday, November 15, 2012 10:53 PM To: cloudstack-dev@incubator.apache.org Subject: Re: [ASFCS41] Proposed schedule for our next release On Mon, Nov 12, 2012 at 4:28 PM, Chip Childers chip.child...@sungard.com wrote: Taking everyone's input into consideration, I've reworked the proposed schedule (below). I've extended the feature dev period until the end of Jan, giving us a 5 month (3 for features, 2 for testing / wrap-up) schedule for this next release. Does this sound like something we can all get behind? Did I miss any significant issues raised in this or other threads? If the 4.1 schedule proposal works, I'd further propose that we shift to a 4 month schedule for feature releases afterward. IMO, we should be basically developing features outside of a release, and bringing them into master when the window is open for inclusion in the next release. This gives any developer as much time as they would like (although the longer it goes on, the harder it is to potentially integrate back into master), and the community gets a clear view of what our time-based release schedule will look like. This rhythm would set us up with the following high level dates: Proposed schedule for ongoing releases 4.1 Nov through Jan - Feature work Feb and March - Testing / Hardening / Wrap-up 4.2 April and May - Feature work June and July - Testing / Hardening / Wrap-up 4.3 August and September - Feature work October and November - Testing / Hardening / Wrap-up 4.4 Start all over in Dec ** This assumes no major version increments, but we could certainly have one! = New 4.1 detailed schedule proposal: = 2012-11-01 through 2013-01-31 Feature and documentation development (obviously ongoing, but continued during this period) 2013-01-31 Feature Freeze All new feature need to have been merged into master by this date. Release branch will be cut on this date. Jenkins updated to include new release branch builds. 2013-02-01 through 2013-02-28 Testing/Bug Fixes (testing against jenkins artifacts) Documentation
[jira] [Created] (CLOUDSTACK-490) Multiple disks on templates
Clayton Weise created CLOUDSTACK-490: Summary: Multiple disks on templates Key: CLOUDSTACK-490 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-490 Project: CloudStack Issue Type: Improvement Components: Template Reporter: Clayton Weise Priority: Minor After some discussion in IRC today the thought came up that it would be nice for the ability to create a template that has not only a root drive but multiple data drives attached. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Security Group support in Advance zone
Hi Murali, Please see the answers inline. -Alena. On 11/14/12 10:54 PM, Murali Reddy murali.re...@citrix.com wrote: Alena, I have couple of queries on the requirements listed in the spec. - Shared Zone Wide SG Enabled Guest network is required in Advance SG enabled zone as CPVM/SSVM are using it. I am not clear why CPVM/SSVM will use the shared guest network with SG. Because this is the only one Shared network with the Public ip addresses in the zone. As the SSVM/CPVM will need access to the internet (Public interface), and there is no public traffic type in the zone, they'll get the Ips from the Guest Shared network. It's very similar to the Basic zone scenario where system vms also get public ips from the Shared zone wide Guest netowrk. - No Isolated networks can be added to the Advance SG enabled zone. No Shared Domain wide networks are allowed either. Does this mean, there will be only one shared network in the entire SG enabled zone? Only one Shared SG enabled Zone wide network + any number of Shared account specific networks. No Isolated, no Domain level Shared networks and no additional zone wide Shared networks. You mentioned relaxing some of these restriction as future release plans, but was wondering why such stringent restriction. Because the initial goal for this release - re-enable 2.2.x feature so existing 2.2.x customers can upgrade. So the feature will work just the way it used to work in 2.2.x, including all the restrictions. As we already have a regression test plan for it, it would be easier for QA to test it. Introducing new functionality/re-writing the logic can cause regressions and would definitely require more time for QA Does overlapping CIDR's of multiple isolated network will conflict with the security groups functionality at hypervisor level? Not sure about that, Anthony would be the right person to answer this question. Thanks, Murali On 14/11/12 12:17 AM, Alena Prokharchyk alena.prokharc...@citrix.com wrote: In 2.2.x version of the cloudStack we provided support for Security Groups in Advance zone. The feature was temporary disabled in released versions of 3.0.x branch due to lack of dev and test resources needed to accommodate the feature to the new NaaS framework. Disabling the feature made an upgrade for existing 2.2.x customers using this network model, impossible. We are going to re-enable the feature in the next CS release with all the limitations accompanying it in 2.2.x branch. Here is the functional specification: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Isolation+based+on + S ecurity+Groups+in+Advance+zone It reflects: * current behavior model * feature limitations * upgrade path * feature enhancements plan Please review and point out if there are any inconsistencies/unclearness in the spec. Anthony Xu will be the key developer for Java + Scripting part; UI developers haven't been assigned to the feature yet. -Alena.
[jira] [Created] (CLOUDSTACK-491) Instance Cloning
Clayton Weise created CLOUDSTACK-491: Summary: Instance Cloning Key: CLOUDSTACK-491 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-491 Project: CloudStack Issue Type: Improvement Components: Template Reporter: Clayton Weise Priority: Minor In some cases the template process can be exhaustive and wasteful. Templates make sense for large scale deployments of a common image but sometimes there is a need to make one or two clones of a system. The process of creating a template, offloading to secondary storage, then loading it _back_ onto primary only to make one or two copies of an instance seems unnecessary if there was simply an ability clone either directly on primary storage using a writable snapshot feature or offloading to secondary storage temporarily then removing the data once the copy has been made (similar to how volumes are imported). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CLOUDSTACK-492) Document procedure to choose default System Offering for System VMs
Kirk Kosinski created CLOUDSTACK-492: Summary: Document procedure to choose default System Offering for System VMs Key: CLOUDSTACK-492 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-492 Project: CloudStack Issue Type: New Feature Components: Doc Affects Versions: 4.0.0 Reporter: Kirk Kosinski Priority: Minor While it is possible to manully change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and the new offering you wish to be used by default. Make a note of their id. select id,name,unique_name,type from disk_offering; 5. Set unique_name = NULL for the original default offering. It is important to use the correct value for id. update disk_offering set unique_name = NULL where id = 10; 6. For the new offering you wish to be used by default, set unique_name = 'Cloud.com-ConsoleProxy' (for the default CPVM offering) or 'Cloud.com-SecondaryStorage' (for the default SSVM offering). update disk_offering set unique_name = 'Cloud.com-ConsoleProxy' where id = 16; 7. Restart CloudStack. This is required because the default offerings are loaded into memory at start-up. service cloud-management restart 8. Destroy the existing CPVM or SSVM and wait for it to be recreated. The new CPVM or SSVM will be configured with the new offering. Note that CLOUDSTACK-338 seems to be requesting that the string used in unique_name be change. When that happens, this procedure would need to be updated with the correct string. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CLOUDSTACK-492) Document procedure to choose default System Offering for System VMs
[ https://issues.apache.org/jira/browse/CLOUDSTACK-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk Kosinski updated CLOUDSTACK-492: - Description: While it is possible to manually change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and the new offering you wish to be used by default. Make a note of their id. select id,name,unique_name,type from disk_offering; 5. Set unique_name = NULL for the original default offering. It is important to use the correct value for id. update disk_offering set unique_name = NULL where id = 10; 6. For the new offering you wish to be used by default, set unique_name = 'Cloud.com-ConsoleProxy' (for the default CPVM offering) or 'Cloud.com-SecondaryStorage' (for the default SSVM offering). update disk_offering set unique_name = 'Cloud.com-ConsoleProxy' where id = 16; 7. Restart CloudStack. This is required because the default offerings are loaded into memory at start-up. service cloud-management restart 8. Destroy the existing CPVM or SSVM and wait for it to be recreated. The new CPVM or SSVM will be configured with the new offering. Note that CLOUDSTACK-338 seems to be requesting that the string used in unique_name be change. When that happens, this procedure would need to be updated with the correct string. was: While it is possible to manully change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and the new offering you wish to be used by default. Make a note of their id. select id,name,unique_name,type from disk_offering; 5. Set unique_name = NULL for the original default offering. It is important to use the correct value for id. update disk_offering set unique_name = NULL where id = 10; 6. For the new offering you wish to be used by default, set unique_name = 'Cloud.com-ConsoleProxy' (for the default CPVM offering) or 'Cloud.com-SecondaryStorage' (for the default SSVM offering). update disk_offering set unique_name = 'Cloud.com-ConsoleProxy' where id = 16; 7. Restart CloudStack. This is required because the default offerings are loaded into memory at start-up. service cloud-management restart 8. Destroy the existing CPVM or SSVM and wait for it to be recreated. The new CPVM or SSVM will be configured with the new offering. Note that CLOUDSTACK-338 seems to be requesting that the string used in unique_name be change. When that happens, this procedure would need to be updated with the correct string. Document procedure to choose default System Offering for System VMs --- Key: CLOUDSTACK-492 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-492 Project: CloudStack Issue Type: New Feature Components: Doc Affects Versions: 4.0.0 Reporter: Kirk Kosinski Priority: Minor Labels: adminguide While it is possible to manually change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and
Re: Integrating autoscale branch to master?
On Nov 15, 2012, at 5:44 PM, Ram Ganesh ram.gan...@citrix.com wrote: Any thoughts? Unless we hear otherwise would like to push the patches. This feature had been code complete for a very long time. If there are still concerns/opinions let us know and we can take steps to correct them. Ram, any thoughts on how this could work without Netscaler ? Any alternative open source load balancer we could use to implement this ? -Sebastien Thanks, Ram -Original Message- From: Ram Ganesh [mailto:ram.gan...@citrix.com] Sent: 15 November 2012 07:09 To: cloudstack-dev@incubator.apache.org Subject: RE: Integrating autoscale branch to master? David, Can we go ahead with merge of AutoScale code into master? Are there any more open questions? Thanks, Ram -Original Message- From: Vijay Venkatachalam [mailto:vijay.venkatacha...@citrix.com] Sent: 13 November 2012 12:34 To: cloudstack-dev@incubator.apache.org Subject: RE: Integrating autoscale branch to master? My replies inline Thanks, Vijay V. -Original Message- From: David Nalley [mailto:da...@gnsa.us] Sent: Monday, October 15, 2012 7:42 PM To: cloudstack-dev@incubator.apache.org Subject: Re: Integrating autoscale branch to master? On Fri, Oct 12, 2012 at 11:54 AM, Vijay Venkatachalam vijay.venkatacha...@citrix.com wrote: Ok I will keep changes ready, and will merge once 4.0's news is declared. -Vijay V. Vijay, I haven't kept up with this recently so a couple of questions/assumptions: 1. Autoscale code will require NetScaler libraries right? There are 2 parts to autoscale code. A. AutoScale Manager and its services, This is part of the core. And has no No Netscaler jar dependency; This part is coded like any other NetworkServiceManager, meaning any network element can provide autoscale service. So this part does not have compile time dependency with NetScaler jar. If an autoscale provider (which is most likely already an LB provider) does not exist in that network an error is thrown at run time. So for all oss builds (where Netscaler is not packaged and cannot be added to the infrastructure) we should get a run-time error when configuring autoscale. B. NetScaler Element and Netscaler Resource (which is part of non-oss build today) has been enhanced to provide autoscale capability. Today only NetScaler does this, in future any network element can he enhanced to provide autoscale. This part already has NetScaler jar dependency (and is considered non-oss today) and will continue to have NetScaler jar dependency. 2. Is autoscale functionality modular enough that we can turn building it on/off at will? Short Answer, No. Since AutoScale is like an addon to LB there are touch- points. For example, when a LoadBalancerRule is deleted the AutoScale entities created for it also should be deleted, hence the dependency. Basically there is code in LB core to delete autoscale entities on the loadbalancer rule's delete path. Hence Part (A.) could not be modularized. Is there an alternative here? Also, in the UI autoscale will appear as part of LB to the user and if he attempts to configure AutoScale in a network which does not have NetScaler; he will get a run-time error. 3. Has there been any change to the netscaler java library licensing? I know there was work underway, but I never heard about a conclusion. I am still chasing the legal team on this, but for the moment, we should continue to treat NetScaler as non-oss. --David
[jira] [Updated] (CLOUDSTACK-492) Document procedure to choose default System Offering for System VMs
[ https://issues.apache.org/jira/browse/CLOUDSTACK-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk Kosinski updated CLOUDSTACK-492: - Description: While it is possible to manually change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and the new offering you wish to be used by default. Make a note of their id. select id,name,unique_name,type from disk_offering; 5. Set unique_name = NULL for the original default offering. It is important to use the correct value for id. update disk_offering set unique_name = NULL where id = 10; 6. For the new offering you wish to be used by default, set unique_name = 'Cloud.com-ConsoleProxy' (for the default CPVM offering) or 'Cloud.com-SecondaryStorage' (for the default SSVM offering). update disk_offering set unique_name = 'Cloud.com-ConsoleProxy' where id = 16; 7. Restart CloudStack. This is required because the default offerings are loaded into memory at start-up. service cloud-management restart 8. Destroy the existing CPVM or SSVM and wait for it to be recreated. The new CPVM or SSVM will be configured with the new offering. Note that CLOUDSTACK-338 seems to be requesting that the string used in unique_name be changed. When that happens, this procedure would need to be updated with the correct string. was: While it is possible to manually change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and the new offering you wish to be used by default. Make a note of their id. select id,name,unique_name,type from disk_offering; 5. Set unique_name = NULL for the original default offering. It is important to use the correct value for id. update disk_offering set unique_name = NULL where id = 10; 6. For the new offering you wish to be used by default, set unique_name = 'Cloud.com-ConsoleProxy' (for the default CPVM offering) or 'Cloud.com-SecondaryStorage' (for the default SSVM offering). update disk_offering set unique_name = 'Cloud.com-ConsoleProxy' where id = 16; 7. Restart CloudStack. This is required because the default offerings are loaded into memory at start-up. service cloud-management restart 8. Destroy the existing CPVM or SSVM and wait for it to be recreated. The new CPVM or SSVM will be configured with the new offering. Note that CLOUDSTACK-338 seems to be requesting that the string used in unique_name be change. When that happens, this procedure would need to be updated with the correct string. Document procedure to choose default System Offering for System VMs --- Key: CLOUDSTACK-492 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-492 Project: CloudStack Issue Type: New Feature Components: Doc Affects Versions: 4.0.0 Reporter: Kirk Kosinski Priority: Minor Labels: adminguide While it is possible to manually change the System Offering for a particular System VM, a CloudStack administrator may want to change the System Offering used by default for System VMs. It would be useful for this procedure to be documented. The following procedure works for me on CloudStack 3.0.2 and 4.0.0-incubating. 1. Create a new system offering with the desired settings. This can be done via UI under the Service Offerings tab. 2. Back up the database. mysqldump -u root -p cloud | bzip2 cloud_backup.sql.bz2 3. Open a mysql prompt to be able to run queries in later steps on the cloud database. mysql -u cloud -p cloud 4. In the disk_offering table in the database, identify the original default offering and
Re: same vlan on different nics
Marcus, Prachi would be the best person to answer this question as she added the constraint to create-schema.sql: 8836a08e (prachi2011-11-08 11:23:37 -0800 658) CONSTRAINT `fk_op_dc_vnet_alloc__physical_network_id` FOREIGN KEY (`physical_network_id`) REFERENCES `physical_network' Commit id is 8836a08e. -Alena. On 11/15/12 7:40 AM, Marcus Sorensen shadow...@gmail.com wrote: https://issues.apache.org/jira/browse/CLOUDSTACK-226 It looks like this was fixed (11fe086adab8e790018343252ed08aac9a27b1c6) by making sure that a particular vlan range can only exist on one physical network. Is there any technical reason for this? It looks like the fix worked around the unique key restriction in the database schema, is that the only limiting factor? We recently changed the naming scheme of KVM bridges to allow the same vlan to be used on different physical networks, so I can make the solution KVM specific. I'm just not sure why this limitation was created in the first place (the schema, not the fix) and want to gather some info before doing too much. I'd rather just make the key unique to vlan on physical network and let the individual doing the implementation decide if they want to do multiple layer2 domains to their boxes or not.
RE: Integrating autoscale branch to master?
Simple answer yes, any LB device could do this. It should be done in 2 parts The open source loadbalancer part, where the loadbalancer have to be modified, for example, to monitor for autoscaling purposes ( in addition to the regular healthmonitoring). The cloudstack part, in the loadbalancer's resource (in cloudstack), translate the autoscale config to the config which the open source loadbalancer can understand. Thanks, Vijay V. -Original Message- From: Sebastien Goasguen [mailto:run...@gmail.com] Sent: Friday, November 16, 2012 1:02 AM To: cloudstack-dev@incubator.apache.org Subject: Re: Integrating autoscale branch to master? On Nov 15, 2012, at 5:44 PM, Ram Ganesh ram.gan...@citrix.com wrote: Any thoughts? Unless we hear otherwise would like to push the patches. This feature had been code complete for a very long time. If there are still concerns/opinions let us know and we can take steps to correct them. Ram, any thoughts on how this could work without Netscaler ? Any alternative open source load balancer we could use to implement this ? -Sebastien Thanks, Ram -Original Message- From: Ram Ganesh [mailto:ram.gan...@citrix.com] Sent: 15 November 2012 07:09 To: cloudstack-dev@incubator.apache.org Subject: RE: Integrating autoscale branch to master? David, Can we go ahead with merge of AutoScale code into master? Are there any more open questions? Thanks, Ram -Original Message- From: Vijay Venkatachalam [mailto:vijay.venkatacha...@citrix.com] Sent: 13 November 2012 12:34 To: cloudstack-dev@incubator.apache.org Subject: RE: Integrating autoscale branch to master? My replies inline Thanks, Vijay V. -Original Message- From: David Nalley [mailto:da...@gnsa.us] Sent: Monday, October 15, 2012 7:42 PM To: cloudstack-dev@incubator.apache.org Subject: Re: Integrating autoscale branch to master? On Fri, Oct 12, 2012 at 11:54 AM, Vijay Venkatachalam vijay.venkatacha...@citrix.com wrote: Ok I will keep changes ready, and will merge once 4.0's news is declared. -Vijay V. Vijay, I haven't kept up with this recently so a couple of questions/assumptions: 1. Autoscale code will require NetScaler libraries right? There are 2 parts to autoscale code. A. AutoScale Manager and its services, This is part of the core. And has no No Netscaler jar dependency; This part is coded like any other NetworkServiceManager, meaning any network element can provide autoscale service. So this part does not have compile time dependency with NetScaler jar. If an autoscale provider (which is most likely already an LB provider) does not exist in that network an error is thrown at run time. So for all oss builds (where Netscaler is not packaged and cannot be added to the infrastructure) we should get a run-time error when configuring autoscale. B. NetScaler Element and Netscaler Resource (which is part of non-oss build today) has been enhanced to provide autoscale capability. Today only NetScaler does this, in future any network element can he enhanced to provide autoscale. This part already has NetScaler jar dependency (and is considered non-oss today) and will continue to have NetScaler jar dependency. 2. Is autoscale functionality modular enough that we can turn building it on/off at will? Short Answer, No. Since AutoScale is like an addon to LB there are touch- points. For example, when a LoadBalancerRule is deleted the AutoScale entities created for it also should be deleted, hence the dependency. Basically there is code in LB core to delete autoscale entities on the loadbalancer rule's delete path. Hence Part (A.) could not be modularized. Is there an alternative here? Also, in the UI autoscale will appear as part of LB to the user and if he attempts to configure AutoScale in a network which does not have NetScaler; he will get a run-time error. 3. Has there been any change to the netscaler java library licensing? I know there was work underway, but I never heard about a conclusion. I am still chasing the legal team on this, but for the moment, we should continue to treat NetScaler as non-oss. --David
[jira] [Commented] (CLOUDSTACK-471) Limit resources using CPU/RAM
[ https://issues.apache.org/jira/browse/CLOUDSTACK-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498318#comment-13498318 ] Clayton Weise commented on CLOUDSTACK-471: -- Perhaps using what's there already limits could be imposed on core count, MHz, and total RAM. Limit resources using CPU/RAM - Key: CLOUDSTACK-471 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-471 Project: CloudStack Issue Type: New Feature Reporter: Jasper Wonnink Request was already in the old tracker but i would like to re-open it in this tracker. http://bugs.cloudstack.org/browse/CS-6668 We would like the ability to set resources limits based on CPU (or RAM). This way we can give a user access to 100 compute units (cores) and they can decide for themselves if they want 50 dual cores, 25 quadcores.. etc etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CLOUDSTACK-496) cloudstack UI - zone wizard - replace Isolation mode VLAN/SecurityGroup radio buttons with one single checkbox SecurityGroup.
Jessica Wang created CLOUDSTACK-496: --- Summary: cloudstack UI - zone wizard - replace Isolation mode VLAN/SecurityGroup radio buttons with one single checkbox SecurityGroup. Key: CLOUDSTACK-496 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-496 Project: CloudStack Issue Type: Bug Reporter: Jessica Wang Assignee: Jessica Wang -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CLOUDSTACK-496) cloudstack UI - zone wizard - replace Isolation mode VLAN/SecurityGroup radio buttons with one single checkbox SecurityGroup.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jessica Wang resolved CLOUDSTACK-496. - Resolution: Fixed Author: Jessica Wang jessica.w...@citrix.com#mailto:jessica.w...@citrix.com Date: 34 seconds ago (Thu Nov 15 15:52:28 2012) Commit hash:bcd60dab09badbf15ba672ac1625f6bfb07d2abd CLOUDSTACK-496: cloudstack UI - zone wizard - replace Isolation mode VLAN/SecurityGroup radio buttons with one single checkbox SecurityGroup. Contained in branches: master Contained in no tag cloudstack UI - zone wizard - replace Isolation mode VLAN/SecurityGroup radio buttons with one single checkbox SecurityGroup. - Key: CLOUDSTACK-496 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-496 Project: CloudStack Issue Type: Bug Reporter: Jessica Wang Assignee: Jessica Wang -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CLOUDSTACK-497) createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key
Ahmad Emneina created CLOUDSTACK-497: Summary: createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key Key: CLOUDSTACK-497 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-497 Project: CloudStack Issue Type: Bug Components: API Affects Versions: 4.0.0 Environment: centos running cloudstack 4.0 Reporter: Ahmad Emneina listkeypair doesnt list the private key, alena checked the code for me, and it turns out we're not saving the key upon generation (createsshkeypairs comand). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request: CLOUDSTACK-487 HttpClient in multithreaded environment
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/8075/ --- (Updated Nov. 16, 2012, 1:35 a.m.) Review request for cloudstack. Description --- Running cloudstack with nicira nvp plugin, I got following error. It seems that HttpClient in servlet must use MultiThreadedHttpConnectionManager explicitly. 2012-11-14 18:21:51,576 WARN [commons.httpclient.SimpleHttpConnectionManager] (DirectAgent-62:null) SimpleHttpConnectionManager being used incorrectly. Be sure that HttpMethod.releaseConnection() is always called and that only one thread and/or method is using this connection manager at a time. 2012-11-14 18:21:52,017 WARN [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 5-847183891: Exception Caught while executing command java.lang.IllegalStateException: Connection is not open at org.apache.commons.httpclient.HttpConnection.assertOpen(HttpConnection.java:1277) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:974) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:943) at org.apache.commons.httpclient.HttpConnection.print(HttpConnection.java:1033) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2187) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2060) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at com.cloud.network.nicira.NiciraNvpApi.executeMethod(NiciraNvpApi.java:344) at com.cloud.network.nicira.NiciraNvpApi.executeDeleteObject(NiciraNvpApi.java:294) at com.cloud.network.nicira.NiciraNvpApi.deleteLogicalSwitchPort(NiciraNvpApi.java:172) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:286) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:192) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:172) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) This addresses bug CLOUDSTACK-487. Diffs (updated) - agent/src/com/cloud/agent/AgentShell.java 05caf8e awsapi/src/com/cloud/bridge/io/S3CAStorBucketAdapter.java ad6f6cd core/src/com/cloud/storage/template/HttpTemplateDownloader.java bd607b3 plugins/network-elements/nicira-nvp/src/com/cloud/network/nicira/NiciraNvpApi.java 2c002ab server/src/com/cloud/maint/UpgradeManagerImpl.java b4bc291 Diff: https://reviews.apache.org/r/8075/diff/ Testing --- Thanks, Hiroaki Kawai
[jira] [Updated] (CLOUDSTACK-487) HttpClient in multithreaded environment
[ https://issues.apache.org/jira/browse/CLOUDSTACK-487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hiroaki Kawai updated CLOUDSTACK-487: - Description: Running cloudstack with nicira nvp plugin, I got following error. It seems that HttpClient in servlet must use MultiThreadedHttpConnectionManager explicitly. Patch will be submitted in reviewboard. https://reviews.apache.org/r/8075/ 2012-11-14 18:21:51,576 WARN [commons.httpclient.SimpleHttpConnectionManager] (DirectAgent-62:null) SimpleHttpConnectionManager being used incorrectly. Be sure that HttpMethod.releaseConnection() is always called and that only one thread and/or method is using this connection manager at a time. 2012-11-14 18:21:52,017 WARN [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 5-847183891: Exception Caught while executing command java.lang.IllegalStateException: Connection is not open at org.apache.commons.httpclient.HttpConnection.assertOpen(HttpConnection.java:1277) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:974) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:943) at org.apache.commons.httpclient.HttpConnection.print(HttpConnection.java:1033) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2187) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2060) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at com.cloud.network.nicira.NiciraNvpApi.executeMethod(NiciraNvpApi.java:344) at com.cloud.network.nicira.NiciraNvpApi.executeDeleteObject(NiciraNvpApi.java:294) at com.cloud.network.nicira.NiciraNvpApi.deleteLogicalSwitchPort(NiciraNvpApi.java:172) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:286) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:192) at com.cloud.network.resource.NiciraNvpResource.executeRequest(NiciraNvpResource.java:172) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) was: Running cloudstack with nicira nvp plugin, I got following error. It seems that HttpClient in servlet must use MultiThreadedHttpConnectionManager explicitly. Patch will be submitted in reviewboard. 2012-11-14 18:21:51,576 WARN [commons.httpclient.SimpleHttpConnectionManager] (DirectAgent-62:null) SimpleHttpConnectionManager being used incorrectly. Be sure that HttpMethod.releaseConnection() is always called and that only one thread and/or method is using this connection manager at a time. 2012-11-14 18:21:52,017 WARN [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 5-847183891: Exception Caught while executing command java.lang.IllegalStateException: Connection is not open at org.apache.commons.httpclient.HttpConnection.assertOpen(HttpConnection.java:1277) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:974) at org.apache.commons.httpclient.HttpConnection.write(HttpConnection.java:943) at org.apache.commons.httpclient.HttpConnection.print(HttpConnection.java:1033) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2187) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2060) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at
Missing dependency in RPM of KVM Agent
Hi all, I have noticed that dependency is missing in RPM of KVM Agent. LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. Should I open a ticket? Or this should be supplemented by a document? Or I have some mistaken? (The following is my superfluous comment) A required package may change by VifDriver implementation used in the future. However, LibvirtComputingResource depends on brctl. I feel this as the issue. Thanks, Satoshi
Re: Missing dependency in RPM of KVM Agent
On 11/15/12 6:01 PM, Satoshi Kobayashi satosh...@stratosphere.co.jp wrote: Hi all, I have noticed that dependency is missing in RPM of KVM Agent. LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. Should I open a ticket? Or this should be supplemented by a document? Or I have some mistaken? (The following is my superfluous comment) A required package may change by VifDriver implementation used in the future. However, LibvirtComputingResource depends on brctl. I feel this as the issue. Thanks, Satoshi Please file the missing bridge-utils dependency. -- Æ
Re: Missing dependency in RPM of KVM Agent
Hi Ahmad, Sorry, what is the meaning of file? I think that it should be added to cloud-agent-libs. It contains LibvirtComputingResource and BridgeVifDriver. $ rpm -qpl cloud-agent-libs-4.0.0-0.140.el6.4.0.x86_64.rpm /usr/share/doc/cloud-agent-libs-4.0.0 /usr/share/doc/cloud-agent-libs-4.0.0/LICENSE /usr/share/doc/cloud-agent-libs-4.0.0/NOTICE /usr/share/java/cloud-agent.jar /usr/share/java/cloud-plugin-hypervisor-kvm.jar /usr/share/java/libvirt-0.4.9.jar $ rpm -qpR cloud-agent-libs-4.0.0-0.140.el6.4.0.x86_64.rpm cloud-core = 4.0.0 cloud-deps = 4.0.0 cloud-utils = 4.0.0 commons-httpclient jakarta-commons-logging java = 1.6.0 jpackage-utils rpmlib(CompressedFileNames) = 3.0.4-1 rpmlib(PayloadFilesHavePrefix) = 4.0-1 2012/11/16 Ahmad Emneina ahmad.emne...@citrix.com: On 11/15/12 6:01 PM, Satoshi Kobayashi satosh...@stratosphere.co.jp wrote: Hi all, I have noticed that dependency is missing in RPM of KVM Agent. LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. Should I open a ticket? Or this should be supplemented by a document? Or I have some mistaken? (The following is my superfluous comment) A required package may change by VifDriver implementation used in the future. However, LibvirtComputingResource depends on brctl. I feel this as the issue. Thanks, Satoshi Please file the missing bridge-utils dependency. -- Æ
Re: Missing dependency in RPM of KVM Agent
On 11/15/12 6:20 PM, Satoshi Kobayashi satosh...@stratosphere.co.jp wrote: Hi Ahmad, Sorry, what is the meaning of file? I think that it should be added to cloud-agent-libs. It contains LibvirtComputingResource and BridgeVifDriver. $ rpm -qpl cloud-agent-libs-4.0.0-0.140.el6.4.0.x86_64.rpm /usr/share/doc/cloud-agent-libs-4.0.0 /usr/share/doc/cloud-agent-libs-4.0.0/LICENSE /usr/share/doc/cloud-agent-libs-4.0.0/NOTICE /usr/share/java/cloud-agent.jar /usr/share/java/cloud-plugin-hypervisor-kvm.jar /usr/share/java/libvirt-0.4.9.jar $ rpm -qpR cloud-agent-libs-4.0.0-0.140.el6.4.0.x86_64.rpm cloud-core = 4.0.0 cloud-deps = 4.0.0 cloud-utils = 4.0.0 commons-httpclient jakarta-commons-logging java = 1.6.0 jpackage-utils rpmlib(CompressedFileNames) = 3.0.4-1 rpmlib(PayloadFilesHavePrefix) = 4.0-1 2012/11/16 Ahmad Emneina ahmad.emne...@citrix.com: On 11/15/12 6:01 PM, Satoshi Kobayashi satosh...@stratosphere.co.jp wrote: Hi all, I have noticed that dependency is missing in RPM of KVM Agent. LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. Should I open a ticket? Or this should be supplemented by a document? Or I have some mistaken? (The following is my superfluous comment) A required package may change by VifDriver implementation used in the future. However, LibvirtComputingResource depends on brctl. I feel this as the issue. Thanks, Satoshi Please file the missing bridge-utils dependency. -- Æ Please create a bug[1], that way this step gets documented in the installation guide. [1] https://issues.apache.org/jira/ -- Æ
[jira] [Created] (CLOUDSTACK-498) Missing dependency in RPM of KVM Agent
Satoshi Kobayashi created CLOUDSTACK-498: Summary: Missing dependency in RPM of KVM Agent Key: CLOUDSTACK-498 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-498 Project: CloudStack Issue Type: Bug Components: KVM Affects Versions: 4.0.0, 4.0.1, 4.1.0 Environment: CentOS 6.3 Reporter: Satoshi Kobayashi LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. If there is no bridge-utils, KVM Agent will not operate. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Missing dependency in RPM of KVM Agent
I understand. I opened the following ticket. https://issues.apache.org/jira/browse/CLOUDSTACK-498 Thanks 2012/11/16 Ahmad Emneina ahmad.emne...@citrix.com: On 11/15/12 6:20 PM, Satoshi Kobayashi satosh...@stratosphere.co.jp wrote: Hi Ahmad, Sorry, what is the meaning of file? I think that it should be added to cloud-agent-libs. It contains LibvirtComputingResource and BridgeVifDriver. $ rpm -qpl cloud-agent-libs-4.0.0-0.140.el6.4.0.x86_64.rpm /usr/share/doc/cloud-agent-libs-4.0.0 /usr/share/doc/cloud-agent-libs-4.0.0/LICENSE /usr/share/doc/cloud-agent-libs-4.0.0/NOTICE /usr/share/java/cloud-agent.jar /usr/share/java/cloud-plugin-hypervisor-kvm.jar /usr/share/java/libvirt-0.4.9.jar $ rpm -qpR cloud-agent-libs-4.0.0-0.140.el6.4.0.x86_64.rpm cloud-core = 4.0.0 cloud-deps = 4.0.0 cloud-utils = 4.0.0 commons-httpclient jakarta-commons-logging java = 1.6.0 jpackage-utils rpmlib(CompressedFileNames) = 3.0.4-1 rpmlib(PayloadFilesHavePrefix) = 4.0-1 2012/11/16 Ahmad Emneina ahmad.emne...@citrix.com: On 11/15/12 6:01 PM, Satoshi Kobayashi satosh...@stratosphere.co.jp wrote: Hi all, I have noticed that dependency is missing in RPM of KVM Agent. LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. Should I open a ticket? Or this should be supplemented by a document? Or I have some mistaken? (The following is my superfluous comment) A required package may change by VifDriver implementation used in the future. However, LibvirtComputingResource depends on brctl. I feel this as the issue. Thanks, Satoshi Please file the missing bridge-utils dependency. -- Æ Please create a bug[1], that way this step gets documented in the installation guide. [1] https://issues.apache.org/jira/ -- Æ
SSVM and Internet Proxy on CS3.0.x and 4.0.x
In multiple versions of 3.0.x and 4.0 I would define the http proxy setting in Global Settings secstorage.proxy - but so far I haven't seen this to be functioning successfully. My infrastructure has internet access via proxy host at the moment. My proxy host is open and does not require username and password. I define it like so http://myproxy.domain.com:3128 I tested my proxy on SSVM by defining it in shell via http_proxy env variable and was able to download the file via wget. However, it does not appear that CS passes the http_proxy variable to SSVM. I've restarted CS services, removed and re-provisioned SSVM, and disables/enabled zone, pod and cluster - no luck so far. What mechanism defines proxy and how would i check that its set on SSVM properly? I'm running CS4.0 build 140, and VmWare vSphere5. Thank you -ilya
[jira] [Commented] (CLOUDSTACK-497) createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key
[ https://issues.apache.org/jira/browse/CLOUDSTACK-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498622#comment-13498622 ] Rohit Yadav commented on CLOUDSTACK-497: Won't this be a potential security issue to store ssh private keys in the database? I don't know of any IaaS who does that. What is the use case? If we want to do this, we should disable this feature by default and enable only via global settings? createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key --- Key: CLOUDSTACK-497 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-497 Project: CloudStack Issue Type: Bug Components: API Affects Versions: 4.0.0 Environment: centos running cloudstack 4.0 Reporter: Ahmad Emneina listkeypair doesnt list the private key, alena checked the code for me, and it turns out we're not saving the key upon generation (createsshkeypairs comand). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CLOUDSTACK-498) Missing dependency in RPM of KVM Agent
[ https://issues.apache.org/jira/browse/CLOUDSTACK-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498624#comment-13498624 ] Rohit Yadav commented on CLOUDSTACK-498: I think we just need to document it, doc bug? Missing dependency in RPM of KVM Agent -- Key: CLOUDSTACK-498 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-498 Project: CloudStack Issue Type: Bug Components: KVM Affects Versions: 4.0.0, 4.0.1, 4.1.0 Environment: CentOS 6.3 Reporter: Satoshi Kobayashi LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. If there is no bridge-utils, KVM Agent will not operate. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
RE: [jira] [Commented] (CLOUDSTACK-497) createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key
I'm just thinking on how AWS does it - they don’t save your private key in their DB either and that is done on purpose. Why would you want to save the private key in the DB? My humble opinion, it’s a security issue. Maybe we make this optional for those who don’t believe this to be an issue and really need to store the private key on a shared platform. -Original Message- From: Rohit Yadav (JIRA) [mailto:j...@apache.org] Sent: Friday, November 16, 2012 1:08 AM To: cloudstack-dev@incubator.apache.org Subject: [jira] [Commented] (CLOUDSTACK-497) createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key [ https://issues.apache.org/jira/browse/CLOUDSTACK-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498622#comment-13498622 ] Rohit Yadav commented on CLOUDSTACK-497: Won't this be a potential security issue to store ssh private keys in the database? I don't know of any IaaS who does that. What is the use case? If we want to do this, we should disable this feature by default and enable only via global settings? createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key -- - Key: CLOUDSTACK-497 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-497 Project: CloudStack Issue Type: Bug Components: API Affects Versions: 4.0.0 Environment: centos running cloudstack 4.0 Reporter: Ahmad Emneina listkeypair doesnt list the private key, alena checked the code for me, and it turns out we're not saving the key upon generation (createsshkeypairs comand). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CLOUDSTACK-497) createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key
[ https://issues.apache.org/jira/browse/CLOUDSTACK-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498632#comment-13498632 ] Musayev, Ilya commented on CLOUDSTACK-497: -- I'm just thinking on how AWS does it - they don’t save your private key in their DB either and that is done on purpose. Why would you want to save the private key in the DB? My humble opinion, it’s a security issue. Maybe we make this optional for those who don’t believe this to be an issue and really need to store the private key on a shared platform. createSSHkeypairs doesnt save the private key to the db, so list sshkeypair doesnt return a private key --- Key: CLOUDSTACK-497 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-497 Project: CloudStack Issue Type: Bug Components: API Affects Versions: 4.0.0 Environment: centos running cloudstack 4.0 Reporter: Ahmad Emneina listkeypair doesnt list the private key, alena checked the code for me, and it turns out we're not saving the key upon generation (createsshkeypairs comand). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Duplicate scripts in codebase for setting password and sshkey for uservms
On 28-Oct-2012, at 5:15 PM, Rohit Yadav rohit.ya...@citrix.com wrote: I found duplicate scripts; fix on one setup/bindir/cloud-set-guest-password.in tools/guest_password/cloud-set-guest-password Which one to keep? setup/bindir/cloud-* are most up to date, there is one patch missing on tools/guest_password/cloud-set-guest-password Ping? Regards.
[jira] [Commented] (CLOUDSTACK-498) Missing dependency in RPM of KVM Agent
[ https://issues.apache.org/jira/browse/CLOUDSTACK-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498640#comment-13498640 ] Satoshi Kobayashi commented on CLOUDSTACK-498: -- I think that a document is required for already released version (4.0) at least. About it or later, I also think that adding bridge-utils to spec of cloud-agent-libs is considered. However, since the license of bridge-utils is GPLv2, if we cannot do it, we should only supported by a document. (Is this view right? Since I am not knowledgeable about the view over a license, I would like to know) Missing dependency in RPM of KVM Agent -- Key: CLOUDSTACK-498 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-498 Project: CloudStack Issue Type: Bug Components: KVM Affects Versions: 4.0.0, 4.0.1, 4.1.0 Environment: CentOS 6.3 Reporter: Satoshi Kobayashi LibvirtComputingResource class and BridgeVifDriver class are dependent on LinuxBridge. They execute brctl command internally. However, the package (bridge-utils) in which it is contained is not included in the dependence of RPM of KVM Agent. If there is no bridge-utils, KVM Agent will not operate. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed
[ https://issues.apache.org/jira/browse/CLOUDSTACK-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498644#comment-13498644 ] Jessica Tomechak commented on CLOUDSTACK-464: - Sebastien, thanks for your kind information to let me know of the proper procedure. I'm sorry to have missed a step through not realizing that was required. I also did not realize you were setting out to rewrite the sections at the time of your original review request, or I would have looked more closely and provided comments in a more timely way. I thought you were only doing the conversion to XML. Again, I'm sorry for that misunderstanding. To respond for requests I have received for detailed information about each issue that I saw in Sebastien's copy, here are the issues one by one. I am providing the following detailed comments at Sebastien's and David N's request. The files aws-ec2-configuration.xml and aws-ec2-requirements.xml mostly rephrased the information that was already in the previous (CloudPlatform 3.0.3) version of the same doc, in a way that was less grammatical and less clear. The version I created is basically a copy-edit of these files, except for the following items: aws-ec2-configuration.xml added an API call example, which looked fine; however it contained a reference to port 8096, which I have been asked in the past to remove from docs for security reasons. This file also added some screen shots which seemed to refer to images that were not checked in. In aws-ec2-introduction.xml, I removed references to REST because I believed that REST was not working, and should not be documented. This was based on information from Prachi and Likitha, who coded the feature. When I checked with them, they referred to the feature as quite broken. Also, I did not see the feature in the 4.0 feature list on the Apache wiki. Sebastien and David have since said they tested the REST interface and it worked for them, so there is some disconnect here. There were a couple of references to plans for the future. In aws-ec2-introduction, the sentence starting Expect ... in new releases refers to the future, and similarly in awd-ec2-requirements, the sentence Effort is underway In my experience, it is a tech docs best practice to record what is currently available rather than talking about future developments (which might not materialize). Therefore I removed this text. In aws-ec2-supported-commands.xml, I removed the headers above the tables, since they were redundant with the table titles. In aws-ec2-timeouts.xml, I added the Timeouts section, which was present in the previous version of these docs and omitted from Sebastien's commit. In aws-interface-compatibility.xml, I changed the title of the section from AWS Interface Guide to AWS Interface Compatibility, since the word Guide is usually used in a book title, not a section that might be reused in several different books. In aws-ec2-user-setup.xml, again the same information from the previous (3.0.3) version was restated in a way that didn't seem more clear. Changes I made in this file were just copy-editing. Also, I have recently learned that the user registration step is not required for users of the REST interface, so if REST is re-introduced to the document, then it should be noted in this section that this step can be skipped by REST users. In the same file, some steps were omitted, such as where to download the cloudstack-aws-api-register script and which values to substitute in the command. In case it is necessary to provide an example of what is meant by less clear, see the following: Text from previous version (CloudStack 3.0.3): The user follows these steps: 1. Obtain the following by looking in the UI, using the API, or asking the cloud administrator: * The CloudStack server's publicly available DNS name or IP address * The user account's API key and Secret key This was changed to the following in Sebastien's version: To register, a user needs to: * Obtain his API key and his secret key as well as the DNS name or IP address of the CloudStack server. Obtaining the keys can be done by asking the CloudStack administrator or by using the GUI or via the API. Aside from the problematic use of his, this creates a run-on sentence, and mixes several items together rather than providing a scannable checklist. Regression in AWSAPI docs, entire sections removed -- Key: CLOUDSTACK-464 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-464 Project: CloudStack Issue Type: Bug Components: Doc Affects Versions: 4.0.0, 4.1.0 Reporter: sebastien goasguen Assignee: Jessica Tomechak Commit 22b5c0cddd798829788b4e630b8ae77b81a05c2f on 10/17: Overwrites some of the
[jira] [Commented] (CLOUDSTACK-464) Regression in AWSAPI docs, entire sections removed
[ https://issues.apache.org/jira/browse/CLOUDSTACK-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498645#comment-13498645 ] Jessica Tomechak commented on CLOUDSTACK-464: - By not yet supported in my previous comment, I meant not yet working. Regression in AWSAPI docs, entire sections removed -- Key: CLOUDSTACK-464 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-464 Project: CloudStack Issue Type: Bug Components: Doc Affects Versions: 4.0.0, 4.1.0 Reporter: sebastien goasguen Assignee: Jessica Tomechak Commit 22b5c0cddd798829788b4e630b8ae77b81a05c2f on 10/17: Overwrites some of the documentation contributed previously on the AWSAPI. The commit introduces a few errors (e.g mention of CloudPlatform ) and overwrites additional documentation submitted by me and committed on Sept 23rd By D. Nalley with commit: 56b4ac184f712f54868af83b5e8110af93b72e83 While the commit does correct some typos, it basically reverts to the old documentation which I had worked on towards improvement. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Can we still use DevCloud VM Image ?
Hi Rohit, Can you answer to this question please ? Do I have to follow instructions here to configure NFS server ( http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#nfs-shares-on-management-server) ? Another thing that I would like to share. If we configure the Xenbr0 interface like this, then the machine is not able to connect to internet more /etc/network/interfaces # This file describes the network interfaces available on your system # and how to activate them. For more information, see interfaces(5). # The loopback network interface auto lo iface lo inet loopback # The primary network interface auto eth0 iface eth0 inet dhcp auto xenbr0 iface xenbr0 inet dhcp bridge_ports eth0 auto eth1 iface eth1 inet static address 192.168.56.2 netmask 255.255.255.0 broadcast 192.168.56.255 gateway 192.168.56.1 Any idea is welcome ? Regards, Charles On Thu, Nov 15, 2012 at 6:47 PM, Charles Moulliard ch0...@gmail.com wrote: My question was more about -- Do I have to follow instructions here to configure NFS server ( http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#nfs-shares-on-management-server) ? On Thu, Nov 15, 2012 at 6:35 PM, Rohit Yadav rohit.ya...@citrix.comwrote: Yes, hack and go through the .bash_history, setup systemvm template. Then you're pretty much done as long as yout network won't fail you. Rest, you have already built and run mgmt server. Won't be much help. Regards. From: Charles Moulliard [ch0...@gmail.com] Sent: Thursday, November 15, 2012 11:00 PM To: cloudstack-dev Subject: Re: Can we still use DevCloud VM Image ? Hi Rohit, I progress. I have been able to install xen, configure network to create a private network and also access to internet and nfs server is installed (apt-get install nfs-kernel-server). Do we have something more to do for NFS ? Regards, Charles On Thu, Nov 15, 2012 at 3:29 PM, Rohit Yadav rohit.ya...@citrix.com wrote: On 15-Nov-2012, at 7:12 PM, Charles Moulliard ch0...@gmail.com wrote: As of ubuntu-11 is configured use xen, As of Ubuntu 11.10 (Oneiric), the default kernel included in Ubuntu can be used directly with the Xen hypervisor as the management (or control) domain (Dom0 or Domain0 in Xen terminology). why don't you create an image using it ? Yes, I'm using this only. apt-get install xen-hypervisor and you're done. To use xen, one just need to select the kernel with xen during booting on grub. If you're keep, hack ~/.bash_history from the DevCloud image, the history will tell you what was performed to create devcloud. About pre-seeding systemvm template, see this: http://incubator.apache.org/cloudstack/docs/en-US/Apache_CloudStack/4.0.0-incubating/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template You need to pre-seed, i.e. put a systemvm template on nfs with which your systemvm, cpvm and domr are created. Regards. On Thu, Nov 15, 2012 at 12:08 PM, Rohit Yadav rohit.ya...@citrix.com wrote: On 15-Nov-2012, at 2:10 PM, Charles Moulliard ch0...@gmail.com wrote: Using VirtualBox R4.2.4 on MacOS 10.7.5 and the image ( http://bhaisaab.org/vms/ubuntu-12.04-x86-minimal-vm.tar.gz) that you provide, the OS does not boot (screen stays black). Oh :( Will start with a new image today again. Will keep you posted. On Thu, Nov 15, 2012 at 9:13 AM, Charles Moulliard ch0...@gmail.com wrote: Many thanks. What do you mean by *Preseed a systemvm template and you should be good to go. (2. is the tricky one) ?* Yes, this one: 2. Configure network such that it's accessible to the host os and can access Internet, *I have started to create a google document to define step-by-step what do do.* Cool. On Wed, Nov 14, 2012 at 11:19 AM, Rohit Yadav rohit.ya...@citrix.com wrote: On 14-Nov-2012, at 3:23 PM, Charles Moulliard ch0...@gmail.com wrote: Hi Rohit, Have you been able to finalize your work about creating a new Ubuntu image for VirtualBox. If this is not the case, can you share with us (document, ...) what you have done to configure Ubunttu (Installating MySQL, Tomcat, ) ? Hi Charles, Alright I'm back online, will work on releasing a devcloud image that I hope would work out of the box, after some code monkey duties this week. In the new image, mysql, tomcat, git etc. won't be installed on devcloud. The idea is that you develop on your host os, debug with your fav. IDE and run mgmt server, mysql, jetty/tomcat as well (if you want to do that on devcloud that too you can do). The default image will
[jira] [Created] (CLOUDSTACK-499) cloudmonkey CLI can't accept complex parameters
Dave Cahill created CLOUDSTACK-499: -- Summary: cloudmonkey CLI can't accept complex parameters Key: CLOUDSTACK-499 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-499 Project: CloudStack Issue Type: Bug Components: Usage Affects Versions: 4.1.0 Environment: Ubuntu 12.04, KVM hypervisor Reporter: Dave Cahill Fix For: 4.1.0 When setting up a networkoffering, there's a serviceProviderList parameter which is a list of items, each of which has several key value pairs. According to Rohit (on dev list): The way maps are handled in url are very different than how cloudmonkey parses and passing key,values. This actually needs to be fixed in Marvin, I've figured out a way but it may cause issues with marvin, will discuss with Prasanna and fix it soon. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: CLI for CloudStack: cloudmonkey
Thanks Rohit - filed this bug to track the issue: https://issues.apache.org/jira/browse/CLOUDSTACK-499 If you have time to write a description of how you're planning to fix it, I could take a look at it - I have my setup 99% automated, just need to get this param passing working. :) Thanks, Dave. On Thu, Nov 15, 2012 at 11:20 PM, Rohit Yadav rohit.ya...@citrix.comwrote: On 15-Nov-2012, at 3:26 PM, Dave Cahill dcah...@midokura.jp wrote: Hi Rohit, I've been using cloudmonkey to script my CloudStack setup process in dev, and had one question. How do we pass complex (MAP) parameters to cloudmonkey? For example, when setting up a networkoffering, there's a serviceProviderList parameter which is a list of items, each of which has several key value pairs. I tried a couple of syntaxes to pass this parameter, but didn't come across the correct one yet - can you enlighten me? ;) Hi Dave, thanks for catching the bug. The way maps are handled in url are very different than how cloudmonkey parses and passing key,values. This actually needs to be fixed in Marvin, I've figured out a way but it may cause issues with marvin, will discuss with Prasanna and fix it soon. You may file an issues if you want to. Regards. Thanks for your work on this, very useful. Thanks, Dave. On Mon, Nov 12, 2012 at 7:01 PM, Rohit Yadav rohit.ya...@citrix.com wrote: Hi Charles, Karaf seems nice, and no worries I don't see any suggestions as flames or war. I would anytime throw away any code for something better, so feel free to start writing your own client and share with us. Patches welcome! Let me share why I wrote it in Python: - First of all the CLI is not even a client to start with, I mean I've totally based it off marvin. It's a small wrapper I would say around marvin. - Python because, the environment is preinstalled on Macs and almost all Linux distros. - Scripting environment that Python provides so one can fork and edit their own versions of cloudmonkey CLI, this saves the user from hack-compile-build-run loop; one can just hack and run. - The best part again is marvin as dependency, you write javadocs etc. in your java code, apidocs gets interface definition and requirements from the java code, the commands.xml created in the process is used by marvin's codegenerator which generates api modules with Cmd and Response classes. The generated cloudstackAPI is used by both marvin clients and the CLI. The CLI which is about 400 lines of Python, in turn loads these modules and generates grammar and command handlers on the fly using some functional magic (injects functions into the classes), I don't think this kind of programming is even possible with Java, they don't have functions as first class citizens. What does the last statement mean for the developers: So, if a developer simply adds a new API which is java code, with required docs etc. apidocs will pick it up automatically and in turn marvin (and it's test clients) will get new cloudstackAPI and CLI too gets the new APIs on the fly. The functional closures in CLI will make sure the new APIs and its handlers are created with grammar rules. The developer won't need to change apidocs, marvin or CLI. I think this is one of my best hacks [0] which leverages on existing code and I think it would be very maintainable in future. Sorry everyone, I'm caught up with some other issues, I want to post a screencast and blog explaining the CLI but only after I finalize the specs for the CLI. Thanks for the feedback so far. The top TODOs left now are: - Reverse search - Bash/zsh completion Regards. PS. Just in case you're curious: [0] https://github.com/bhaisaab/hacktools From: Charles Moulliard [ch0...@gmail.com] Sent: Monday, November 12, 2012 12:49 PM To: cloudstack-dev Subject: Re: CLI for CloudStack: cloudmonkey Hi, I don't want to create a developer war or position a technology against another (python against java) but we could leverage Apache Karaf (OSGI runtime container) project to provide the cloudmonkey client. This work has already be done for jclouds (http://www.youtube.com/watch?v=EKVkm6AV19U , https://github.com/jclouds/jclouds-karaf) and could be easily created created for cloudmonkey. Karaf which is a shell environment proposes a lot of by default features (http://karaf.apache.org/ : ssh, jaas, provisioning, administration, history, config files support, ... - http://karaf.apache.org/manual/latest-2.3.x/developers-guide/index.html ) that we could extend with cloudmonkey commands ( http://karaf.apache.org/manual/latest-2.3.x/developers-guide/extending-console.html ) and rebrand Karaf into a cloudmonkey karaf container. Regards, Charles On Fri, Nov 9, 2012 at 10:53 PM, Musayev, Ilya imusa...@webmd.net wrote:
