Deleting sparse snapshots from XenServer SR
Hi Folks, So we are in a situation where we have (a lot of) sparse snapshots, so snapshots hanging there without the actual VM still existing, on one SR, and they don't clean up. Is it safe to flush them manually from XenServer or there is another way of doing it? Thanks -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: 4.4.4 RPMs not on repo
The apt-get.eu one. FG On 2015-06-30 3:42 PM, Rohit Yadav wrote: On 30-Jun-2015, at 9:42 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: why typo, *why - which Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineeringhttp://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: 4.4.4 RPMs not on repo
Oh I see. I misunderstood the concept then :) I went ahead with ShapeBlue's repo. Thanks! FG On 2015-06-30 4:00 PM, Erik Weber wrote: Currently there are no official packages or templates AFAIK, only source code. apt-get.eu is a courtesy from Wido (IIRC), whilst shapeblue.com obviously comes from them. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Windows Template Startup time
Windows instances are usually having a much bigger size than the typical
Linux VM. It's normal to take longer. Even with 10GB network, it can
take up to 5 minutes depending of the load on our SS.
FG
On 2015-06-29 10:28 AM, Timothy Lothering wrote:
Hi Prashant,
There are a couple of questions here:
1. Has your hardware been configured for optimal I/O throughput?
2. Have you installed XenTools on the VM?
Slow VM Template Deployment:
Initial Template download from SS is dependent on the SSVM, CPU, RAM and Network speed. Check
that all of these have been configured to optimal speed size. Initial template
deployment is slow as the template needs to be copied from SS first. Subsequent
deployments should be faster.
Slow VM Reboot:
This is dependent on the hardware configuration and whether PV drivers
(XenTools) have been installed.
Kind Regards,
Timothy Lothering
Timothy Lothering
Solutions Architect
Managed Services
T: +27877415535
F: +27877415100
C: +27824904099
E: tlother...@datacentrix.co.za
DISCLAIMER NOTICE:
Everything in this e-mail and any attachments relating to the official business
of Datacentrix Holdings Ltd. and its subsidiaries
('Datacentrix') is proprietary to Datacentrix. It is confidential, legally
privileged and protected by law. Datacentrix does not
own and endorse any other content. Views and opinions are those of the sender
unless clearly stated as being that of Datacentrix.
The person addressed in the e-mail is the sole authorised recipient. Please
notify the sender immediately if it has unintentionally
reached you and do not read, disclose or use the content in any way.
Datacentrix cannot assure that the integrity of this communication
has been maintained nor that it is free of errors, virus, interception or
interference.
-Original Message-
From: prashant priyam [mailto:prashant_pri...@outlook.com]
Sent: 29 June 2015 04:07 PM
To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: Windows Template Startup time
Hi,
I have create a windows server 2012 R2 64 bit template with 8 vCPU and 16Gbs
RAM and 350Gbs as Root Disk and created template on cloudstack 4.3 and xen
server 6.2 .
Now when I porvision vm with this template it takes around 15 minutes to start
the VM and after creation it again takes around 20 minutes to reboot the VM.
Please help how can I minimize the reboot time .
With warm regards,Prashant
Priyam(+91-8802955489)http://in.linkedin.com/in/prashantpriyam
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: Tokyo and Seoul
Pretty good read though :) Im glad to see others are using SF with ACS!! FG On May 27, 2015 9:13 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I must make that mistake at least once or twice a year. :/ Sorry for the spam! :( On Wednesday, May 27, 2015, Sebastien Goasguen run...@gmail.com wrote: I am pretty sure Mike T meant this for the solidfire private mailing list. ask him for free beer next time you see him... On May 27, 2015, at 10:34 PM, Mike Tutkowski mike.tutkow...@solidfire.com javascript:; wrote: Hi everyone, Just as an FYI: I will be heading to Tokyo this coming Saturday to present at the CloudStack Days conference next week and to meet with three SolidFire/CloudStack prospects. I'll then be making a short trip to Seoul, Korea to meet with a prospect that has been PoCing SolidFire and CloudStack for the past few months. During this time, I'll have access to e-mail, but - as you'd expect with a 15-hour timezone difference - my responses may not be as prompt as you're used to. Here's a link to the CloudStack Days Tokyo presentation I'll be giving next Tuesday: https://cloudstackdaystokyo2015.sched.org/event/d3a648980a693a5561c51732f2ac4339#.VWYn6GRViko I expect to be flying back to Colorado on June 9th. Talk to you later! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com javascript:; o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™*
Re: External LB integration
Erik, Thats correct. Its called NetworkGuru. This is to avoid overlapping subnets on a shared netscaler. Pretty sure if you use a dedicated one, youll have more flexibility. FG On May 27, 2015 4:30 PM, Erik Weber terbol...@gmail.com wrote: Doing some tests with Netscaler at the moment (input welcome!), and discovered that if you have a network offering with external LB, you're not allowed to specify the CIDR later when you add a network. Instead it seems to randomly pick a range, from I don't know where, and use that. Does anyone know where this behaviour comes from? Why does CloudStack think it is better at specifying a proper CIDR than me? Where is it getting it's range from? The saga continues -- Erik
Re: External LB integration
I dont think its configurable, maybe have a look in global settings? We are using netscalers but in a VPC model. So we dont have to deal with networkguru at all :) FG On May 27, 2015 5:57 PM, Erik Weber terbol...@gmail.com wrote: Thank you Francois, Do you know if the subnets it considers are customizable somehow? As far as I could see it chose something completely random, which might not be a good thing. -- Erik On Wed, May 27, 2015 at 11:17 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Erik, Thats correct. Its called NetworkGuru. This is to avoid overlapping subnets on a shared netscaler. Pretty sure if you use a dedicated one, youll have more flexibility. FG On May 27, 2015 4:30 PM, Erik Weber terbol...@gmail.com wrote: Doing some tests with Netscaler at the moment (input welcome!), and discovered that if you have a network offering with external LB, you're not allowed to specify the CIDR later when you add a network. Instead it seems to randomly pick a range, from I don't know where, and use that. Does anyone know where this behaviour comes from? Why does CloudStack think it is better at specifying a proper CIDR than me? Where is it getting it's range from? The saga continues -- Erik
VPC not restarting
Anybody seen this before with XenServer? Trying to restart a VPC, and getting a NPE. We are on 4.4.1: 2015-05-07 14:13:11,325 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-225:ctx-22776ed8) Plug Nic failed due to java.lang.NullPointerException java.lang.NullPointerException at com.cloud.hypervisor.xen.resource.CitrixResourceBase.getVifByMac(CitrixResourceBase.java:3887) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:7383) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:542) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102) at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:293) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: VPC not restarting
Right, sorry for the confusion,it's a custom 4.4.1 (non GA). Might want to
look in the 4.4.0 code.
Also this looks like it happened when I deleted a private gateway when the
VR was stopped.
FG
On May 7, 2015 5:46 PM, Daan Hoogland daan.hoogl...@gmail.com wrote:
I am a bit confused Francois,
I checked out GA-4.4.1
The line
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getVifByMac(CitrixResourceBase.java:3887)
contains
protected VIF getVifByMac(Connection conn, VM router, String mac)
throws XmlRpcException, XenAPIException {
which means it is not a line of code but a function declaration.
Are you sure you are running 4.4.1?
Op do 7 mei 2015 om 20:30 schreef Francois Gaudreault
fgaudrea...@cloudops.com:
Anybody seen this before with XenServer? Trying to restart a VPC, and
getting a NPE. We are on 4.4.1:
2015-05-07 14:13:11,325 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-225:ctx-22776ed8) Plug Nic failed due to
java.lang.NullPointerException
java.lang.NullPointerException
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getVifByMac(CitrixResourceBase.java:3887)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:7383)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:542)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102)
at
com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:293)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: VPC not restarting
I can try to get this from jenkins, but Ill most likely won't find it.
FG
On May 7, 2015 6:14 PM, Daan Hoogland daan.hoogl...@gmail.com wrote:
Do you have an commit ID?
Op do 7 mei 2015 om 23:58 schreef Francois Gaudreault
fgaudrea...@cloudops.com:
Right, sorry for the confusion,it's a custom 4.4.1 (non GA). Might want
to look in the 4.4.0 code.
Also this looks like it happened when I deleted a private gateway when
the VR was stopped.
FG
On May 7, 2015 5:46 PM, Daan Hoogland daan.hoogl...@gmail.com wrote:
I am a bit confused Francois,
I checked out GA-4.4.1
The line
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getVifByMac(CitrixResourceBase.java:3887)
contains
protected VIF getVifByMac(Connection conn, VM router, String mac)
throws XmlRpcException, XenAPIException {
which means it is not a line of code but a function declaration.
Are you sure you are running 4.4.1?
Op do 7 mei 2015 om 20:30 schreef Francois Gaudreault
fgaudrea...@cloudops.com:
Anybody seen this before with XenServer? Trying to restart a VPC, and
getting a NPE. We are on 4.4.1:
2015-05-07 14:13:11,325 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-225:ctx-22776ed8) Plug Nic failed due to
java.lang.NullPointerException
java.lang.NullPointerException
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getVifByMac(CitrixResourceBase.java:3887)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:7383)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:542)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102)
at
com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:293)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
XenServer and Attach Volume
Hi, Quick question. On Volume attach code for XenServer, does CloudStack push the /dev/sd* or /dev/xvd* for XenServer to use? Is there any potential reasons why on some host, ACS would push /dev/hde instead of /dev/xvde for the 5th drive? We use 4.4 -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: XenServer and Attach Volume
Ok, so then what would make a host not mapping the appropriate drive name? Is there a script dropped on XenServer or something? It works fine on some host, and doesn't on some other on the same cluster :S FG On 2015-04-07 10:44 PM, Mike Tutkowski wrote: CloudStack picks a disk sequence number from the DB and passes it to the XenServer agent. It appears the /dev path you see is perhaps selected inside of XAPI. This is the relevant CloudStack code in XenServerStorageProcessor (diskNumber is the disk sequence number): vbdr.VM = vm; vbdr.VDI = vdi; vbdr.bootable = false; vbdr.userdevice = diskNumber; vbdr.mode = Types.VbdMode.RW; vbdr.type = Types.VbdType.DISK; vbdr.unpluggable = true; VBD vbd = VBD.create(conn, vbdr); // Attach the VBD to the VM vbd.plug(conn); On Tue, Apr 7, 2015 at 8:31 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Hi, Quick question. On Volume attach code for XenServer, does CloudStack push the /dev/sd* or /dev/xvd* for XenServer to use? Is there any potential reasons why on some host, ACS would push /dev/hde instead of /dev/xvde for the 5th drive? We use 4.4 -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 tel:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play/™/ -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ANNOUNCE] Rohit Yadav as new PMC member of CloudStack
On 2015-03-27 4:07 AM, Sebastien Goasguen wrote: The Project Management Committee (PMC) for Apache CloudStack are pleased to announce that Rohit Yadav has accepted our invitation to join the PMC. Please join me in congratulating him. On behalf of the Apache CloudStack PMC Was about time! :) Congrats Rohit! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ANNOUNCE] Rohit Yadav as new PMC member of CloudStack
On 2015-03-27 4:07 AM, Sebastien Goasguen wrote: The Project Management Committee (PMC) for Apache CloudStack are pleased to announce that Rohit Yadav has accepted our invitation to join the PMC. Please join me in congratulating him. On behalf of the Apache CloudStack PMC Was about time! :) Congrats Rohit! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Jira Housekeeping - 'Old Blockers'
Paul, I do see my name beside some of these :S I believe it's fair to downgrade mine to something lower and/or close them. However, I am pretty sure these bugs still exists today, but unfortunately I'm not equipped to fully retest them. If you go with the close option, I can reopen them later if needed. Thanks! FG On 2015-03-10 9:26 AM, Paul Angus wrote: Thanks Rajani, It's an interesting read. I'm hoping to rope a load of people into the overall effort. There are 1468 open issues in Jira, we really need to start by cleaning up duplicates, obsolete issues, and 'non-issues'. Regards Paul Angus Cloud Architect S: +44 20 3603 0540 | M: +447711418784 | T: CloudyAngus paul.an...@shapeblue.com -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 08 March 2015 10:50 To: dev@cloudstack.apache.org Subject: Re: Jira Housekeeping - 'Old Blockers' I would like to share a blog post I read recently which I believe is relevant in this context. http://words.steveklabnik.com/how-to-be-an-open-source-gardener ~Rajani On Sat, Mar 7, 2015 at 11:18 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: Guys, It has been discussed before and My proposal was that no issue is a blocker unless it has been discussed as such on dev@. This has never been voted on AFAIR. No release should go out with a blocker open, so 'old' blockers is kind of awkward. I'd say triage them and close or downgrade. On Fri, Mar 6, 2015 at 12:51 PM, Abhinandan Prateek abhinandan.prat...@shapeblue.com wrote: Hi Paul, This is a good initiative ! I think we should clean up Jira as we go forward. Blockers languishing around is not a good sign. I personally feel that blockers that are more than a year old can be safely closed, as these may be hard to reproduce as things have changed since then or probably these are not relevant now. anything remaining should then be worked upon and resolved/closed. On 06-Mar-2015, at 3:42 pm, Paul Angus paul.an...@shapeblue.commailto: paul.an...@shapeblue.com wrote: Hey Guys, I’m thinking that it would be a good idea to do a bit of Jira housekeeping to clear up any orphaned bugs (or fix any long standing issues). So, starting at the top, we have 9 ‘Blockers’ to old releases. Which are still hanging around. Could people maybe pick one or two and close them if no longer an issue or update the Affects Version(s) if it’s still relevant ? Issue Type Key Summary Assignee Reporter Priority Status Resolution Created Updated Affects Version/s Bug CLOUDSTACK-6801https://issues.apache.org/jira/browse/CLOUDSTACK-680 1 Public IP not assigned to eth1 on VR in VPC Unassigned Andrija Panic Blocker Open Unresolved 28/05/2014 20:19 30/05/2014 18:36 4.3.0 Bug CLOUDSTACK-6004https://issues.apache.org/jira/browse/CLOUDSTACK-600 4 Cannot do Local to Local Xen StorageMotion using XS6.2SP1 Unassigned Francois Gaudreault Blocker Open Unresolved 31/01/2014 15:21 31/01/2014 15:24 4.2.1 Bug CLOUDSTACK-5717https://issues.apache.org/jira/browse/CLOUDSTACK-571 7 Unable to start new instance Unassigned Alex Rybchenko Blocker Open Unresolved 02/01/2014 11:34 02/01/2014 11:44 4.2.0 Bug CLOUDSTACK-5397https://issues.apache.org/jira/browse/CLOUDSTACK-539 7 Starting VM fails if VM snapshot is created Unassigned Antonio Petrocelli Blocker Open Unresolved 06/12/2013 08:31 06/12/2013 08:31 4.2.0 Bug CLOUDSTACK-5159https://issues.apache.org/jira/browse/CLOUDSTACK-515 9 Reset SSH keypair sometimes fails in Vmware Unassigned Girish Shilamkar Blocker Open Unresolved 14/11/2013 05:29 14/11/2013 05:29 4.2.1 Bug CLOUDSTACK-5108https://issues.apache.org/jira/browse/CLOUDSTACK-510 8 test_vpc_network_pfules tests sometimes fails to wget from spawned instance Unassigned Girish Shilamkar Blocker Open Unresolved 08/11/2013 13:13 08/11/2013 14:46 4.2.1 Bug CLOUDSTACK-5095https://issues.apache.org/jira/browse/CLOUDSTACK-509 5 est_project_limits.TestResourceLimitsProject.test_05_snapshots_per_pro ject fails to create snapshot Unassigned Girish Shilamkar Blocker Open Unresolved 08/11/2013 04:21 17/12/2013 08:48 4.2.1 Bug CLOUDSTACK-4192https://issues.apache.org/jira/browse/CLOUDSTACK-419 2 AutoScaling: More VMs than Maximum are created Unassigned Francois Gaudreault Blocker Open Unresolved 08/08/2013 15:45 08/08/2013 15:45 4.1.1 Bug CLOUDSTACK-83https://issues.apache.org/jira/browse/CLOUDSTACK-83 hitting exception when trying to take two consecutive snapshot on same volume Unassigned shweta agarwal Blocker Reopened Unresolved 12/09/2012 12:44 02/09/2014 08:59 pre-4.0.0 Jira search URL: https://issues.apache.org/jira/issues/?jql=project%20%3D%20CLOUDSTACK% 20AND%20issuetype%20%3D%20Bug%20AND%20status%20in%20%28Open%2C%20%22In %20Progress%22%2C%20Reopened%2C%20Reviewable%29%20AND%20priority%20%3D %20Blocker%20AND%20resolution%20%3D%20Unresolved%20AND%20affectedVersi on%20in%20%284.0.0%2C%204.0.1%2C
Remove/Change SSH Keys from instance
Hi, Quick question, using the API, how would a user remove an associated SSH keys to an instance? What call should we use? Seems that you can't based on the existing API calls. Furthermore, how can we change the SSH Key? Is it the resetSSHKeyForVirtualMachine call? Thanks. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Remove/Change SSH Keys from instance
Yes what? That API call is not clear at all. I guess a try it yourself is what you meant? Thanks for your great help. FG On Feb 16, 2015 5:04 PM, Nux! n...@li.nux.ro wrote: yes? https://cloudstack.apache.org/docs/api/apidocs-4.4/user/resetSSHKeyForVirtualMachine.html -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Francois Gaudreault fgaudrea...@cloudops.com To: dev@cloudstack.apache.org Sent: Monday, 16 February, 2015 20:03:59 Subject: Remove/Change SSH Keys from instance Hi, Quick question, using the API, how would a user remove an associated SSH keys to an instance? What call should we use? Seems that you can't based on the existing API calls. Furthermore, how can we change the SSH Key? Is it the resetSSHKeyForVirtualMachine call? Thanks. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Remove/Change SSH Keys from instance
Look...I apologize for the sarcasm. I was a little bit irritated. I just wanted to get some help. I read the API documentation, I read the User guide. I just wanted to same some time and ask on this list. Thanks. FG On 2015-02-16 5:04 PM, Nux! wrote: yes? https://cloudstack.apache.org/docs/api/apidocs-4.4/user/resetSSHKeyForVirtualMachine.html -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Francois Gaudreault fgaudrea...@cloudops.com To: dev@cloudstack.apache.org Sent: Monday, 16 February, 2015 20:03:59 Subject: Remove/Change SSH Keys from instance Hi, Quick question, using the API, how would a user remove an associated SSH keys to an instance? What call should we use? Seems that you can't based on the existing API calls. Furthermore, how can we change the SSH Key? Is it the resetSSHKeyForVirtualMachine call? Thanks. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_ -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Remove/Change SSH Keys from instance
Thanks for looking at it and testing it. That answers the key replacement. Looks like there is no way to actually removing the key from a created VM. I believe the only way left is the deletion. The updateVM call won't update it either :S FG On 2015-02-16 6:37 PM, Nux! wrote: resetSSHKeyForVirtualMachine Resets the SSH Key for virtual machine. The virtual machine must be in a Stopped state. [async] Apologies for causing you extra stress. We all had a long Monday. I also never used this function before and here's how I tested. - empty or move /root/.ssh/authorized_keys on the VM prior to the operation - in cloudmonkey - stop virtualmachine id=XXX - reset sshkeyforvirtualmachine keypair=newkey id=XXX - start virtualmachine id=XXX - after it came back I checked /root/.ssh/authorized_keys and .. lo behold, the new key was there. So, answer: yes, that's how to reset the SSH key and no, you can't remove it that way - it will check if the provided key name actually exists and you must provide one. ☕ :-) -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Francois Gaudreault fgaudrea...@cloudops.com To: Nux! n...@li.nux.ro Cc: dev@cloudstack.apache.org Sent: Monday, 16 February, 2015 22:22:34 Subject: Re: Remove/Change SSH Keys from instance Yes what? That API call is not clear at all. I guess a try it yourself is what you meant? Thanks for your great help. FG On Feb 16, 2015 5:04 PM, Nux! n...@li.nux.ro wrote: yes? https://cloudstack.apache.org/docs/api/apidocs-4.4/user/resetSSHKeyForVirtualMachine.html -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Francois Gaudreault fgaudrea...@cloudops.com To: dev@cloudstack.apache.org Sent: Monday, 16 February, 2015 20:03:59 Subject: Remove/Change SSH Keys from instance Hi, Quick question, using the API, how would a user remove an associated SSH keys to an instance? What call should we use? Seems that you can't based on the existing API calls. Furthermore, how can we change the SSH Key? Is it the resetSSHKeyForVirtualMachine call? Thanks. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_ -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Templates are no longer available on SSVM/ACS restart when using Swift
We have a very weird situation here. All the templates derived from snapshots are put to Not Available upon a ACS/SSVM restart. We use Swift as the secondary storage provider. Basically, the data looks like this prior the restart: data_center_id: NULL data_center_uuid: NULL data_center_name: NULL lp_account_id: NULL store_id: 4 store_scope: REGION state: Ready download_state: DOWNLOADED download_pct: 100 error_str: NULL size: 4082758144 destroyed: 0 created_on_store: 2015-02-03 15:33:39 detail_name: platform detail_value: viridian:true;acpi:1;apic:true;pae:true;nx:true;timeoffset:0 And looks like this after the restart: data_center_id: 1 data_center_uuid: 04afdbd1-e32d-4999-86d0-96703736dded data_center_name: QC-1 lp_account_id: NULL store_id: NULL store_scope: NULL state: NULL download_state: NULL download_pct: NULL error_str: NULL size: NULL destroyed: NULL created_on_store: NULL detail_name: hypervisortoolsversion detail_value: xenserver56 Also, all templates that have been imported are not affected. We are running 4.4.1. Ideas? -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
StorageManager-Scavenger tries to delete VMs that are no longer existing.
We had an issue last November when our storage repositories went a
little crazy.
For some reason, 1 of the two SR was available so ACS tried to copy the
running VMs to the available SR. Which is by the way a wrong approach
when the source is not available... whatever.
Now I keep having these scavenger threads going with this message in the
logs:
2015-01-06 15:47:46,287 DEBUG [c.c.a.m.ClusteredAgentAttache]
(StorageManager-Scavenger-10:ctx-0a0112b5) Seq 1-3174756262319494428:
Forwarding Seq 1-3174756262319494428: { Cmd , MgmtId: 130589506760615,
via: 1(cca-c7-xen01), Ver: v1, Flags: 100011,
[{org.apache.cloudstack.storage.command.DeleteCommand:{data:{org.apache.cloudstack.storage.to.VolumeObjectTO:{uuid:da40461c-a04f-4a67-8eb1-a7c8b69c4ff8,volumeType:ROOT,dataStore:{org.apache.cloudstack.storage.to.PrimaryDataStoreTO:{uuid:3e6146bb-0252-3336-89cd-6bfa10dbad7d,id:13,poolType:IscsiLUN,..
Output from the DB:
mysql select pool_id, instance_id, name, state, created, removed from
volumes where instance_id = 128;
+-+-+--+--+-+-+
| pool_id | instance_id | name | state| created |
removed |
+-+-+--+--+-+-+
| 13 | 128 | ROOT-128 | Destroy | 2014-09-16 17:35:34 |
NULL|
| 7 | 128 | ROOT-128 | Expunged | 2014-11-13 17:38:05 |
2014-11-13 18:01:25 |
| 7 | 128 | ROOT-128 | Destroy | 2014-11-13 17:38:10 |
NULL|
| 7 | 128 | ROOT-128 | Destroy | 2014-11-13 17:38:16 |
NULL|
| 7 | 128 | ROOT-128 | Destroy | 2014-11-13 17:38:21 |
NULL|
| 7 | 128 | ROOT-128 | Destroy | 2014-11-13 17:38:26 |
NULL|
| 7 | 128 | ROOT-128 | Destroy | 2014-11-13 17:38:31 |
NULL|
+-+-+--+--+-+-+
Should I just go and delete the first row?
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: time zones
Hmm... AFAIK this list covers all timezones available. Pick the one that match your timezone? Even if its not Your city thata written. I dont think any is missing. (?) FG On Dec 2, 2014 7:41 AM, Alireza Eskandari astro.alir...@yahoo.com.invalid wrote: Hi,Does CloudStack accepted time zones limited to list below? http://docs.cloudstack.apache.org/en/latest/dev.html?highlight=time%20zones#time-zones Is it possible to use different time zone outside of the above list?Thanks
Re: time zones
Interesting. I guess you should do a JIRA ticket to track it. Most of these timezone probably comes from Java tho. FG On Dec 2, 2014 7:56 AM, Alireza Eskandari astro.alir...@yahoo.com.invalid wrote: Francois, you are right but unfortunately our time zone isn't standard. We use +3.5 (+4.5 with DST)Thanks
NetScaler 10.5
Guys, Is NetScaler 10.5 supposed to work on the 4.4.x branch? I was under to impression there was a bug with the way ACS uses the API of 10.5, correct? Is that bug fixed in 4.5? If its the case, can we merge back that commit in 4.4? Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [DISCUSS] Should we install XenServer tools in systemvmtemplates
In our case, we kinda mitigate that by adding the debian package inside the systemvm.iso file, and modifying the firstboot script to add a dkpg command. When a VR or SSVM are brought up, the deb automatically installs with the proper version we are using at that moment. If we ever change the XS version, we will need to update on a case by case basis until we standardized the entire DC. Which is not optimal. It's probably not the right way of doing it, but there might be a way of figuring out the version of Xen where the VM will be launched, and then dynamically install the appropriate xentools. FG On 2014-11-20 4:19 PM, Rohit Yadav wrote: Hi, During the CCCEU conference, I’ve been in some discussions with few people on whether we should install/bundle xenserver tools (and vmware tools and/or virtio-modules). I think we can easily do this, but let’s discuss the following; - Which version of xs-tools etc. we should install? For the build system, is a publicly available source (iso etc)? - Will installing these tools cause any issue? - If we install all these tools on a single template, could that cause any issue? Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineeringhttp://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
uuid was invalid
Hi, We had some issues with one of our cluster SR, and since then, ACS goes crazy. Any ideas how to fix this? 2014-11-13 14:22:54,307 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-340:ctx-1a22d5c2) Catch Exception: class com.xensource.xenapi.Types$UuidInvalid due to The uuid you supplied was invalid. The uuid you supplied was invalid. at com.xensource.xenapi.Types.checkResponse(Types.java:1482) at com.xensource.xenapi.Connection.dispatch(Connection.java:350) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456) at com.xensource.xenapi.VDI.getByUuid(VDI.java:326) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1224) -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: uuid was invalid
This is shared storage. Deploying a new VM works fine. If I run a xe vdi-list, the number of volumes doesn't match what I see in ACS. In fact, all the VMs I have issues with are not having a VDI in any SR... Did ACS deleted my data for some reason? FG On 2014-11-13 2:43 PM, Mike Tutkowski wrote: Hey Francois, Is this for local or shared storage? When do you actually see this happen (when deploying a VM?)? If you'd like, you and I could jump on the phone or do a WebEx or something (today or tomorrow...heading to Budapest for CCC on Saturday). It's hard to say right now because there isn't much context, but perhaps we could get you up and running by modifying the DB. By the way, is this a production system or test? Talk to you later, Mike On Thu, Nov 13, 2014 at 12:24 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Hi, We had some issues with one of our cluster SR, and since then, ACS goes crazy. Any ideas how to fix this? 2014-11-13 14:22:54,307 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-340:ctx-1a22d5c2) Catch Exception: class com.xensource.xenapi.Types$UuidInvalid due to The uuid you supplied was invalid. The uuid you supplied was invalid. at com.xensource.xenapi.Types.checkResponse(Types.java:1482) at com.xensource.xenapi.Connection.dispatch(Connection.java:350) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456) at com.xensource.xenapi.VDI.getByUuid(VDI.java:326) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1224) -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 tel:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play/™/ -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: uuid was invalid
Sure. Contact me offlist. FG On 2014-11-13 3:09 PM, Mike Tutkowski wrote: Not sure off hand if ACS deleted anything, but we could take a look, if you'd like. On Thu, Nov 13, 2014 at 1:02 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: This is shared storage. Deploying a new VM works fine. If I run a xe vdi-list, the number of volumes doesn't match what I see in ACS. In fact, all the VMs I have issues with are not having a VDI in any SR... Did ACS deleted my data for some reason? FG On 2014-11-13 2:43 PM, Mike Tutkowski wrote: Hey Francois, Is this for local or shared storage? When do you actually see this happen (when deploying a VM?)? If you'd like, you and I could jump on the phone or do a WebEx or something (today or tomorrow...heading to Budapest for CCC on Saturday). It's hard to say right now because there isn't much context, but perhaps we could get you up and running by modifying the DB. By the way, is this a production system or test? Talk to you later, Mike On Thu, Nov 13, 2014 at 12:24 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Hi, We had some issues with one of our cluster SR, and since then, ACS goes crazy. Any ideas how to fix this? 2014-11-13 14:22:54,307 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-340:ctx-1a22d5c2) Catch Exception: class com.xensource.xenapi.Types$UuidInvalid due to The uuid you supplied was invalid. The uuid you supplied was invalid. at com.xensource.xenapi.Types.checkResponse(Types.java:1482) at com.xensource.xenapi.Connection.dispatch(Connection.java:350) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456) at com.xensource.xenapi.VDI.getByUuid(VDI.java:326) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1224) -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 tel:514-629-6775 tel:514-629-6775 tel:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com http://cloudops.com | tw: @CloudOps_ -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com o: 303.746.7302 tel:303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play/™/ -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 tel:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play/™/ -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Issue with Snapshot push to Swift
Hi, I am facing a weird issue where the volume snapshots are not pushed to Swift, but the system thinks it's there. Any ideas where to start troubleshooting? We are using XenServer. In the snapshot_spool_ref, I see the database entries for my snapshot, but in reality, the file is not in Swift (verified using CyberDuck): | 500 |7 | 193 | 2014-10-27 15:21:44 | NULL| NULL | Primary| 68719476736 | 0 | 0 | 20831aa6-bcc6-41c6-94e9-77e480e807c3 | Ready |2 | 0 | 2014-10-27 15:21:47 | 965 | --- | 502 |4 | 193 | 2014-10-27 15:21:47 | NULL| NULL | Image | 0 | 0 | 0 | S-965/fc30d0e5-dc26-42db-b5ca-5e7cf8ef3ef8.vhd | Ready |2 | 0 | 2014-10-27 15:25:22 | 965 | Thanks -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Issue with Snapshot push to Swift
Further details. Looks like the swift script fails on my dom0 with: Oct 27 12:00:47 cca-c7-xen01 xapi: [debug|cca-c7-xen01|11232208|Async.host.call_plugin R:59f11fa92646|dispatcher] Server_helpers.exec exception_handler: Got exception XENAPI_PLUGIN_FAILURE: [ swift; TypeError; unsubscriptable object ] What can cause this? FG On 2014-10-27 11:29 AM, Francois Gaudreault wrote: Hi, I am facing a weird issue where the volume snapshots are not pushed to Swift, but the system thinks it's there. Any ideas where to start troubleshooting? We are using XenServer. In the snapshot_spool_ref, I see the database entries for my snapshot, but in reality, the file is not in Swift (verified using CyberDuck): | 500 |7 | 193 | 2014-10-27 15:21:44 | NULL| NULL | Primary| 68719476736 | 0 | 0 | 20831aa6-bcc6-41c6-94e9-77e480e807c3 | Ready |2 | 0 | 2014-10-27 15:21:47 | 965 | --- | 502 |4 | 193 | 2014-10-27 15:21:47 | NULL| NULL | Image | 0 | 0 | 0 | S-965/fc30d0e5-dc26-42db-b5ca-5e7cf8ef3ef8.vhd | Ready |2 | 0 | 2014-10-27 15:25:22 | 965 | Thanks -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Cannot convert snapshot to templates with Swift secondary storage
,_role:ImageCache}},vmName:i-40-174-VM,name:Sysbench_ROOT-174_20141022140400,hypervisorType:XenServer,id:107,quiescevm:false,physicalSize:0}},destTO:{org.apache.cloudstack.storage.to.TemplateObjectTO:{path:template/tmpl/40/229,uuid:3a52db5c-00c5-45ec-b393-11fd5dba498c,id:229,format:RAW,accountId:40,hvm:true,displayText:test,imageDataStore:{com.cloud.agent.api.to.SwiftTO:{id:4,url:http://STRIPPED,account:xxx,userName:xxx,key:xxx}},name:11098f6bcd-4621-3373-8ade-4e832627b4f6,hypervisorType:XenServer}},executeInSequence:false,options:{},wait:10800}}]
}
2014-10-22 10:07:54,388 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-1:null) Seq 43-3461016313634228640: Processing: {
Ans: , MgmtId: 130589506760615, via: 43, Ver: v1, Flags: 10,
[{org.apache.cloudstack.storage.command.CopyCmdAnswer:{result:false,details:30#failed
to query
/mnt/SecStorage/4dbd3ea3-688f-3eda-a48f-4c3062e3029f/snapshots/40/367/7193b0c9-a61c-46f0-accd-665050b02f46.vhd,wait:0}}]
}
2014-10-22 10:07:54,388 DEBUG [c.c.a.t.Request]
(API-Job-Executor-11:ctx-61de07d0 job-8087 ctx-ed4c2151) Seq
43-3461016313634228640: Received: { Ans: , MgmtId: 130589506760615,
via: 43, Ver: v1, Flags: 10, { CopyCmdAnswer } }
2014-10-22 10:07:54,402 DEBUG [c.c.t.TemplateManagerImpl]
(API-Job-Executor-11:ctx-61de07d0 job-8087 ctx-ed4c2151) Failed to
create template30#failed to query
/mnt/SecStorage/4dbd3ea3-688f-3eda-a48f-4c3062e3029f/snapshots/40/367/7193b0c9-a61c-46f0-accd-665050b02f46.vhd
2014-10-22 10:07:54,425 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-11:ctx-61de07d0 job-8087) Unexpected exception while
executing org.apache.cloudstack.api.command.user.template.CreateTemplateCmd
com.cloud.utils.exception.CloudRuntimeException: Failed to create
template30#failed to query
/mnt/SecStorage/4dbd3ea3-688f-3eda-a48f-4c3062e3029f/snapshots/40/367/7193b0c9-a61c-46f0-accd-665050b02f46.vhd
at
com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManagerImpl.java:1402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
...
On the SSVM:
2014-10-22 14:27:59,230 DEBUG
[storage.resource.NfsSecondaryStorageResource]
(agentRequest-Handler-1:null) Executing:
/usr/local/cloud/systemvm/scripts/storage/secondary/create_privatetemplate_from_snapshot_xen.sh
-p /mnt/SecStorage/4dbd3ea3-688f-3eda-a48f-4c3062e3029f/snapshots/40/367
-s 7193b0c9-a61c-46f0-accd-665050b02f46.vhd -n
7f4a0432-ce74-47c4-8e59-1dc9d2469238.vhd -t
/mnt/SecStorage/4dbd3ea3-688f-3eda-a48f-4c3062e3029f/template/tmpl/40/235
2014-10-22 14:27:59,238 DEBUG
[storage.resource.NfsSecondaryStorageResource]
(agentRequest-Handler-1:null) Exit value is 2
2014-10-22 14:27:59,238 DEBUG
[storage.resource.NfsSecondaryStorageResource]
(agentRequest-Handler-1:null) 30#failed to query
/mnt/SecStorage/4dbd3ea3-688f-3eda-a48f-4c3062e3029f/snapshots/40/367/7193b0c9-a61c-46f0-accd-665050b02f46.vhd
Any Ideas?
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
CLOUDSTACK-7539
Looks like we are hitting that same problem, but with different symptoms on swift. We even see the template being pushed to secstor staging in a directory instead of a file. Any idea how to mitigate or workaround? We can deploy some templates, but not some others works once in 20. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ACS441] which systemvm templates to use in 4.4.1 for the Release notes?
VPN fixes for OSX is a good one :S FG On 2014-09-22, 1:20 AM, Daan Hoogland wrote: Yes, I have/know no reason to upgrade the systemvms. On Sat, Sep 20, 2014 at 5:12 PM, Pierre-Luc Dion pd...@cloudops.com wrote: I'm writing Release-notes and I'd like to know where will be systemvms for 4.4.1? last repo used was: http://cloudstack.apt-get.eu/systemvm/4.4/ so I supose we will have vm named: systemvm64template-4.4.0-hypervisor.vhd ? thanks PL -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Snapshots to template issue using Swift
We ran into another issue on 4.4.1 trying to convert a snapshot to a template. We are using swift as secondary storage. This one is quite important since users can't create templates out of a VM snapshot :S Any one would like to have a look? https://issues.apache.org/jira/browse/CLOUDSTACK-7584 -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Snapshots to template issue using Swift
We don't have a 4.3.x setup using Swift.. unfortunately. I don't know if the issue was there on 4.3 as well. If we use pure NFS, it's all good. FG On 2014-09-18, 3:13 PM, Daan Hoogland wrote: java.lang.NullPointerException at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.createTemplateFromSnapshot(AncientDataMotionStrategy.java:469) means your data store is not defined or hasn't got a role field. Did you try this same (scripted) configuration in another version? On Thu, Sep 18, 2014 at 7:31 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: We ran into another issue on 4.4.1 trying to convert a snapshot to a template. We are using swift as secondary storage. This one is quite important since users can't create templates out of a VM snapshot :S Any one would like to have a look? https://issues.apache.org/jira/browse/CLOUDSTACK-7584 -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Snapshots to template issue using Swift
Not on this specific deployment for sure... I'll check with PL Dion to see what we can do in our lab. FG On 2014-09-18, 3:39 PM, Daan Hoogland wrote: On Thu, Sep 18, 2014 at 9:24 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: We don't have a 4.3.x setup using Swift.. unfortunately. I don't know if the issue was there on 4.3 as well. If we use pure NFS, it's all good. Can you install a 4.3 version in this environment and try? -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: S3/Swift Problem around Virtual Size
That's great Punith :) Thanks for handling this one. I am not too worried about the option, as long as it fixes SF integration for 4.5 :) FG On Tue, Sep 9, 2014 at 11:55 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Thanks for the info, Punith! Does that mean you are fixing the issue via Option2? On Tue, Sep 9, 2014 at 7:52 AM, Punith S punit...@cloudbyte.com wrote: yes mike, w.r.t to option 1: it will be like creating a VM w.r.t ISO, where admin will have to specify the os disk(ROOT) disk size. for option 2: i have figured out the issue, post downloading the template to S3, cloudstack will again download the template from S3 to staging nfs store. here we need to access the file and process it with VHD processor in order to calculate the virtualsize but we are skipping this process, hence the virtual size is not being calculated while using the S3 or swift. the templates already present in the staging nfs storage cannot be applied to this process. for option 3: it's convenient to calculate the template virtual size while it is being copied from s3 to staged nfs store instead of staged nfs to primary, since admin might be using more than one primary stores. i'm fixing the issue, will post the patch ASAP for 4.5.snapshot. thanks! On Tue, Sep 9, 2014 at 11:13 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: By the way, for anyone new to this issue, this is what we're referring to here: https://issues.apache.org/jira/browse/CLOUDSTACK-7406 On Mon, Sep 8, 2014 at 11:41 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Great :) Then a question might be, Is it too late in the game to interrogate the template to discover its virtual size if we're just about to copy the template to primary storage? If it's not, this might be the place to run the logic to figure out the virtual size. Really, there are three big possibilities: 1) Just ask the end user to provide the virtual size (not commenting here on what happens for already-uploaded templates) or 2) Figure out the virtual size when the template is copied from object storage to secondary storage and update the DB with this info (not sure what happens if the template has already been copied to (secondary-storage) NFS because it was used before) or 3) Figure out the virtual size when the template is about to be copied from secondary storage to primary storage On Mon, Sep 8, 2014 at 11:35 PM, Sanjeev Neelarapu sanjeev.neelar...@citrix.com wrote: Mike, You are right. Template gets copied to (secondary-storage) NFS before being copied to primary storage -Sanjeev -Original Message- From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Tuesday, September 09, 2014 10:55 AM To: dev@cloudstack.apache.org Cc: Punith S; Francois Gaudreault Subject: Re: S3/Swift Problem around Virtual Size Hi Will, Thanks for the input! I like the idea of storing the virtual size as metadata in S3 or Swift although this could require that the end user provide this value when uploading the template. However, if we have the ability to determine the virtual size of the template after it gets downloaded to (secondary-storage) NFS and we're able to update the database with this info, then it would seem we would never need to ask the user for this value. Either way, the tricky part might be if the template in object storage has already been downloaded to (secondary-storage) NFS (say it was used before). In this case, we won't need to download it to (secondary-storage) NFS again (at least not in the same zone), so we won't have an easy opportunity to figure out the virtual size upon download from object storage. I wonder if it's too late in this process if we figured out the virtual size before the copied template (now on (secondary-storage) NFS) gets copied to primary storage. If we could do it at this point, then we wouldn't have to worry about fixing the legacy situation because it would just work out naturally. We would look in the DB to see if the virtual size for this template is known and, if not, we could figure out the virtual size before downloading from (secondary-storage) NFS to primary storage each time. (Although I'm thinking this would come too late in the process because we may have already asked the primary-storage plug-in to create the necessary volume.) By the way, I'm assuming that a template gets copied to (secondary-storage) NFS before being copied to primary storage. I'm not super familiar with how this process works. Talk to you later, Mike On Mon, Sep 8, 2014 at 10:59 PM, Will Stevens wstev...@cloudops.com wrote: My two cents on the topic. Ideally we would save the size in the object store metadata and retrieve it from the metadata if it is set. If it is not set in the object store metadata, then when it is fetched, we have to put it on NFS and determine the size (then ideally save
Re: [ACS44] 4.4.1 rc question
I wouldnt wait too long we are on this code base for a bit. We kinda need GA code :) FG On Sep 8, 2014 6:09 AM, Wido den Hollander w...@widodh.nl wrote: On 09/08/2014 12:03 PM, Daan Hoogland wrote: H, In view of our release 4.3.1, should I wait with creating a release candidate before it is out? It seems that no more work is going on and 4.4 is ready for a new release. I'd say wait for a moment. There seems to be a last minute bugfix coming from the ShapeBlue guys for 4.3.1 We should make sure that everything we fix in 4.3.1 is ALSO fixed in 4.4.1 Wido
Re: Cherry-picking fix that may change 4.3.1 schema
Do I read the ticket wrong or that fix is already in 4.4? FG On 2014-09-02, 10:48 AM, Rohit Yadav wrote: On 02-Sep-2014, at 4:38 pm, David Nalley da...@gnsa.us wrote: I agree - how will users upgrade from 4.3.1 to 4.4.x or later - schema changes aren't necessarily going to screw up the upgrade process, but certainly have a high likelihood of doing so. What happens when 4.3.0-to-4.4.0.sql runs? The table already exists - and upgrade will puke. 4.4.0 is already released; so not like you can roll that change back. Since 4.4.0 is already released, people who will install 4.3.1 won’t be able to upgrade to 4.4.0 as the 4.4.0 artifacts won’t have an upgrade path from 4.3.1 to 4.4.0; but this can be only fixed (i.e. have an upgrade path) in 4.4.1. For 4.3.1, we can still have the changes but 4.3.1 users would only be able to upgrade to 4.4.1 or later releases and not 4.4.0 because there is no path from 4.3.1 to 4.4.0 in 4.4.0 release. This is true for all ACS releases, only the latest releases know and have upgrade paths. So, what I also proposed here was to refactor the whole upgrade logic as a tool and maintain it separately and this tool can perhaps has its own release process that is faster than the ACS releases and this tool knows about all the releases and has the necessary upgrade paths. Regards, Rohit Yadav Software Architect, ShapeBlue M. +41 779015219 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Cherry-picking fix that may change 4.3.1 schema
On 2014-09-02, 11:00 AM, Rohit Yadav wrote: On 02-Sep-2014, at 4:54 pm, Francois Gaudreault fgaudrea...@cloudops.com wrote: Do I read the ticket wrong or that fix is already in 4.4? FG Yes, this already is in 4.4 but the issue is — do we want it for 4.3 branch as it affects 4.3.0 release as well and it’s a major issue for people using ACS usage. I see. Well, I think we were impacted by that too, and we made the decision to move on 4.4.1-snap (even if it's technically less stable?) and then upgrade to 4.4.1 GA (next week?) I personally don't think pulling back DB changes in lower releases is a good idea :S But that's only my opinion :) FG Regards, Rohit Yadav Software Architect, ShapeBlue M. +41 779015219 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ACS44][DISCUSS]release 4.4.1
Daan, We are working on fixing SSL offload for projects. Any chance we can slide that in 4.4.1 or should we target 4.5? Assuming we have the code working later this week... FG On 2014-09-01, 10:30 AM, Wido den Hollander wrote: On 09/01/2014 04:20 PM, Daan Hoogland wrote: SO May 1st and 1st manday in september are both due to may 4th... Nice read Stephen. Now back to 4.4.x I would like to create a new release if people feel we have something to release. How is the general population of this list thinking about that? Is there still focus on the 4.4 branch? Are all major issues from the 4.4.0 release solved? Would I say all issues? I don't know. I do know however that all issues that I encountered have been fixed in 4.4.1 Wido thanks for any (encouraging) responds, Daan On Mon, Sep 1, 2014 at 10:33 AM, Stephen Turner stephen.tur...@citrix.com wrote: Interestingly, the reason Labour Day is on May 1 in the rest of the world is the same reason it's not in May in the US and Canada, to do with communists and anarchists commemorating a riot in Chicago. See http://en.wikipedia.org/wiki/Labor_Day http://en.wikipedia.org/wiki/Haymarket_affair -- Stephen Turner -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: 01 September 2014 09:05 To: dev; Mike Tutkowski Cc: Francois Gaudreault Subject: Re: [ACS44][DISCUSS]release 4.4.1 Hey Mike, You guys are not supposed to add random red holidays to your calendars. You're the commy bashers. May 1st not enough for ya'll? On Mon, Sep 1, 2014 at 12:00 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Just an FYI that it's Labor Day Weekend in the U.S., so you might not get many, if any, replies until Tuesday. On Sat, Aug 30, 2014 at 2:06 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: On 2014-08-30, 4:01 PM, Daan Hoogland wrote: H, How is the felling on list about 4.4.1? Do we have a stable enough branch 4.4 at this moment? Especially the answer on this of KVM saffy people is appreciated. I am running on 4.4.1 since a week now. I did hit couple small bugs, but no real blocker. We also try to fix the SSL offload code to work with projects. We would really really like to get this feature in 4.4.1. FG -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_ -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™* -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ACS4.4.1] Cherry-Pick fix for CLOUDSTACK-7124
Thanks!! FG On Aug 31, 2014 6:02 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: Ah, I didn't merge that one before because the HEAD seems to contain no logic. I now saw two commits in the branch and merged it. sorry, On Sat, Aug 30, 2014 at 10:04 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Since I have you... Can you also merge hotfix/4.4-7343? This is a swift secondary storage bug we fixed. I tested it on a 4.4.1 with Swift and it's all ok. Otherwise, if the directory path was already on the NFS store, the templates wouldn't be copied, and the VM wouldn't start. We basically copied the fix from the S3 code. FG On 2014-08-30, 3:58 PM, Daan Hoogland wrote: looks ok/is in On Sat, Aug 30, 2014 at 9:53 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Daan!!! Welcome back :) This is commit abc0b40acb5d1b5b87362b4737605249525455dc from master. It impacts the site-to-site vpn creation. BTW we ran 4.4.1-snapshot for a week now, and we identified bunch of small bugs. I'll try to list them so we can include their fix in 4.4.1. FG On 2014-08-30, 5:25 AM, Daan Hoogland wrote: What commit is it, Francois? On Fri, Aug 29, 2014 at 6:47 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Hi, Any chance we could cherry-pick the commit from master to fix CLOUDSTACK-7124 on 4.4.1? We are also impacted. Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com http://cloudops.com | tw: @CloudOps_ -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_ -- Daan
Re: [ACS4.4.1] Cherry-pick for CLOUDSTACK-7087
Thx! On Aug 31, 2014 1:59 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: On Sat, Aug 30, 2014 at 10:14 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: 2dfd278625a5d569a5cce2fec5ccb0d7c515c9e8 picked to 4.4 -- Daan
Re: [ACS4.4.1] Cherry-Pick fix for CLOUDSTACK-7124
Daan!!! Welcome back :) This is commit abc0b40acb5d1b5b87362b4737605249525455dc from master. It impacts the site-to-site vpn creation. BTW we ran 4.4.1-snapshot for a week now, and we identified bunch of small bugs. I'll try to list them so we can include their fix in 4.4.1. FG On 2014-08-30, 5:25 AM, Daan Hoogland wrote: What commit is it, Francois? On Fri, Aug 29, 2014 at 6:47 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Hi, Any chance we could cherry-pick the commit from master to fix CLOUDSTACK-7124 on 4.4.1? We are also impacted. Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ACS4.4.1] Cherry-Pick fix for CLOUDSTACK-7124
Since I have you... Can you also merge hotfix/4.4-7343? This is a swift secondary storage bug we fixed. I tested it on a 4.4.1 with Swift and it's all ok. Otherwise, if the directory path was already on the NFS store, the templates wouldn't be copied, and the VM wouldn't start. We basically copied the fix from the S3 code. FG On 2014-08-30, 3:58 PM, Daan Hoogland wrote: looks ok/is in On Sat, Aug 30, 2014 at 9:53 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Daan!!! Welcome back :) This is commit abc0b40acb5d1b5b87362b4737605249525455dc from master. It impacts the site-to-site vpn creation. BTW we ran 4.4.1-snapshot for a week now, and we identified bunch of small bugs. I'll try to list them so we can include their fix in 4.4.1. FG On 2014-08-30, 5:25 AM, Daan Hoogland wrote: What commit is it, Francois? On Fri, Aug 29, 2014 at 6:47 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Hi, Any chance we could cherry-pick the commit from master to fix CLOUDSTACK-7124 on 4.4.1? We are also impacted. Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com http://cloudops.com | tw: @CloudOps_ -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com http://cloudops.com | tw: @CloudOps_ -- Daan -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ACS44][DISCUSS]release 4.4.1
On 2014-08-30, 4:01 PM, Daan Hoogland wrote: H, How is the felling on list about 4.4.1? Do we have a stable enough branch 4.4 at this moment? Especially the answer on this of KVM saffy people is appreciated. I am running on 4.4.1 since a week now. I did hit couple small bugs, but no real blocker. We also try to fix the SSL offload code to work with projects. We would really really like to get this feature in 4.4.1. FG -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
[ACS4.4.1] Cherry-pick for CLOUDSTACK-7087
This is another issue that should be fixed in 4.4.1. I think it's in 4.3.1, and master, but not 4.4.1. I am running master systemvms in my setup to avoid that issue, but I am not sure it's a good idea :P Master commit is 2dfd278625a5d569a5cce2fec5ccb0d7c515c9e8 https://issues.apache.org/jira/browse/CLOUDSTACK-7087 Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
[ACS4.4.1] Cherry-Pick fix for CLOUDSTACK-7124
Hi, Any chance we could cherry-pick the commit from master to fix CLOUDSTACK-7124 on 4.4.1? We are also impacted. Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Usage issue in 4.4.1
I am seeing some weird behavior with the usage daemon on 4.4.1. See below. Any ideas? pid: 15033 job_type: 1 scheduled: 1 start_millis: 140924160 end_millis: 140924159 exec_time: 2 start_date: 2014-08-28 16:00:00 end_date: 2014-08-28 15:59:59 success: 0 heartbeat: 2014-08-28 16:15:00 Some errors: 2014-08-28 16:00:42,234 DEBUG [db.Transaction.Transaction] (Usage-Job-1:null) Transaction is not closed properly: -UsageEventDaoImpl.getRecentEvents:102-ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept:122-UsageManagerImpl.parse:587-UsageManagerImpl.runInContextInternal:378-UsageManagerImpl$1.runInContext:320-ManagedContextRunnable$1.run:49-DefaultManagedContext$1.call:56-DefaultManagedContext.callWithContext:103-DefaultManagedContext.runWithContext:53-ManagedContextRunnable.run:46-UsageManagerImpl.run:317-Executors$RunnableAdapter.call:471 : -UsageEventDaoImpl.getRecentEvents:102-ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept:122-UsageManagerImpl.parse:587-UsageManagerImpl.runInContextInternal:378-UsageManagerImpl$1.runInContext:320-ManagedContextRunnable$1.run:49-DefaultManagedContext$1.call:56-DefaultManagedContext.callWithContext:103-DefaultManagedContext.runWithContext:53-ManagedContextRunnable.run:46-UsageManagerImpl.run:317-Executors$RunnableAdapter.call:471, . Called by -TransactionLegacy.open:164-TransactionLegacy.open:124-UsageManagerImpl.parse:820-UsageManagerImpl.runInContextInternal:378-UsageManagerImpl$1.runInContext:320-ManagedContextRunnable$1.run:49-DefaultManagedContext$1.call:56-DefaultManagedContext.callWithContext:103-DefaultManagedContext.runWithContext:53-ManagedContextRunnable.run:46-UsageManagerImpl.run:317-Executors$RunnableAdapter.call:471 2014-08-28 16:00:42,236 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) usage job complete 2014-08-28 16:15:41,637 DEBUG [cloud.usage.UsageManagerImpl] (Usage-HB-1:null) Scheduling Usage job... 2014-08-28 16:15:41,637 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) starting usage job... 2014-08-28 16:15:41,642 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) not parsing usage records since start time mills (140924160) is on or after end time millis (140924159) 2014-08-28 16:15:41,650 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) usage job complete -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: S3/Swift Problem around Virtual Size
Punith, We are using Swift. We have a tmpauth proxy. FG On Aug 26, 2014 2:48 AM, Punith S punit...@cloudbyte.com wrote: sure mike, since i don't have a S3 account, i'm getting one today. francois, can you brief me how you seeded your templates into S3. thanks! On Mon, Aug 25, 2014 at 11:16 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Yes, I expect we'll see the same issue with S3, as well. Punith - Is this something you might have time to investigate? Perhaps Edison can point us in the right direction here. On Mon, Aug 25, 2014 at 5:17 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Punith, I highly anticipate the same issue with S3... it shares a lot of code with swift. My focus would be swift, but we should fix for both :) FG On Aug 25, 2014 6:33 AM, Punith S punit...@cloudbyte.com wrote: thanks for opening this thread mike, since i only use nfs as my secondary storage provider, i didn't see this issue till date. is this issue occurring even using a S3 secondary storage with staging nfs store ? if so like edison pointed we need to fetch the virtual size from the nfs store instead of S3 in the deploymentmanager. thanks On Sat, Aug 23, 2014 at 3:45 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hey Edison, Do you know how difficult/easy of a fix this is, who might be available to put this fix in, and for what release (hopefully 4.4.1) this fix could find its way in? Thanks! Mike On Fri, Aug 22, 2014 at 3:37 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Min, Ok, but this is not the behavior I see. Even without requesting a VM create, the template is pushed to the staging NFS at least once. Is it downloaded there or pushed after download, that I am not sure. I was assuming the swift upload bash script was executed after the template is on the staging. Anyway... the focus is on the virt size, and you all know the code better than I do :) FG On Aug 22, 2014 5:28 PM, Min Chen min.c...@citrix.com wrote: No. For S3/Swift, register template will directly upload templates to S3 without going through staging NFS. It will only be copied to staging NFS when we first use that template to provision a VM. Thanks -min On 8/22/14 2:25 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Edison, Isnt the templates downloaded to the Staging NFS first? FG On Aug 22, 2014 5:20 PM, Edison Su edison...@citrix.com wrote: I know the reason why the size of template doesn¹t have correct virtual size if it¹s registered in S3/Swift: In case of s3/swift, the template is directly stored into s3/swift through swift/s3 api, there is no place for cloudstack to look into template, to find out the virtual size during template registration. While, if secondary storage is NFS, the template is first stored on NFS(which has file system), cloudstack can unzip the template(if it¹s a zipped file), and read virtual size from the file, then report back to mgt server. In order to fix it, we can add some code as: all the templates registered on Swift/S3, need to be downloaded to a NFS intermediate storage before it can be consumed by primary storage. After the download finished, then we check virtual size of template, and report back to mgt server/update DB etc. From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Friday, August 22, 2014 1:38 PM To: dev@cloudstack.apache.org Cc: Edison Su Subject: S3/Swift Problem around Virtual Size Hi, This was brought up in a different e-mail thread, but I wanted to make it more clear that it's related to CloudStack's download code around S3/Swift, so I'm opening up a new thread. Francois (from CloudOps) noticed today that when he downloaded a template (VHD format) to Swift (but it looks like the same applies for S3) that the physical and virtual sizes are set to be the same. This appears to have the following consequence: You can download a template with a physical size of, say, 3 GB and a root disk that's supposed to be, say, 20 GB. Instead of the virtual size showing as 20 GB, it shows as 3 GB. This is not an issue with NFS. In that situation, the two sizes are correctly accounted for. What later can happen is the template is downloaded from Swift and takes up an unexpected amount of space on the XenServer storage repository (SR
Re: S3/Swift Problem around Virtual Size
I mean we are populating the template just like we would do with normal NFS using the UI. ACS takes care of pushing to swift. FG On Aug 26, 2014 6:02 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Punith, We are using Swift. We have a tmpauth proxy. FG On Aug 26, 2014 2:48 AM, Punith S punit...@cloudbyte.com wrote: sure mike, since i don't have a S3 account, i'm getting one today. francois, can you brief me how you seeded your templates into S3. thanks! On Mon, Aug 25, 2014 at 11:16 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Yes, I expect we'll see the same issue with S3, as well. Punith - Is this something you might have time to investigate? Perhaps Edison can point us in the right direction here. On Mon, Aug 25, 2014 at 5:17 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Punith, I highly anticipate the same issue with S3... it shares a lot of code with swift. My focus would be swift, but we should fix for both :) FG On Aug 25, 2014 6:33 AM, Punith S punit...@cloudbyte.com wrote: thanks for opening this thread mike, since i only use nfs as my secondary storage provider, i didn't see this issue till date. is this issue occurring even using a S3 secondary storage with staging nfs store ? if so like edison pointed we need to fetch the virtual size from the nfs store instead of S3 in the deploymentmanager. thanks On Sat, Aug 23, 2014 at 3:45 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hey Edison, Do you know how difficult/easy of a fix this is, who might be available to put this fix in, and for what release (hopefully 4.4.1) this fix could find its way in? Thanks! Mike On Fri, Aug 22, 2014 at 3:37 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Min, Ok, but this is not the behavior I see. Even without requesting a VM create, the template is pushed to the staging NFS at least once. Is it downloaded there or pushed after download, that I am not sure. I was assuming the swift upload bash script was executed after the template is on the staging. Anyway... the focus is on the virt size, and you all know the code better than I do :) FG On Aug 22, 2014 5:28 PM, Min Chen min.c...@citrix.com wrote: No. For S3/Swift, register template will directly upload templates to S3 without going through staging NFS. It will only be copied to staging NFS when we first use that template to provision a VM. Thanks -min On 8/22/14 2:25 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Edison, Isnt the templates downloaded to the Staging NFS first? FG On Aug 22, 2014 5:20 PM, Edison Su edison...@citrix.com wrote: I know the reason why the size of template doesn¹t have correct virtual size if it¹s registered in S3/Swift: In case of s3/swift, the template is directly stored into s3/swift through swift/s3 api, there is no place for cloudstack to look into template, to find out the virtual size during template registration. While, if secondary storage is NFS, the template is first stored on NFS(which has file system), cloudstack can unzip the template(if it¹s a zipped file), and read virtual size from the file, then report back to mgt server. In order to fix it, we can add some code as: all the templates registered on Swift/S3, need to be downloaded to a NFS intermediate storage before it can be consumed by primary storage. After the download finished, then we check virtual size of template, and report back to mgt server/update DB etc. From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Friday, August 22, 2014 1:38 PM To: dev@cloudstack.apache.org Cc: Edison Su Subject: S3/Swift Problem around Virtual Size Hi, This was brought up in a different e-mail thread, but I wanted to make it more clear that it's related to CloudStack's download code around S3/Swift, so I'm opening up a new thread. Francois (from CloudOps) noticed today that when he downloaded a template (VHD format) to Swift (but it looks like the same applies for S3) that the physical and virtual sizes are set to be the same. This appears to have the following consequence: You can download a template with a physical size of, say, 3 GB and a root disk that's supposed to be, say, 20 GB. Instead of the virtual size showing as 20 GB, it shows as 3 GB. This is not an issue with NFS. In that situation, the two sizes
Re: S3/Swift Problem around Virtual Size
Punith, We ran into the same problem. The only way we found to get around that, is to start from a standard NFS, get the SSVMs up, and then move to Swift. If you find a way to avoid such manipulation, let me know! FG On 2014-08-26, 9:58 AM, Punith S wrote: hi, i'm trying to deploy a zone with S3 alongside an empty staging nfs store as the secondary storage, does anyone have idea about how to seed the s3 secondary storage with ssvm templates to bring up the secondary storage VM ? like in nfs we seed nfs sec store by running this script /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt\ -m /mnt/secondary\ -uhttp://cloudstack.apt-get.eu/systemvm/4.4/systemvm64template-4.4.0-6-xen.vhd.bz2 \ -h xenserver\ -s optional-management-server-secret-key\ -F should i seed the staging nfs with the above script ? thanks On Tue, Aug 26, 2014 at 4:00 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: I mean we are populating the template just like we would do with normal NFS using the UI. ACS takes care of pushing to swift. FG On Aug 26, 2014 6:02 AM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Punith, We are using Swift. We have a tmpauth proxy. FG On Aug 26, 2014 2:48 AM, Punith S punit...@cloudbyte.com mailto:punit...@cloudbyte.com wrote: sure mike, since i don't have a S3 account, i'm getting one today. francois, can you brief me how you seeded your templates into S3. thanks! On Mon, Aug 25, 2014 at 11:16 PM, Mike Tutkowski mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com wrote: Yes, I expect we'll see the same issue with S3, as well. Punith - Is this something you might have time to investigate? Perhaps Edison can point us in the right direction here. On Mon, Aug 25, 2014 at 5:17 AM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Punith, I highly anticipate the same issue with S3... it shares a lot of code with swift. My focus would be swift, but we should fix for both :) FG On Aug 25, 2014 6:33 AM, Punith S punit...@cloudbyte.com mailto:punit...@cloudbyte.com wrote: thanks for opening this thread mike, since i only use nfs as my secondary storage provider, i didn't see this issue till date. is this issue occurring even using a S3 secondary storage with staging nfs store ? if so like edison pointed we need to fetch the virtual size from the nfs store instead of S3 in the deploymentmanager. thanks On Sat, Aug 23, 2014 at 3:45 AM, Mike Tutkowski mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com wrote: Hey Edison, Do you know how difficult/easy of a fix this is, who might be available to put this fix in, and for what release (hopefully 4.4.1) this fix could find its way in? Thanks! Mike On Fri, Aug 22, 2014 at 3:37 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Min, Ok, but this is not the behavior I see. Even without requesting a VM create, the template is pushed to the staging NFS at least once. Is it downloaded there or pushed after download, that I am not sure. I was assuming the swift upload bash script was executed after the template is on the staging. Anyway... the focus is on the virt size, and you all know the code better than I do :) FG On Aug 22
VMs stuck in expunging
Hi, We have couple VMs stuck in Expunging state in our setup, and I am not sure why. This is a 4.3.1-snapshot. This is what the log says: 2014-08-25 23:30:31,789 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Stopped called on VM[User|ketchup-web] but the state is Expunging 2014-08-25 23:30:31,808 WARN [c.c.u.n.Link] (AgentManager-Selector:null) SSL: Fail to find the generated keystore. Loading fail-safe one to continue. 2014-08-25 23:30:31,810 DEBUG [c.c.c.CapacityManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) VM state transitted from :Expunging to Expunging with event: ExpungeOperationvm's original host id: 1 new host id: null host id before state transition: null 2014-08-25 23:30:31,811 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Destroying vm VM[User|ketchup-web] 2014-08-25 23:30:31,811 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning up NICS 2014-08-25 23:30:31,811 DEBUG [o.a.c.e.o.NetworkOrchestrator] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning network for vm: 61 2014-08-25 23:30:31,814 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage 2014-08-25 23:30:31,821 DEBUG [o.a.c.e.o.VolumeOrchestrator] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning storage for vm: 61 2014-08-25 23:30:31,825 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Expunged VM[User|ketchup-web] 2014-08-25 23:30:31,825 DEBUG [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Starting cleaning up vm VM[User|ketchup-web] resources... 2014-08-25 23:30:31,856 DEBUG [c.c.n.f.FirewallManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) No firewall rules are found for vm id=61 2014-08-25 23:30:31,872 DEBUG [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Firewall rules are removed successfully as a part of vm id=61 expunge 2014-08-25 23:30:31,884 DEBUG [c.c.u.d.T.Transaction] (UserVm-Scavenger-1:ctx-bfdf6aa3) Rolling back the transaction: Time = 5 Name = UserVm-Scavenger-1; called by -TransactionLegacy.rollback:896-TransactionLegacy.removeUpTo:839-TransactionLegacy.close:663-Transaction.execute:41-Transaction.execute:46-FirewallManagerImpl.revokeRule:732-GeneratedMethodAccessor278.invoke:-1-DelegatingMethodAccessorImpl.invoke:43-Method.invoke:606-AopUtils.invokeJoinpointUsingReflection:317-ReflectiveMethodInvocation.invokeJoinpoint:183-ReflectiveMethodInvocation.proceed:150 2014-08-25 23:30:31,887 WARN [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Unable to expunge VM[User|ketchup-web] Any idea what's going on? Bug? -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Getting the system template when using Swift as Secondary Storage
So I looked it more, and apparently my template is being downloaded, pushed to Swift, but then nothing happens. The template is never switched to Ready in the DB, so SSVMs are never launched. Any ideas what would cause that? FG On 2014-08-25, 10:21 AM, Francois Gaudreault wrote: Hi, So far, the only way I found to get SSVM running if using Swift as SecStorage is to initially configure the secondary storage as standard NFS, get the SSVMs to start, and then switch back to Swift + NFS Staging. I have a feeling that this is not the expected behavior. Should we be able to start the zone without having to switch from standard NFS to Swift once the SSVMs are up? Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: VMs stuck in expunging
Oh man, we have four in this state, and you don't want to see the other names lol I'll pump the log to trace and see what's going on. Thanks! FG On 2014-08-26, 2:41 PM, ilya musayev wrote: Its apparent that expunge failed, because VM name ketchup-web was to good to be deleted :) Try increasing the verbosity level on log4j so we can get a better picture. On 8/26/14, 7:29 AM, Francois Gaudreault wrote: Hi, We have couple VMs stuck in Expunging state in our setup, and I am not sure why. This is a 4.3.1-snapshot. This is what the log says: 2014-08-25 23:30:31,789 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Stopped called on VM[User|ketchup-web] but the state is Expunging 2014-08-25 23:30:31,808 WARN [c.c.u.n.Link] (AgentManager-Selector:null) SSL: Fail to find the generated keystore. Loading fail-safe one to continue. 2014-08-25 23:30:31,810 DEBUG [c.c.c.CapacityManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) VM state transitted from :Expunging to Expunging with event: ExpungeOperationvm's original host id: 1 new host id: null host id before state transition: null 2014-08-25 23:30:31,811 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Destroying vm VM[User|ketchup-web] 2014-08-25 23:30:31,811 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning up NICS 2014-08-25 23:30:31,811 DEBUG [o.a.c.e.o.NetworkOrchestrator] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning network for vm: 61 2014-08-25 23:30:31,814 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage 2014-08-25 23:30:31,821 DEBUG [o.a.c.e.o.VolumeOrchestrator] (UserVm-Scavenger-1:ctx-bfdf6aa3) Cleaning storage for vm: 61 2014-08-25 23:30:31,825 DEBUG [c.c.v.VirtualMachineManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Expunged VM[User|ketchup-web] 2014-08-25 23:30:31,825 DEBUG [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Starting cleaning up vm VM[User|ketchup-web] resources... 2014-08-25 23:30:31,856 DEBUG [c.c.n.f.FirewallManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) No firewall rules are found for vm id=61 2014-08-25 23:30:31,872 DEBUG [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Firewall rules are removed successfully as a part of vm id=61 expunge 2014-08-25 23:30:31,884 DEBUG [c.c.u.d.T.Transaction] (UserVm-Scavenger-1:ctx-bfdf6aa3) Rolling back the transaction: Time = 5 Name = UserVm-Scavenger-1; called by -TransactionLegacy.rollback:896-TransactionLegacy.removeUpTo:839-TransactionLegacy.close:663-Transaction.execute:41-Transaction.execute:46-FirewallManagerImpl.revokeRule:732-GeneratedMethodAccessor278.invoke:-1-DelegatingMethodAccessorImpl.invoke:43-Method.invoke:606-AopUtils.invokeJoinpointUsingReflection:317-ReflectiveMethodInvocation.invokeJoinpoint:183-ReflectiveMethodInvocation.proceed:150 2014-08-25 23:30:31,887 WARN [c.c.v.UserVmManagerImpl] (UserVm-Scavenger-1:ctx-bfdf6aa3) Unable to expunge VM[User|ketchup-web] Any idea what's going on? Bug? -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: Getting the system template when using Swift as Secondary Storage
I opened a bug. If anybody wants to look at it. Ill upload the management log snippet on the morning: https://issues.apache.org/jira/browse/CLOUDSTACK-7443 If the file structure is present, the routing-1 template is not pulled back from swift, and the SSVM creation fails. However, if I strip one directory level to make it template/1 instead of template/1/1, it's all working. FG On 2014-08-26, 1:59 PM, Francois Gaudreault wrote: So I looked it more, and apparently my template is being downloaded, pushed to Swift, but then nothing happens. The template is never switched to Ready in the DB, so SSVMs are never launched. Any ideas what would cause that? FG On 2014-08-25, 10:21 AM, Francois Gaudreault wrote: Hi, So far, the only way I found to get SSVM running if using Swift as SecStorage is to initially configure the secondary storage as standard NFS, get the SSVMs to start, and then switch back to Swift + NFS Staging. I have a feeling that this is not the expected behavior. Should we be able to start the zone without having to switch from standard NFS to Swift once the SSVMs are up? Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: S3/Swift Problem around Virtual Size
Looks like your SSVM cannot reach Internet properly?
FG
On 2014-08-26, 11:14 AM, Punith S wrote:
hi francois,
since i'm not having a swift setup, i'm using the s3 bucket.
and as you recommended i got the SSVM up with seeded nfs storage,
post that i removed the nfs secondary storage and added the S3 with
staging nfs store as the new sec storage, since you cannot have any
nfs secondary storage while using the S3.
on registering the a new template, i'm getting template status
as*Unable to execute HTTP request: No route to host*
in managementserver.log
2014-08-26 20:41:07,502 DEBUG [o.a.c.s.RemoteHostEndPoint]
(Timer-24:ctx-b68380cd) Sending command
org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 10
2014-08-26 20:41:07,507 DEBUG [c.c.a.t.Request]
(Timer-24:ctx-b68380cd) Seq 10-5684105679694996125: Sending { Cmd ,
MgmtId: 52242179434, via: 10(s-142-VM), Ver: v1, Flags: 100011,
[{org.apache.cloudstack.storage.command.DownloadProgressCommand:{jobId:d43a17c9-3b03-4ff9-8906-e1d155981e86,request:GET_STATUS,hvm:true,description:centext,maxDownloadSizeInBytes:53687091200,id:209,resourceType:TEMPLATE,installPath:template/tmpl/2/209/209-2-b624436c-5f37-30d4-8eaf-81582eb0d39d,_store:{com.cloud.agent.api.to.S3TO:{id:14,uuid:e4afd7bb-39ea-4128-ab93-f8a09b1d5e03,bucketName:test-cloudstack,httpsFlag:false,created:Aug
26, 2014 8:16:24
PM,enableRRS:false,maxSingleUploadSizeInBytes:5368709120}},url:http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2,format:VHD,accountId:2,name:209-2-b624436c-5f37-30d4-8eaf-81582eb0d39d,wait:0}}]
}
2014-08-26 20:41:07,556 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-10:null) Seq 10-5684105679694996125: Processing:
{ Ans: , MgmtId: 52242179434, via: 10, Ver: v1, Flags: 10,
[{com.cloud.agent.api.storage.DownloadAnswer:{jobId:d43a17c9-3b03-4ff9-8906-e1d155981e86,downloadPct:0,errorString:No
route to
host,downloadStatus:DOWNLOAD_ERROR,installPath:template/tmpl/2/209/209-2-b624436c-5f37-30d4-8eaf-81582eb0d39d,templateSize:0,templatePhySicalSize:0,result:true,details:No
route to host,wait:0}}] }
but i don't see any logging happening in secondary storage vm's cloud.log
not sure this error is happening due to S3!
thanks!
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: S3/Swift Problem around Virtual Size
Punith, I highly anticipate the same issue with S3... it shares a lot of code with swift. My focus would be swift, but we should fix for both :) FG On Aug 25, 2014 6:33 AM, Punith S punit...@cloudbyte.com wrote: thanks for opening this thread mike, since i only use nfs as my secondary storage provider, i didn't see this issue till date. is this issue occurring even using a S3 secondary storage with staging nfs store ? if so like edison pointed we need to fetch the virtual size from the nfs store instead of S3 in the deploymentmanager. thanks On Sat, Aug 23, 2014 at 3:45 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hey Edison, Do you know how difficult/easy of a fix this is, who might be available to put this fix in, and for what release (hopefully 4.4.1) this fix could find its way in? Thanks! Mike On Fri, Aug 22, 2014 at 3:37 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Min, Ok, but this is not the behavior I see. Even without requesting a VM create, the template is pushed to the staging NFS at least once. Is it downloaded there or pushed after download, that I am not sure. I was assuming the swift upload bash script was executed after the template is on the staging. Anyway... the focus is on the virt size, and you all know the code better than I do :) FG On Aug 22, 2014 5:28 PM, Min Chen min.c...@citrix.com wrote: No. For S3/Swift, register template will directly upload templates to S3 without going through staging NFS. It will only be copied to staging NFS when we first use that template to provision a VM. Thanks -min On 8/22/14 2:25 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Edison, Isnt the templates downloaded to the Staging NFS first? FG On Aug 22, 2014 5:20 PM, Edison Su edison...@citrix.com wrote: I know the reason why the size of template doesn¹t have correct virtual size if it¹s registered in S3/Swift: In case of s3/swift, the template is directly stored into s3/swift through swift/s3 api, there is no place for cloudstack to look into template, to find out the virtual size during template registration. While, if secondary storage is NFS, the template is first stored on NFS(which has file system), cloudstack can unzip the template(if it¹s a zipped file), and read virtual size from the file, then report back to mgt server. In order to fix it, we can add some code as: all the templates registered on Swift/S3, need to be downloaded to a NFS intermediate storage before it can be consumed by primary storage. After the download finished, then we check virtual size of template, and report back to mgt server/update DB etc. From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Friday, August 22, 2014 1:38 PM To: dev@cloudstack.apache.org Cc: Edison Su Subject: S3/Swift Problem around Virtual Size Hi, This was brought up in a different e-mail thread, but I wanted to make it more clear that it's related to CloudStack's download code around S3/Swift, so I'm opening up a new thread. Francois (from CloudOps) noticed today that when he downloaded a template (VHD format) to Swift (but it looks like the same applies for S3) that the physical and virtual sizes are set to be the same. This appears to have the following consequence: You can download a template with a physical size of, say, 3 GB and a root disk that's supposed to be, say, 20 GB. Instead of the virtual size showing as 20 GB, it shows as 3 GB. This is not an issue with NFS. In that situation, the two sizes are correctly accounted for. What later can happen is the template is downloaded from Swift and takes up an unexpected amount of space on the XenServer storage repository (SR). If there is enough space on the SR, this isn't too big of a deal. However, for so-called managed storage plug-ins (examples are SolidFire and CloudByte), this will lead to them dynamically creating a SAN volume of the wrong size. Francois opened up the following ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-7406 Thanks! -- Mike Tutkowski Senior CloudStack Developer, SolidFire Inc. e: mike.tutkow...@solidfire.commailto: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™* -- regards, punith s cloudbyte.com
[ACS441] Hotfix for 7343
Daan, PLD made a fix for 4.4.1 in the hotfix/4.4-7343 branch. Can you merge into 4.4? Not sure if he also made the patch for master. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ACS441] Hotfix for 7343
Anybody backing Daan for 4.4 RM? We have tested the fix, and so far no issues. This is mainly the same fix as S3. FG On 2014-08-25, 9:56 AM, Francois Gaudreault wrote: Daan, PLD made a fix for 4.4.1 in the hotfix/4.4-7343 branch. Can you merge into 4.4? Not sure if he also made the patch for master. -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
SolidFire Plugin - Weird Behavior
Hi Mike,
I tryed the SolidFire plugin on 4.4.1, and I don't think the behavior is
right for the ROOT volume. Tried on XenServer 6.2.
First, I am using a template with technically a 20GB space, but the
storage plugin will create the volume only according to the size of the
vhd (which is 3GB). This is wrong :)
Second, the creation fails with a XenServer error saying there is not
enough space to copy the VDI:
2014-08-22 11:25:44,417 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-249:ctx-81a37f3b) Task failed! Task record:
uuid: b7cf8b1d-d9d9-c2c0-aba0-7368c181a2cb
nameLabel: Async.VDI.copy
nameDescription:
allowedOperations: []
currentOperations: {}
created: Fri Aug 22 11:25:43 EDT 2014
finished: Fri Aug 22 11:25:43 EDT 2014
status: failure
residentOn: com.xensource.xenapi.Host@a7913c69
progress: 1.0
type: none/
result:
errorInfo: [SR_BACKEND_FAILURE_44, , There is insufficient
space]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
Should we also have a SR to handle template copy?
Thanks!
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: SolidFire Plugin - Weird Behavior
I would also add that the ROOT volume created stayed on the SF cluster,
even if the VM creation failed. That's also a problem, although I
believe the storage garbage collector would delete it?
FG
On 2014-08-22, 11:39 AM, Francois Gaudreault wrote:
Hi Mike,
I tryed the SolidFire plugin on 4.4.1, and I don't think the behavior
is right for the ROOT volume. Tried on XenServer 6.2.
First, I am using a template with technically a 20GB space, but the
storage plugin will create the volume only according to the size of
the vhd (which is 3GB). This is wrong :)
Second, the creation fails with a XenServer error saying there is not
enough space to copy the VDI:
2014-08-22 11:25:44,417 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-249:ctx-81a37f3b) Task failed! Task
record: uuid: b7cf8b1d-d9d9-c2c0-aba0-7368c181a2cb
nameLabel: Async.VDI.copy
nameDescription:
allowedOperations: []
currentOperations: {}
created: Fri Aug 22 11:25:43 EDT 2014
finished: Fri Aug 22 11:25:43 EDT 2014
status: failure
residentOn: com.xensource.xenapi.Host@a7913c69
progress: 1.0
type: none/
result:
errorInfo: [SR_BACKEND_FAILURE_44, , There is insufficient
space]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
Should we also have a SR to handle template copy?
Thanks!
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: SolidFire Plugin - Weird Behavior
Mark and I worked on that off-list, and it looks like it's a Swift
provider issue. See, in ACS, when you use NFS, the reported template
size is the ROOT volume size. While using swift, it's the VHD file size,
which is not the ROOT volume size.
SolidFire will rely on this metric to create the LUN for this VM.
So, any idea why the Swift provider is NOT getting us the right
information? :)
FG
On 2014-08-22, 11:47 AM, Mike Tutkowski wrote:
Hi Francois,
Interesting...all of my tests on XS 6.1 and 6.2 check out just fine
(but that is with CS 4.4).
I'll contact you off list and we can work this out.
Thanks,
Mike
On Fri, Aug 22, 2014 at 9:44 AM, Francois Gaudreault
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote:
I would also add that the ROOT volume created stayed on the SF
cluster, even if the VM creation failed. That's also a problem,
although I believe the storage garbage collector would delete it?
FG
On 2014-08-22, 11:39 AM, Francois Gaudreault wrote:
Hi Mike,
I tryed the SolidFire plugin on 4.4.1, and I don't think the
behavior is right for the ROOT volume. Tried on XenServer 6.2.
First, I am using a template with technically a 20GB space,
but the storage plugin will create the volume only according
to the size of the vhd (which is 3GB). This is wrong :)
Second, the creation fails with a XenServer error saying there
is not enough space to copy the VDI:
2014-08-22 11:25:44,417 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-249:ctx-81a37f3b) Task failed! Task record:
uuid: b7cf8b1d-d9d9-c2c0-aba0-7368c181a2cb
nameLabel: Async.VDI.copy
nameDescription:
allowedOperations: []
currentOperations: {}
created: Fri Aug 22 11:25:43 EDT 2014
finished: Fri Aug 22 11:25:43 EDT 2014
status: failure
residentOn: com.xensource.xenapi.Host@a7913c69
progress: 1.0
type: none/
result:
errorInfo: [SR_BACKEND_FAILURE_44, , There is
insufficient space]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
Should we also have a SR to handle template copy?
Thanks!
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775 tel:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com http://cloudops.com | tw: @CloudOps_
--
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
http://solidfire.com/solution/overview/?video=play/™/
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
Re: SolidFire Plugin - Weird Behavior
Ok. I digged a little more, and now I know why it fails, but don't know
how to fix this :) I opened a defect:
https://issues.apache.org/jira/browse/CLOUDSTACK-7406
To me this is a fairly important one since is does have impacts on other
features (e.g SF storage plugin, and maybe usage reporting).
FG
On 2014-08-22, 12:27 PM, Francois Gaudreault wrote:
Mark and I worked on that off-list, and it looks like it's a Swift
provider issue. See, in ACS, when you use NFS, the reported template
size is the ROOT volume size. While using swift, it's the VHD file
size, which is not the ROOT volume size.
SolidFire will rely on this metric to create the LUN for this VM.
So, any idea why the Swift provider is NOT getting us the right
information? :)
FG
On 2014-08-22, 11:47 AM, Mike Tutkowski wrote:
Hi Francois,
Interesting...all of my tests on XS 6.1 and 6.2 check out just fine
(but that is with CS 4.4).
I'll contact you off list and we can work this out.
Thanks,
Mike
On Fri, Aug 22, 2014 at 9:44 AM, Francois Gaudreault
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote:
I would also add that the ROOT volume created stayed on the SF
cluster, even if the VM creation failed. That's also a problem,
although I believe the storage garbage collector would delete it?
FG
On 2014-08-22, 11:39 AM, Francois Gaudreault wrote:
Hi Mike,
I tryed the SolidFire plugin on 4.4.1, and I don't think the
behavior is right for the ROOT volume. Tried on XenServer 6.2.
First, I am using a template with technically a 20GB space,
but the storage plugin will create the volume only according
to the size of the vhd (which is 3GB). This is wrong :)
Second, the creation fails with a XenServer error saying there
is not enough space to copy the VDI:
2014-08-22 11:25:44,417 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-249:ctx-81a37f3b) Task failed! Task record:
uuid: b7cf8b1d-d9d9-c2c0-aba0-7368c181a2cb
nameLabel: Async.VDI.copy
nameDescription:
allowedOperations: []
currentOperations: {}
created: Fri Aug 22 11:25:43 EDT 2014
finished: Fri Aug 22 11:25:43 EDT 2014
status: failure
residentOn: com.xensource.xenapi.Host@a7913c69
progress: 1.0
type: none/
result:
errorInfo: [SR_BACKEND_FAILURE_44, , There is
insufficient space]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
Should we also have a SR to handle template copy?
Thanks!
-- Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform
Services
t:514-629-6775 tel:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com http://cloudops.com | tw: @CloudOps_
--
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com mailto:mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the cloud
http://solidfire.com/solution/overview/?video=play/™/
--
Francois Gaudreault
Gestionnaire de Produit | Product Manager - Cloud Platform Services
t:514-629-6775
CloudOps Votre partenaire infonuagique | Cloud Solutions Experts
420 rue Guy | Montreal | Quebec | H3J 1S6
w: cloudops.com | tw: @CloudOps_
RE: S3/Swift Problem around Virtual Size
Edison, Isnt the templates downloaded to the Staging NFS first? FG On Aug 22, 2014 5:20 PM, Edison Su edison...@citrix.com wrote: I know the reason why the size of template doesn’t have correct virtual size if it’s registered in S3/Swift: In case of s3/swift, the template is directly stored into s3/swift through swift/s3 api, there is no place for cloudstack to look into template, to find out the virtual size during template registration. While, if secondary storage is NFS, the template is first stored on NFS(which has file system), cloudstack can unzip the template(if it’s a zipped file), and read virtual size from the file, then report back to mgt server. In order to fix it, we can add some code as: all the templates registered on Swift/S3, need to be downloaded to a NFS intermediate storage before it can be consumed by primary storage. After the download finished, then we check virtual size of template, and report back to mgt server/update DB etc. From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Friday, August 22, 2014 1:38 PM To: dev@cloudstack.apache.org Cc: Edison Su Subject: S3/Swift Problem around Virtual Size Hi, This was brought up in a different e-mail thread, but I wanted to make it more clear that it's related to CloudStack's download code around S3/Swift, so I'm opening up a new thread. Francois (from CloudOps) noticed today that when he downloaded a template (VHD format) to Swift (but it looks like the same applies for S3) that the physical and virtual sizes are set to be the same. This appears to have the following consequence: You can download a template with a physical size of, say, 3 GB and a root disk that's supposed to be, say, 20 GB. Instead of the virtual size showing as 20 GB, it shows as 3 GB. This is not an issue with NFS. In that situation, the two sizes are correctly accounted for. What later can happen is the template is downloaded from Swift and takes up an unexpected amount of space on the XenServer storage repository (SR). If there is enough space on the SR, this isn't too big of a deal. However, for so-called managed storage plug-ins (examples are SolidFire and CloudByte), this will lead to them dynamically creating a SAN volume of the wrong size. Francois opened up the following ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-7406 Thanks! -- Mike Tutkowski Senior CloudStack Developer, SolidFire Inc. e: mike.tutkow...@solidfire.commailto:mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play™
Re: S3/Swift Problem around Virtual Size
Min, Ok, but this is not the behavior I see. Even without requesting a VM create, the template is pushed to the staging NFS at least once. Is it downloaded there or pushed after download, that I am not sure. I was assuming the swift upload bash script was executed after the template is on the staging. Anyway... the focus is on the virt size, and you all know the code better than I do :) FG On Aug 22, 2014 5:28 PM, Min Chen min.c...@citrix.com wrote: No. For S3/Swift, register template will directly upload templates to S3 without going through staging NFS. It will only be copied to staging NFS when we first use that template to provision a VM. Thanks -min On 8/22/14 2:25 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Edison, Isnt the templates downloaded to the Staging NFS first? FG On Aug 22, 2014 5:20 PM, Edison Su edison...@citrix.com wrote: I know the reason why the size of template doesn¹t have correct virtual size if it¹s registered in S3/Swift: In case of s3/swift, the template is directly stored into s3/swift through swift/s3 api, there is no place for cloudstack to look into template, to find out the virtual size during template registration. While, if secondary storage is NFS, the template is first stored on NFS(which has file system), cloudstack can unzip the template(if it¹s a zipped file), and read virtual size from the file, then report back to mgt server. In order to fix it, we can add some code as: all the templates registered on Swift/S3, need to be downloaded to a NFS intermediate storage before it can be consumed by primary storage. After the download finished, then we check virtual size of template, and report back to mgt server/update DB etc. From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Friday, August 22, 2014 1:38 PM To: dev@cloudstack.apache.org Cc: Edison Su Subject: S3/Swift Problem around Virtual Size Hi, This was brought up in a different e-mail thread, but I wanted to make it more clear that it's related to CloudStack's download code around S3/Swift, so I'm opening up a new thread. Francois (from CloudOps) noticed today that when he downloaded a template (VHD format) to Swift (but it looks like the same applies for S3) that the physical and virtual sizes are set to be the same. This appears to have the following consequence: You can download a template with a physical size of, say, 3 GB and a root disk that's supposed to be, say, 20 GB. Instead of the virtual size showing as 20 GB, it shows as 3 GB. This is not an issue with NFS. In that situation, the two sizes are correctly accounted for. What later can happen is the template is downloaded from Swift and takes up an unexpected amount of space on the XenServer storage repository (SR). If there is enough space on the SR, this isn't too big of a deal. However, for so-called managed storage plug-ins (examples are SolidFire and CloudByte), this will lead to them dynamically creating a SAN volume of the wrong size. Francois opened up the following ticket: https://issues.apache.org/jira/browse/CLOUDSTACK-7406 Thanks! -- Mike Tutkowski Senior CloudStack Developer, SolidFire Inc. e: mike.tutkow...@solidfire.commailto:mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play
Re: Apache CloudStack 4.3.1 Release Help
At that point, shouldn't we put all the efforts on 4.4.1 instead? Francois On 2014-08-19, 8:28 PM, ilya musayev wrote: Sebastian, I'd like to help you with Apache CloudStack 4.3.1 release that is if you need help. If you do need help, lets sync up via call, GTM, IRC or whatever else works. Regards ilya -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
NetScaler not tagging public VLAN
Hi, Anybody from Citrix/NetScaler could look at this for getting a fix into 4.4.1? :) https://issues.apache.org/jira/browse/CLOUDSTACK-7364 Thanks! -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
Re: [ANNOUNCE] Will Stevens as committer
Finally! :) Good Job Will! Francois On 2014-07-03, 8:25 PM, Nguyen Anh Tu wrote: Congrats Will! --Tuna Sent from my GT-N7000 On Jul 4, 2014 4:26 AM, Alex Hitchins a...@alexhitchins.com wrote: Congratulations! Alex Hitchins | 07788 423 969 | 01892 523 587 -Original Message- From: sebgoa [mailto:run...@gmail.com] Sent: 03 July 2014 21:43 To: cloudstack Subject: [ANNOUNCE] Will Stevens as committer The Project Management Committee (PMC) for Apache CloudStack has asked Will Stevens to become a committer and we are pleased to announce that he has accepted. Being a committer allows many contributors to contribute more autonomously. For developers, it makes it easier to submit changes and eliminates the need to have contributions reviewed via the patch submission process. Whether contributions are development-related or otherwise, it is a recognition of a contributor's participation in the project and commitment to the project and the Apache Way. Please join me in congratulating Will! PS: Good job on the Palo Alto feature and the documentation, keep it up :) -Sebastien For the CloudStack PMC -- Francois Gaudreault Gestionnaire de Produit | Product Manager - Cloud Platform Services t:514-629-6775 CloudOps Votre partenaire infonuagique | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w: cloudops.com | tw: @CloudOps_
docker.io integration
Hi all, I am curious, anyone working on docker.io integration with CloudStack? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: docker.io integration
Cool! Anh: Can you share the current state of the Branch? Thanks! On 2014-03-31, 1:21 PM, Sebastien Goasguen wrote: Tuna has started a 'docker' branch On Mar 31, 2014, at 11:50 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Hi all, I am curious, anyone working on docker.io integration with CloudStack? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: [DISCUSS] Policy blocker?
I may be wrong here, and far from being an expert at this, but isn't the MariaDB connector doing the same thing, but under a Lesser GPL license? Which would solve a lot of licensing issues (no need to put CloudStack entirely on GPL). FG On 2/20/2014, 5:10 PM, Chip Childers wrote: Real quick, because I don't know if I will be able to track this thread in detail starting tonight... Take this as input to the discussion that the whole community needs to have about the *potential* problem with the current situation. Legal documentation as well as application of the valid license categories is tied to the bits in something we distribute. So that means that we have LICENSE and NOTICE for the source package (with all code either being valid licenses or developed at the ASF). This same logic applies to any binary distribution... they have their own legal documents, and they should pertain to all bits included in that distribution. Unlike other ASF projects, we do NOT offer binary builds from ASF infra. This is where things are fuzzy, and there needs to be a discussion. We offer packages that are pre-compiled. That being said, we actually offer RPMs that include the nonoss features, while our community hosted DEBs do not contain those bits. Theoretically though, the packages should be the place to depend on system dependencies. The other issue is one of default build not having any category X dependencies. There is a fine line between a system dependency and a dependency that is pulled down during the build. We had previously agreed that the cat X stuff would require manual work and not be pulled in automatically. Transitive dependencies are also an issue... if we package them, we should respect their license and actually need to have them in the legal docs. Not sure where they stand WRT being pulled in by the build process... So... no answers, just a bit of background. I'm going to be offline (mostly) until Wed of next week. I will try to watch this thread and rescind my -1 on the RC if we can work our way through this logic puzzle in a way that satisfies my concerns about the current state of things. -chip On Thu, Feb 20, 2014 at 5:01 PM, Chip Childers chipchild...@apache.org wrote: On Thu, Feb 20, 2014 at 1:44 PM, Animesh Chaturvedi animesh.chaturv...@citrix.com wrote: Chip, David thanks for the detailed explanation, is one of you taking care of fixing this issue or we need to find other volunteers I'm sorry to say that I do not have the available cycles. $dayjob + getting ready for a few days off has me pretty booked up. -chip -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: [DISCUSS] Policy blocker?
I find a little ironic that the internal policies are a lot more restrictive than the Apache license itself :S Meanwhile, isn't CloudStack falling into the MySQL FOSS exception? http://www.mysql.com/about/legal/licensing/foss-exception/ Francois On 2/20/2014, 9:20 PM, David Nalley wrote: On Thu, Feb 20, 2014 at 9:10 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: I may be wrong here, and far from being an expert at this, but isn't the MariaDB connector doing the same thing, but under a Lesser GPL license? Which would solve a lot of licensing issues (no need to put CloudStack entirely on GPL). FG Hi Francois: L/GPL is also Cat X according to ASF Policy, and thus isn't effectively any better. --David -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: [VOTE] Apache CloudStack 4.3.0 (sixth round)
+1 Tested Adv. Zone with XS 6.2, Built Windows 2008 VM from ISO, Deleted failed ISO, Snapshot, Create a template from snapshot. However, I am still running into this bug: https://issues.apache.org/jira/browse/CLOUDSTACK-6096 (which is not a blocker, but still very very annoying). Another thing, I ran into a weird situation were the system VMs were failing to start, but still consuming management IPs. CloudStack wasn't returning the IPs to the pool after the deployment errors. (Un)fortunately, I couldn't reproduce it yet... although I think it's related to the fact I added the host with VT flag disabled, and then later changed the BIOS flag for VT to enable. CloudStack panicked. But even if it's the case, it's a corner case, and not a blocker. Francois On 2/18/2014, 11:25 PM, Animesh Chaturvedi wrote: Hi All, I've created a 4.3.0 release, with the following artifacts up for a vote: Given that we have had multiple RC rounds with community testing a few times, and this VOTE has just one isolated fix in Nicira from previous RC, I would like to close the VOTE sooner by Thursday morning PST (36 hours). Please call out if you want to stick to 72 hour (3 working day) period. Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.3 Commit: 307ad15bb68179129b8eadeaed115f5d088adfd9 List of changes: New Features in 4.3: https://issues.apache.org/jira/issues/?filter=12325248 Improvement in 4.3: https://issues.apache.org/jira/issues/?filter=12325249 Issues fixed in 4.3 https://issues.apache.org/jira/issues/?filter=12326161 Known Issues in 4.3: https://issues.apache.org/jira/issues/?filter=12326162 Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/4.3.0/ PGP release keys (signed using 94BE0D7C): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Testing instructions are here: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+test+procedure Vote will be open for 36 hours (Thursday morning PST) For sanity in tallying the vote, can PMC members please be sure to indicate (binding) with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: CLOUDSTACK-6096
Tanner, Just curious, have you been able to test? If not let me know, Ill try to get some time to spin up an environment real quick at my office. Thanks again! FG On 2/13/2014, 8:57 AM, Francois Gaudreault wrote: Thanks Tanner :) Keep us posted please :) FG On 2/13/2014, 8:54 AM, Tanner Danzey wrote: Hi Francois, I can potentially test this tonight for you. We're deploying 4.3 to see if it alleviates some of our issues with S3, but thats a few hours from now in case someine wants to test it sooner. Regards, Tanner On Feb 13, 2014 7:50 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Hi, https://issues.apache.org/jira/browse/CLOUDSTACK-6096 I filed this today. This impact 4.2.1, but I would like to know if it also impact 4.3. Does anyone have an environment with 4.3 that would be able/willing to test? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
CLOUDSTACK-6096
Hi, https://issues.apache.org/jira/browse/CLOUDSTACK-6096 I filed this today. This impact 4.2.1, but I would like to know if it also impact 4.3. Does anyone have an environment with 4.3 that would be able/willing to test? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: CLOUDSTACK-6096
Thanks Tanner :) Keep us posted please :) FG On 2/13/2014, 8:54 AM, Tanner Danzey wrote: Hi Francois, I can potentially test this tonight for you. We're deploying 4.3 to see if it alleviates some of our issues with S3, but thats a few hours from now in case someine wants to test it sooner. Regards, Tanner On Feb 13, 2014 7:50 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Hi, https://issues.apache.org/jira/browse/CLOUDSTACK-6096 I filed this today. This impact 4.2.1, but I would like to know if it also impact 4.3. Does anyone have an environment with 4.3 that would be able/willing to test? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: CLOUDSTACK-5406
Sanjay,
On 2/3/2014, 2:02 AM, Sanjay Tripathi wrote:
Francois,
First can you check if there are disks waiting to expunge. If there are, then
the primary storage count will get reduced once the disks gets expunged.
When I go in the database, I do have couple volumes in the Destroy
state, 2 of them are associated with my account, but they aren't showing
in the UI??
Also, apart from primary_storage count, can you check the volume count.
u'vmrunning': 2,
u'vmtotal': 2,
u'volumeavailable': u'Unlimited',
u'volumelimit': u'Unlimited',
u'volumetotal': 5,
I see 3 volumes on the UI, but the resource count has 5. Still, if I
look at the resource count, it says 301GB. If I do this:
select SUM(size) from volumes where account_id = 5 and state !=
Expunged;
I get 286638735360 bytes, which is 286ish GB. It doesn't make sense. Now
digging a little further, I noticed there is a volume in the Destroy
state with an appended 0 to the size:
| 36 | 5 | 2 |NULL | NULL | 28
| 0 | ROOT-28 | af79dbcc-a46c-4609-aed7-b42d26c45ebe | -
214748364800 - | NULL | NULL |
NULL | 1 | NULL | NULL| ROOT| NULL
|6 |NULL | NULL
| 0 | 2014-01-30 14:38:16 | NULL | 2014-01-30 14:38:24 |
2014-01-30 14:38:24 | Destroy | NULL |1 | NULL
| NULL |211 | 0 | VHD| NULL |
NULL |
It should be 20GB, not 200GB since it has been created with the default
template.
What is happening here? :)
Francois
--Sanjay
-Original Message-
From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com]
Sent: Friday, January 31, 2014 9:15 PM
To: Sanjay Tripathi
Cc: dev@cloudstack.apache.org; Sangeetha Hariharan; Animesh Chaturvedi
Subject: Re: CLOUDSTACK-5406
Sanjay,
Yep, I understand that the bug was for resource count for secondary storage,
but the causes and errors are similar to what I see for primary storage.
Here are the information you requested.
{u'account': [{u'accounttype': 0,
u'cpuavailable': u'Unlimited',
u'cpulimit': u'Unlimited',
u'cputotal': 0,
u'domain': u'Prod',
u'domainid': u'c18ac2cf-f74c-45a3-a412-368ed0310686',
u'id': u'6c48bca4-7b9a-4939-a189-cfc7fe7229b2',
u'ipavailable': u'Unlimited',
u'iplimit': u'Unlimited',
u'iptotal': 1,
u'isdefault': False,
u'memoryavailable': u'Unlimited',
u'memorylimit': u'Unlimited',
u'memorytotal': 0,
u'name': u'Operations',
u'networkavailable': u'Unlimited',
u'networklimit': u'Unlimited',
u'networktotal': 1,
* u'primarystorageavailable': u'Unlimited',**
** u'primarystoragelimit': u'Unlimited',**
** u'primarystoragetotal': 236,*
u'projectavailable': u'Unlimited',
u'projectlimit': u'Unlimited',
u'projecttotal': 0,
u'receivedbytes': 3133532,
u'secondarystorageavailable': u'Unlimited',
u'secondarystoragelimit': u'Unlimited',
u'secondarystoragetotal': 0,
u'sentbytes': 87766,
u'snapshotavailable': u'Unlimited',
u'snapshotlimit': u'Unlimited',
u'snapshottotal': 0,
u'state': u'enabled',
u'templateavailable': u'Unlimited',
u'templatelimit': u'Unlimited',
u'templatetotal': 0,
u'user': [{u'account': u'Operations',
There is currently no VMs running for this account, and the command outputs
236GB. So when I try to spin a new VM I get:
Maximum number of resources of type 'primary_storage' for account
name=Operations in domain id=2 has been exceeded.
Let me know if you need more info. The bug seems identical to the one
identified for the secondary storage.
Thanks!
Francois
On 1/31/2014, 1:59 AM, Sanjay Tripathi wrote:
Francois,
Bug CLOUDSTACK-5406 was related to snapshot size and secondary storage
count.
For your issue, can you paste the response of listAccounts API for the
account you are trying to deploy VM with; this will help us to check
the resource_limit set for your account and what is the resource_count
that account is having.
Also paste the error message you are getting during the VM deployment.
--Sanjay
*From:*Francois Gaudreault [mailto:fgaudrea...@cloudops.com]
*Sent:* Friday, January 31, 2014 10:58 AM
*To:* Sanjay Tripathi
*Cc:* dev@cloudstack.apache.org; Sangeetha Hariharan; Animesh
Chaturvedi
*Subject:* RE: CLOUDSTACK-5406
No, its the same thing as the ticket
Re: Xen StorageMotion Fails
Just did: https://issues.apache.org/jira/browse/CLOUDSTACK-6004 I put it as a blocker because it breaks the ability to do proper server maintenance without downtime. Thanks for looking into this. Like I said, it's possible it's fixed in 4.3, but I am not equipped to test right now. Francois On 1/31/2014, 12:56 AM, Devdeep Singh wrote: Hi Francois, This looks like an issue in cloudstack. Can you file a bug with the details? Regards, Devdeep -Original Message- From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com] Sent: Thursday, January 30, 2014 6:48 PM To: Srikanteswararao Talluri Cc: dev@cloudstack.apache.org Subject: RE: Xen StorageMotion Fails I used the UI for the vm migration. I can get you the exact api call but isnt the call in the pastebin output already.. Another thing, if there is a vm running on the same network on the destination host, I dont have the exception but the volume stay in migrate state forever. Thanks Francois On Jan 30, 2014 2:19 AM, Srikanteswararao Talluri srikanteswararao.tall...@citrix.com wrote: Yes, I am able to migrate a VM on local storage(host) to another local storage(host). Can you paste the API call you tried? Thanks, ~Talluri -Original Message- From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com] Sent: Wednesday, 29 January 2014 6:31 PM To: dev@cloudstack.apache.org Subject: Xen StorageMotion Fails Hi, I posted this on the users@ mailing-list yesterday, but giving it more thoughts I think this should have been posted here. We are running 4.2.1 with XenServer 6.2SP1. I tried to run a storage motion from a local storage to another, and I am getting this error. Xen returns a VM_REQUIRES_NETWORK when attempting the migration. This error, according to the javadoc means: You attempted to run a VM on a host which doesn't have a PIF on a Network needed by the VM. The VM has at least one VIF attached to the Network. http://pastebin.com/cHcAyPtP I believe this is supposed to be supported since CloudStack let me do it from the UI. Right? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: CLOUDSTACK-5406
Sanjay,
Yep, I understand that the bug was for resource count for secondary
storage, but the causes and errors are similar to what I see for primary
storage.
Here are the information you requested.
{u'account': [{u'accounttype': 0,
u'cpuavailable': u'Unlimited',
u'cpulimit': u'Unlimited',
u'cputotal': 0,
u'domain': u'Prod',
u'domainid': u'c18ac2cf-f74c-45a3-a412-368ed0310686',
u'id': u'6c48bca4-7b9a-4939-a189-cfc7fe7229b2',
u'ipavailable': u'Unlimited',
u'iplimit': u'Unlimited',
u'iptotal': 1,
u'isdefault': False,
u'memoryavailable': u'Unlimited',
u'memorylimit': u'Unlimited',
u'memorytotal': 0,
u'name': u'Operations',
u'networkavailable': u'Unlimited',
u'networklimit': u'Unlimited',
u'networktotal': 1,
* u'primarystorageavailable': u'Unlimited',**
** u'primarystoragelimit': u'Unlimited',**
** u'primarystoragetotal': 236,*
u'projectavailable': u'Unlimited',
u'projectlimit': u'Unlimited',
u'projecttotal': 0,
u'receivedbytes': 3133532,
u'secondarystorageavailable': u'Unlimited',
u'secondarystoragelimit': u'Unlimited',
u'secondarystoragetotal': 0,
u'sentbytes': 87766,
u'snapshotavailable': u'Unlimited',
u'snapshotlimit': u'Unlimited',
u'snapshottotal': 0,
u'state': u'enabled',
u'templateavailable': u'Unlimited',
u'templatelimit': u'Unlimited',
u'templatetotal': 0,
u'user': [{u'account': u'Operations',
There is currently no VMs running for this account, and the command
outputs 236GB. So when I try to spin a new VM I get:
Maximum number of resources of type 'primary_storage' for account
name=Operations in domain id=2 has been exceeded.
Let me know if you need more info. The bug seems identical to the one
identified for the secondary storage.
Thanks!
Francois
On 1/31/2014, 1:59 AM, Sanjay Tripathi wrote:
Francois,
Bug CLOUDSTACK-5406 was related to snapshot size and secondary storage
count.
For your issue, can you paste the response of listAccounts API for the
account you are trying to deploy VM with; this will help us to check
the resource_limit set for your account and what is the resource_count
that account is having.
Also paste the error message you are getting during the VM deployment.
--Sanjay
*From:*Francois Gaudreault [mailto:fgaudrea...@cloudops.com]
*Sent:* Friday, January 31, 2014 10:58 AM
*To:* Sanjay Tripathi
*Cc:* dev@cloudstack.apache.org; Sangeetha Hariharan; Animesh Chaturvedi
*Subject:* RE: CLOUDSTACK-5406
No, its the same thing as the ticket describe. I tried to lunch a VM,
and the resource limit was reached for my account even if there was no
volume running at all.
FG
On Jan 31, 2014 12:15 AM, Sanjay Tripathi
sanjay.tripa...@citrix.com mailto:sanjay.tripa...@citrix.com wrote:
Hi Francois,
Can you please explain what is the impact you are seeing in
primary storage count. Is it the negative value of primary storage
count or something else.
--Sanjay
-Original Message-
From: Animesh Chaturvedi
Sent: Friday, January 31, 2014 5:23 AM
To: dev@cloudstack.apache.org mailto:dev@cloudstack.apache.org;
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com
Cc: Sangeetha Hariharan; Sanjay Tripathi
Subject: RE: CLOUDSTACK-5406
Copying the folks that worked on it
-Original Message-
From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com
mailto:fgaudrea...@cloudops.com]
Sent: Thursday, January 30, 2014 3:49 PM
To: dev@cloudstack.apache.org mailto:dev@cloudstack.apache.org
Subject: CLOUDSTACK-5406
Hi,
I saw this bug as been fixed for the secondary storage limits in 4.3:
CLOUDSTACK-5406
But it seems to impact the primary storage limit count as well, at
least in 4.2.1. Is the primary storage count fixed in 4.3 (I can't
test right
now) as well?
Thanks!
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com
514-629-6775 tel:514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com http://www.cloudops.com
@CloudOps_
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com
@CloudOps_
RE: Xen StorageMotion Fails
I used the UI for the vm migration. I can get you the exact api call but isnt the call in the pastebin output already.. Another thing, if there is a vm running on the same network on the destination host, I dont have the exception but the volume stay in migrate state forever. Thanks Francois On Jan 30, 2014 2:19 AM, Srikanteswararao Talluri srikanteswararao.tall...@citrix.com wrote: Yes, I am able to migrate a VM on local storage(host) to another local storage(host). Can you paste the API call you tried? Thanks, ~Talluri -Original Message- From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com] Sent: Wednesday, 29 January 2014 6:31 PM To: dev@cloudstack.apache.org Subject: Xen StorageMotion Fails Hi, I posted this on the users@ mailing-list yesterday, but giving it more thoughts I think this should have been posted here. We are running 4.2.1 with XenServer 6.2SP1. I tried to run a storage motion from a local storage to another, and I am getting this error. Xen returns a VM_REQUIRES_NETWORK when attempting the migration. This error, according to the javadoc means: You attempted to run a VM on a host which doesn't have a PIF on a Network needed by the VM. The VM has at least one VIF attached to the Network. http://pastebin.com/cHcAyPtP I believe this is supposed to be supported since CloudStack let me do it from the UI. Right? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
CLOUDSTACK-5406
Hi, I saw this bug as been fixed for the secondary storage limits in 4.3: CLOUDSTACK-5406 But it seems to impact the primary storage limit count as well, at least in 4.2.1. Is the primary storage count fixed in 4.3 (I can't test right now) as well? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
RE: CLOUDSTACK-5406
No, its the same thing as the ticket describe. I tried to lunch a VM, and the resource limit was reached for my account even if there was no volume running at all. FG On Jan 31, 2014 12:15 AM, Sanjay Tripathi sanjay.tripa...@citrix.com wrote: Hi Francois, Can you please explain what is the impact you are seeing in primary storage count. Is it the negative value of primary storage count or something else. --Sanjay -Original Message- From: Animesh Chaturvedi Sent: Friday, January 31, 2014 5:23 AM To: dev@cloudstack.apache.org; fgaudrea...@cloudops.com Cc: Sangeetha Hariharan; Sanjay Tripathi Subject: RE: CLOUDSTACK-5406 Copying the folks that worked on it -Original Message- From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com] Sent: Thursday, January 30, 2014 3:49 PM To: dev@cloudstack.apache.org Subject: CLOUDSTACK-5406 Hi, I saw this bug as been fixed for the secondary storage limits in 4.3: CLOUDSTACK-5406 But it seems to impact the primary storage limit count as well, at least in 4.2.1. Is the primary storage count fixed in 4.3 (I can't test right now) as well? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Xen StorageMotion Fails
Hi, I posted this on the users@ mailing-list yesterday, but giving it more thoughts I think this should have been posted here. We are running 4.2.1 with XenServer 6.2SP1. I tried to run a storage motion from a local storage to another, and I am getting this error. Xen returns a VM_REQUIRES_NETWORK when attempting the migration. This error, according to the javadoc means: You attempted to run a VM on a host which doesn't have a PIF on a Network needed by the VM. The VM has at least one VIF attached to the Network. http://pastebin.com/cHcAyPtP I believe this is supposed to be supported since CloudStack let me do it from the UI. Right? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: XS master handling in 4.3.0
Ok, thanks for the heads-up! Francois On 1/23/2014, 6:56 PM, Anthony Xu wrote: The patch will be in next release, XS HA can be enabled only after upgrading to the CS release including this patch. We will provide document in the next CS release. Anthony -Original Message- From: Animesh Chaturvedi [mailto:animesh.chaturv...@citrix.com] Sent: Thursday, January 23, 2014 3:41 PM To: dev@cloudstack.apache.org; fgaudrea...@cloudops.com Subject: RE: XS master handling in 4.3.0 That change was reverted and is not in 4.3.0 so the behavior will be the same as 4.2.1 -Original Message- From: Francois Gaudreault [mailto:fgaudrea...@cloudops.com] Sent: Thursday, January 23, 2014 7:57 AM To: dev@cloudstack.apache.org Subject: XS master handling in 4.3.0 Quick question... In the 4.3.0 vote thread, I saw this ticket: CLOUDSTACK-5923 OK fine, but what happens if we are running 4.2.1 with a cluster today? Should we enable HA today or only when we upgrade to 4.3? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_ -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: DB timeouts on failover
Anyone? :S On 1/23/2014, 10:33 AM, Francois Gaudreault wrote: Hi, There was a thread on the users mailing list around the DB connection timeouts when the underlaying MySQL active/passive cluster changes master. The solution so far is to use a crontab to monitor if the server is crashed. I'm not too familiar with the tomcat or cloudstack configs, but is there any jdbc settings or timeouts we can tweak? -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
DB timeouts on failover
Hi, There was a thread on the users mailing list around the DB connection timeouts when the underlaying MySQL active/passive cluster changes master. The solution so far is to use a crontab to monitor if the server is crashed. I'm not too familiar with the tomcat or cloudstack configs, but is there any jdbc settings or timeouts we can tweak? -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
XS master handling in 4.3.0
Quick question... In the 4.3.0 vote thread, I saw this ticket: CLOUDSTACK-5923 OK fine, but what happens if we are running 4.2.1 with a cluster today? Should we enable HA today or only when we upgrade to 4.3? Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Cannot delete ISO
We have a fresh 4.2.1 install, and apparently we cannot delete ISO that
failed to download? We are using XenServer hypervisors.
2014-01-17 16:06:41,833 INFO [cloud.template.HypervisorTemplateAdapter]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
Delete template from image store: Prod-SecStor
2014-01-17 16:06:41,836 DEBUG [storage.image.TemplateDataFactoryImpl]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
template 203 is already in store:1, type:Image
2014-01-17 16:06:41,956 DEBUG [agent.transport.Request]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ]) Seq
5-2088570903: Sending { Cmd , MgmtId: 99433950741773, via: 5, Ver: v1,
Flags: 100011,
[{org.apache.cloudstack.storage.command.DeleteCommand:{data:{org.apache.cloudstack.storage.to.TemplateObjectTO:{path:template/tmpl/5/203,origUrl:http://cloudstack.ixxx.com/iso/WinServer_2008_R2_x64_ENG.ISO,uuid:94e4ee85-c1af-4eac-b695-d5912a6c9c41,id:203,format:ISO,accountId:5,hvm:true,displayText:Test
2nd,imageDataStore:{com.cloud.agent.api.to.NfsTO:{_url:nfs://10.100.x.xxx/data/prod_zone,_role:Image}},name:203-5-7cca35bd-0eaa-37fe-a45a-418bcc5d9b96,hypervisorType:None}},wait:0}}]
}
2014-01-17 16:06:42,054 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 5-2088570903: Processing: { Ans: ,
MgmtId: 99433950741773, via: 5, Ver: v1, Flags: 10,
[{com.cloud.agent.api.Answer:{result:false,details:Unable to
delete file 204 under Template path template/tmpl/5/203,wait:0}}] }
2014-01-17 16:06:42,054 DEBUG [agent.transport.Request]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ]) Seq
5-2088570903: Received: { Ans: , MgmtId: 99433950741773, via: 5, Ver:
v1, Flags: 10, { Answer } }
2014-01-17 16:06:42,125 WARN [cloud.template.HypervisorTemplateAdapter]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
Failed to delete the template
Tmpl[203-ISO-203-5-7cca35bd-0eaa-37fe-a45a-418bcc5d9b96 from the image
store: Prod-SecStor due to: Unable to delete file 204 under Template
path template/tmpl/5/203
2014-01-17 16:06:42,206 ERROR [cloud.async.AsyncJobManagerImpl]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
Unexpected exception while executing
org.apache.cloudstack.api.command.user.iso.DeleteIsoCmd
com.cloud.utils.exception.CloudRuntimeException: Failed to delete ISO
at
com.cloud.template.TemplateManagerImpl.deleteIso(TemplateManagerImpl.java:1120)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.iso.DeleteIsoCmd.execute(DeleteIsoCmd.java:110)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com
@CloudOps_
Re: Cannot delete ISO
Looks like it :) I just opened a ticket:
CLOUDSTACK-5900
Also, I would like to point out that my template was ID 203, and it was
trying to delete the file/folder 204, which is not the proper directory...
Thanks!
FG
On 1/17/2014, 6:23 PM, Min Chen wrote:
This is a bug in deleting an ISO that is not successfully downloaded.
Thanks
-min
On 1/17/14 1:12 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote:
We have a fresh 4.2.1 install, and apparently we cannot delete ISO that
failed to download? We are using XenServer hypervisors.
2014-01-17 16:06:41,833 INFO [cloud.template.HypervisorTemplateAdapter]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
Delete template from image store: Prod-SecStor
2014-01-17 16:06:41,836 DEBUG [storage.image.TemplateDataFactoryImpl]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
template 203 is already in store:1, type:Image
2014-01-17 16:06:41,956 DEBUG [agent.transport.Request]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ]) Seq
5-2088570903: Sending { Cmd , MgmtId: 99433950741773, via: 5, Ver: v1,
Flags: 100011,
[{org.apache.cloudstack.storage.command.DeleteCommand:{data:{org.apac
he.cloudstack.storage.to.TemplateObjectTO:{path:template/tmpl/5/203,
origUrl:http://cloudstack.ixxx.com/iso/WinServer_2008_R2_x64_ENG.ISO
,uuid:94e4ee85-c1af-4eac-b695-d5912a6c9c41,id:203,format:ISO,a
ccountId:5,hvm:true,displayText:Test
2nd,imageDataStore:{com.cloud.agent.api.to.NfsTO:{_url:nfs://10.10
0.x.xxx/data/prod_zone,_role:Image}},name:203-5-7cca35bd-0eaa-37fe
-a45a-418bcc5d9b96,hypervisorType:None}},wait:0}}]
}
2014-01-17 16:06:42,054 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 5-2088570903: Processing: { Ans: ,
MgmtId: 99433950741773, via: 5, Ver: v1, Flags: 10,
[{com.cloud.agent.api.Answer:{result:false,details:Unable to
delete file 204 under Template path template/tmpl/5/203,wait:0}}] }
2014-01-17 16:06:42,054 DEBUG [agent.transport.Request]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ]) Seq
5-2088570903: Received: { Ans: , MgmtId: 99433950741773, via: 5, Ver:
v1, Flags: 10, { Answer } }
2014-01-17 16:06:42,125 WARN [cloud.template.HypervisorTemplateAdapter]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
Failed to delete the template
Tmpl[203-ISO-203-5-7cca35bd-0eaa-37fe-a45a-418bcc5d9b96 from the image
store: Prod-SecStor due to: Unable to delete file 204 under Template
path template/tmpl/5/203
2014-01-17 16:06:42,206 ERROR [cloud.async.AsyncJobManagerImpl]
(Job-Executor-21:job-54 = [ 934ed1bf-c382-42f4-b5fe-3bcd0284dfb8 ])
Unexpected exception while executing
org.apache.cloudstack.api.command.user.iso.DeleteIsoCmd
com.cloud.utils.exception.CloudRuntimeException: Failed to delete ISO
at
com.cloud.template.TemplateManagerImpl.deleteIso(TemplateManagerImpl.java:
1120)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD
ispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.iso.DeleteIsoCmd.execute(DeleteIsoC
md.java:110)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
:615)
at java.lang.Thread.run(Thread.java:701)
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com
@CloudOps_
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com
514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com
@CloudOps_
Create version tag 4.2.1 on JIRA
Can someone create version 4.2.1 on JIRA? :) I have a bug report to tag :P Thanks! -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: Nexenta iSCSI Storage driver
Victor, What would you gain? I mean, isn't Nexanta using open-iscsi? Francois On 1/2/2014, 5:25 PM, Victor Rodionov wrote: Hello, I'm working on Nexenta iSCSI storage driver for cloudstack, what you think about this guys? Thanks, Victor Rodionov -- Francois Gaudreault Architecte de Solution Cloud | Cloud Solutions Architect fgaudrea...@cloudops.com 514-629-6775 - - - CloudOps 420 rue Guy Montréal QC H3J 1S6 www.cloudops.com @CloudOps_
Re: [DISCUSS][PROPOSAL] Move docs to .rst format and readthedocs
+1. Anything to move away from manual docbook is good!!! Now we won't have any reasons not to update the documentation if we find bugs in it :S asciidoc would have been another possibility tho... but reST is fine :) Francois On Tue, Dec 10, 2013 at 12:23 PM, Animesh Chaturvedi animesh.chaturv...@citrix.com wrote: -Original Message- From: Sebastien Goasguen [mailto:run...@gmail.com] Sent: Monday, December 09, 2013 11:31 PM To: dev@cloudstack.apache.org Cc: Radhika Puthiyetath; msweet@gmail.com; Mike Tutkowski Subject: Re: [DISCUSS][PROPOSAL] Move docs to .rst format and readthedocs On Dec 9, 2013, at 9:37 PM, Animesh Chaturvedi animesh.chaturv...@citrix.com wrote: I am +1 to make documentation easier but we just passed code freeze for 4.3 and I feel we need to do it after 4.3. docs are not in the 4.3 code branch. it's different releases... Animesh But they will be released together. Animesh -Original Message- From: sebgoa [mailto:run...@gmail.com] Sent: Monday, December 09, 2013 3:54 AM To: dev@cloudstack.apache.org Cc: Radhika Puthiyetath; msweet@gmail.com; Mike Tutkowski Subject: [DISCUSS][PROPOSAL] Move docs to .rst format and readthedocs Hi, There has been lots of discussion about docs over the last 3/4 months, in summary the issues are: -Difficult to maintain and keep website up to date (issues with lang and issues with pdf formatting lately) -Difficult to contribute to easily, docbook is fine but tedious to work on. -Errors in the docs don't get properly fixed -Mix of OS information -Lack of content for certain features -Docs release cycle. Docs have bugs that will never get fixed in that specific release (because we see it as code release) To remedy some of those issues and work on a new release process specific to docs we moved the docs to its own repo: https://git-wip-us.apache.org/repos/asf?p=cloudstack-docs.git *I propose that we move away from docbook and use a more readable format: restructuredtext* I have worked on a prototype that uses restructured text: http://docutils.sourceforge.net/rst.html This format makes it extremely easy to write docs. Existing docbook content could be converted to .rst using a tool like pandoc: http://johnmacfarlane.net/pandoc/ *In addition to changing the format I propose that we use readthedocs.org* This will help with the release and build of the docs. readthedocs grabs the docs from a git repo, builds html, pdf and epub. It can also maintain several releases. We can apply a specific -theme- to our docs. See a prototype here: http://cloudstack.readthedocs.org/en/latest/ *I propose that we move to this as early as 4.3 documentation* Assuming this proposal passes, we would need to: -re-architect the repo -create the proper cnames to be in accordance with trademark guidelines -we can decide what content to keep or not and convert what we keep. -decide how we organize the content -start accepting pull requests (noting that pages can be edited directly from github) -make a first release of this new doc site at the same time than 4.3 release. Thoughts, flames ? -Sebastien
Re: Trunk interface to VM
Hi, Thanks for the suggestions. I will investigate the VLAN 4095 on ESX and the SDN/GRE avenue. Thanks! FG On Tue, Nov 19, 2013 at 5:38 AM, Murali Reddy murali.re...@citrix.comwrote: If you can run XenServer on ESXi, there there is 'virtual guest tagging'[1] where VLAN 4095 lets guest instances to send and receive tagged traffic on to physical network. Perhaps you can try creating a network with 4095 VLAN tag from CS and spin up XS VM instances. You can do it on XenServer as well, but VIF needs to connect to a non-VLAN network. I use NetScaler VPX on XenServer[2], where VPX sends and receives tagged traffic from the XenServer. [1] http://kb.vmware.com/selfservice/microsites/search.do?language=en_UScmd=di splayKCexternalId=1003806 [2] http://support.citrix.com/proddocs/topic/netscaler-vpx-10/ns-vpx-overview-w rapper-con.html On 16/11/13 11:31 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Yes. We want to be able spin XS within CloudStack. We also need those XS to consume VLAN tags to do advanced networking (kind of CS inside CS). Lets say we do have devs with ambitious needs :) Francois On 2013-11-15 9:46 PM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: You want to pass the vlan tags into a VM that is actually a XenServer? On 11/14/13 3:02 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Is there a way to assign a trunked interface to a VM running in CS? Like assign the entire guest interface. We have a use case where we need to run XenServer hosts within a cloudstack managed infra. Thanks! Francois
Re: Trunk interface to VM
Yes. We want to be able spin XS within CloudStack. We also need those XS to consume VLAN tags to do advanced networking (kind of CS inside CS). Lets say we do have devs with ambitious needs :) Francois On 2013-11-15 9:46 PM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: You want to pass the vlan tags into a VM that is actually a XenServer? On 11/14/13 3:02 PM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Is there a way to assign a trunked interface to a VM running in CS? Like assign the entire guest interface. We have a use case where we need to run XenServer hosts within a cloudstack managed infra. Thanks! Francois
Trunk interface to VM
Is there a way to assign a trunked interface to a VM running in CS? Like assign the entire guest interface. We have a use case where we need to run XenServer hosts within a cloudstack managed infra. Thanks! Francois
Re: LXC and SSVM/CPVM on the host
Kelven, This is what I get in the LXC host agent log when I try to check the console from CS: 2013-10-29 10:07:42,079 WARN [cloud.agent.Agent] (agentRequest-Handler-4:null) Caught: java.lang.NullPointerException at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2711) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1216) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) This is the error on the CS side: 2013-10-29 10:12:58,215 DEBUG [agent.manager.AgentManagerImpl] (catalina-exec-16:null) Details from executing class com.cloud.agent.api.GetVncPortCommand: java.lang.NullPointerException at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2711) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1216) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2013-10-29 10:12:58,215 ERROR [cloud.servlet.ConsoleProxyServlet] (catalina-exec-16:null) Unexepected exception in ConsoleProxyServlet java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.GetVncPortAnswer at com.cloud.server.ManagementServerImpl.getVncPort(ManagementServerImpl.java:2193) at com.cloud.servlet.ConsoleProxyServlet.composeConsoleAccessUrl(ConsoleProxyServlet.java:381) at com.cloud.servlet.ConsoleProxyServlet.handleAccessRequest(ConsoleProxyServlet.java:269) at com.cloud.servlet.ConsoleProxyServlet.doGet(ConsoleProxyServlet.java:171) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:679) On 10/28/2013, 9:05 PM, Kelven Yang wrote: As long as the container VNC console is reachable from console proxy agent, I don't see a technical issue here. Need some log details to understand the situation. For example, what information does LXC hypervisor resource agent returns on GetVncPort command? Kelven On 10/28/13 10:59 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Thanks! Is the console proxy issue will be fixed at some point in the future or this won't be possible? Francois On 10/28/2013, 1:57 PM, Phong Nguyen wrote: Yes, the console proxy VM is unable to connect to the LXC console. Use virsh to connect from the host. virsh -c lxc:/// console i-2-20-VM -Phong On Mon, Oct 28, 2013 at 1:22 PM, Francois Gaudreault fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote: Ok, I followed Chiradeep's comment here, and it now works fine. I have CentOS 6 containers running. My only other questions would be: - Is it normal that the console proxy VM cannot proxy the container's console? - How can I access the container console from the host? (I am on CentOS) I can ssh to the container tho. Thanks! Francois
Re: LXC and SSVM/CPVM on the host
Filed as : https://issues.apache.org/jira/browse/CLOUDSTACK-4990 On 10/29/2013, 1:45 PM, Kelven Yang wrote: It looks like a LXC resource agent bug. LXC resource agent needs to respond VNC command correctly in order to get console work on LXC. Could you file a bug against LXC resource agent component? Kelven On 10/29/13, 7:13 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Kelven, This is what I get in the LXC host agent log when I try to check the console from CS: 2013-10-29 10:07:42,079 WARN [cloud.agent.Agent] (agentRequest-Handler-4:null) Caught: java.lang.NullPointerException at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(Libvirt ComputingResource.java:2711) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest( LibvirtComputingResource.java:1216) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: 1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java :615) at java.lang.Thread.run(Thread.java:744) This is the error on the CS side: 2013-10-29 10:12:58,215 DEBUG [agent.manager.AgentManagerImpl] (catalina-exec-16:null) Details from executing class com.cloud.agent.api.GetVncPortCommand: java.lang.NullPointerException at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(Libvirt ComputingResource.java:2711) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest( LibvirtComputingResource.java:1216) at com.cloud.agent.Agent.processRequest(Agent.java:525) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852) at com.cloud.utils.nio.Task.run(Task.java:83) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: 1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java :615) at java.lang.Thread.run(Thread.java:744) 2013-10-29 10:12:58,215 ERROR [cloud.servlet.ConsoleProxyServlet] (catalina-exec-16:null) Unexepected exception in ConsoleProxyServlet java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.GetVncPortAnswer at com.cloud.server.ManagementServerImpl.getVncPort(ManagementServerImpl.java :2193) at com.cloud.servlet.ConsoleProxyServlet.composeConsoleAccessUrl(ConsoleProxy Servlet.java:381) at com.cloud.servlet.ConsoleProxyServlet.handleAccessRequest(ConsoleProxyServ let.java:269) at com.cloud.servlet.ConsoleProxyServlet.doGet(ConsoleProxyServlet.java:171) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati onFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter Chain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve. java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve. java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1 27) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1 02) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja va:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298 ) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.jav a:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process (Http11NioProtocol.java:721) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.jav a:2268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: 1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java :615) at java.lang.Thread.run(Thread.java:679) On 10/28/2013, 9:05 PM, Kelven Yang wrote: As long as the container VNC console is reachable from console proxy agent, I don't see a technical issue here. Need some log details to understand the situation. For example, what information does LXC hypervisor resource agent returns on GetVncPort command? Kelven On 10/28/13 10:59 AM, Francois Gaudreault fgaudrea...@cloudops.com wrote: Thanks! Is the console proxy issue will be fixed at some point in the future or this won't be possible? Francois On 10/28/2013, 1:57 PM, Phong Nguyen wrote: Yes, the console proxy VM is unable to connect to the LXC console. Use virsh to connect from the host. virsh -c lxc:/// console i-2-20-VM -Phong On Mon, Oct 28, 2013 at 1:22 PM, Francois Gaudreault fgaudrea...@cloudops.com
Re: LXC and SSVM/CPVM on the host
Ok, I followed Chiradeep's comment here, and it now works fine. I have
CentOS 6 containers running.
My only other questions would be:
- Is it normal that the console proxy VM cannot proxy the container's
console?
- How can I access the container console from the host? (I am on CentOS)
I can ssh to the container tho.
Thanks!
Francois
On 10/24/2013, 7:00 PM, Chiradeep Vittal wrote:
So here's what should work
Create zone
Add a KVM cluster - add a KVM host - wait for systemvms to start
Add a LXC cluster - add a LXC host
On 10/24/13 9:55 AM, Francois Gaudreault fgaudrea...@cloudops.com
wrote:
If it's designed to do that, then something is wrong with how CS deals
with it.
When I was trying to get the KVM images to work, they were starting,
getting IPs, but then something was killing the VM. I though for
sometime that libvirt was the issue, so I tried Ubuntu 13.10, 12.04 and
CentOS with the same results. I then switched the hypervisor type in CS
from LXC to KVM (rebuilt the zone), keep the same settings on my host,
and the System VMs are running fine since then.
Anyone have time to help me troubleshoot? I mean, this is not a blocker,
but I can't get standalone LXC cluster to work...
Francois
On 10/24/2013, 11:53 AM, Phong Nguyen wrote:
So we need a KVM cluster to run the VMs? (Added the author of the
feature)
As it was originally discussed and implemented, the decision was to
use KVM as the system VM for LXC clusters instead of creating an LXC
system VM. A zone with only LXC clusters will deploy a KVM system VM
on a host running an LXC agent. Behind the scenes, this is possible
because both KVM and LXC agents use libvirt for provisioning (and that
the setup of an LXC agent is almost identical to KVM and perfectly
capable of running KVM VMs).
-Phong
On Thu, Oct 24, 2013 at 8:57 AM, Francois Gaudreault
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote:
If this is the case, then you should remove the ability to create
LXC zones or clarify the documentation about that.
According to the wiki page:
Each of the different hypervisors currently have their own System
VMs. These system VM images are used to run a console proxy,
secondary storage, and router VMs.
We discussed the possibility of creating System VMs for LXC. There
was concern with the complexity and potential issues involving
iptables for the router inside an LXC container. As an
intermediate solution we are going to use KVM System VMs inside
the LXC Cluster.
So we need a KVM cluster to run the VMs? (Added the author of the
feature)
Francois
On 10/22/2013, 1:24 AM, Chiradeep Vittal wrote:
As far as I understand, in an LXC scenario, the system vms are
expected to
run on real hypervisors.
You can always use the QuickCloud way to not use system vms at
all.
On 10/21/13 1:45 PM, Francois Gaudreault
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com
wrote:
Ok I think we have to look at this further. I'll stop
hijacking other
threads.
I am trying to get the SSVM/CPVM to run on a LXC host. The
SSVM/CPVM
starts, get IPs, but then CloudStack kill them for some
reason. Yes, I
use the 4.2 images :
2013-10-21 16:19:21,605 DEBUG
[agent.manager.AgentManagerImpl]
(AgentManager-Handler-9:null) SeqA 73--1: Processing Seq
73--1: { Cmd ,
MgmtId: -1, via: 73, Ver: v1, Flags: 111,
[{com.cloud.agent.api.ShutdownCommand:{reason:sig.kill,wait:0}}]
}
2013-10-21 16:19:21,605 INFO
[agent.manager.AgentManagerImpl]
(AgentManager-Handler-9:null) Host 73 has informed us that
it is
shutting down with reason sig.kill and detail null
2013-10-21 16:19:21,606 INFO
[agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) Host 73 is disconnecting with event
ShutdownRequested
2013-10-21 16:19:21,609 DEBUG
[agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) The next status of agent 73is
Disconnected,
current status is Up
2013-10-21 16:19:21,609 DEBUG
[agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) Deregistering link for 73 with
state Disconnected
2013-10-21 16:19:21,609 DEBUG
[agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) Remove Agent : 73
2013-10-21 16:19:21,609 DEBUG
[agent.manager.ConnectedAgentAttache]
(AgentTaskPool-11:null) Processing Disconnect.
I transferred the host to KVM, and now the same SSVM/CPVM
images are
running fine for the last 30min ( so I assume it works
fine
Re: LXC and SSVM/CPVM on the host
If it's designed to do that, then something is wrong with how CS deals
with it.
When I was trying to get the KVM images to work, they were starting,
getting IPs, but then something was killing the VM. I though for
sometime that libvirt was the issue, so I tried Ubuntu 13.10, 12.04 and
CentOS with the same results. I then switched the hypervisor type in CS
from LXC to KVM (rebuilt the zone), keep the same settings on my host,
and the System VMs are running fine since then.
Anyone have time to help me troubleshoot? I mean, this is not a blocker,
but I can't get standalone LXC cluster to work...
Francois
On 10/24/2013, 11:53 AM, Phong Nguyen wrote:
So we need a KVM cluster to run the VMs? (Added the author of the
feature)
As it was originally discussed and implemented, the decision was to
use KVM as the system VM for LXC clusters instead of creating an LXC
system VM. A zone with only LXC clusters will deploy a KVM system VM
on a host running an LXC agent. Behind the scenes, this is possible
because both KVM and LXC agents use libvirt for provisioning (and that
the setup of an LXC agent is almost identical to KVM and perfectly
capable of running KVM VMs).
-Phong
On Thu, Oct 24, 2013 at 8:57 AM, Francois Gaudreault
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com wrote:
If this is the case, then you should remove the ability to create
LXC zones or clarify the documentation about that.
According to the wiki page:
Each of the different hypervisors currently have their own System
VMs. These system VM images are used to run a console proxy,
secondary storage, and router VMs.
We discussed the possibility of creating System VMs for LXC. There
was concern with the complexity and potential issues involving
iptables for the router inside an LXC container. As an
intermediate solution we are going to use KVM System VMs inside
the LXC Cluster.
So we need a KVM cluster to run the VMs? (Added the author of the
feature)
Francois
On 10/22/2013, 1:24 AM, Chiradeep Vittal wrote:
As far as I understand, in an LXC scenario, the system vms are
expected to
run on real hypervisors.
You can always use the QuickCloud way to not use system vms at
all.
On 10/21/13 1:45 PM, Francois Gaudreault
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com
wrote:
Ok I think we have to look at this further. I'll stop
hijacking other
threads.
I am trying to get the SSVM/CPVM to run on a LXC host. The
SSVM/CPVM
starts, get IPs, but then CloudStack kill them for some
reason. Yes, I
use the 4.2 images :
2013-10-21 16:19:21,605 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-9:null) SeqA 73--1: Processing Seq
73--1: { Cmd ,
MgmtId: -1, via: 73, Ver: v1, Flags: 111,
[{com.cloud.agent.api.ShutdownCommand:{reason:sig.kill,wait:0}}]
}
2013-10-21 16:19:21,605 INFO [agent.manager.AgentManagerImpl]
(AgentManager-Handler-9:null) Host 73 has informed us that
it is
shutting down with reason sig.kill and detail null
2013-10-21 16:19:21,606 INFO [agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) Host 73 is disconnecting with event
ShutdownRequested
2013-10-21 16:19:21,609 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) The next status of agent 73is
Disconnected,
current status is Up
2013-10-21 16:19:21,609 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) Deregistering link for 73 with
state Disconnected
2013-10-21 16:19:21,609 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-11:null) Remove Agent : 73
2013-10-21 16:19:21,609 DEBUG
[agent.manager.ConnectedAgentAttache]
(AgentTaskPool-11:null) Processing Disconnect.
I transferred the host to KVM, and now the same SSVM/CPVM
images are
running fine for the last 30min ( so I assume it works
fine...).
Something seems to be wrong with the LXC side :S
Anyone wants to invest some time to troubleshoot? I'll
open a ticket also.
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
fgaudrea...@cloudops.com mailto:fgaudrea...@cloudops.com
514-629-6775 tel:514-629-6775
- - -
CloudOps
420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com http://www.cloudops.com
@CloudOps_
--
Francois Gaudreault
Architecte de Solution Cloud | Cloud Solutions Architect
