Re: Virtual Router Monitoring/Patching

[Remi Bergsma]

Hi,

For your information: This how we implemented the VPC syslog server feature:
https://github.com/MissionCriticalCloud/cosmic/pull/418

You don’t need to alter the template, it can be handled in the python code on 
the router itself.

However, I’m quite sure the patch doesn’t apply to CloudStack as-is. But maybe 
you could get some inspiration from it and ask your devs to implement it.

Regards,
Remi


On 09/10/2017, 15:42, "Alessandro Caviglione"  wrote:

Yes, this is what we need! :)
But... how can i do it?? :DDD

On Mon, Oct 9, 2017 at 3:32 PM, Rafael Weingärtner <
raf...@autonomiccs.com.br> wrote:

> Yes it is possible.
>
> We already did that, we direct all the logs to a remote log repository,
> and then using Graylog we present the information that is aggregated.
>
>
> On 10/9/2017 10:30 AM, Alessandro Caviglione wrote:
>
>> Hi,
>> I'm replying because I'm already interested in this topic.
>> In fact, we'd like to monitor VR and collect logs with rsyslog.
>> So, is it possible to modify the template image to configure an rsyslog
>> and
>> snmp to allow monitoring of all new deployed VR?
>>
>> Thank you.
>>
>> On Wed, Oct 4, 2017 at 5:10 PM, Dag Sonstebo 
>> wrote:
>>
>> Hi Alexander,
>>>
>>> As you point out the attack surface of the VRs have been minimised and
>>> the
>>> system VMs overall hardened.
>>> You have two issues with updating the software on the VRs – an update 
has
>>> the potential to break VR services (or agent services on SSVM/CPVM) as
>>> you
>>> already mentioned,  in addition any updates will obviously be lost the
>>> next
>>> time you restart a network with cleanup. You would also need to somehow
>>> automate the updates on new VRs.
>>>
>>> In general I would think most CloudStack users will wait for new system
>>> VM
>>> templates to be released – but interested in hearing other thoughts on
>>> this.
>>>
>>> Regards,
>>> Dag Sonstebo
>>> Cloud Architect
>>> ShapeBlue
>>>
>>> On 04/10/2017, 15:35, "Stock, Alexander" 
>>> wrote:
>>>
>>>  Hi all,
>>>
>>>  at the moment we try to improve our monitoring of the virtual
>>> routers
>>> in our environment.
>>>  For this we also monitor the update status of the machines and 
could
>>> see that there are some updates pending (OS Updates not Template
>>> Updates) .
>>>
>>>  So what would like to know is if you have some experience in 
pathing
>>> the virtual routers and if you have an update strategy for this
>>> (redundant
>>> router,etc..).
>>>  I am in worry that some updates could crash the services which are
>>> responsible for communication with the cloudstack controller.
>>>  I am also not sure if the attack surface is too small to don't 
worry
>>> about patching.
>>>
>>>  Any ideas or comments are welcome.
>>>  Thank you.
>>>  Alexander
>>>
>>>
>>>
>>>
>>> dag.sonst...@shapeblue.com
>>> www.shapeblue.com
>>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>>> @shapeblue
>>>
>>>
>>>
>>>
>>>
> --
> Rafael Weingärtner
>
>

Re: Network architecture

[Remi Bergsma]

Hi,

My advise is to make it as resilient as possible while keeping it simple. Using 
a single 10g nic towards primary storage means all your VMs will go down/are 
halted/risk corruption when the switch is rebooted for maintenance, or dies 
etc. I’d always use a mlag/port channel with 2x10G towards different switches. 
Then you can also use them active/active if your switches support it. We’re 
using Arista, and that can handle this well. Having redundancy on public 
without having redundancy on the backend doesn’t really help in my opinion.

Is there a specific reason to use XenServer? KVM is very mature these days and 
I’d recommend it over XenServer. I’ve hunderds of both running and in my 
experience KVM is faster on the same hardware and has less issues to deal with. 
XenServer will work, for sure. I just think KVM (for example on CentOS7) will 
give you a better experience.

Regards,
Remi



On 04/07/2017, 22:15, "Grégoire Lamodière"  wrote:

Dear All,

In the process of implementing a new CS advanced zone (4.9.2), I am 
wondering about the best network architecture to implement.
Any idea / advice would be highly appreciated.

1/ Each host has 4 networks adapters, 2 x 1 Gbe, 2 x 10 Gbe
2/ The PR Store is nfs based 10 Gbe
3/ The sec Store is nfs based 10 Gbe
4/ Maximum network offering is 1 Gbit to Internet
5/ Hypervisor Xen 7
6/ Hardware Hp Blade c7000

Right now, my choice would be :

1/ Bound the 2 gigabit networks cards and use the bound for mgmt + public
2/ Use 1 10Gbe for storage network (operations on sec Store)
3/ Use 1 10 Gbe for guest traffic (and pr store traffic by design)

This architecture sounds good in terms of performance (using 10 Gbe where 
it makes sense, redundancy on mgmt + public with bound).

Another option would be to bound the 2 10 Gbe interfaces, and use Xen Label 
to manage Storage and guest on the same physical network. This choice would 
give us faileover on storage and guest traffic, but I am wondering if 
performances would be badly affected.

Do you have any feedback on this ?

Thanks all.

Best Regards.

---
Grégoire Lamodière
T/ + 33 6 76 27 03 31
F/ + 33 1 75 43 89 71

Re: Xenserver 6.5 live migration with local volumes

[Remi Bergsma]

FYI testing this patch as it seems related to the issue I observe: 
https://github.com/apache/cloudstack/pull/925

Regards, Remi 

Sent from my iPhone

> On 26 Jun 2016, at 17:41, Remi Bergsma <rberg...@schubergphilis.com> wrote:
> 
> This is about xenserver 6.5. 
> 
> Regards, Remi 
> 
> Sent from my iPhone
> 
>> On 26 Jun 2016, at 14:14, Will Stevens <williamstev...@gmail.com> wrote:
>> 
>> Which hypervisor are you using?
>>> On Jun 26, 2016 2:00 AM, "Remi Bergsma" <rberg...@schubergphilis.com> wrote:
>>> 
>>> Hi Makrand,
>>> 
>>> Thanks for the info. What I want is migrate a VM from one cluster (with
>>> cluster scope shared storage) to another one. The UI / API allows that (it
>>> says: storage migration required) but it doesn't work. The goal is to
>>> consolidate two half empty clusters into one and then reprovison the empty
>>> one.
>>> 
>>> I was wondering whether others know this feature even works in which case
>>> my issue might be a local config issue or so.
>>> 
>>> I'll try to reproduce in a test setup so that I can hook in the debugger
>>> and see what's going on.
>>> 
>>> If there are tips please let me know :-)
>>> 
>>> Thanks, Remi
>>> 
>>> Sent from my iPhone
>>> 
>>>> On 25 Jun 2016, at 17:41, Makrand <makrandsa...@gmail.com> wrote:
>>>> 
>>>> Hi Remi,
>>>> 
>>>> If you're talking about common storage for all clusters, then its Zone
>>> wide
>>>> primary storage. I think it works pretty well, only if the new created VM
>>>> have disks already created on same new storage.
>>>> 
>>>> With my previous employer, we rolled out zonewide primary (with cluster
>>>> level primary setup already in place) and it worked pretty good once we
>>>> vmotioned VMs from *cluster primary* to *Zone wide primary* and updated
>>> DB
>>>> (storage & volumes tables). (We eventually ditched Cluster primary).
>>>> 
>>>> --
>>>> Best,
>>>> Makrand
>>>> 
>>>> 
>>>> On Fri, Jun 24, 2016 at 7:31 PM, Remi Bergsma <
>>> rberg...@schubergphilis.com>
>>>> wrote:
>>>> 
>>>>> Hi Anshul,
>>>>> 
>>>>> Thanks! Did you ever try live migrating from CloudStack with storage
>>>>> between clusters? I can't get that to work. I'll collect some details in
>>>>> the next days but was wondering if it was supposed to work.
>>>>> 
>>>>> Regards, Remi
>>>>> 
>>>>> Sent from my iPhone
>>>>> 
>>>>>>> On 24 Jun 2016, at 06:30, Anshul Gangwar <
>>> anshul.gang...@accelerite.com>
>>>>>> wrote:
>>>>>> 
>>>>>> Created the PR https://github.com/apache/cloudstack/pull/1596.
>>>>>> 
>>>>>> Regards,
>>>>>> Anshul
>>>>>> 
>>>>>> On 24/06/16, 2:33 AM, "Dave Garbus" <davegar...@spiceworks.com> wrote:
>>>>>> 
>>>>>> Is there anybody that wants to take this on?
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> - Dave
>>>>>> 
>>>>>>> On May 24, 2016, at 10:57 AM, Dave Garbus <davegar...@spiceworks.com>
>>>>> wrote:
>>>>>>> 
>>>>>>> I updated the issue referenced in this email (
>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9353) to include
>>>>> CloudStack 4.8 as an affected version. If we could at least get someone
>>>>> assigned to it, that’d be a good start.
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> 
>>>>>>> - Dave
>>>>>>> 
>>>>>>> On May 24, 2016, at 9:42 AM, Ivan Derbenev <
>>>>> ivan.derbe...@tech-corps.com<mailto:ivan.derbe...@tech-corps.com>>
>>> wrote:
>>>>>>> 
>>>>>>> Is there a way I can fix this on my installation, without recompiling
>>>>> jar files?
>>>>>>> 
>>>>>>> Regards,
>>>>>>> IT engineer
>>>>>>> Farheap, Russia
>>>>>>> Ivan Derbenev
>>>>>>> 
>>>>>&

Re: Xenserver 6.5 live migration with local volumes

[Remi Bergsma]

This is about xenserver 6.5. 

Regards, Remi 

Sent from my iPhone

> On 26 Jun 2016, at 14:14, Will Stevens <williamstev...@gmail.com> wrote:
> 
> Which hypervisor are you using?
>> On Jun 26, 2016 2:00 AM, "Remi Bergsma" <rberg...@schubergphilis.com> wrote:
>> 
>> Hi Makrand,
>> 
>> Thanks for the info. What I want is migrate a VM from one cluster (with
>> cluster scope shared storage) to another one. The UI / API allows that (it
>> says: storage migration required) but it doesn't work. The goal is to
>> consolidate two half empty clusters into one and then reprovison the empty
>> one.
>> 
>> I was wondering whether others know this feature even works in which case
>> my issue might be a local config issue or so.
>> 
>> I'll try to reproduce in a test setup so that I can hook in the debugger
>> and see what's going on.
>> 
>> If there are tips please let me know :-)
>> 
>> Thanks, Remi
>> 
>> Sent from my iPhone
>> 
>>> On 25 Jun 2016, at 17:41, Makrand <makrandsa...@gmail.com> wrote:
>>> 
>>> Hi Remi,
>>> 
>>> If you're talking about common storage for all clusters, then its Zone
>> wide
>>> primary storage. I think it works pretty well, only if the new created VM
>>> have disks already created on same new storage.
>>> 
>>> With my previous employer, we rolled out zonewide primary (with cluster
>>> level primary setup already in place) and it worked pretty good once we
>>> vmotioned VMs from *cluster primary* to *Zone wide primary* and updated
>> DB
>>> (storage & volumes tables). (We eventually ditched Cluster primary).
>>> 
>>> --
>>> Best,
>>> Makrand
>>> 
>>> 
>>> On Fri, Jun 24, 2016 at 7:31 PM, Remi Bergsma <
>> rberg...@schubergphilis.com>
>>> wrote:
>>> 
>>>> Hi Anshul,
>>>> 
>>>> Thanks! Did you ever try live migrating from CloudStack with storage
>>>> between clusters? I can't get that to work. I'll collect some details in
>>>> the next days but was wondering if it was supposed to work.
>>>> 
>>>> Regards, Remi
>>>> 
>>>> Sent from my iPhone
>>>> 
>>>>>> On 24 Jun 2016, at 06:30, Anshul Gangwar <
>> anshul.gang...@accelerite.com>
>>>>> wrote:
>>>>> 
>>>>> Created the PR https://github.com/apache/cloudstack/pull/1596.
>>>>> 
>>>>> Regards,
>>>>> Anshul
>>>>> 
>>>>> On 24/06/16, 2:33 AM, "Dave Garbus" <davegar...@spiceworks.com> wrote:
>>>>> 
>>>>> Is there anybody that wants to take this on?
>>>>> 
>>>>> Thanks,
>>>>> 
>>>>> - Dave
>>>>> 
>>>>>> On May 24, 2016, at 10:57 AM, Dave Garbus <davegar...@spiceworks.com>
>>>> wrote:
>>>>>> 
>>>>>> I updated the issue referenced in this email (
>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9353) to include
>>>> CloudStack 4.8 as an affected version. If we could at least get someone
>>>> assigned to it, that’d be a good start.
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> - Dave
>>>>>> 
>>>>>> On May 24, 2016, at 9:42 AM, Ivan Derbenev <
>>>> ivan.derbe...@tech-corps.com<mailto:ivan.derbe...@tech-corps.com>>
>> wrote:
>>>>>> 
>>>>>> Is there a way I can fix this on my installation, without recompiling
>>>> jar files?
>>>>>> 
>>>>>> Regards,
>>>>>> IT engineer
>>>>>> Farheap, Russia
>>>>>> Ivan Derbenev
>>>>>> 
>>>>>> -Original Message-
>>>>>> From: Koushik Das [mailto:koushik@accelerite.com]
>>>>>> Sent: Tuesday, May 24, 2016 2:06 PM
>>>>>> To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
>>>>>> Subject: Re: Xenserver 6.5 live migration with local volumes
>>>>>> 
>>>>>> This is a product bug and needs to be fixed. There is some
>>>> serialization issue that needs fixing.
>>>>>> 
>>>>>> In the below code volumeToFiler is null as Map is not a serializable
>>>> type. It needs to

Re: Xenserver 6.5 live migration with local volumes

[Remi Bergsma]

Hi Makrand,

Thanks for the info. What I want is migrate a VM from one cluster (with cluster 
scope shared storage) to another one. The UI / API allows that (it says: 
storage migration required) but it doesn't work. The goal is to consolidate two 
half empty clusters into one and then reprovison the empty one. 

I was wondering whether others know this feature even works in which case my 
issue might be a local config issue or so. 

I'll try to reproduce in a test setup so that I can hook in the debugger and 
see what's going on. 

If there are tips please let me know :-)

Thanks, Remi 

Sent from my iPhone

> On 25 Jun 2016, at 17:41, Makrand <makrandsa...@gmail.com> wrote:
> 
> Hi Remi,
> 
> If you're talking about common storage for all clusters, then its Zone wide
> primary storage. I think it works pretty well, only if the new created VM
> have disks already created on same new storage.
> 
> With my previous employer, we rolled out zonewide primary (with cluster
> level primary setup already in place) and it worked pretty good once we
> vmotioned VMs from *cluster primary* to *Zone wide primary* and updated DB
> (storage & volumes tables). (We eventually ditched Cluster primary).
> 
> --
> Best,
> Makrand
> 
> 
> On Fri, Jun 24, 2016 at 7:31 PM, Remi Bergsma <rberg...@schubergphilis.com>
> wrote:
> 
>> Hi Anshul,
>> 
>> Thanks! Did you ever try live migrating from CloudStack with storage
>> between clusters? I can't get that to work. I'll collect some details in
>> the next days but was wondering if it was supposed to work.
>> 
>> Regards, Remi
>> 
>> Sent from my iPhone
>> 
>>>> On 24 Jun 2016, at 06:30, Anshul Gangwar <anshul.gang...@accelerite.com>
>>> wrote:
>>> 
>>> Created the PR https://github.com/apache/cloudstack/pull/1596.
>>> 
>>> Regards,
>>> Anshul
>>> 
>>> On 24/06/16, 2:33 AM, "Dave Garbus" <davegar...@spiceworks.com> wrote:
>>> 
>>> Is there anybody that wants to take this on?
>>> 
>>> Thanks,
>>> 
>>> - Dave
>>> 
>>>> On May 24, 2016, at 10:57 AM, Dave Garbus <davegar...@spiceworks.com>
>> wrote:
>>>> 
>>>> I updated the issue referenced in this email (
>> https://issues.apache.org/jira/browse/CLOUDSTACK-9353) to include
>> CloudStack 4.8 as an affected version. If we could at least get someone
>> assigned to it, that’d be a good start.
>>>> 
>>>> Thanks,
>>>> 
>>>> - Dave
>>>> 
>>>> On May 24, 2016, at 9:42 AM, Ivan Derbenev <
>> ivan.derbe...@tech-corps.com<mailto:ivan.derbe...@tech-corps.com>> wrote:
>>>> 
>>>> Is there a way I can fix this on my installation, without recompiling
>> jar files?
>>>> 
>>>> Regards,
>>>> IT engineer
>>>> Farheap, Russia
>>>> Ivan Derbenev
>>>> 
>>>> -Original Message-
>>>> From: Koushik Das [mailto:koushik@accelerite.com]
>>>> Sent: Tuesday, May 24, 2016 2:06 PM
>>>> To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
>>>> Subject: Re: Xenserver 6.5 live migration with local volumes
>>>> 
>>>> This is a product bug and needs to be fixed. There is some
>> serialization issue that needs fixing.
>>>> 
>>>> In the below code volumeToFiler is null as Map is not a serializable
>> type. It needs to be replaced with getVolumeToFilerAsList() and then the
>> data needs to be read appropriately.
>>>> 
>>>> final Map<VolumeTO, StorageFilerTO> volumeToFiler =
>> command.getVolumeToFiler();
>>>> 
>>>> -Koushik
>>>> 
>>>> On 24/05/16, 3:23 PM, "Ivan Derbenev" <ivan.derbe...@tech-corps.com
>> <mailto:ivan.derbe...@tech-corps.com>> wrote:
>>>> 
>>>> Hello!
>>>> After the migration onto XS 6.5 (and installing all the updates) and CS
>>>> 4.8 I can't migrate VMs with Local Storage
>>>> 
>>>> The issue is similar to this:
>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9353, but it doesn't
>> have any solutions Any ideas?
>>>> 
>>>> Errors:
>>>> 
>>>> 2016-05-24 12:10:16,440 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-26:ctx-ab4250ff) (logid:4fa92c13) Done with process
>>>> of VM state report. host: 136592
>>>> 2016-05-24 12:10:16,450 

Re: Xenserver 6.5 live migration with local volumes

[Remi Bergsma]

Hi Anshul,

Thanks! Did you ever try live migrating from CloudStack with storage between 
clusters? I can't get that to work. I'll collect some details in the next days 
but was wondering if it was supposed to work. 

Regards, Remi 

Sent from my iPhone

> On 24 Jun 2016, at 06:30, Anshul Gangwar  
> wrote:
> 
> Created the PR https://github.com/apache/cloudstack/pull/1596. 
> 
> Regards,
> Anshul 
> 
> On 24/06/16, 2:33 AM, "Dave Garbus"  wrote:
> 
> Is there anybody that wants to take this on?
> 
> Thanks,
> 
> - Dave
> 
>> On May 24, 2016, at 10:57 AM, Dave Garbus  wrote:
>> 
>> I updated the issue referenced in this email 
>> (https://issues.apache.org/jira/browse/CLOUDSTACK-9353) to include 
>> CloudStack 4.8 as an affected version. If we could at least get someone 
>> assigned to it, that’d be a good start.
>> 
>> Thanks,
>> 
>> - Dave
>> 
>> On May 24, 2016, at 9:42 AM, Ivan Derbenev 
>> > wrote:
>> 
>> Is there a way I can fix this on my installation, without recompiling jar 
>> files?
>> 
>> Regards,
>> IT engineer
>> Farheap, Russia
>> Ivan Derbenev
>> 
>> -Original Message-
>> From: Koushik Das [mailto:koushik@accelerite.com]
>> Sent: Tuesday, May 24, 2016 2:06 PM
>> To: users@cloudstack.apache.org
>> Subject: Re: Xenserver 6.5 live migration with local volumes
>> 
>> This is a product bug and needs to be fixed. There is some serialization 
>> issue that needs fixing.
>> 
>> In the below code volumeToFiler is null as Map is not a serializable type. 
>> It needs to be replaced with getVolumeToFilerAsList() and then the data 
>> needs to be read appropriately.
>> 
>>  final Map volumeToFiler = 
>> command.getVolumeToFiler();
>> 
>> -Koushik
>> 
>> On 24/05/16, 3:23 PM, "Ivan Derbenev" 
>> > wrote:
>> 
>> Hello!
>> After the migration onto XS 6.5 (and installing all the updates) and CS
>> 4.8 I can't migrate VMs with Local Storage
>> 
>> The issue is similar to this:
>> https://issues.apache.org/jira/browse/CLOUDSTACK-9353, but it doesn't have 
>> any solutions Any ideas?
>> 
>> Errors:
>> 
>> 2016-05-24 12:10:16,440 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>> (DirectAgentCronJob-26:ctx-ab4250ff) (logid:4fa92c13) Done with process
>> of VM state report. host: 136592
>> 2016-05-24 12:10:16,450 DEBUG [c.c.h.x.r.CitrixResourceBase]
>> (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Looking for network
>> named cloud-main
>> 2016-05-24 12:10:16,466 DEBUG [c.c.h.x.r.XsLocalNetwork]
>> (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Found a network called
>> cloud-main on host=10.7.130.103;
>> Network=9632020b-4d98-1bed-9ae8-477e0993cab0;
>> pif=3c7d1121-2bde-26cf-9478-18e51ffca75f
>> 2016-05-24 12:10:16,477 DEBUG [c.c.h.x.r.CitrixResourceBase]
>> (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Creating VLAN 1007 on
>> host 10.7.130.103 on device eth0
>> 2016-05-24 12:10:17,163 DEBUG [c.c.h.x.r.CitrixResourceBase]
>> (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) VLAN is created for
>> 1007.  The uuid is ec053fee-0426-9665-150a-77399562196b
>> 2016-05-24 12:10:17,170 WARN
>> [c.c.h.x.r.w.x.XenServer610MigrateWithStorageCommandWrapper] 
>> (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Catch Exception 
>> java.lang.NullPointerException. Storage motion failed due to 
>> java.lang.NullPointerException java.lang.NullPointerException
>> at 
>> com.cloud.hypervisor.xenserver.resource.wrapper.xen610.XenServer610MigrateWithStorageCommandWrapper.execute(XenServer610MigrateWithStorageCommandWrapper.java:86)
>> at 
>> com.cloud.hypervisor.xenserver.resource.wrapper.xen610.XenServer610MigrateWithStorageCommandWrapper.execute(XenServer610MigrateWithStorageCommandWrapper.java:54)
>> at 
>> com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequestWrapper.execute(CitrixRequestWrapper.java:122)
>> at 
>> com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:1677)
>> at 
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315)
>> at 
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>> at 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>> at 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>> at 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>> at 
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>> at 
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at 

Re: Failing to enable SSL/HTTPS on console proxy vm

[Remi Bergsma]

Yes, it is.

On 16/06/16 18:51, "Will Stevens"  wrote:

>That's in global settings I presume?
>On Jun 16, 2016 12:19 PM, "Nux!"  wrote:
>
>> Dammit, I was missing the consoleproxy.url.domain! What an idiot ...
>> Works just fine now.
>>
>> Will, it can be done, don't give up! :)
>>
>> Thanks Andy!
>>
>> Lucian
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> - Original Message -
>> > From: "Andy Dills" 
>> > To: users@cloudstack.apache.org
>> > Cc: d...@cloudstack.apache.org
>> > Sent: Thursday, 16 June, 2016 17:10:55
>> > Subject: Re: Failing to enable SSL/HTTPS on console proxy vm
>>
>> > I have this working perfectly.
>> >
>> > Couple of key things that are not mentioned in the
>> > documentation:
>> >
>> > - You need to set consoleproxy.url.domain to *.domain.com for whatever
>> domain
>> > you're using. Do this before re-uploading your SSL certificate. The SSL
>> upload
>> > dialogue doesn't set this value as it should.
>> >
>> > - You need a wildcard certificate for that domain.
>> >
>> > Assuming you setup the proper DNS records, it should then work.
>> >
>> > I'm open to follow up questions if anybody is struggling with this.
>> >
>> > Thanks,
>> > Andy
>> >
>> > Sent from my iPhone
>> >
>> >> On Jun 16, 2016, at 12:01 PM, Will Stevens 
>> wrote:
>> >>
>> >> We have been having issues with this for as long as I can remember (on
>> both
>> >> ACS and CCP).  In order to get it to work you have to 'trust unsafe
>> >> scripts' or whatever by clicking the shield in the URL bar in the top
>> right
>> >> (maybe that is chrome).
>> >>
>> >> I don't know that there is a solution, but if there is, I am all ears...
>> >>
>> >> *Will STEVENS*
>> >> Lead Developer
>> >>
>> >> *CloudOps* *| *Cloud Solutions Experts
>> >> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
>> >> w cloudops.com *|* tw @CloudOps_
>> >>
>> >>> On Thu, Jun 16, 2016 at 11:54 AM, Nux!  wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> Is there any particular voodoo involved in getting the $subject to work
>> >>> correctly on 4.8.0?
>> >>> I've uploaded the Comodo wildcard cabundle, crt and key in the
>> >>> Infrastructure page, the systemvms have rebooted.
>> >>> They came back fine and nothing dodgy in the logs, but when I open the
>> >>> console of a VM Firefox will say there are insecure contents loaded and
>> >>> will not display the terminal ajax thingy.
>> >>> View source shoes an iframe linking http://1.2.3.4 instead of
>> >>> https://1-2-3-4.wildcarddomain.tld.
>> >>>
>> >>> Apache HTTPD and Tomcat had no issues with these certs.
>> >>>
>> >>> Is there something that I am missing?
>> >>>
>> >>> Thanks
>> >>>
>> >>>
>> >>> --
>> >>> Sent from the Delta quadrant using Borg technology!
>> >>>
>> >>> Nux!
>> >>> www.nux.ro
>>

Re: XenServer nested on XenServer

[Remi Bergsma]

Hi Paul,

I don’t get it but that’s probably me :-) Never mind.

Regards,
Remi

On 13/06/16 16:00, "Paul Angus" <paul.an...@shapeblue.com> wrote:

>Remi,
>
>I think asking for the details for Maruko San's networking in order to give 
>him (hopefully) useful specific help covered that part.
>
>Haters gonna hate.
>Paul Angus
>
>paul.an...@shapeblue.com 
>www.shapeblue.com
>53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>@shapeblue
>
>
>
>-Original Message-
>From: Remi Bergsma [mailto:rberg...@schubergphilis.com] 
>Sent: 13 June 2016 14:26
>To: users@cloudstack.apache.org
>Subject: Re: XenServer nested on XenServer
>
>I kinda like shameless self-plugs although I fail to see how this one answers 
>the question asked?
>
>On 13/06/16 14:09, "Paul Angus" <paul.an...@shapeblue.com> wrote:
>
>>Hi Maruko San
>>
>>We'd need to see the details of your networking.  
>>We've created Trillian   github.com/shapeblue/Trillian - it's based on ESXi 
>>and uses CloudStack to orchestrate everything.
>>
>>
>>
>>Kind regards,
>>
>>Paul Angus
>>
>>paul.an...@shapeblue.com
>>www.shapeblue.com
>>53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>>
>>
>>
>>-Original Message-
>>From: 丸子良太 / MARUKO，RYOTA [mailto:ryota.maruko...@hitachi-solutions.com] 
>>Sent: 13 June 2016 07:53
>>To: users@cloudstack.apache.org
>>Subject: XenServer nested on XenServer
>>
>>Hi
>>
>>I tried to create XenServer nested on XenServer for CloudStack.
>>It is success to create XenServer nested on XenServer, And CloudStack Manager 
>>create the system VMs.
>>
>>But VR could not access the user VMs.
>>
>>Please tell me about the problem.
>>
>>Regards
>>
>

Re: XenServer nested on XenServer

[Remi Bergsma]

I kinda like shameless self-plugs although I fail to see how this one answers 
the question asked?

On 13/06/16 14:09, "Paul Angus"  wrote:

>Hi Maruko San
>
>We'd need to see the details of your networking.  
>We've created Trillian   github.com/shapeblue/Trillian - it's based on ESXi 
>and uses CloudStack to orchestrate everything.
>
>
>
>Kind regards,
>
>Paul Angus
>
>paul.an...@shapeblue.com 
>www.shapeblue.com
>53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>@shapeblue
>
>
>
>-Original Message-
>From: 丸子良太 / MARUKO，RYOTA [mailto:ryota.maruko...@hitachi-solutions.com] 
>Sent: 13 June 2016 07:53
>To: users@cloudstack.apache.org
>Subject: XenServer nested on XenServer
>
>Hi
>
>I tried to create XenServer nested on XenServer for CloudStack.
>It is success to create XenServer nested on XenServer, And CloudStack Manager 
>create the system VMs.
>
>But VR could not access the user VMs.
>
>Please tell me about the problem.
>
>Regards
>

Re: 4.8.0 install fails with tomcat files missing

[Remi Bergsma]

Hi Ron,

As far as I know Tomcat7 is not by default included in CentOS 6. It is the 
default in CentOS 7. It’s probably best to document both.

Tomcat is a package dependency, and not shipped with CloudStack. The package of 
CloudStack 4.8 for CentOS 6 depends on Tomcat6, the one for CentOS 7 depends on 
Tomcat 7.

Regards, Remi



On 12/06/16 03:55, "Ron Wheeler" <rwhee...@artifact-software.com> wrote:

>You were exactly right and --tomcat7 solved the problem.
>In fact there was a small note on the CentOS 6.5 quick start 
>documentation that this flag could be used.
>I was using this as a Guide but was altering my actions to handle CentOS 7.
>
>I am not sure that this should be optional since 4.8.0 seems to include 
>Tomcat 7 so you really do not have an option of using another version if 
>you use the Quick Start Guide.
>It should be the default for the CentOS 6.5 Quick Install since there is 
>no other version of Tomcat involved.
>
>In the docs, 
>http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.8/qig.html
> 
>the option should be in the command shown in the code figure since it is 
>for a very specific setup - CentOS 6 and the stock 4.8.x distribution.
>
>Thanks for your help.
>
>Ron
>
>
>On 11/06/2016 7:11 AM, Remi Bergsma wrote:
>> Hi Ron,
>>
>> There's a flag to run the setup mgt script to support tomcat7. Can't 
>> remember its exact naming (am on a phone now). Something like --tomcat7 or 
>> --centos7 or so. That should work.
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>>> On 10 Jun 2016, at 23:04, Ron Wheeler <rwhee...@artifact-software.com> 
>>> wrote:
>>>
>>> I had cloudstack 4.5.2 installed and running at one point on CentOS7.
>>>
>>> After updating a lot of packages including the kernel, it stopped working.
>>>
>>> I uninstalled the old cloudstack - deleted the database and installed  
>>> 4.8.0. It did not work.
>>>
>>> I found out that the uninstall did not actually remove very many files.
>>>
>>> I uninstalled 4.8.0 and deleted the cloudstack folders on /etc and 
>>> usr/share, deleted the database and started again.
>>>
>>> Seemed OK until cloudstack-setup-management.
>>>
>>> "Cannot find /etc/cloudstack/management/server-nonssl.xml or 
>>> /etc/cloudstack/management/tomcat6-nonssl.conf, https enable failed"
>>>
>>> Sure enough there are no such files and I recall on the older setup that 
>>> there were links from /etc/ to /user/share.
>>>
>>> There are no instructions about setting these up manually and I would have 
>>> thought that the install would have done this.
>>>
>>> Did I miss something?
>>>
>>> Console output:
>>>
>>> CloudStack has successfully initialized database, you can check your 
>>> database configuration in /etc/cloudstack/management/db.properties
>>>
>>> [root@vserver1 management]# cloudstack-setup-management
>>> Starting to configure CloudStack Management Server:
>>> Configure Firewall ...[OK]
>>> Configure CloudStack Management Server ...[Failed]
>>> Cannot find /etc/cloudstack/management/server-nonssl.xml or 
>>> /etc/cloudstack/management/tomcat6-nonssl.conf, https enable failed
>>> Try to restore your system:
>>> Restore Firewall ...  [OK]
>>> Restore CloudStack Management Server ...[OK]
>>>
>>> [root@vserver1 management]# cd /etc/cloudstack/management
>>> [root@vserver1 management]# ls
>>> Catalina catalina.properties  commons-logging.properties 
>>> environment.properties  key  server7-nonssl.xml tomcat-users.xml
>>> catalina.policy  classpath.conf   db.properties java.security.ciphers   
>>> log4j-cloud.xml  server7-ssl.xml web.xml
>>>
>>> [root@vserver1 management]# ls /usr/share/cloudstack-management/conf
>>> Catalina catalina.properties  commons-logging.properties 
>>> environment.properties  key  server7-nonssl.xml tomcat-users.xml
>>> catalina.policy  classpath.conf   db.properties java.security.ciphers   
>>> log4j-cloud.xml  server7-ssl.xml web.xml
>>>
>>>
>>>
>>> -- 
>>> Ron Wheeler
>>> President
>>> Artifact Software Inc
>>> email: rwhee...@artifact-software.com
>>> skype: ronaldmwheeler
>>> phone: 866-970-2435, ext 102
>>>
>
>
>-- 
>Ron Wheeler
>President
>Artifact Software Inc
>email: rwhee...@artifact-software.com
>skype: ronaldmwheeler
>phone: 866-970-2435, ext 102
>

Re: 4.8.0 install fails with tomcat files missing

[Remi Bergsma]

Hi Ron,

There's a flag to run the setup mgt script to support tomcat7. Can't remember 
its exact naming (am on a phone now). Something like --tomcat7 or --centos7 or 
so. That should work. 

Regards, Remi 

Sent from my iPhone

> On 10 Jun 2016, at 23:04, Ron Wheeler  wrote:
> 
> I had cloudstack 4.5.2 installed and running at one point on CentOS7.
> 
> After updating a lot of packages including the kernel, it stopped working.
> 
> I uninstalled the old cloudstack - deleted the database and installed  4.8.0. 
> It did not work.
> 
> I found out that the uninstall did not actually remove very many files.
> 
> I uninstalled 4.8.0 and deleted the cloudstack folders on /etc and usr/share, 
> deleted the database and started again.
> 
> Seemed OK until cloudstack-setup-management.
> 
> "Cannot find /etc/cloudstack/management/server-nonssl.xml or 
> /etc/cloudstack/management/tomcat6-nonssl.conf, https enable failed"
> 
> Sure enough there are no such files and I recall on the older setup that 
> there were links from /etc/ to /user/share.
> 
> There are no instructions about setting these up manually and I would have 
> thought that the install would have done this.
> 
> Did I miss something?
> 
> Console output:
> 
> CloudStack has successfully initialized database, you can check your database 
> configuration in /etc/cloudstack/management/db.properties
> 
> [root@vserver1 management]# cloudstack-setup-management
> Starting to configure CloudStack Management Server:
> Configure Firewall ...[OK]
> Configure CloudStack Management Server ...[Failed]
> Cannot find /etc/cloudstack/management/server-nonssl.xml or 
> /etc/cloudstack/management/tomcat6-nonssl.conf, https enable failed
> Try to restore your system:
> Restore Firewall ...  [OK]
> Restore CloudStack Management Server ...[OK]
> 
> [root@vserver1 management]# cd /etc/cloudstack/management
> [root@vserver1 management]# ls
> Catalina catalina.properties  commons-logging.properties 
> environment.properties  key  server7-nonssl.xml tomcat-users.xml
> catalina.policy  classpath.conf   db.properties java.security.ciphers   
> log4j-cloud.xml  server7-ssl.xml web.xml
> 
> [root@vserver1 management]# ls /usr/share/cloudstack-management/conf
> Catalina catalina.properties  commons-logging.properties 
> environment.properties  key  server7-nonssl.xml tomcat-users.xml
> catalina.policy  classpath.conf   db.properties java.security.ciphers   
> log4j-cloud.xml  server7-ssl.xml web.xml
> 
> 
> 
> -- 
> Ron Wheeler
> President
> Artifact Software Inc
> email: rwhee...@artifact-software.com
> skype: ronaldmwheeler
> phone: 866-970-2435, ext 102
> 

Re: regular disconnection every 2-3 mins on haproxy cloudstack mgmt server LB implementation

[Remi Bergsma]

You're welkome! Great to hear it now works :-)

Sent from my iPhone

> On 30 Apr 2016, at 23:13, Indra Pramana <in...@sg.or.id> wrote:
> 
> Hi Remi,
> 
> Many thanks for your tips! You are right indeed, by default haproxy has
> timeout set to 50 seconds (or 50,000ms). I changed it to 120 seconds (2
> minutes) and have monitored the agent connection and it's no longer
> flapping. Monitoring now and will let you know if there are any further
> issues.
> 
> On /etc/haproxy/haproxy.cfg, modify this under defaults section:
> 
>timeout client  12
>timeout server  12
>#timeout client  5
>#timeout server  5
> 
> and restart the haproxy service for the changes to take effect.
> 
> Again, many thanks Remi, greatly appreciated. :)
> 
> -ip-
> 
> 
> On Sun, May 1, 2016 at 4:30 AM, Remi Bergsma <rberg...@schubergphilis.com>
> wrote:
> 
>> Hi,
>> 
>> You may want to check if HAproxy keeps the connection open long enough.
>> The system vms send traffic every minute or so and you want haproxy to keep
>> the connection open longer than that. If haproxy is set to close idle
>> connections after say 30sec then this will result in flapping connections.
>> 
>> Regards, Remi
>> 
>> Sent from my iPhone
>> 
>>> On 30 Apr 2016, at 22:00, Indra Pramana <in...@sg.or.id> wrote:
>>> 
>>> Dear all,
>>> 
>>> We are running CloudStack 4.2.0 with KVM hypervisor and Ceph RBD storage.
>>> We implemented secondary CloudStack management server and haproxy load
>>> balancer, and tonight we changed our configuration so that the CloudStack
>>> agents will be connecting to the LB IP rather than the CS mgmt server
>>> directly.
>>> 
>>> However, we noted that the agent will be regularly disconnected every 2-3
>>> minutes. Here are the excerpts on the agent.log:
>>> 
>>> 
>>> 2016-05-01 01:30:10,982 DEBUG [utils.nio.NioConnection]
>>> (Agent-Selector:null) Location 1: Socket
>>> Socket[addr=/X.X.X.8,port=8250,localport=50613] closed on read.  Pro
>>> bably -1 returned: Connection closed with -1 on reading size.
>>> 2016-05-01 01:30:10,983 DEBUG [utils.nio.NioConnection]
>>> (Agent-Selector:null) Closing socket
>>> Socket[addr=/X.X.X.8,port=8250,localport=50613]
>>> 2016-05-01 01:30:10,983 DEBUG [cloud.agent.Agent] (Agent-Handler-3:null)
>>> Clearing watch list: 2
>>> 2016-05-01 01:30:15,984 INFO  [cloud.agent.Agent] (Agent-Handler-3:null)
>>> Lost connection to the server. Dealing with the remaining commands...
>>> 2016-05-01 01:30:20,985 INFO  [cloud.agent.Agent] (Agent-Handler-3:null)
>>> Reconnecting...
>>> 2016-05-01 01:30:20,986 INFO  [utils.nio.NioClient] (Agent-Selector:null)
>>> Connecting to X.X.X.8:8250
>>> 2016-05-01 01:30:21,101 INFO  [utils.nio.NioClient] (Agent-Selector:null)
>>> SSL: Handshake done
>>> 2016-05-01 01:30:21,101 INFO  [utils.nio.NioClient] (Agent-Selector:null)
>>> Connected to X.X.X.8:8250
>>> 2016-05-01 01:30:21,133 DEBUG [kvm.resource.LibvirtCapXMLParser]
>>> (Agent-Handler-1:null) Found /usr/bin/kvm as a suiteable emulator
>>> 2016-05-01 01:30:21,134 DEBUG [kvm.resource.LibvirtComputingResource]
>>> (Agent-Handler-1:null) Executing: /bin/bash -c qemu-img --help|grep
>> convert
>>> 2016-05-01 01:30:21,152 DEBUG [kvm.resource.LibvirtComputingResource]
>>> (Agent-Handler-1:null) Execution is successful.
>>> 2016-05-01 01:30:21,152 DEBUG [kvm.resource.LibvirtComputingResource]
>>> (Agent-Handler-1:null)   convert [-c] [-p] [-q] [-n] [-f fmt] [-t cache]
>>> [-T src_cache] [-O output
>>> _fmt] [-o options] [-s snapshot_id_or_name] [-l snapshot_param] [-S
>>> sparse_size] filename [filename2 [...]] output_filename
>>>   options are: 'none', 'writeback' (default, except for convert),
>>> 'writethrough',
>>>   'directsync' and 'unsafe' (default for convert)
>>> 
>>> 
>>> and then it will reconnected again, and then got disconnected again, etc.
>>> It will continue on that loop.
>>> 
>>> haproxy.cfg configuration for the NIC facing the hypervisors:
>>> 
>>> 
>>> listen cloudstack_systemvm_8250
>>> bind X.X.X.8:8250
>>> mode tcp
>>> option tcplog
>>> balance source
>>> server management-server-01.xxx.com X.X.X.3:8250 maxconn 32 check
>>> server management-server-02.xxx.com X.X.X.6:8250 maxconn 32 check
>>> 
>>> 
>>> Note 

Re: regular disconnection every 2-3 mins on haproxy cloudstack mgmt server LB implementation

[Remi Bergsma]

Hi,

You may want to check if HAproxy keeps the connection open long enough. The 
system vms send traffic every minute or so and you want haproxy to keep the 
connection open longer than that. If haproxy is set to close idle connections 
after say 30sec then this will result in flapping connections. 

Regards, Remi 

Sent from my iPhone

> On 30 Apr 2016, at 22:00, Indra Pramana  wrote:
> 
> Dear all,
> 
> We are running CloudStack 4.2.0 with KVM hypervisor and Ceph RBD storage.
> We implemented secondary CloudStack management server and haproxy load
> balancer, and tonight we changed our configuration so that the CloudStack
> agents will be connecting to the LB IP rather than the CS mgmt server
> directly.
> 
> However, we noted that the agent will be regularly disconnected every 2-3
> minutes. Here are the excerpts on the agent.log:
> 
> 
> 2016-05-01 01:30:10,982 DEBUG [utils.nio.NioConnection]
> (Agent-Selector:null) Location 1: Socket
> Socket[addr=/X.X.X.8,port=8250,localport=50613] closed on read.  Pro
> bably -1 returned: Connection closed with -1 on reading size.
> 2016-05-01 01:30:10,983 DEBUG [utils.nio.NioConnection]
> (Agent-Selector:null) Closing socket
> Socket[addr=/X.X.X.8,port=8250,localport=50613]
> 2016-05-01 01:30:10,983 DEBUG [cloud.agent.Agent] (Agent-Handler-3:null)
> Clearing watch list: 2
> 2016-05-01 01:30:15,984 INFO  [cloud.agent.Agent] (Agent-Handler-3:null)
> Lost connection to the server. Dealing with the remaining commands...
> 2016-05-01 01:30:20,985 INFO  [cloud.agent.Agent] (Agent-Handler-3:null)
> Reconnecting...
> 2016-05-01 01:30:20,986 INFO  [utils.nio.NioClient] (Agent-Selector:null)
> Connecting to X.X.X.8:8250
> 2016-05-01 01:30:21,101 INFO  [utils.nio.NioClient] (Agent-Selector:null)
> SSL: Handshake done
> 2016-05-01 01:30:21,101 INFO  [utils.nio.NioClient] (Agent-Selector:null)
> Connected to X.X.X.8:8250
> 2016-05-01 01:30:21,133 DEBUG [kvm.resource.LibvirtCapXMLParser]
> (Agent-Handler-1:null) Found /usr/bin/kvm as a suiteable emulator
> 2016-05-01 01:30:21,134 DEBUG [kvm.resource.LibvirtComputingResource]
> (Agent-Handler-1:null) Executing: /bin/bash -c qemu-img --help|grep convert
> 2016-05-01 01:30:21,152 DEBUG [kvm.resource.LibvirtComputingResource]
> (Agent-Handler-1:null) Execution is successful.
> 2016-05-01 01:30:21,152 DEBUG [kvm.resource.LibvirtComputingResource]
> (Agent-Handler-1:null)   convert [-c] [-p] [-q] [-n] [-f fmt] [-t cache]
> [-T src_cache] [-O output
> _fmt] [-o options] [-s snapshot_id_or_name] [-l snapshot_param] [-S
> sparse_size] filename [filename2 [...]] output_filename
>options are: 'none', 'writeback' (default, except for convert),
> 'writethrough',
>'directsync' and 'unsafe' (default for convert)
> 
> 
> and then it will reconnected again, and then got disconnected again, etc.
> It will continue on that loop.
> 
> haproxy.cfg configuration for the NIC facing the hypervisors:
> 
> 
> listen cloudstack_systemvm_8250
> bind X.X.X.8:8250
> mode tcp
> option tcplog
> balance source
> server management-server-01.xxx.com X.X.X.3:8250 maxconn 32 check
> server management-server-02.xxx.com X.X.X.6:8250 maxconn 32 check
> 
> 
> Note that .3 and .6 are the first and second CloudStack management servers
> respectively, while .8 is the IP of the load balancer. We are using one LB
> at the moment.
> 
> Nothing much is found on the haproxy.log, see below.
> 
> 
> May  1 01:14:41 cs-haproxy-02 haproxy[923]: X.X.X.28:50401
> [01/May/2016:01:12:50.803] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/110340 8584 cD
> 0/0/0/0/0 0/0
> May  1 01:15:46 cs-haproxy-02 haproxy[923]: X.X.X.28:50402
> [01/May/2016:01:14:51.150] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/54920 8234 cD
> 0/0/0/0/0 0/0
> May  1 01:16:47 cs-haproxy-02 haproxy[923]: X.X.X.28:50403
> [01/May/2016:01:15:56.075] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/51344 7868 cD
> 0/0/0/0/0 0/0
> May  1 01:17:48 cs-haproxy-02 haproxy[923]: X.X.X.28:50404
> [01/May/2016:01:16:57.426] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/50854 7630 cD
> 0/0/0/0/0 0/0
> May  1 01:18:49 cs-haproxy-02 haproxy[923]: X.X.X.28:50405
> [01/May/2016:01:17:58.285] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/50955 7630 cD
> 0/0/0/0/0 0/0
> May  1 01:24:49 cs-haproxy-02 haproxy[923]: X.X.X.28:50406
> [01/May/2016:01:18:59.245] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/350361 14638 cD
> 0/0/0/0/0 0/0
> May  1 01:28:00 cs-haproxy-02 haproxy[923]: X.X.X.28:50571
> [01/May/2016:01:27:09.638] cloudstack_systemvm_8250
> cloudstack_systemvm_8250/management-server-01.xxx.com 1/0/50602 2852 cD
> 0/0/0/0/0 0/0
> May  1 01:30:11 cs-haproxy-02 haproxy[923]: X.X.X.28:50613
> [01/May/2016:01:29:20.260] cloudstack_systemvm_8250
> 

Re: Cloudstack 4.7 password reset issue - resolved.

[Remi Bergsma]

Hi Richard,

Great you fixed it! Can you send the patch of your fix as a spul request on 
github?

Required upgrade is yes when the router reports a version older than the 
minreq.sysvm.version (or similar) global setting. It's used to upgrade systemvm 
templates. 

Regards, Remi 

Sent from my iPhone

> On 13 Apr 2016, at 22:23, Richard Klein (RSI)  wrote:
> 
> I finally found the problem and resolved the issue.  The problem was in the 
> Python code change I made.  I had a flag variable that indicated to save data 
> when it was changed while processing a list.  This worked fine as long as it 
> executed the logic and defined the flag variable.  The problem was during 
> startup when it doesn't go through the loop and the flag variable was 
> undefined.  This cause the "update_config.py" to fail which then bubbled back 
> up as an error and prevent the router from starting.
> 
> Once I changed the code and rebuilt the project all worked well and the bug 
> is fixed.  Thanks so much for everyone's help.  This process was very 
> educational and looking forward to learning more.
> 
> I do have one question just out of curiosity.  What makes the "Requires 
> Upgrade" column on the Home->Infrastructure->Virtual Router page indicated 
> "Yes"?
> 
> Thanks again,
> 
> 
> Richard Klein   
> RSI 
> 5426 Guadalupe, Suite 100 
> Austin TX 78751 
> 
> 
> 
> 
>> -Original Message-
>> From: Rajani Karuturi [mailto:raj...@apache.org]
>> Sent: Tuesday, April 12, 2016 6:15 AM
>> To: users@cloudstack.apache.org
>> Subject: Re: Cloudstack 4.7 password reset issue.
>> 
>> Can you check the vm_instance table for the VR entry and update
>> vm_template_id?
>> 
>> This might be helpful
>> https://gist.github.com/terbolous/102ae8edd1cda192561c
>> 
>> ~Rajani
>> 
>> On Sat, Apr 9, 2016 at 5:45 AM, Richard Klein (RSI) 
>> wrote:
>> 
>>> I found the password reset issue and it ended up being a Python script
>>> on the VR.  I ended up modifying the "/opt/cloud/bin/configure.py" to
>>> resolve the issue.  Basically there is a "/etc/cloud/vmpassword.json"
>>> file that is updated with the IP/password pair when the GUI password
>>> change is performed.  During the power on process the VM configuration
>>> info is sent to the router which reads the vmpassword.json file and
>>> sends the password changes to the password server cache file.  When
>>> the client retrieved the password it was cleared from the password
>>> cache file but not the vmpassword.json file.  So every time a VM
>>> started the last password reset was sent to the password server again.
>>> 
>>> The question I have now is how do I get the system VM template updated
>>> with the change?  Since we are using CS v4.7 we used the system
>>> template for v4.6 per the installation instructions for CentOS7 and
>>> KVM.  I performed the following steps to use a new system VM template:
>>> 
>>> * I copied the system vm template QCOW2 file from secondary storage to
>>> a work server and made a backup of it.
>>> * On the work server I mounted the QCOW2 template file using
>> "guestmount"
>>> tools and made the code changes to the template.
>>> * I then copied this modified template file to a web server and
>>> registered the template in cloudstack with all checkboxes off except for
>> "routing".
>>> * Then we set the cloudstack global value of "router.template.kvm" to
>>> the name of the new template.
>>> * The management services were restarted.
>>> * I picked a test VR, powered it off, destroyed it then let the system
>>> recreate it.
>>> * When I look at the code I changed on the new VR it does not appear.
>>> 
>>> I even doubled checked the database and the vm_instance table for the
>>> test VR showed the new template ID.  I must be missing something or I
>>> don't really understand how the system templates are created.  Any
>>> help/suggestions would be appreciated.
>>> 
>>> 
>>> 
>>> Richard Klein  
>>> RSI
>>> 5426 Guadalupe, Suite 100
>>> Austin TX 78751
>>> 
>>> 
>>> 
 -Original Message-
 From: Richard Klein (RSI)
 Sent: Tuesday, April 05, 2016 2:32 PM
 To: users@cloudstack.apache.org
 Subject: RE: Cloudstack 4.7 password reset issue.
 
 The snippets for before and after the reboot via console look the
 same
>>> so I
 pasted the 2nd set of message instead of the first.  Sorry about that.
>>> I did
 discover that the /var/lib/dhclient/dhclient.leases existed but was
>>> empty.  I've
 run across an issue with CentOS 7 where the lease file is missing so
 I
>>> wrote a
 "cloud-dhcp-check" service that makes sure it exists but now I need
 to
>>> validate
 its content.  That being said, I have insured that the
 dhclient_leases
>>> was valid
 and replicated the problem.
 
 The cloud-set-guest- scripts are from the master branch GitHub
>>> repository
 for apaches/cloudstack using the
 "
>>> 

Re: Re[2]: High Availability Cloudstack

[Remi Bergsma]

Hi,

I have tested this multiple times with a multi-node kvm cluster. When you kill 
one hypervisor (and it will not come back) then HA kicks in as expected and VMs 
with HA but set are started again. Quite sure all versions since 4.6 work fine, 
most likely older versions as well. 

Very simple to test, just give it a try. 

Maybe we should write a Marvin integration test to prove it works as people 
keep saying it doesn't for some reason. 

Regards, Remi 

> On 08 Apr 2016, at 04:43, Indra Pramana  wrote:
> 
> Hi Simon,
> 
> Apologise for replying to an old thread - may I know if you have managed to
> test this out on your lab? How was the result?
> 
> Thank you.
> 
> 
>> On Thu, Feb 4, 2016 at 3:05 AM, Simon Weller  wrote:
>> 
>> i'll test it out in our lab 4.7.1 lab and see what happens.
>> 
>> 
>> From: Nux! 
>> Sent: Wednesday, February 3, 2016 12:34 PM
>> To: users@cloudstack.apache.org
>> Cc: Mohd Zainal Abidin Rabani
>> Subject: Re: Re[2]: High Availability Cloudstack
>> 
>> Simon,
>> 
>> I think this is no longer correct. After a certain timeout the management
>> server will bring up the VMs on another hypervisor. We discussed this in
>> the somewhat recent past, but can't find the thread right now.
>> There was some nice insight from Wido or Marcus.
>> 
>> Lucian
>> 
>> --
>> Sent from the Delta quadrant using Borg technology!
>> 
>> Nux!
>> www.nux.ro
>> 
>> - Original Message -
>>> From: "Simon Weller" 
>>> To: "users" 
>>> Cc: "Mohd Zainal Abidin Rabani" 
>>> Sent: Wednesday, 3 February, 2016 16:23:55
>>> Subject: Re: Re[2]: High Availability Cloudstack
>> 
>>> My understanding is that HA will never actually function on KVM there
>> way most
>>> expect, unless the original host that failed comes back up and the agents
>>> report the VMs not running. This is due to Cloudstack not wanting to risk
>>> starting a vm that already is locked by another process, on a different
>> server.
>>> 
>>> The only way I know of to force HA to function is to remove the host out
>> of
>>> CloudStack, to force CloudStack to reallocate the VMs.
>>> 
>>> There has been a lot of talk about introducing a reliable fencing
>> mechanism into
>>> management, so that CloudStack management is 100% confident the vm is
>> safe to
>>> restart on a new host.
>>> 
>>> The current proposal for that is here:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/KVM+HA+with+IPMI+Fencing
>>> 
>>> - Si
>>> 
>>> 
>>> 
>>> 
>>> From: Andrei Mikhailovsky 
>>> Sent: Wednesday, February 3, 2016 1:49 AM
>>> To: users
>>> Cc: Mohd Zainal Abidin Rabani
>>> Subject: Re: Re[2]: High Availability Cloudstack
>>> 
>>> Hi,
>>> 
>>> from what i can can see, this issue has been resolved in version 4.4 and
>> Mohd is
>>> running 4.6.
>>> 
>>> From my testing with KVM, the management server performs a poll once in
>> a while
>>> and the agent replies if a vm is up. It might take some time before the
>> state
>>> changes, like 30 seconds or so, so give it a bit more time. My testing
>> show
>>> that the management server does update the state if the vm is manually
>> powered
>>> down.
>>> 
>>> I've not tested tha HA feature for sometime, but last time i checked it
>> was
>>> working. You should also set the HA option in the vm's system offering.
>>> 
>>> Andrei
>>> - Original Message -
 From: "Suresh Sadhu" 
 To: "users" , "Mohd Zainal Abidin Rabani"
 
 Sent: Wednesday, 3 February, 2016 06:24:49
 Subject: RE: Re[2]: High Availability Cloudstack
>>> 
 Please see below issue:
 https://issues.apache.org/jira/browse/CLOUDSTACK-5582
 
 regards
 sadhu
 
 -Original Message-
 From: Mohd Zainal Abidin Rabani [mailto:zai...@nocser.net]
 Sent: Wednesday, February 3, 2016 10:12 AM
 To: users@cloudstack.apache.org
 Subject: Re[2]: High Availability Cloudstack
 
 I'm using KVM that come with centos 7. That management also using
>> centos 7.
 Cloudstack version is 4.6.
 
 -
 Regards,
 Mohd Zainal Abidin Rabani
 Technical Support
 
 ModernOne Data Solutions Sdn. Bhd.(1119382-D) No. 83-2, Jalan TKS 1,
>> Kajang
 Sentral, 43000 Kajang, Selangor.
 T : 03-8737 0030 | F : 03-8737 0070
 E : zai...@nocser.net
 W : www.modern.com.my | www.nocser.net
 
 
 
 -- Original Message --
 From: "Abhinandan Prateek" 
 To: "users@cloudstack.apache.org" ; "Mohd
>> Zainal
 Abidin Rabani" 
 Sent: 03/02/2016 12:38:38
 Subject: Re: High Availability Cloudstack
 
> MS version, Hypervisor ? Are there more hosts in the cluster 

Re: Cloudstack 4.7 password reset issue.

[Remi Bergsma]

Hi,

It’s best to make a change in the source of CloudStack, then send it as a Pull 
Request to get it included.

When you run: `mvn clean install -P systemvm` a new systemvm.iso is generated.

However, the management server will check the systemvm.iso’s signature, so I’m 
not sure if replacing works without also copying it to the management server 
and restart it (so it generates a new signature).

Another trick is to alter the scripts on live routers with Ansible.

Regards,
Remi




On 09/04/16 03:42, "Simon Weller"  wrote:

>
>Richard,
>
>The system vms are bootstrapped with an iso that is mounted and all the 
>scripts are installed from there. The reason for this is to reduce the number 
>of times you have to completely redeploy routers (we used to have to do it for 
>every release).
>My guess is the file you need to change is within that iso.
>The iso is part of the cloudstack-common package that is installed onto all 
>the hosts (along with the cloudstack-agent).
>Take a look in /usr/share/cloudstack-common/vms. There should be an iso in 
>there called systemvm.iso
>
>You'll probably need to mount the iso make your changes to the filesystem, 
>rebuild the iso with mkisofs, copy that new iso to all of your hosts and then 
>stop and start your VR.
>
>Hope this helps.
>
>- Si
>
>
>
>
>
>From: Richard Klein (RSI) 
>Sent: Friday, April 8, 2016 7:15 PM
>To: users@cloudstack.apache.org
>Subject: RE: Cloudstack 4.7 password reset issue.
>
>I found the password reset issue and it ended up being a Python script on the 
>VR.  I ended up modifying the "/opt/cloud/bin/configure.py" to resolve the 
>issue.  Basically there is a "/etc/cloud/vmpassword.json" file that is updated 
>with the IP/password pair when the GUI password change is performed.  During 
>the power on process the VM configuration info is sent to the router which 
>reads the vmpassword.json file and sends the password changes to the password 
>server cache file.  When the client retrieved the password it was cleared from 
>the password cache file but not the vmpassword.json file.  So every time a VM 
>started the last password reset was sent to the password server again.
>
>The question I have now is how do I get the system VM template updated with 
>the change?  Since we are using CS v4.7 we used the system template for v4.6 
>per the installation instructions for CentOS7 and KVM.  I performed the 
>following steps to use a new system VM template:
>
>* I copied the system vm template QCOW2 file from secondary storage to a work 
>server and made a backup of it.
>* On the work server I mounted the QCOW2 template file using "guestmount" 
>tools and made the code changes to the template.
>* I then copied this modified template file to a web server and registered the 
>template in cloudstack with all checkboxes off except for "routing".
>* Then we set the cloudstack global value of "router.template.kvm" to the name 
>of the new template.
>* The management services were restarted.
>* I picked a test VR, powered it off, destroyed it then let the system 
>recreate it.
>* When I look at the code I changed on the new VR it does not appear.
>
>I even doubled checked the database and the vm_instance table for the test VR 
>showed the new template ID.  I must be missing something or I don't really 
>understand how the system templates are created.  Any help/suggestions would 
>be appreciated.
>
>
>
>Richard Klein  
>RSI
>5426 Guadalupe, Suite 100
>Austin TX 78751
>
>
>
>> -Original Message-
>> From: Richard Klein (RSI)
>> Sent: Tuesday, April 05, 2016 2:32 PM
>> To: users@cloudstack.apache.org
>> Subject: RE: Cloudstack 4.7 password reset issue.
>>
>> The snippets for before and after the reboot via console look the same so I
>> pasted the 2nd set of message instead of the first.  Sorry about that.  I did
>> discover that the /var/lib/dhclient/dhclient.leases existed but was empty.  
>> I've
>> run across an issue with CentOS 7 where the lease file is missing so I wrote 
>> a
>> "cloud-dhcp-check" service that makes sure it exists but now I need to 
>> validate
>> its content.  That being said, I have insured that the dhclient_leases was 
>> valid
>> and replicated the problem.
>>
>> The cloud-set-guest- scripts are from the master branch GitHub repository
>> for apaches/cloudstack using the
>> "https://github.com/apache/cloudstack/blob/master/setup/bindir/cloud-set-
>> guest-password.in" and the
>> "https://github.com/apache/cloudstack/blob/master/setup/bindir/cloud-set-
>> guest-sshkey.in" links.
>>
>> I have attached the entire log from the VR but have some snippets below along
>> with the VM client logs and the issue still occurs after fixing the dhcp 
>> lease file.
>> I did not perform any password resets via the GUI during this process.
>>
>

Re: AW: AW: Packet loss on redundant virtual router since <=4.7.1

[Remi Bergsma]

Hi Martin,

The public interface is supposed to be DOWN on the backup. Don’t ask me why 
this is designed like this, it doesn’t use VRRP for public. Most likely to save 
ip addresses. It’s like this from the start.

If both are UP, I can imagine there is packet loss.

What is the state of the routers? Backup/Master of Master/Master? You can see 
this in the UI on the Infrastructure tab.

Regards,
Remi




On 11/03/16 13:34, "Martin Emrich" <martin.emr...@empolis.com> wrote:

>Hi!
>
>I did the checks:
>
>- If I shut down the backup via Cloudstack, the packet loss disappears.
>- VRRP traffic can be seen both on the master (r-1904-VM) and the backup 
>(r-1905-VM).
>- The internal gateway IP is only on the master. (eth0)
>- The external IP is on both hosts (eth2):
>
>root@r-1904-VM:/var/log# ip addr show
>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
>link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>inet 127.0.0.1/8 scope host lo
>2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP 
>qlen 1000
>link/ether 02:00:2f:2b:00:02 brd ff:ff:ff:ff:ff:ff
>inet 192.168.100.151/23 brd 192.168.101.255 scope global eth0
>inet 192.168.100.1/32 brd 192.168.101.255 scope global eth0
>3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP 
>qlen 1000
>link/ether 0e:00:a9:fe:01:ce brd ff:ff:ff:ff:ff:ff
>inet 169.254.1.206/16 brd 169.254.255.255 scope global eth1
>4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP 
>qlen 1000
>link/ether 06:be:76:00:01:68 brd ff:ff:ff:ff:ff:ff
>inet 10.32.17.103/20 brd 10.32.31.255 scope global eth2
>
>
>root@r-1905-VM:~# ip addr show
>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
>link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>inet 127.0.0.1/8 scope host lo
>2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP 
>qlen 1000
>link/ether 02:00:18:ba:00:03 brd ff:ff:ff:ff:ff:ff
>inet 192.168.100.221/23 brd 192.168.101.255 scope global eth0
>3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP 
>qlen 1000
>link/ether 0e:00:a9:fe:01:f0 brd ff:ff:ff:ff:ff:ff
>inet 169.254.1.240/16 brd 169.254.255.255 scope global eth1
>4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP 
>qlen 1000
>link/ether 06:be:76:00:01:68 brd ff:ff:ff:ff:ff:ff
>inet 10.32.17.103/20 brd 10.32.31.255 scope global eth2
>
>So there's something going on with eth2, both are up, and also have the same 
>MAC address. The keepalived configurations seems to deal only with eth0.
>
>Thanks
>
>Martin 
>
>-Ursprüngliche Nachricht-
>Von: Remi Bergsma [mailto:rberg...@schubergphilis.com] 
>Gesendet: Montag, 7. März 2016 18:27
>An: users@cloudstack.apache.org
>Betreff: Re: AW: Packet loss on redundant virtual router since <=4.7.1
>
>The PR mentioned is not related, as it deals with private gateways, which is a 
>vpc feature. 
>
>Changing the MAC address will not help as they will still have the same IP 
>address. One interface is supposed to be down (backup) and one up (master). 
>The first guest tier is used to talk vrrp so make sure they see each other 
>(check with tcpdump to see if the vrrp announce packets make it to the other 
>router. If both are master, they are unable to talk to each other and both 
>assume they are alone. I suspect this is going wrong for you somehow. Please 
>let us know what tcpdump shows. 
>
>There are several integration tests that deal with this so I'm quite sure it 
>should work. 
>
>Regards, Remi 
>
>Sent from my iPhone
>
>> On 07 Mar 2016, at 18:13, Nux! <n...@li.nux.ro> wrote:
>> 
>> I am not sure on how to apply this, perhaps Wilder or someone else will be 
>> able to advise.
>> What I would try to do first is to change the MAC addr on the backup VR to 
>> something else and see if that stops the problems.
>> 
>> --
>> Sent from the Delta quadrant using Borg technology!
>> 
>> Nux!
>> www.nux.ro
>> 
>> - Original Message -
>>> From: "Martin Emrich" <martin.emr...@empolis.com>
>>> To: users@cloudstack.apache.org
>>> Sent: Monday, 7 March, 2016 16:05:02
>>> Subject: AW: Packet loss on redundant virtual router since <=4.7.1
>> 
>>> Hi!
>>> 
>>> Thanks for the hint! On my test isolated network, currently both 
>>> routers have the same configuration on eth2 (the "public" interface), 
>>> including the same MAC address, and bei

Re: AW: Packet loss on redundant virtual router since <=4.7.1

[Remi Bergsma]

The PR mentioned is not related, as it deals with private gateways, which is a 
vpc feature. 

Changing the MAC address will not help as they will still have the same IP 
address. One interface is supposed to be down (backup) and one up (master). The 
first guest tier is used to talk vrrp so make sure they see each other (check 
with tcpdump to see if the vrrp announce packets make it to the other router. 
If both are master, they are unable to talk to each other and both assume they 
are alone. I suspect this is going wrong for you somehow. Please let us know 
what tcpdump shows. 

There are several integration tests that deal with this so I'm quite sure it 
should work. 

Regards, Remi 

Sent from my iPhone

> On 07 Mar 2016, at 18:13, Nux!  wrote:
> 
> I am not sure on how to apply this, perhaps Wilder or someone else will be 
> able to advise.
> What I would try to do first is to change the MAC addr on the backup VR to 
> something else and see if that stops the problems.
> 
> --
> Sent from the Delta quadrant using Borg technology!
> 
> Nux!
> www.nux.ro
> 
> - Original Message -
>> From: "Martin Emrich" 
>> To: users@cloudstack.apache.org
>> Sent: Monday, 7 March, 2016 16:05:02
>> Subject: AW: Packet loss on redundant virtual router since <=4.7.1
> 
>> Hi!
>> 
>> Thanks for the hint! On my test isolated network, currently both routers have
>> the same configuration on eth2 (the "public" interface), including the same 
>> MAC
>> address, and being up.
>> 
>> So either the VRs do some ARP/ebtables magic to ensure only one reacts to
>> packets at each given moment, or something is wrong here.
>> 
>> Could that relate to your issue?
>> 
>> I have built ACS RPMs before, what's the easiest way to get a build with this
>> fix included (just to test whether it applies to us). Note that we do not use
>> VPC, these are "normal" virtual routers for isolated networks.
>> 
>> Thanks again,
>> 
>> Martin
>> 
>> -Ursprüngliche Nachricht-
>> Von: Nux! [mailto:n...@li.nux.ro]
>> Gesendet: Montag, 7. März 2016 16:18
>> An: users@cloudstack.apache.org
>> Betreff: Re: Packet loss on redundant virtual router since <=4.7.1
>> 
>> Can you check nex time this happens if the VRs don't have both the interface 
>> up
>> and same mac addr?
>> Could be this issue https://github.com/apache/cloudstack/pull/1413
>> 
>> HTH
>> 
>> --
>> Sent from the Delta quadrant using Borg technology!
>> 
>> Nux!
>> www.nux.ro
>> 
>> - Original Message -
>>> From: "Martin Emrich" 
>>> To: users@cloudstack.apache.org
>>> Sent: Monday, 7 March, 2016 14:00:38
>>> Subject: Packet loss on redundant virtual router since <=4.7.1
>> 
>>> Hello!
>>> 
>>> I just upgraded from 4.4.4 to 4.7.1, and upgraded the virtual routers to 
>>> 4.6.0.
>>> Since then, we have some packet loss with redundant virtual routers.
>>> If I shut down one of the routers (leaving the other one running), the
>>> problem disappears.
>>> 
>>> I often see messages like "Redundant Virtual Router just switched from
>>> Unknown to Master".
>>> I also noticed lots of these messages in the messages-logfile on the
>>> master
>>> router: "Password server failed with error code 1. Restarting it..."
>>> 
>>> What could be wrong?
>>> 
>>> Thanks
>>> 
>>> Martin Emrich
>>> Senior IT Administrator
>>> 
>>> Empolis Information Management GmbH | Europaallee 10 | 67657
>>> Kaiserslautern | Germany Phone +49 631 68037-71 | Fax +49 631 68037-77
>>> martin.emr...@empolis.com
>>> 
>>> www.empolis.com
>>> Sitz Kaiserslautern  | Amtsgericht Kaiserslautern HRB 31317
>>> Geschäftsführer: Dr. Stefan Wess, Stefan Volland, Dr. Christian Schulmeyer, 
>>> Dr.
>>> Peter Tepassé
>>> 
>>> SMART INFORMATION MANAGEMENT
>>> Empolis-Lösungen befähigen Unternehmen und Organisationen, die
>>> exponentiell wachsende Menge strukturierter und unstrukturierter Daten
>>> zu analysieren, zu interpretieren und automatisiert zu verarbeiten.
>>> Sie nutzen damit ihr Wissenskapital, um unternehmenskritische
>>> Geschäftsprozesse zu optimieren.
>>> Entscheider, Mitarbeiter und Kunden erhalten so stets situations- und
>>> aufgabengerecht genau die Information, die für sie relevant ist.
>>> Abonnieren Sie unseren
>>> Newsletter>> tc3r> | Folgen Sie uns auf
>>> Facebook | Besuchen Sie uns
>>> auf YouTube
>>> [Banner.Experton2016.Signatur]

Re: User data is not base64 encoded

[Remi Bergsma]

It means: make it safe to be passed in an url. Base64 encoded data can still 
contain "+", "=" and “/" which may confuse the browser/server.

Example:
data: "some data" becomes base64 encoded: ZGF0YTogInNvbWUgZGF0YSI= and url 
encoded: ZGF0YTogInNvbWUgZGF0YSI%3D

To play with it, see:
https://www.base64encode.org/

http://www.albionresearch.com/misc/urlencode.php


Regards,
Remi






On 28/02/16 15:52, "Nux!"  wrote:

>Suresh,
>
>Can you please rephrase that? What's "urlencoded"?
>
>--
>Sent from the Delta quadrant using Borg technology!
>
>Nux!
>www.nux.ro
>
>- Original Message -
>> From: "Suresh Sadhu" 
>> To: users@cloudstack.apache.org
>> Sent: Sunday, 28 February, 2016 14:49:08
>> Subject: RE: User data is not base64 encoded
>
>> Hi,
>> 
>> After converting userdata to base64 format and make it urlencoded then pass 
>> the
>> userdata string as api parameter.
>> 
>> 
>> Regards
>> Sadhu
>> 
>> 
>> 
>> From: Yacubovich, David 
>> Sent: Thursday, February 25, 2016 12:30 PM
>> To: users@cloudstack.apache.org
>> Subject: User data is not base64 encoded
>> 
>> Hello All,
>> I am trying to test the use of userdata on CS 4.6. I am creating new instance
>> from the UI and I paste the base64 encoded string into the userdata box. But 
>> I
>> get this error every time. I can't find any examples of how to use userdata
>> online. Can someone please give me an example of how this should work?
>> 
>> Here is m example:
>> 
>> # echo "env: poclab
>> container: tomcat" | base64
>> ZW52OiBwb2NsYWIKY29udGFpbmVyOiB0b21jYXQK
>> 
>> And I paste this string into userdata box.
>> 
>> Thanks,
>> David

Re: Unable Create/CleanUp Virual Router After upgraded to ACS 4.6.2

[Remi Bergsma]

Hi Suneel,

If you want to upgrade, use 4.7.1 instead of 4.6.x as many bugs have been 
fixed. In another thread we discussed a timeout setting you can bump to make it 
work, too.

Regards,
Remi




On 29/01/16 12:17, "mvs babu"  wrote:

>Hi All,
>
>Getting same issue (http://picpaste.com/pics/VPC-rhH48Qao.1454066282.PNG) with 
>below stable/latest builds of System VM Template.
>
>
>
>http://jenkins.buildacloud.org/job/build-systemvm64-master/lastStableBuild/artifact/tools/appliance/dist/systemvm64template-master-4.6.0-xen.vhd.bz2
>
>http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-4.6.0-xen.vhd.bz2
>
>Please help to resolve this issue ASAP, because we planning to upgrade our 
>production environment from 4.3.1.
>
>
>Thank you,
>Suneel Mallela
>
>
>
>
>
>From: mvs babu
>Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎5‎:‎34‎ ‎PM
>To: users@cloudstack.apache.org
>Cc: d...@cloudstack.apache.org
>
>
>
>
>
>Hi,
>
>
>Thank you for response.
>
>
>Followed below documentation,
>http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.6.0/upgrade/upgrade-4.3.html
>
>
>and templates are,
>http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-xen.vhd.bz2
>http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-xen.vhd.bz2
>
>
>
>
>
>
>Thank you,
>Suneel Mallela
>
>
>
>
>
>From: Harikrishna Patnala
>Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎5‎:‎26‎ ‎PM
>To: users@cloudstack.apache.org
>Cc: d...@cloudstack.apache.org
>
>
>
>
>
>Hi,
>
>Latest system vm template has flask installed in it. Can you please let us 
>which system vm template you have used.
>
>Thanks,
>Harikrishna
>
>
>On 27-Jan-2016, at 4:17 pm, mvs babu  wrote:
>
>> Sorry, it is not allowing to attach a screenshot. Please find below link.
>> 
>> 
>> http://picpaste.com/pics/VPC-rhH48Qao.1453891619.PNG
>> 
>> 
>> 
>> 
>> 
>> 
>> Thank you,
>> Suneel Mallela
>> 
>> 
>> 
>> 
>> 
>> From: mvs babu
>> Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎4‎:‎14‎ ‎PM
>> To: users@cloudstack.apache.org
>> Cc: d...@cloudstack.apache.org
>> 
>> 
>> 
>> 
>> 
>> Please find attachment.
>> 
>> 
>> 
>> 
>> 
>> 
>> Thank you,
>> Suneel Mallela
>> 
>> 
>> 
>> 
>> 
>> From: mvs babu
>> Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎4‎:‎08‎ ‎PM
>> To: users@cloudstack.apache.org
>> Cc: d...@cloudstack.apache.org
>> 
>> 
>> 
>> 
>> 
>> Hi All,
>> 
>> We upgraded ACS from 4.3.1 to 4.6.2. After this we tried to create new 
>> VPC/Network and getting below error from Virtual Router then after router 
>> get shutdown.
>> 
>> 
>> 
>> 
>> We are using XenServer 6.2 and CentOS 6.3.
>> 
>> Please help us to fix this issue.
>> 
>> 
>> Thank you,
>> Suneel Mallela,
>> 
>> AxiomIO.

Re: Unable Create/CleanUp Virual Router After upgraded to ACS 4.6.2

[Remi Bergsma]

You can use the 4.6 version in 4.6, 4.7 and 4.8.



On 29/01/16 13:24, "mvs babu" <mvsbabu0...@outlook.com> wrote:

>Hi Remi,
>
>Thanks for suggestion, sure we will test with 4.7. But, there is no System VM 
>Template available for 4.7.
>
>
>Thank you,
>Suneel Mallela
>
>AxiomIO.
>
>
>
>From: Remi Bergsma
>Sent: ‎Friday‎, ‎January‎ ‎29‎, ‎2016 ‎5‎:‎45‎ ‎PM
>To: users@cloudstack.apache.org
>Cc: d...@cloudstack.apache.org
>
>
>
>
>
>Hi Suneel,
>
>If you want to upgrade, use 4.7.1 instead of 4.6.x as many bugs have been 
>fixed. In another thread we discussed a timeout setting you can bump to make 
>it work, too.
>
>Regards,
>Remi
>
>
>
>
>On 29/01/16 12:17, "mvs babu" <mvsbabu0...@outlook.com> wrote:
>
>>Hi All,
>>
>>Getting same issue (http://picpaste.com/pics/VPC-rhH48Qao.1454066282.PNG) 
>>with below stable/latest builds of System VM Template.
>>
>>
>>
>>http://jenkins.buildacloud.org/job/build-systemvm64-master/lastStableBuild/artifact/tools/appliance/dist/systemvm64template-master-4.6.0-xen.vhd.bz2
>>
>>http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-4.6.0-xen.vhd.bz2
>>
>>Please help to resolve this issue ASAP, because we planning to upgrade our 
>>production environment from 4.3.1.
>>
>>
>>Thank you,
>>Suneel Mallela
>>
>>
>>
>>
>>
>>From: mvs babu
>>Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎5‎:‎34‎ ‎PM
>>To: users@cloudstack.apache.org
>>Cc: d...@cloudstack.apache.org
>>
>>
>>
>>
>>
>>Hi,
>>
>>
>>Thank you for response.
>>
>>
>>Followed below documentation,
>>http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.6.0/upgrade/upgrade-4.3.html
>>
>>
>>and templates are,
>>http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-xen.vhd.bz2
>>http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-xen.vhd.bz2
>>
>>
>>
>>
>>
>>
>>Thank you,
>>Suneel Mallela
>>
>>
>>
>>
>>
>>From: Harikrishna Patnala
>>Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎5‎:‎26‎ ‎PM
>>To: users@cloudstack.apache.org
>>Cc: d...@cloudstack.apache.org
>>
>>
>>
>>
>>
>>Hi,
>>
>>Latest system vm template has flask installed in it. Can you please let us 
>>which system vm template you have used.
>>
>>Thanks,
>>Harikrishna
>>
>>
>>On 27-Jan-2016, at 4:17 pm, mvs babu <mvsbabu0...@outlook.com> wrote:
>>
>>> Sorry, it is not allowing to attach a screenshot. Please find below link.
>>> 
>>> 
>>> http://picpaste.com/pics/VPC-rhH48Qao.1453891619.PNG
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Thank you,
>>> Suneel Mallela
>>> 
>>> 
>>> 
>>> 
>>> 
>>> From: mvs babu
>>> Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎4‎:‎14‎ ‎PM
>>> To: users@cloudstack.apache.org
>>> Cc: d...@cloudstack.apache.org
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Please find attachment.
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Thank you,
>>> Suneel Mallela
>>> 
>>> 
>>> 
>>> 
>>> 
>>> From: mvs babu
>>> Sent: ‎Wednesday‎, ‎January‎ ‎27‎, ‎2016 ‎4‎:‎08‎ ‎PM
>>> To: users@cloudstack.apache.org
>>> Cc: d...@cloudstack.apache.org
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Hi All,
>>> 
>>> We upgraded ACS from 4.3.1 to 4.6.2. After this we tried to create new 
>>> VPC/Network and getting below error from Virtual Router then after router 
>>> get shutdown.
>>> 
>>> 
>>> 
>>> 
>>> We are using XenServer 6.2 and CentOS 6.3.
>>> 
>>> Please help us to fix this issue.
>>> 
>>> 
>>> Thank you,
>>> Suneel Mallela,
>>> 
>>> AxiomIO.

Re: AW: AW: AW: AW: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout

[Remi Bergsma]

Like I said, it’s already much better in 4.7.1. I start to see packages 
appearing, for example here: http://cloudstack.apt-get.eu/centos7/4.7/oss/

With 4.7.1 we tested hundreds of rules and that worked fine.

Regards,
Remi



On 28/01/16 17:24, "Martin Emrich" <martin.emr...@empolis.com> wrote:

>This was/is 4.7.0.
>
>With the KVM problem: I suspect that the KVM hosts somehow got wonky, as the 
>VR has no network connectivity (tried virsh console to it, and had no internet 
>there). Next I'll try rebooting one.
>
>Another network (with 48 firewall/portforwarding rules) took ca. 30min, the 
>first one with 22 rules took 10 minutes, so the time is consumed during 
>configuration of the rules.
>
>Ciao
>
>Martin 
>
>-Ursprüngliche Nachricht-
>Von: Remi Bergsma [mailto:rberg...@schubergphilis.com] 
>Gesendet: Donnerstag, 28. Januar 2016 17:20
>An: users@cloudstack.apache.org
>Betreff: Re: AW: AW: AW: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout
>
>The 4.7.1 packages will be there soon. I’d advise anyone currently on 4.6 to 
>upgrade to it as it has several speed improvements.
>
>What version was this Martin?
>
>Regards,
>Remi
>
>
>
>
>On 28/01/16 15:46, "Martin Emrich" <martin.emr...@empolis.com> wrote:
>
>>Thanks, that's it.
>>
>>So (at least) I seem to have two issues:
>>
>>1. VirtualRouters now fail to start on KVM (at least when there's already a 
>>VR on the KVM host) , but work on XenServer.
>>
>>2. VirtualRouters take very long to start since 4.6: The VR I just started 
>>belongs to a network with some 20 firewall and port forwarding rules, and the 
>>VR took ca. 10 minutes to configure (eating 100% CPU in the process). Thanks 
>>to setting the timeout high enough, the network finally came up.
>>I took a copy of the VR cloud.log ca. 8 minutes into the process, if anyone 
>>is interested.
>>
>>Ciao
>>
>>Martin
>>
>>-Ursprüngliche Nachricht-
>>Von: Remi Bergsma [mailto:rberg...@schubergphilis.com] 
>>Gesendet: Donnerstag, 28. Januar 2016 14:09
>>An: users@cloudstack.apache.org
>>Betreff: Re: AW: AW: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout
>>
>>Hi Martin,
>>
>>4.7.1 has a fix for the overall timeout of 120 seconds. I expect the packages 
>>will be ready in a day or two.
>>
>>If XenServer works, try setting system.vm.default.hypervisor to XenServer and 
>>it will not use another hypervisor.
>>
>>Regards,
>>Remi
>>
>>
>>
>>On 28/01/16 13:38, "Martin Emrich" <martin.emr...@empolis.com> wrote:
>>
>>>Hi!
>>>
>>>To follow up:
>>>
>>>- I upgraded to 4.7.0 (there are no 4.7.1 el6 RPMs yet, neither from 
>>>CloudStack nor from Shapeblue)
>>>- The problem still persists
>>>- It seems that VRs can be created on XenServer, but not on KVM. I tried 
>>>forcing new VRs to XenServers only via host tags, but the decision to use 
>>>KVM is being made before the tags are evaluated, so this leaves no hosts 
>>>when the decision for KVM is made.
>>>- I see this in the KVM host agent.log:
>>>2016-01-28 13:29:10,956 WARN  [kvm.resource.LibvirtComputingResource] 
>>>(Script-2:null) (logid:) Interrupting script.
>>>2016-01-28 13:29:10,958 WARN  [kvm.resource.LibvirtComputingResource] 
>>>(agentRequest-Handler-4:null) (logid:7d8981d1) Timed out: 
>>>/usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh vr_cfg.sh 
>>>169.254.3.252 -c 
>>>/var/cache/cloud/VR-0193b95c-96ee-4e0d-a527-964960baa49e.cfg .  Output is:
>>>- router.aggregation.command.each.timeout is set to whopping 600s, but the 
>>>error appears ca. 1-2 minutes after I click on "restart network" with 
>>>cleanup=true.
>>>
>>>
>>>Any Ideas?
>>>
>>>Thanks
>>>
>>>Martin
>>>

Re: Virtual Router volume migration

[Remi Bergsma]

Good morning,

By default it cannot be done. I wrote a collection of scripts [1] that can do 
it. In the README, search for "Migrate a Virtual Router”. The script you need 
is [2].

Regards,
Remi

[1] https://github.com/schubergphilis/cloudstackOps
[2] 
https://github.com/schubergphilis/cloudstackOps/blob/master/migrateRouterVM.py




On 28/01/16 09:21, "Mārtiņš Jakubovičs"  wrote:

>Hello,
>
>Is it possible to migrate Virtual Routers volume with storage migration 
>from one storage to other, like it is possible with user volumes? Can't 
>find such function.

Re: Virtual Router volume migration

[Remi Bergsma]

Hi Martins,

That also works indeed! I also need the database, but only read from it.

Regards,
Remi



On 28/01/16 10:32, "Mārtiņš Jakubovičs" <mart...@vertigs.lv> wrote:

>Hello Remi,
>
>Thanks, I will check your scripts. Right now I migrate in XenServer it 
>self, after that update router's volume pool_id and path fields.
>
>Best regards,
>Martins
>
>On 2016.01.28. 11:22, Remi Bergsma wrote:
>> Good morning,
>>
>> By default it cannot be done. I wrote a collection of scripts [1] that can 
>> do it. In the README, search for "Migrate a Virtual Router”. The script you 
>> need is [2].
>>
>> Regards,
>> Remi
>>
>> [1] https://github.com/schubergphilis/cloudstackOps
>> [2] 
>> https://github.com/schubergphilis/cloudstackOps/blob/master/migrateRouterVM.py
>>
>>
>>
>>
>> On 28/01/16 09:21, "Mārtiņš Jakubovičs" <mart...@vertigs.lv> wrote:
>>
>>> Hello,
>>>
>>> Is it possible to migrate Virtual Routers volume with storage migration
>> >from one storage to other, like it is possible with user volumes? Can't
>>> find such function.
>

Re: AW: AW: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout

[Remi Bergsma]

Hi Martin,

4.7.1 has a fix for the overall timeout of 120 seconds. I expect the packages 
will be ready in a day or two.

If XenServer works, try setting system.vm.default.hypervisor to XenServer and 
it will not use another hypervisor.

Regards,
Remi



On 28/01/16 13:38, "Martin Emrich"  wrote:

>Hi!
>
>To follow up:
>
>- I upgraded to 4.7.0 (there are no 4.7.1 el6 RPMs yet, neither from 
>CloudStack nor from Shapeblue)
>- The problem still persists
>- It seems that VRs can be created on XenServer, but not on KVM. I tried 
>forcing new VRs to XenServers only via host tags, but the decision to use KVM 
>is being made before the tags are evaluated, so this leaves no hosts when the 
>decision for KVM is made.
>- I see this in the KVM host agent.log:
>2016-01-28 13:29:10,956 WARN  [kvm.resource.LibvirtComputingResource] 
>(Script-2:null) (logid:) Interrupting script.
>2016-01-28 13:29:10,958 WARN  [kvm.resource.LibvirtComputingResource] 
>(agentRequest-Handler-4:null) (logid:7d8981d1) Timed out: 
>/usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh vr_cfg.sh 
>169.254.3.252 -c /var/cache/cloud/VR-0193b95c-96ee-4e0d-a527-964960baa49e.cfg 
>.  Output is:
>- router.aggregation.command.each.timeout is set to whopping 600s, but the 
>error appears ca. 1-2 minutes after I click on "restart network" with 
>cleanup=true.
>
>
>Any Ideas?
>
>Thanks
>
>Martin
>

Re: (Self-Host) Unable to Add Host

[Remi Bergsma]

Hi,

Out of interest: why version 4.3? It’s rather old. I’d pick a newer version if 
you are building something new.

Can the CloudStack management server SSH to the KVM hypervisor (172.16.134.94) 
with the supplied user/passwd? It needs to be root in 4.3.

Regards,
Remi




On 28/01/16 10:51, "Syafiq Rokman"  wrote:

>CS 4.3 on Ubuntu 14.04.
>Using KVM as hypervisor.
>I'm trying to set up a simple self-hosted cloud.
>
>I am unable to add the management server as host on the admin UI.
>
>
>/var/log/cloudstack/agent/agent.log
>
>INFO [c.c.r.ResourceManagerImpl] (catalina-exec-5:ctx-3933d9f3
>ctx-e0903949) Trying to add a new host at http://172.16.134.94 in data
>center 1
>WARN [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-5:ctx-3933d9f3
>ctx-e0903949) can't setup agent, due to java.io.IOException: There was a
>problem while connecting to 172.16.134.94:22 - There was a problem while
>connecting to 172.16.134.94:22
>WARN [c.c.r.ResourceManagerImpl] (catalina-exec-5:ctx-3933d9f3
>ctx-e0903949) Unable to find the server resources at http://172.16.134.94
>INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-5:ctx-3933d9f3
>ctx-e0903949) Could not find exception:
>com.cloud.exception.DiscoveryException in error code list for exceptions
>WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-5:ctx-3933d9f3 ctx-e0903949)
>Exception: com.cloud.exception.DiscoveryException: Unable to add the host
>at
>com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:780)
>at
>com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:575)
>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>at java.lang.reflect.Method.invoke(Method.java:606) at
>org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>at
>org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>at
>org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>at
>org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>at
>org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>at
>org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>at com.sun.proxy.$Proxy145.discoverHosts(Unknown Source) at
>org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:143)
>at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) at
>com.cloud.api.ApiServer.queueCommand(ApiServer.java:627) at
>com.cloud.api.ApiServer.handleRequest(ApiServer.java:470) at
>com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:323) at
>com.cloud.api.ApiServlet.access$000(ApiServlet.java:53) at
>com.cloud.api.ApiServlet$1.run(ApiServlet.java:115) at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:112) at
>com.cloud.api.ApiServlet.doPost(ApiServlet.java:79) at
>javax.servlet.http.HttpServlet.service(HttpServlet.java:643) at
>javax.servlet.http.HttpServlet.service(HttpServlet.java:723) at
>org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>at
>org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>at
>org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>at
>org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>at
>org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>at
>org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
>at
>org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)
>at
>org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>at
>org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
>at
>org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:891)
>at
>org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:750)
>at
>org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2283)
>at
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>at

Re: AW: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout

[Remi Bergsma]

The routers from Daniel work when we bumped global setting 
router.aggregation.command.each.timeout to 20 or higher. You may need to 
upgrade to 4.7.1 for that to work, but that's a good thing to do anyway because 
it has a load of fixes over 4.6. The upgrade is quick and painless. 

For the record, it doesn't have to do with the template. Be happy we reuse it, 
makes upgrading way easier. 

Regards, Remi 

Sent from my iPhone

> On 28 Jan 2016, at 07:12, Daniel Mezentsev  wrote:
> 
> 4.7.1 also affected.
> All versions use 4.6 templates.
> 
> P.S.: would it be usefull to move discussion to devs list. Looks like it's
> pretty big issue.
> 
>> Hi!
>> 
>> After upgrading from 4.5.2 to 4.6.2, I also face this issue. We use both
>> KVM and XenServer. Any stable workaround for this?
>> 
>> Thanx
>> 
>> Martin
>> 
>> -Ursprüngliche Nachricht-
>> Von: Andrei Mikhailovsky [mailto:and...@arhont.com]
>> Gesendet: Freitag, 18. Dezember 2015 02:55
>> An: users 
>> Betreff: Re: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout
>> 
>> Hello guys,
>> 
>> I've just upgraded to 4.6.2 and have similar issues with three virtual
>> routers out of 22 in total. They are all failing exactly the same way as
>> described here.
>> 
>> Has anyone found a permanent workaround for this issue?
>> 
>> Thanks
>> 
>> Andrei
>> 
>> - Original Message -
>>> From: "Stephan Seitz" 
>>> To: "users" 
>>> Sent: Monday, 30 November, 2015 19:53:57
>>> Subject: Re: upgrading 4.5.2 -> 4.6.0 virtualrouter upgrade timeout
>> 
>>> Does anybody else experiemce problems due to (very) slow deployment of
>>> VRs?
>>> 
>>> Am Dienstag, den 24.11.2015, 16:31 +0100 schrieb Stephan Seitz:
 Update / FYI:
 After faking the particular VRu in sql, I tried to restart that
 network, and it always fails. To me it looks like the
 update_config.py - which takes almost all cpu ressources - runs way
 longer any watchdog will accept.
 
 I'm able to mitigate that by very nasty workarounds:
 a) start the router
 b) wait until its provisioned
 c) restart cloudstack-management
 d)  update vm_instance
 set state='Running',
 power_state='PowerOn' where name = 'r-XXX-VM';
 e) once: update domain_router
 set template_version="Cloudstack Release 4.6.0 Wed Nov 4 08:22:47 UTC
 2015", scripts_version="546c9e7ac38e0aa16ecc498899dac8e2"
 where id=XXX;
 f) wait until update_config.py finishes (for me thats about 15
 minutes)
 
 Since I expect the need for VR restarts in the future, this behaviour
 is somehow unsatisfying. It needs a lot of errorprone intervention.
 
 I'm quite unsure if it's introduced with the update or the particular
 VR just has simply not been restarted after getting configured with
 lots of ips and rules.
 
 Am Dienstag, den 24.11.2015, 12:29 +0100 schrieb Stephan Seitz:
 Hi List!
 
 After upgrading from 4.5.2 to 4.6.0 I faced a problem with one
 virtualrouter. This particular VR has about 10 IPs w/ LB and FW
 rules
 defined. During the upgrade process, and after about 4-5 minutes a
 watchdog kicks in and kills the respective VR due to no response.
 
 So far I didn't find any timeout value in the global settings.
 Temporarily setting network.router.EnableServiceMonitoring to false
 doesn't change the behaviour.
 
 Any help, how to mitigate that nasty timeout would be really
 appreciated :)
 
 cheers,
 
 Stephan
 
 From within the VR, the logs show
 
 2015-11-24 11:24:33,807  CsFile.py search:123 Searching for
 dhcp-range=interface:eth0,set:interface and replacing with
 dhcp-range=interface:eth0,set:interface-eth0,10.10.22.1,static
 2015-11-24 11:24:33,808  merge.py load:56 Creating data bag type
 guestnetwork
 2015-11-24 11:24:33,808  CsFile.py search:123 Searching for
 dhcp-option=tag:interface-eth0,15 and replacing with
 dhcp-option=tag:interface-eth0,15,heinlein.cloudservice
 2015-11-24 11:24:33,808  CsFile.py search:123 Searching for
 dhcp-option=tag:interface-eth0,6 and replacing with
 dhcp-option=tag:interface
 -eth0,6,10.10.22.1,195.10.208.2,91.198.250.2
 2015-11-24 11:24:33,809  CsFile.py search:123 Searching for
 dhcp-option=tag:interface-eth0,3, and replacing with
 dhcp-option=tag:interface-eth0,3,10.10.22.1
 2015-11-24 11:24:33,809  CsFile.py search:123 Searching for
 dhcp-option=tag:interface-eth0,1, and replacing with
 dhcp-option=tag:interface-eth0,1,255.255.255.0
 2015-11-24 11:24:33,810  CsHelper.py execute:160 Executing: service
 dnsmasq restart
 
 ==> /var/log/messages <==
 Nov 24 11:24:34 r-504-VM shutdown[6752]: shutting down for system
 halt
 
 Broadcast message from root@r-504-VM (Tue Nov 24 11:24:34 2015):
 
 

Re: is ACS 4.7 stable

[Remi Bergsma]

Hi,

We just released 4.7.1 and I think it’s fairly stable. At Schuberg Philis we 
run it in production. Although any release has (both known and unknown) bugs so 
I recommend testing the upgrade in a lab before proceeding to production. A 
major change is the virtual router code, so you may want to have an extra look 
at that.

Regards,
Remi



On 26/01/16 08:29, "Sonali Jadhav"  wrote:

>hi
>
>I was wondering if 4.7 is stable release to update production 4.5.2 
>environment?
>
>/sj

Re: Cannot add host in Cloudstack 4.7

[Remi Bergsma]

Do you happen to run Java 8? It should be Java 7 still.




On 22/01/16 11:32, "Rui Mao"  wrote:

>I updated everything, including nss & openssl, still failed, same error.
>
>I also tried CentOS 6.5 & CloudStack 4.6, followed the installation guide 
>exactly, but ... :-(
>
>Best regards,
>Rui Mao
>
>
>-邮件原件-
>发件人: users-return-24362-maorui2k=163@cloudstack.apache.org 
>[mailto:users-return-24362-maorui2k=163@cloudstack.apache.org] 代表 Erik 
>Weber
>发送时间: 2016年1月22日 16:11
>收件人: users@cloudstack.apache.org
>主题: Re: Cannot add host in Cloudstack 4.7
>
>On Thu, Jan 21, 2016 at 11:39 AM, Rui Mao  wrote:
>
>> I'm new to CloudStack, and just installed Cloudstack 4.7.0 in two 
>> computers.
>>
>>
>>
>> I got a problem when I tried to add a host.
>>
>>
>>
>> The management node is 10.4.0.11, and the other compute node is 10.4.0.12.
>>
>>
>>
>> In the mgmt. log, I saw successful messages.
>>
>>
>>
>> 2016-01-21 17:02:57,417 DEBUG [c.c.u.s.SSHCmdHelper]
>> (catalina-exec-1:ctx-5c87e5f4 ctx-1d155b58) (logid:ecbd70ac) 
>> cloudstack-setup-agent  -m 10.4.0.11 -z 1 -p 1 -c 1 -g 
>> 3aeb10a1-12ee-392d-ab8a-db571c529e1f -a --pubNic=cloudbr0 
>> --prvNic=cloudbr0
>> --guestNic=cloudbr0 --hypervisor=kvm output:Starting to configure your
>> system:
>>
>> Configure Cgroup ...  [OK]
>>
>> Configure SElinux ... [OK]
>>
>> Configure Network ... [OK]
>>
>> Configure Libvirt ... [OK]
>>
>> Configure Firewall ...[OK]
>>
>> Configure Nfs ... [OK]
>>
>> Configure cloudAgent ...  [OK]
>>
>> CloudStack Agent setup is done!
>>
>>
>>
>> But in the agent.log, a connection error happened!
>>
>>
>>
>> 2016-01-21 17:02:58,042 INFO  [cloud.agent.AgentShell] (main:null) 
>> (logid:) Agent started
>>
>> 2016-01-21 17:02:58,046 INFO  [cloud.agent.AgentShell] (main:null) 
>> (logid:) Implementation Version is 4.7.0
>>
>> 2016-01-21 17:02:58,047 INFO  [cloud.agent.AgentShell] (main:null) 
>> (logid:) agent.properties found at 
>> /etc/cloudstack/agent/agent.properties
>>
>> 2016-01-21 17:02:58,054 INFO  [cloud.agent.AgentShell] (main:null) 
>> (logid:) Defaulting to using properties file for storage
>>
>> 2016-01-21 17:02:58,056 INFO  [cloud.agent.AgentShell] (main:null) 
>> (logid:) Defaulting to the constant time backoff algorithm
>>
>> 2016-01-21 17:02:58,077 INFO  [cloud.utils.LogUtils] (main:null) 
>> (logid:) log4j configuration found at 
>> /etc/cloudstack/agent/log4j-cloud.xml
>>
>> 2016-01-21 17:02:58,097 INFO  [cloud.agent.AgentShell] (main:null) 
>> (logid:) Preferring IPv4 address family for agent connection
>>
>> 2016-01-21 17:02:58,183 INFO  [cloud.agent.Agent] (main:null) (logid:) 
>> id is
>>
>>
>> 2016-01-21 17:02:58,235 INFO  [kvm.resource.LibvirtConnection] 
>> (main:null)
>> (logid:) No existing libvirtd connection found. Opening a new one
>>
>> 2016-01-21 17:02:58,725 INFO  [org.reflections.Reflections] 
>> (main:null)
>> (logid:) Reflections took 113 ms to scan 1 urls, producing 7 keys and 
>> 10 values
>>
>> 2016-01-21 17:02:58,901 INFO  [kvm.resource.LibvirtComputingResource]
>> (main:null) (logid:) No libvirt.vif.driver specified. Defaults to 
>> BridgeVifDriver.
>>
>> 2016-01-21 17:02:58,941 INFO  [cloud.agent.Agent] (main:null) (logid:) 
>> Agent [id = new : type = LibvirtComputingResource : zone = 1 : pod = 1 
>> : workers =
>> 5 : host = 10.4.0.11 : port = 8250
>>
>> 2016-01-21 17:02:58,946 INFO  [utils.nio.NioClient] (main:null) 
>> (logid:) Connecting to 10.4.0.11:8250
>>
>> 2016-01-21 17:03:59,131 ERROR [utils.nio.NioConnection] (main:null)
>> (logid:)
>> Unable to initialize the threads.
>>
>> java.io.IOException: Connection closed with -1 on reading size.
>>
>
>
>Could be SSL/TLS issue, ensure that packages are updated on your management 
>server, in particular anything related to nss.
>
>--
>Erik
>
>

Re: VPC virtual router NIC limit

[Remi Bergsma]

Hoi Erik,

You then don’t need eth interfaces for each tier and create a virtual interface 
in the openvswitch bridge instead. This has virtually no limit.

Openvswitch also brings features like vxlan connections between routers and 
such, so could be very interesting.

Regards,
Remi






On 07/01/16 08:30, "Erik Weber" <terbol...@gmail.com> wrote:

>From a technical or code perspective?
>
>How would changing to openvswitch change anything in this scenario?
>
>-- 
>Erik
>
>On Thu, Jan 7, 2016 at 7:16 AM, Remi Bergsma <rberg...@schubergphilis.com>
>wrote:
>
>> I don't think that would work. Instead, we could change to openvswitch as
>> that makes it way more flexibele. As far as I know there are no plans / is
>> no one working on that right now.
>>
>> Sent from my iPhone
>>
>> > On 06 Jan 2016, at 23:52, Erik Weber <terbol...@gmail.com> wrote:
>> >
>> > A theoretical change could be to switch from VLAN assigned VIFs to using
>> > the VLAN feature in Linux kernel. That would give interface names like
>> > eth0.100 instead of eth0-6. Would need one NIC for each physical Network
>> > though.
>> >
>> > And I do not know if all hypervisors supports trunk ports.
>> >
>> >
>> > Erik
>> >
>> > Den mandag 28. desember 2015 skrev Davide Pala <davide.p...@gesca.it>
>> > følgende:
>> >
>> >> Hi all.
>> >> I've read about vpc and tiers, now i've a question. VPC's virtual router
>> >> is a virtual machine and as the other vm it have some limit such as the
>> max
>> >> number of nic that an hypervisor can provide to vm (in xenserver this
>> limit
>> >> is set to 7) ...this mean that the vpc can have only 6 tier? there is a
>> way
>> >> to bypass this limit?
>> >> thanks to all
>> >>
>> >> Davide Pala
>> >> Infrastructure Specialist
>> >> Gesca srl
>> >>
>> >> Via degli Olmetti, 18
>> >> 00060 Formello (Roma)
>> >> Office:  +39 06 9040661
>> >> Fax: +39 06 9040
>> >> E-mail: davide.p...@gesca.it <javascript:;><mailto:davide.p...@gesca.it
>> >> <javascript:;>>
>> >> Web:www.gesca.it<http://www.gesca.it/>
>> >>
>> >> [Descrizione: Descrizione: Descrizione: Descrizione: Descrizione:
>> >> Descrizione: logoGescaPER FIRMA]
>> >>
>> >>
>>

Re: VPC virtual router NIC limit

[Remi Bergsma]

I don't think that would work. Instead, we could change to openvswitch as that 
makes it way more flexibele. As far as I know there are no plans / is no one 
working on that right now. 

Sent from my iPhone

> On 06 Jan 2016, at 23:52, Erik Weber  wrote:
> 
> A theoretical change could be to switch from VLAN assigned VIFs to using
> the VLAN feature in Linux kernel. That would give interface names like
> eth0.100 instead of eth0-6. Would need one NIC for each physical Network
> though.
> 
> And I do not know if all hypervisors supports trunk ports.
> 
> 
> Erik
> 
> Den mandag 28. desember 2015 skrev Davide Pala 
> følgende:
> 
>> Hi all.
>> I've read about vpc and tiers, now i've a question. VPC's virtual router
>> is a virtual machine and as the other vm it have some limit such as the max
>> number of nic that an hypervisor can provide to vm (in xenserver this limit
>> is set to 7) ...this mean that the vpc can have only 6 tier? there is a way
>> to bypass this limit?
>> thanks to all
>> 
>> Davide Pala
>> Infrastructure Specialist
>> Gesca srl
>> 
>> Via degli Olmetti, 18
>> 00060 Formello (Roma)
>> Office:  +39 06 9040661
>> Fax: +39 06 9040
>> E-mail: davide.p...@gesca.it > >
>> Web:www.gesca.it
>> 
>> [Descrizione: Descrizione: Descrizione: Descrizione: Descrizione:
>> Descrizione: logoGescaPER FIRMA]
>> 
>> 

Re: A Story of a Failed XenServer Upgrade

[Remi Bergsma]

CloudStack should always do the migration of VM's not the Hypervisor.

That's not true. You can safely migrate outside of CloudStack as the power 
report will tell CloudStack where the vms live and the db gets updated 
accordingly. I do this a lot while patching and that works fine on 6.2 and 6.5. 
I use both CloudStack 4.4.4 and 4.7.0.

Regards, Remi


Sent from my iPhone

On 02 Jan 2016, at 16:26, Jeremy Peterson 
> wrote:

I don't use XenServer maintenance mode until after CloudStack has put the Host 
in maintenance mode.

When you initiate maintenance mode from the host rather than CloudStack the db 
does not know where the VM's are and your UUID's get jacked.

CS is your brains not the hypervisor.

Maintenance in CS.  All VM's will migrate.  Maintenance in XenCenter.  Upgrade. 
 Reboot.  Join Pool.  Remove Maintenance starting at hypervisor if needed and 
then CS and move on to the next Host.

CloudStack should always do the migration of VM's not the Hypervisor.

Jeremy


-Original Message-
From: Davide Pala [mailto:davide.p...@gesca.it]
Sent: Friday, January 1, 2016 5:18 PM
To: users@cloudstack.apache.org
Subject: R: A Story of a Failed XenServer Upgrade

Hi alessandro. If u put in maintenance mode the master you force the election 
of a new pool master. Now when you have see the upgraded host as disconnected 
you are connected to the new pool master and the host (as a pool member) cannot 
comunicate with a pool master of an earliest version. The solution? Launche the 
upgrade on the pool master without enter in maintenance mode. And remember a 
consistent backup!!!



Inviato dal mio dispositivo Samsung


 Messaggio originale 
Da: Alessandro Caviglione 
>
Data: 01/01/2016 23:23 (GMT+01:00)
A: users@cloudstack.apache.org
Oggetto: A Story of a Failed XenServer Upgrade

Hi guys,
I want to share my XenServer Upgrade adventure to understand if I did domething 
wrong.
I upgraded CS from 4.4.4 to 4.5.2 without any issues, after all the VRs has 
been upgraded I start the upgrade process of my XenServer hosts from 6.2 to 6.5.
I do not already have PoolHA enabled so I followed this article:
http://www.shapeblue.com/how-to-upgrade-an-apache-cloudstack-citrix-xenserver-cluster/

The cluster consists of n° 3 XenServer hosts.

First of all I added manage.xenserver.pool.master=false
to environment.properties file and restarted cloudstack-management service.

After that I put in Maintenance Mode Pool Master host and, after all VMs has 
been migrated, I Unmanaged the cluster.
At this point all host appears as "Disconnected" from CS interface and this 
should be right.
Now I put XenServer 6.5 CD in the host in Maintenance Mode and start a in-place 
upgrade.
After XS6.5 has been installed, I istalled the 6.5SP1 and reboot again.
At this point I expected that, after click on Manage Cluster on CS, all the 
hosts come back to "UP" and I could go ahead upgrading the other hosts

But, instead of that, all the hosts still appears as "Disconnected", I tried a 
couple of cloudstack-management service restart without success.

So I opened XenCenter and connect to Pool Master I upgraded to 6.5 and it 
appear in Maintenance Mode, so I tried to Exit from Maint Mode but I got the 
error: The server is still booting

After some investigation, I run the command "xe task-list" and this is the
result:

uuid ( RO): 72f48a56-1d24-1ca3-aade-091f1830e2f1
name-label ( RO): VM.set_memory_dynamic_range name-description ( RO):
status ( RO): pending
progress ( RO): 0.000

I tried a couple of reboot but nothing changes so I decided to shut down 
the server, force raise a slave host to master with emergency mode, remove old 
server from CS and reboot CS.

After that, I see my cluster up and running again, so I installed XS 6.2SP1 on 
the "upgraded" host and added again to the cluster

So after an entire day of work, I'm in the same situation! :D

Anyone can tell me if I made something wrong??

Thank you very much!

Re: VPC Issue - ACS-4.6.0-1

[Remi Bergsma]

Hi, 

This week a bug has been fixed in the private gateway. It just missed the 4.6.1 
release. 
https://github.com/apache/cloudstack/pull/1184

It will be included in both 4.6.2 and 4.7.0. 

You may build packages from the 4.6 branch and give those a go (packaging 
folder). Also integration tests have been improved to make sure it won't break 
again without noticing. 

Regards, Remi 

Sent from my iPhone

> On 11 Dec 2015, at 15:13, Kaushik Bora  wrote:
> 
> VPC private gateway static route is not created in VR.. However its
> reflecting on UI. But there is no entry on static_route table...using ip
> route show table static_route.
> 
> Regards
> Kaushik

Re: Default route is not configured on Redundant VPC VR (tier2)

[Remi Bergsma]

Satoru Sakaya, thanks for reporting the issue. Will discuss it with Wilder. 

Daan, I assume he means the 2nd tier on the router(s) which returns without ip 
after the reboots and failovers that are described. (this is the default gw for 
vms in this tier and the vip in the router)

Let's try to reproduce and write a Marvin test for it. 

Regards, Remi 

Sent from my iPhone

> On 06 Dec 2015, at 09:20, Daan Hoogland  wrote:
> 
> Satoru san,
> 
> Knowing your reports in the past I assume this is reproducible and a
> genuine bug. This leaves me to wonder, does it matter which tier is
> rebooted first?
> 
> It is certainly not supposed to happen.
> 
> On Sun, Dec 6, 2015 at 2:32 AM, giraffeg forestg 
> wrote:
> 
>> Hi all.
>> 
>> My environment:
>> 
>> CloudStack 4.6.1 , CentOS7
>> http://packages.shapeblue.com/cloudstack/upstream/centos7/4.6/
>> 
>> Hypervisor CentOS7 , KVM
>> 
>> SystemVM
>> 
>> http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2
>> 
>> 
>> Steps to reproduce:
>> 
>> 1)Create VPC (Redundant VPC offering)
>> 
>> 2)Create tier1 & tier2
>> 
>> 3)Create VM Instance on tier1 & tier2
>> 
>> 4)Check VPC VR IP Address (no problem)
>> 
>> root@r-9-VM:~# ip a
>> 1: lo:  mtu 16436 qdisc noqueue state UNKNOWN
>>link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>>inet 127.0.0.1/8 scope host lo
>> 2: eth0:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 0e:00:a9:fe:00:9a brd ff:ff:ff:ff:ff:ff
>>inet 169.254.0.154/16 brd 169.254.255.255 scope global eth0
>> 3: eth1:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 06:ac:80:00:00:21 brd ff:ff:ff:ff:ff:ff
>>inet 10.0.1.102/24 brd 10.0.1.255 scope global eth1
>>inet 10.0.1.103/24 brd 10.0.1.255 scope global secondary eth1
>> 4: eth2:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 02:00:7f:b8:00:05 brd ff:ff:ff:ff:ff:ff
>>inet 172.16.0.67/24 brd 172.16.0.255 scope global eth2
>>inet 172.16.0.1/24 brd 172.16.0.255 scope global secondary eth2
>> 5: eth3:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 02:00:03:56:00:04 brd ff:ff:ff:ff:ff:ff
>>inet 172.16.1.25/24 brd 172.16.1.255 scope global eth3
>>inet 172.16.1.1/24 brd 172.16.1.255 scope global secondary eth3
>> root@r-9-VM:~#
>> 
>> root@r-10-VM:~# ip a
>> 1: lo:  mtu 16436 qdisc noqueue state UNKNOWN
>>link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>>inet 127.0.0.1/8 scope host lo
>> 2: eth0:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 0e:00:a9:fe:00:49 brd ff:ff:ff:ff:ff:ff
>>inet 169.254.0.73/16 brd 169.254.255.255 scope global eth0
>> 3: eth1:  mtu 1500 qdisc noop state DOWN qlen 1000
>>link/ether 06:ac:80:00:00:21 brd ff:ff:ff:ff:ff:ff
>>inet 10.0.1.102/24 brd 10.0.1.255 scope global eth1
>>inet 10.0.1.103/24 brd 10.0.1.255 scope global secondary eth1
>> 4: eth2:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 02:00:19:11:00:06 brd ff:ff:ff:ff:ff:ff
>>inet 172.16.0.233/24 brd 172.16.0.255 scope global eth2
>> 5: eth3:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 02:00:20:19:00:05 brd ff:ff:ff:ff:ff:ff
>>inet 172.16.1.231/24 brd 172.16.1.255 scope global eth3
>> root@r-10-VM:~#
>> 
>> 
>> 5)Reboot VPC VR r-9-VM
>> 6)Check VPC VR IP Address (no problem)
>> 
>> root@r-9-VM:~# ip a
>> 1: lo:  mtu 16436 qdisc noqueue state UNKNOWN
>>link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>>inet 127.0.0.1/8 scope host lo
>> 2: eth0:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 0e:00:a9:fe:01:28 brd ff:ff:ff:ff:ff:ff
>>inet 169.254.1.40/16 brd 169.254.255.255 scope global eth0
>> 3: eth1:  mtu 1500 qdisc noop state DOWN qlen 1000
>>link/ether 06:ac:80:00:00:21 brd ff:ff:ff:ff:ff:ff
>>inet 10.0.1.103/24 brd 10.0.1.255 scope global eth1
>>inet 10.0.1.102/24 brd 10.0.1.255 scope global secondary eth1
>> 4: eth2:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 02:00:7f:b8:00:05 brd ff:ff:ff:ff:ff:ff
>>inet 172.16.0.67/24 brd 172.16.0.255 scope global eth2
>> 5: eth3:  mtu 1500 qdisc pfifo_fast state
>> UP qlen 1000
>>link/ether 02:00:03:56:00:04 brd ff:ff:ff:ff:ff:ff
>>inet 172.16.1.25/24 brd 172.16.1.255 scope global eth3
>> root@r-9-VM:~#
>> 
>> root@r-10-VM:~# ip a
>> 1: lo:  mtu 16436 qdisc noqueue state UNKNOWN
>>link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>>inet 127.0.0.1/8 scope 

Re: Default route is not configured on Redundant VPC VR (tier2)

[Remi Bergsma]

Ok, check. You mean the order of the reboot of the routers. Let's make some 
scenarios and try them. 

> On 06 Dec 2015, at 12:06, Daan Hoogland <daan.hoogl...@gmail.com> wrote:
> 
> I know what his example shows, Remi. I'm just wondering whether the order
> of rebooting might be significant.
> 
> On Sun, Dec 6, 2015 at 11:57 AM, Remi Bergsma <rberg...@schubergphilis.com>
> wrote:
> 
>> Satoru Sakaya, thanks for reporting the issue. Will discuss it with Wilder.
>> 
>> Daan, I assume he means the 2nd tier on the router(s) which returns
>> without ip after the reboots and failovers that are described. (this is the
>> default gw for vms in this tier and the vip in the router)
>> 
>> Let's try to reproduce and write a Marvin test for it.
>> 
>> Regards, Remi
>> 
>> Sent from my iPhone
>> 
>>> On 06 Dec 2015, at 09:20, Daan Hoogland <daan.hoogl...@gmail.com> wrote:
>>> 
>>> Satoru san,
>>> 
>>> Knowing your reports in the past I assume this is reproducible and a
>>> genuine bug. This leaves me to wonder, does it matter which tier is
>>> rebooted first?
>>> 
>>> It is certainly not supposed to happen.
>>> 
>>> On Sun, Dec 6, 2015 at 2:32 AM, giraffeg forestg <
>> giraffefore...@gmail.com>
>>> wrote:
>>> 
>>>> Hi all.
>>>> 
>>>> My environment:
>>>> 
>>>> CloudStack 4.6.1 , CentOS7
>>>> http://packages.shapeblue.com/cloudstack/upstream/centos7/4.6/
>>>> 
>>>> Hypervisor CentOS7 , KVM
>>>> 
>>>> SystemVM
>> http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2
>>>> 
>>>> 
>>>> Steps to reproduce:
>>>> 
>>>> 1)Create VPC (Redundant VPC offering)
>>>> 
>>>> 2)Create tier1 & tier2
>>>> 
>>>> 3)Create VM Instance on tier1 & tier2
>>>> 
>>>> 4)Check VPC VR IP Address (no problem)
>>>> 
>>>> root@r-9-VM:~# ip a
>>>> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
>>>>   link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>>>>   inet 127.0.0.1/8 scope host lo
>>>> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state
>>>> UP qlen 1000
>>>>   link/ether 0e:00:a9:fe:00:9a brd ff:ff:ff:ff:ff:ff
>>>>   inet 169.254.0.154/16 brd 169.254.255.255 scope global eth0
>>>> 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state
>>>> UP qlen 1000
>>>>   link/ether 06:ac:80:00:00:21 brd ff:ff:ff:ff:ff:ff
>>>>   inet 10.0.1.102/24 brd 10.0.1.255 scope global eth1
>>>>   inet 10.0.1.103/24 brd 10.0.1.255 scope global secondary eth1
>>>> 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state
>>>> UP qlen 1000
>>>>   link/ether 02:00:7f:b8:00:05 brd ff:ff:ff:ff:ff:ff
>>>>   inet 172.16.0.67/24 brd 172.16.0.255 scope global eth2
>>>>   inet 172.16.0.1/24 brd 172.16.0.255 scope global secondary eth2
>>>> 5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state
>>>> UP qlen 1000
>>>>   link/ether 02:00:03:56:00:04 brd ff:ff:ff:ff:ff:ff
>>>>   inet 172.16.1.25/24 brd 172.16.1.255 scope global eth3
>>>>   inet 172.16.1.1/24 brd 172.16.1.255 scope global secondary eth3
>>>> root@r-9-VM:~#
>>>> 
>>>> root@r-10-VM:~# ip a
>>>> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
>>>>   link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>>>>   inet 127.0.0.1/8 scope host lo
>>>> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state
>>>> UP qlen 1000
>>>>   link/ether 0e:00:a9:fe:00:49 brd ff:ff:ff:ff:ff:ff
>>>>   inet 169.254.0.73/16 brd 169.254.255.255 scope global eth0
>>>> 3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
>>>>   link/ether 06:ac:80:00:00:21 brd ff:ff:ff:ff:ff:ff
>>>>   inet 10.0.1.102/24 brd 10.0.1.255 scope global eth1
>>>>   inet 10.0.1.103/24 brd 10.0.1.255 scope global secondary eth1
>>>> 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state
>>>> UP qlen 1000
>>>>   link/ether 02:00:19:11:00:06 brd ff:ff:ff:ff:ff:ff
&g

Re: cloudstack-management start failed (CloudStack 4.6.1 + CentOS7)

[Remi Bergsma]

Good morning,

On centos7 try running this:

cloudstack-setup-management --tomcat7

When i try that, it works fine for me. This is due to tomcat 6/7 change. 

Regards, Remi 


Sent from my iPhone

> On 06 Dec 2015, at 02:33, giraffeg forestg  wrote:
> 
> Hi all.
> 
> My environment:
> 
> CloudStack 4.6.1 , CentOS7
> http://packages.shapeblue.com/cloudstack/upstream/centos7/4.6/
> 
> 
> Steps to reproduce:
> 
> 1)clean install CloudStack 4.6.1 on CentOS7
> 
> use http://packages.shapeblue.com/cloudstack/upstream/centos7/4.6/
> 
> [root@acs ~]# cat /etc/redhat-release
> CentOS Linux release 7.1.1503 (Core)
> [root@acs ~]#
> [root@acs ~]# rpm -qa | grep cloudstack
> cloudstack-management-4.6.1-shapeblue0.el7.centos.x86_64
> cloudstack-common-4.6.1-shapeblue0.el7.centos.x86_64
> [root@acs ~]#
> 
> 2)cloudstack-setup-databases...(snip)
> 
> 3)cloudstack-setup-management (Failed)
> 
> [root@acs ~]# cloudstack-setup-management
> Starting to configure CloudStack Management Server:
> Configure Firewall ... [OK]
> Configure CloudStack Management Server ...[Failed]
> Cannot find /etc/cloudstack/management/server-nonssl.xml or
> /etc/cloudstack/management/tomcat6-nonssl.conf, https enable failed
> Try to restore your system:
> Restore Firewall ... [OK]
> Restore CloudStack Management Server ...[OK]
> [root@acs ~]#
> 
> 4)check log (/var/log/messages)
> 
> Dec 6 10:08:51 acs server: WARNING: Unable to load server configuration
> from [/usr/share/cloudstack-management/conf/server.xml]
> 
> 5)check service status (failed)
> 
> [root@acs ~]# systemctl status cloudstack-management.service
> cloudstack-management.service - CloudStack Management Server
> Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service;
> enabled)
> Active: failed (Result: exit-code) since Sun 2015-12-06 10:08:52 JST; 11s
> ago
> Process: 3061 ExecStop=/usr/libexec/tomcat/server stop (code=exited,
> status=1/FAILURE)
> Process: 3026 ExecStart=/usr/libexec/tomcat/server start (code=exited,
> status=0/SUCCESS)
> Main PID: 3026 (code=exited, status=0/SUCCESS)
> 
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> java.io.FileInputStream.(FileInputStream.java:146)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> org.apache.catalina.startup.Catalina.stopServer(Catalina.java:466)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI...va:43)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> java.lang.reflect.Method.invoke(Method.java:606)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> org.apache.catalina.startup.Bootstrap.stopServer(Bootstrap.java:370)
> Dec 06 10:08:52 acs.dom.local server[3061]: at
> org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:457)
> Dec 06 10:08:52 acs.dom.local systemd[1]: cloudstack-management.service:
> control process exited, code=exited status=1
> Dec 06 10:08:52 acs.dom.local systemd[1]: Unit
> cloudstack-management.service entered failed state.
> Hint: Some lines were ellipsized, use -l to show in full.
> [root@acs ~]#
> 
> workaround:
> The correct do not know whether or not , but it worked.
> 
> 6)check file
> 
> [root@acs ~]# ls -la /etc/cloudstack/management
> total 132
> drwxr-xr-x. 3 root root 4096 Dec 5 17:59 .
> drwxr-xr-x. 3 root root 4096 Dec 5 17:53 ..
> drwxrwx---. 3 root cloud 4096 Dec 5 17:53 Catalina
> rw-rr-. 1 root root 8945 Dec 1 20:22 catalina.policy
> rw-rr-. 1 root root 3794 Dec 1 20:22 catalina.properties
> rw-rr-. 1 root root 1653 Dec 1 20:22 classpath.conf
> rw-rr-. 1 root root 1357 Dec 1 20:22 commons-logging.properties
> rw-r. 1 root cloud 3137 Dec 5 17:59 db.properties
> rw-rr-. 1 root root 979 Dec 1 20:22 environment.properties
> rw-rr-. 1 root root 927 Dec 1 20:22 java.security.ciphers
> rw-rr-. 1 root root 8 Dec 5 17:55 key
> rw-rr-. 1 root root 7020 Dec 1 20:22 log4j-cloud.xml
> rw-rr-. 1 root root 6722 Dec 1 20:22 server7-nonssl.xml
> rw-rr-. 1 root root 7251 Dec 1 20:22 server7-ssl.xml
> rw-rr-. 1 root root 1383 Dec 1 20:22 tomcat-users.xml
> rw-rr-. 1 root root 50475 Dec 1 20:22 web.xml
> [root@acs ~]
> 
> 7)copy file
> 
> [root@acs ~]# cd /etc/cloudstack/management
> [root@acs management]# cp -p server7-nonssl.xml server.xml
> 
> 8)start cloudstack-management service
> 
> [root@acs ~]# systemctl start cloudstack-management.service
> 
> 9)check service status (running)
> 
> [root@acs ~]# systemctl status cloudstack-management.service
> cloudstack-management.service - CloudStack Management Server
> Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service;
> enabled)
> Active: active (running) since Sun 2015-12-06 10:12:23 JST; 1min 0s ago
> Process: 3061 ExecStop=/usr/libexec/tomcat/server stop (code=exited,
> 

Re: cloudstack 4.6 Unable to add the host

[Remi Bergsma]

Hi,

In global settings there is a 'host' setting that should contain the mgt server 
ip. The KVM agent should get this ip in agent.properties during setup. 

The agent will connect to this ip on tcp/8250. Be sure this port is open and 
reachable (test using with telnet). 

Also, from my experience you need to run java7 on both mgt and hypervisor. 

Finally, when adding be sure the agent state is stopped. It should then be 
added without problems. 

Your logs show a connection issue from agent to mgt server on port 8250. Please 
double check this is reachable. 

Regards, Remi 

Sent from my iPhone

> On 29 Nov 2015, at 06:29, Alexander Couzens  wrote:
> 
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA256
> 
> Hi lixq,
> 
> I think this is a connection or dns problem.
> Do you checked the firewall and ensure you neither have a connection or
> dns problem between your nodes?
> 
> Try to ping the nodes each other using their hostnames.
> Also check the hostname and on what ip it maps itself.
> e.g.
> ping cloudstack-a from itself should *NOT* show an ip starting with 127.
> like 127.0.1.1.
> 
> Best,
> lynxis
> 
> On Sun, 29 Nov 2015 11:06:04 +0800
> lixq  wrote:
> 
>> hi every one:
>> I have configure cloudstack 4.6 on centos 6.5 A (manage console and
>> nfs) and  centos 6.5 B (kvm), but when I add the compute node ,
>> report error "Unable to add the host"
>> 
>> I was fllow 
>> http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.6/qig.html
>>  
>> config it .
>> 
>> Thanks a lot !!!
> - -- 
> Alexander Couzens
> 
> mail: lyn...@fe80.eu
> jabber: lyn...@fe80.eu
> mobile: +4915123277221
> gpg: 390D CF78 8BF9 AA50 4F8F  F1E2 C29E 9DA6 A0DF 8604
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v2
> 
> iQIcBAEBCAAGBQJWWo0iAAoJEMKenaag34YEDEoP/1Q8g3U8Q/BEzk4ovryWdhwQ
> EL49Hw7uENkihuvfCyeg8uAaF5IkKq3Ew5CNUBdPIbj9mhzU8yllFxSZ4E4HdNGR
> EoVcpmNaQfbWe8HxHR/hoPrnGhOFafqHMSd0DMYD/yU+100lmjhaltrMH6lpb4D/
> b4lKFcNjYCiRTJp8EAeKKaoXDecOqaXM1rsmnpVoNjJD9EZv8/YOVLsnxGr8/BT0
> 6dOmLDMyyIQFgzAD258hRQGQJSOFW/pu8evmfi4Zd6kSLel8D8s5dSqG1ZczVhv0
> KapEnn3R9Cz2RS9rDq17Z8+7/09QzCpN4fD7SGmO/ybJ0gBMfGzfUe8ztzCayfBg
> JdQUbWbbzxn5xKMp1+feHbctFQtpzQsPl4JJFKGtv1MD3Svg8ChH1ECqBDs2ssZm
> qDBwO+nUffWj9ryTDH2HjAlW6a7fg58KbYrW33aRMzadZpeFwXqpKcDK5OhBMEwC
> QoEAjPyR4VVcYmW326Srs13WxvjJGdE5KPkHEZugZflv0Q3/3b7F+F9Ns0DFdRDe
> 415v8vEeBaPdTq31yASl1osekcQQZj4ITetSR2dojjSJ/6VCXJ4R4BklZygWsuKM
> SvSv9Fyp52eaBuLZJyXDGJCRjrFdFuf2HmPYyG5vMK7GOoJssnYCMAwgq8+N1GeL
> Ysc8skHqUJKUwapUURPq
> =yfo/
> -END PGP SIGNATURE-

Re: can not add host

[Remi Bergsma]

Hi Frank,

Seems that the KVM agent cannot communicate back to the management server. 

In agent.properties the ip is specified, which is the "host" global setting. Is 
this setting set to the right ip address? Did it end up in the 
agent.properties? Finally, Can the KVM host talk to the management server over 
port 8250?

Regards,
Remi 

Sent from my iPhone

> On 28 Nov 2015, at 05:35, frank  wrote:
> 
> Dear cloudstack user & team,
> when I add host in cloudstack 4.6 UI,i got following output:
> Unable to add the host.
> 
> managerment.log is:
> 
> 2015-11-28 03:10:07,864 DEBUG [c.c.u.s.SSHCmdHelper] (catalina-exec-17:ctx-
> cbe178af ctx-4d8872cb) cloudstack-setup-agent  -m 192.168.85.136 -z 1 -p 1 -c 
> 1 
> -g faa1065b-cacf-3c1b-8c32-5e59e7551806 -a --pubNic=cloudbr0 
> --prvNic=cloudbr0 
> --guestNic=cloudbr0 --hypervisor=kvm output:Starting to configure your system:
> Configure Cgroup ...  [OK]
> Configure SElinux ... [OK]
> Configure Network ... [OK]
> Configure Libvirt ... [OK]
> Configure Firewall ...[OK]
> Configure Nfs ... [OK]
> Configure cloudAgent ...  [OK]
> CloudStack Agent setup is done!
> .
> 
> ...
> 2015-11-28 03:15:08,071 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-
> exec-17:ctx-cbe178af ctx-4d8872cb) Timeout, to wait for the host connecting 
> to 
> mgt svr, assuming it is failed
> 2015-11-28 03:15:09,254 WARN  [c.c.r.ResourceManagerImpl] (catalina-exec-
> 17:ctx-cbe178af ctx-4d8872cb) Unable to find the server resources at 
> http://192.168.85.135
> 2015-11-28 03:15:09,255 INFO  [c.c.u.e.CSExceptionErrorCode] (catalina-exec-
> 17:ctx-cbe178af ctx-4d8872cb) Could not find exception: 
> com.cloud.exception.DiscoveryException in error code list for exceptions
> 2015-11-28 03:15:09,255 WARN  [o.a.c.a.c.a.h.AddHostCmd] 
> (catalina-exec-17:ctx-
> cbe178af ctx-4d8872cb) Exception:
> com.cloud.exception.DiscoveryException: Unable to add the host
>at 
> com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.ja
> va:804)
>at 
> com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:5
> 99)
>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja
> va:43)
>at java.lang.reflect.Method.invoke(Method.java:606)
>at 
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtil
> s.java:317)
>at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(Re
> flectiveMethodInvocation.java:183)
>at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflective
> MethodInvocation.java:150)
>at 
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeIn
> vocationInterceptor.java:91)
>at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflective
> MethodInvocation.java:172)
> 
> at 
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.
> java:204)
>at com.sun.proxy.$Proxy156.discoverHosts(Unknown Source)
>at 
> org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java
> :142)
>at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
>at com.cloud.api.ApiServer.queueCommand(ApiServer.java:703)
>at com.cloud.api.ApiServer.handleRequest(ApiServer.java:528)
>at 
> com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:296)
>at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
>at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(Default
> ManagedContext.java:56)
>at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContex
> t(DefaultManagedContext.java:103)
>at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext
> (DefaultManagedContext.java:53)
>at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
>at com.cloud.api.ApiServlet.doPost(ApiServlet.java:91)
>at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
>at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
>at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFil
> terChain.java:290)
>at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain
> .java:206)
>at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:
> 233)
>at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:
> 191)
>at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>at 
> 

Re: Up-graduation of CS 4.3.1 to 4.6.0

[Remi Bergsma]

You need the 4.5 and 4.6 systemvm templates when upgrading (will be fixed in 
4.6.1). We tried upgrading from 4.4 and that works. 

Do you use xenserver? There were many changes in 4.4 regarding xenha. Be sure 
to check that. 

Testing it in a lab before actually performing the upgrade is always a good 
idea that gives you an idea of the issues you may face. 

Be sure to read all release notes, it's quite an upgrade all the way from 4.3 
:-)

Sent from my iPhone

> On 24 Nov 2015, at 08:25, Erik Weber  wrote:
> 
> On Tue, Nov 24, 2015 at 4:41 AM, kotipalli venkatesh <
> venkateshcloudt...@gmail.com> wrote:
> 
>> Hi All,
>> 
>> Preset we are using 4.3.1 version of cloudstack. so i want to upgrade my CS
>> 4.3.1 to 4.6.0? Is it good way or not ?
>> 
>> Good way means we are thinking directly jump to 4.3.1 to 4.6.0 while
>> up-graduation we are facing any issues?
>> 
>> Is there any one face this scenario please suggest me guys...
> I haven't tried that route yet myself, but make sure to register systemvm
> templates for all major versions to be on the safe side.
> 
> -- 
> Erik

Re: CS 4.5 + XEN 6.5 using bond and pvlan

[Remi Bergsma]

Hi Vadim,

All fine, don’t worry! Glad we discussed it :-)

Regards,
Remi




On 19/11/15 10:10, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:

>Dear Remi,
>
>I had this impression you described indeed. Have been with CS 
>project from version 4.0 and updates always being very exiting thing :)
>Your words make me more confident in what you did. The idea to 
>stabilize master is great! I am sorry for panic. Please, accept my 
>apologize
>
>Regards,
>
>Vadim.
>
>
>On 2015-11-18 21:29, Remi Bergsma wrote:
>
>> Hi Vadim,
>> 
>> Thanks for your reply. For the 4.6 release we changed the way we work. 
>> Instead of branching off early and making a release branch stable, we 
>> decided to stabilise master. We got many complaints that master didn't 
>> compile at times or functionality wasn't tested before it entered 
>> master. Making master stable was quite some work, even harder than 
>> making a release branch stable. I can imagine that process gives you 
>> the impression of "many problems".
>> 
>> In reality, this should bring more stable releases. 4.7 will be built 
>> on top of 4.6, so if 4.6 is good, 4.7 will be better (and so on). In 
>> the past, 4.5 was not built on top of 4.4 (so you saw problems coming 
>> back and had to wait until a .1 or .2 release, indeed).
>> 
>> 4.6.0 was released after just two RC voting rounds, while previous 
>> releases needed more of them. That says something about the quality 
>> IMHO.
>> 
>> This is not so related to the question that was asked but I wanted to 
>> be sure there weren't any "problems" in 4.6 that I didn't know about 
>> (so they could be addressed). It's perfectly fine not to upgrade yet. 
>> But please don't give people the impression there are "many problems" 
>> while you cannot name them.
>> 
>> In the mean while we work on 4.6.1 and 4.7.0 and hopefully some day 
>> you'll have a smooth upgrade and enjoy the new features.
>> 
>> If you need any help with upgrading, please drop us a line on the dev 
>> list.
>> 
>> Regards,
>> Remi
>> 
>> On 18/11/15 15:45, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:
>> 
>> Dear Remi,
>> 
>> My apologize to mislead Audrey with notations - problem were
>> with VPC, not VR. Voting process for 4.6 release was also very
>> difficult. Of course official release will be stabilized, but from user
>> perspective I will say the same to Aundery - 4.6 will not solve his
>> problem with OVS plugin and probably will bring more problems than
>> 4.5.2. May be this is just fear before release, but this is my personal
>> fear - I will wait until 4.6.1 definitely. My 4.5.2 VPC works too good
>> to take a risk of immediate update :)
>> 
>> Vadim.
>> 
>> On 2015-11-18 15:32, Remi Bergsma wrote:
>> 
>> Hi Vadim,
>> 
>> What VR problems do you refer to in ACS 4.6?
>> 
>> Regards,
>> Remi
>> 
>> On 18/11/15 12:52, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:
>> 
>> Dear Audrey,
>> 
>> OVS plugin, as I remember, last seen OK before CS 4.4.0. I have created
>> bug report in JIRA
>> https://issues.apache.org/jira/browse/CLOUDSTACK-7446 [1] [1 [1]]. 
>> Since 4.5.1
>> this
>> plugin is not in the list anymore. The reason, I guess, is outdated
>> code
>> that is not compatible with this release. CS 4.6 version has a lot of
>> problems with VR, so I would not recommend you to install it. Don't
>> know
>> if OVS is back there. I doubt.
>> 
>> I think you may find OVS plugin at CS source tree, but whether you want
>> to update it? Is PVLAN so important for you?
>> 
>> Vadim.
>> 
>> On 2015-11-18 13:30, Audrey Roberto B Baldin wrote:
>> 
>> Hi Vadim, thanks for your help.
>> 
>> After reading your message I remembered of the plugin area of CS and
>> yes, the OVS plugin is missing. So I ask: Why is it missing? I had seen
>> it before (CS 4.5.1 probably) and using XEN 6.5 was able to configure
>> PVLAN.
>> 
>> Is it possible to instal the OVS plugin? Where can I find it?
>> 
>> Does CS 4.6 has the plugin out-of-the-box?
>> 
>> Att.,
>> Audrey
>> 
>> - Mensagem original -
>> De: "Vadim Kimlaychuk" <va...@kickcloud.net>
>> Para: users@cloudstack.apache.org
>> Cc: "Audrey Roberto B Baldin" <audrey.bal...@unitelco.com.br>
>> Enviadas: Terça-feira, 17 de Novembro de 2015 19:08:10

Re: CS 4.5 + XEN 6.5 using bond and pvlan

[Remi Bergsma]

Hi Vadim,

Thanks for your reply. For the 4.6 release we changed the way we work. Instead 
of branching off early and making a release branch stable, we decided to 
stabilise master. We got many complaints that master didn’t compile at times or 
functionality wasn’t tested before it entered master. Making master stable was 
quite some work, even harder than making a release branch stable. I can imagine 
that process gives you the impression of “many problems”.

In reality, this should bring more stable releases. 4.7 will be built on top of 
4.6, so if 4.6 is good, 4.7 will be better (and so on). In the past, 4.5 was 
not built on top of 4.4 (so you saw problems coming back and had to wait until 
a .1 or .2 release, indeed).


4.6.0 was released after just two RC voting rounds, while previous releases 
needed more of them. That says something about the quality IMHO.

This is not so related to the question that was asked but I wanted to be sure 
there weren’t any “problems” in 4.6 that I didn’t know about (so they could be 
addressed). It’s perfectly fine not to upgrade yet. But please don’t give 
people the impression there are “many problems” while you cannot name them.


In the mean while we work on 4.6.1 and 4.7.0 and hopefully some day you’ll have 
a smooth upgrade and enjoy the new features.

If you need any help with upgrading, please drop us a line on the dev list.

Regards,
Remi


On 18/11/15 15:45, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:

>Dear Remi,
>
> My apologize to mislead Audrey with notations - problem were 
>with VPC, not VR. Voting process for 4.6 release was also very 
>difficult. Of course official release will be stabilized, but from user 
>perspective I will say the same to Aundery - 4.6 will not solve his 
>problem with OVS plugin and probably will bring more problems than 
>4.5.2. May be this is just fear before release, but this is my personal 
>fear - I will wait until 4.6.1 definitely.  My 4.5.2 VPC works too good 
>to take a risk of immediate update :)
>
>Vadim.
>
>On 2015-11-18 15:32, Remi Bergsma wrote:
>
>> Hi Vadim,
>> 
>> What VR problems do you refer to in ACS 4.6?
>> 
>> Regards,
>> Remi
>> 
>> On 18/11/15 12:52, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:
>> 
>> Dear Audrey,
>> 
>> OVS plugin, as I remember, last seen OK before CS 4.4.0. I have created
>> bug report in JIRA
>> https://issues.apache.org/jira/browse/CLOUDSTACK-7446 [1]. Since 4.5.1 
>> this
>> plugin is not in the list anymore. The reason, I guess, is outdated 
>> code
>> that is not compatible with this release. CS 4.6 version has a lot of
>> problems with VR, so I would not recommend you to install it. Don't 
>> know
>> if OVS is back there. I doubt.
>> 
>> I think you may find OVS plugin at CS source tree, but whether you want
>> to update it? Is PVLAN so important for you?
>> 
>> Vadim.
>> 
>> On 2015-11-18 13:30, Audrey Roberto B Baldin wrote:
>> 
>> Hi Vadim, thanks for your help.
>> 
>> After reading your message I remembered of the plugin area of CS and
>> yes, the OVS plugin is missing. So I ask: Why is it missing? I had seen
>> it before (CS 4.5.1 probably) and using XEN 6.5 was able to configure
>> PVLAN.
>> 
>> Is it possible to instal the OVS plugin? Where can I find it?
>> 
>> Does CS 4.6 has the plugin out-of-the-box?
>> 
>> Att.,
>> Audrey
>> 
>> - Mensagem original -
>> De: "Vadim Kimlaychuk" <va...@kickcloud.net>
>> Para: users@cloudstack.apache.org
>> Cc: "Audrey Roberto B Baldin" <audrey.bal...@unitelco.com.br>
>> Enviadas: Terça-feira, 17 de Novembro de 2015 19:08:10
>> Assunto: Re: CS 4.5 + XEN 6.5 using bond and pvlan
>> 
>> Hello Audrey,
>> 
>> Look at this document:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/PVLAN+for+isolation+within+a+VLAN
>>  
>> [2]
>> [1]
>> XenServer uses OVS and CS have OVS pluging to work with. OVS plugin
>> for cloudstack hasn't been updated for a long time as I know. At my CS
>> 4.5.2 this plugin is missing, though in older versions of CS it was
>> present. I think this functionality does not work for XenServer 6.5.
>> Use
>> VLANs - it is more reliable.
>> 
>> Vadim.
>> 
>> On 2015-11-17 21:11, Audrey Roberto B Baldin wrote:
>> 
>> Hello everybody!
>> 
>> I installed CS 4.5.2 and I'm using XEN 6.5. There is one NIC dedicated
>> for Public traffic, one for MGMT + Secondary Storage, one for Primary
>> Storage and a bond configured for the Guest traffic. Zone is installed
>

Re: CS 4.5 + XEN 6.5 using bond and pvlan

[Remi Bergsma]

Hi Vadim,

What VR problems do you refer to in ACS 4.6?

Regards,
Remi






On 18/11/15 12:52, "Vadim Kimlaychuk"  wrote:

>Dear Audrey,
>
>  OVS plugin, as I remember, last seen OK before CS 4.4.0. I have created 
>bug report in JIRA 
>https://issues.apache.org/jira/browse/CLOUDSTACK-7446. Since 4.5.1 this 
>plugin is not in the list anymore. The reason, I guess, is outdated code 
>that is not compatible with this release. CS 4.6 version has a lot of 
>problems with VR, so I would not recommend you to install it. Don't know 
>if OVS is back there. I doubt.
>
>  I think you may find OVS plugin at CS source tree, but whether you want 
>to update it? Is PVLAN so important for you?
>
>Vadim.
>
>On 2015-11-18 13:30, Audrey Roberto B Baldin wrote:
>
>> Hi Vadim, thanks for your help.
>> 
>> After reading your message I remembered of the plugin area of CS and 
>> yes, the OVS plugin is missing. So I ask: Why is it missing? I had seen 
>> it before (CS 4.5.1 probably) and using XEN 6.5 was able to configure 
>> PVLAN.
>> 
>> Is it possible to instal the OVS plugin? Where can I find it?
>> 
>> Does CS 4.6 has the plugin out-of-the-box?
>> 
>> Att.,
>> Audrey
>> 
>> - Mensagem original -
>> De: "Vadim Kimlaychuk" 
>> Para: users@cloudstack.apache.org
>> Cc: "Audrey Roberto B Baldin" 
>> Enviadas: Terça-feira, 17 de Novembro de 2015 19:08:10
>> Assunto: Re: CS 4.5 + XEN 6.5 using bond and pvlan
>> 
>> Hello Audrey,
>> 
>> Look at this document:
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/PVLAN+for+isolation+within+a+VLAN
>>  
>> [1]
>> XenServer uses OVS and CS have OVS pluging to work with. OVS plugin
>> for cloudstack hasn't been updated for a long time as I know. At my CS
>> 4.5.2 this plugin is missing, though in older versions of CS it was
>> present. I think this functionality does not work for XenServer 6.5. 
>> Use
>> VLANs - it is more reliable.
>> 
>> Vadim.
>> 
>> On 2015-11-17 21:11, Audrey Roberto B Baldin wrote:
>> 
>>> Hello everybody!
>>> 
>>> I installed CS 4.5.2 and I'm using XEN 6.5. There is one NIC dedicated
>>> for Public traffic, one for MGMT + Secondary Storage, one for Primary
>>> Storage and a bond configured for the Guest traffic. Zone is installed
>>> as Advanced without Security Groups.
>>> 
>>> When I add a Guest Network with PVLAN, the network is created, but 
>>> when
>>> I try to create a new instance it does not start. I realized that the
>>> virtual router also does not start. Adding a Guest Network without
>>> PVLAN works as expected.
>>> 
>>> Does anyone have an idea about it?
>>> 
>>> Looking into the log I could find the information below:
>>> 
>>> 2015-11-17 12:03:48,924 WARN [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-280:ctx-c1d905bf) callHostPlugin failed for cm
>>> d: setup-pvlan-dhcp with args dhcp-mac: 06:b9:40:00:08:91, nw-label:
>>> GUESTBR0, isolated-pvlan: 999, op: add, dhcp-name:
>>> r-10-VM, primary-pvlan: 900, dhcp-ip: 200.150.236.11, due to There was
>>> a failure communicating with the plugin.
>>> 
>>> 2015-11-17 12:03:48,924 WARN [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-280:ctx-c1d905bf) Seq 1-6584825605169088819: Thr
>>> owable caught while executing command
>>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
>>> for cmd: setup-pvlan-dhcp with args dhcp-mac: 06:
>>> b9:40:00:08:91, nw-label: GUESTBR0, isolated-pvlan: 999, op: add,
>>> dhcp-name: r-10-VM, primary-pvlan: 900, dhcp-ip: 200.1
>>> 50.236.11, due to There was a failure communicating with the plugin.
>>> at
>>> com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:3686)
>>> at
>>> com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1708)
>>> at
>>> com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:541)
>>> at
>>> com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
>>> at
>>> com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
>>> at
>>> com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:6
>>> 5)
>>> at
>>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:1
>>> 03)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53
>>> )
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>> 

Re: VirtualRouter has duplicated public interface and broken NAT functionality

[Remi Bergsma]

Hi,

You are right, eth3 should not be there. Somehow the detection of the public 
interface goes wrong and it ends up creating a new one.

In the logs, instead of ethX, I see null which is an indication:

2015-11-17 01:38:17,760 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) 
Processing command: com.cloud.agent.api.routing.IpAssocCommand
2015-11-17 01:38:17,769 DEBUG [kvm.resource.OvsVifDriver] 
(agentRequest-Handler-1:null) plugging nic=[Nic:Public-null-vlan://104]

I've seen this before and I think it is the combination of ovs with a tagged 
(as in vlan) network. 

You probably have specified a vlan tag in CloudStack (104?) on some bridge. If 
you can change it to use untagged, but then point to an ovs bridge that is 
tagged it will most likely work. You then move the tagging from CloudStack to 
ovs. I think this is how I worked around it when I saw this. 

Don't get me wrong, what you did should work so this is a bug. The cause needs 
to be figured out but it wasn't too obvious. 

I'm also curious to know if 4.6.0 (which will be available this week) still has 
this issue. 

This is what I remember, hope it gives some pointers. 

Regards, Remi 



> On 17 Nov 2015, at 06:56, Alexander Couzens  wrote:
> 
> Hi,
> 
> a VirtualRouter is not nat-ing any Packets. Even there are egress
> rules, it's not possible to ping anything from a guest VM to the outer world.
> 
> I'm not sure if I'm doing something wrong or if this is a bug.
> 
> The VR has XXX.XXX.221.102 as public ip, guest net is 10.1.1.0/24.
> The webui + cloudmonkey shows me 3 nics on the VM, but it has obvious 4 nics.
> Looking into the database confirms it, there isn't any forth nic.
> 
> Logging into the machine shows
> # ip r
> default via XXX.XXX.221.126 dev eth2 
> 10.1.1.0/24 dev eth0  proto kernel  scope link  src 10.1.1.1 
> XXX.XXX.221.96/27 dev eth2  proto kernel  scope link  src XXX.XXX.221.102 
> XXX.XXX.221.96/27 dev eth3  proto kernel  scope link  src XXX.XXX.221.102 
> 169.254.0.0/16 dev eth1  proto kernel  scope link  src 169.254.0.158 
> 
> Also looking on iptables I found the nat rule:
> Chain POSTROUTING (policy ACCEPT 6 packets, 415 bytes)
> pkts bytes target prot opt in out source   
> destination 
>0 0 SNAT   all  --  *  eth30.0.0.0/0 0.0.0.0/0
> to:XXX.XXX.221.102
> 
> Mention the eth3, which is the later interface. But the traffic will route 
> from the guest vm is
> using eth2. There are policy routing which uses the table Table_eth3, but it 
> also uses eth2 for traffic instead of eth3.
> # ip r s ta Table_eth3
> default via XXX.XXX.221.126 dev eth2  proto static 
> throw 10.1.1.0/24  proto static 
> throw XXX.XXX.221.96/27  proto static 
> throw 169.254.0.0/16  proto static 
> 
> So I would say that eth3 is wrong.
> When the vm is created it only has 3 network interface and looks correct, but 
> later cloudstack
> generates the last one looking into the log [1].
> 
> Any ideas?
> 
> Best
> lynxis
> 
> 
> [1]
> 2015-11-17 01:38:17,760 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.AggregationControlCommand
> 2015-11-17 01:38:17,760 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.IpAssocCommand
> 2015-11-17 01:38:17,769 DEBUG [kvm.resource.OvsVifDriver] 
> (agentRequest-Handler-1:null) plugging nic=[Nic:Public-null-vlan://104]
> 2015-11-17 01:38:17,898 DEBUG [kvm.resource.LibvirtComputingResource] 
> (agentRequest-Handler-1:null) Executing: 
> /usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh netusage.sh 
> 169.254.0.158 -a eth3 
> 2015-11-17 01:38:18,033 DEBUG [kvm.resource.LibvirtComputingResource] 
> (agentRequest-Handler-1:null) Execution is successful.
> 2015-11-17 01:38:18,034 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.SetFirewallRulesCommand
> 2015-11-17 01:38:18,034 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.SetMonitorServiceCommand
> 2015-11-17 01:38:18,034 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.DhcpEntryCommand
> 2015-11-17 01:38:18,034 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.VmDataCommand
> 2015-11-17 01:38:18,035 DEBUG [cloud.agent.Agent] 
> (agentRequest-Handler-1:null) Processing command: 
> com.cloud.agent.api.routing.AggregationControlCommand
> 2015-11-17 01:38:18,271 DEBUG [kvm.resource.LibvirtComputingResource] 
> (agentRequest-Handler-1:null) Executing: 
> /usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh vr_cfg.sh 
> 169.254.0.158 -c /var/cache/cloud/VR-1c6cc724-79ac-4155-bb73-284514213d10.cfg 
> 2015-11-17 01:38:19,062 DEBUG [kvm.resource.LibvirtComputingResource] 
> 

Re: Re[2]: GRE Isolation Performance

[Remi Bergsma]

Hi David,

STT support was added to mainstream OVS only a few months ago, last summer. 
Before that you had to patch it in. 

To be honest, in 2012 when we started using this, STT was the only option that 
could use the offloading of the nic. Today, VXLAN also is able to do that. For 
new deployments, that is the way forward as it is widely adopted and supported. 

I never tried VXLAN without a controller, but it is worth investigating. For 
sure Nicira and Nuage support it. 

We might consider dropping GRE support, but that's more of a subject for the 
dev list. If you have stats/performance details to share, that might help 
showing it is not a real option any more for production deployments. 

Regards, Remi 

Sent from my iPhone

> On 05 Nov 2015, at 08:19, David Amorín <david.amo...@adderglobal.com> wrote:
> 
> It looks VXLAN and STT are currently the best options. If OVS has support for 
> STT tunnels, why CS doesn't support this configuration?
> 
> David
> 
> 
> -----Mensaje original- 
>> De: "Remi Bergsma" <rberg...@schubergphilis.com> 
>> A: users@cloudstack.apache.org 
>> Fecha: 04/11/2015 20:29 
>> Asunto: Re: GRE Isolation Performance 
>> 
>> Hi David,
>> 
>> I haven’t used GRE myself, but I do know that performance wise you need 
>> something that offloads to the nic, as with vlan tagging (instead of having 
>> the cpu do all the work). Did you consider VXLAN? That has nic offloading 
>> support in most nics these days. We are using STT (also does offloading) 
>> with Nicira and it is very fast. If I had to build again, I’d investigate 
>> VXLAN.
>> 
>> 
>> 
>> Regards,
>> Remi
>> 
>> 
>>> On 04/11/15 12:31, "David Amorín" <david.amo...@adderglobal.com> wrote:
>>> 
>>> Hi all,
>>> We are working in an environment with CS 4.5.2 / XenServer 6.5 with 
>>> multiple zones (Spain and Netherlands) using GRE Isolation and we have some 
>>> concerns that we would like to share with you. Basically, we make a CPU 
>>> benchmark between VLAN isolation and GRE isolation and the results show us 
>>> that the consumption of CPU with GRE isolation is too much compared with 
>>> VLAN isolation.
>>> 
>>> 
>>> Can anyone share with us the experience working with GRE isolation?
>>> 
>>> 
>>> We are not sure if this configuration in production will be safe, scalable 
>>> and with an acceptable level of performance.
>>> 
>>> 
>>> Thanks,
>>> 
>>> 
>>> David
> 

Re: Re[2]: GRE Isolation Performance

[Remi Bergsma]

Hi David,

All I know is that you need NSX-mh (multi hypervisor version) and that works 
with KVM and xenserver. 

The licensing options changed a lot since it became VMware. 

Also checkout Nuage, they are actively maintaining and supporting their plugin 
(whereas the Nicira plugin was made by the community). 

Both controllers need to be licensed so that brings in extra costs one way or 
the other. But they also bring in many new features not possible without SDN. 

Regards, Remi 

Sent from my iPhone

> On 05 Nov 2015, at 08:25, David Amorín <david.amo...@adderglobal.com> wrote:
> 
> Remi,Can you please confirm the cost of Nicira (VMware NSX) aprox.?  I saw 
> that they offer a perpetual license per CPU socket $6K each one. Is that 
> correct?
> 
> 
> http://searchsdn.techtarget.com/news/2240222952/VMware-NSX-price-finally-published-as-channel-starts-selling
> 
> DA
> 
> 
> -----Mensaje original- 
>> De: "Remi Bergsma" <rberg...@schubergphilis.com> 
>> A: users@cloudstack.apache.org 
>> Fecha: 04/11/2015 20:29 
>> Asunto: Re: GRE Isolation Performance 
>> 
>> Hi David,
>> 
>> I haven’t used GRE myself, but I do know that performance wise you need 
>> something that offloads to the nic, as with vlan tagging (instead of having 
>> the cpu do all the work). Did you consider VXLAN? That has nic offloading 
>> support in most nics these days. We are using STT (also does offloading) 
>> with Nicira and it is very fast. If I had to build again, I’d investigate 
>> VXLAN.
>> 
>> 
>> 
>> Regards,
>> Remi
>> 
>> 
>>> On 04/11/15 12:31, "David Amorín" <david.amo...@adderglobal.com> wrote:
>>> 
>>> Hi all,
>>> We are working in an environment with CS 4.5.2 / XenServer 6.5 with 
>>> multiple zones (Spain and Netherlands) using GRE Isolation and we have some 
>>> concerns that we would like to share with you. Basically, we make a CPU 
>>> benchmark between VLAN isolation and GRE isolation and the results show us 
>>> that the consumption of CPU with GRE isolation is too much compared with 
>>> VLAN isolation.
>>> 
>>> 
>>> Can anyone share with us the experience working with GRE isolation?
>>> 
>>> 
>>> We are not sure if this configuration in production will be safe, scalable 
>>> and with an acceptable level of performance.
>>> 
>>> 
>>> Thanks,
>>> 
>>> 
>>> David
> 

Apache CloudStack 4.6.0RC1 heads-up

[Remi Bergsma]

Hi all,

On the dev list we’re working on Apache CloudStack 4.6.0 and a Release 
Candidate was released today.

Details: http://cloudstack.markmail.org/thread/ps6abib7ixclxre7

If you want a sneak preview or help testing, please do!

Regards,
Remi

Re: GRE Isolation Performance

[Remi Bergsma]

Hi David,

I haven’t used GRE myself, but I do know that performance wise you need 
something that offloads to the nic, as with vlan tagging (instead of having the 
cpu do all the work). Did you consider VXLAN? That has nic offloading support 
in most nics these days. We are using STT (also does offloading) with Nicira 
and it is very fast. If I had to build again, I’d investigate VXLAN.



Regards,
Remi


On 04/11/15 12:31, "David Amorín"  wrote:

>Hi all,
>We are working in an environment with CS 4.5.2 / XenServer 6.5 with multiple 
>zones (Spain and Netherlands) using GRE Isolation and we have some concerns 
>that we would like to share with you. Basically, we make a CPU benchmark 
>between VLAN isolation and GRE isolation and the results show us that the 
>consumption of CPU with GRE isolation is too much compared with VLAN isolation.
>
>
>Can anyone share with us the experience working with GRE isolation?
>
>
>We are not sure if this configuration in production will be safe, scalable and 
>with an acceptable level of performance.
>
>
>Thanks,
>
>
>David
>
>
>
>
>
>
>
>
>
>
>

Re: Redundant VPC Virtual Router's state is BACKUP & BACKUP

[Remi Bergsma]

Thanks, we will look into this tomorrow!

Regards, Remi 

Sent from my iPhone

> On 01 Nov 2015, at 03:48, giraffeg forestg  wrote:
> 
> Hi all.
> 
> My environment:
> 
> CloudStack master(2015/10/31) 4.6.0-snapshot
> 
> Hypervisor CentOS6/KVM
> 
> SystemVM
> build #654 (2015/10/22 19:27:55)
> http://jenkins.buildacloud.org/job/build-systemvm64-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-master-4.6.0-kvm.qcow2.bz2
> 
> 
> Steps of reproduce.
> 
> 1)Create VPC (Redundant VPC offering)
> 
> 2)Create tier
> 
> 3)Create VM Instance on this tier
> 
> 4)Check Redundant state (good)
>   r-14-VM Redundant state:MASTER
>   r-15-VM Redundant state:BACKUP
> 
> 5) r-14-VM Reboot Router
> 
> 6)Check Redundant state (good)
>   r-14-VM Redundant state:BACKUP
>   r-15-VM Redundant state:MASTER
> 
> 7) r-15-VM Reboot Router
> 
> 8)Check Redundant state (bad)
>   r-14-VM Redundant state:BACKUP
>   r-15-VM Redundant state:BACKUP
> 
> 9)Check Log(r-14-VM's /var/log/messages)
> 
> Nov  1 00:46:29 r-14-VM Keepalived_vrrp[3711]:
> VRRP_Instance(inside_network) sending 0 priority
> Nov  1 00:47:34 r-14-VM Keepalived_vrrp[2179]: Netlink: filter function
> error
> Nov  1 00:47:34 r-14-VM Keepalived_healthcheckers[2178]: Netlink: filter
> function error
> Nov  1 00:47:53 r-14-VM Keepalived_healthcheckers[2178]: Netlink: filter
> function error
> Nov  1 00:47:53 r-14-VM Keepalived_vrrp[2179]: Netlink: filter function
> error
> Nov  1 00:47:54 r-14-VM Keepalived_healthcheckers[2178]: Netlink: filter
> function error
> Nov  1 00:47:54 r-14-VM Keepalived_vrrp[2179]: Netlink: filter function
> error
> 
> 10)Check Log(r-15-VM's /var/log/messages)
> 
> Nov  1 00:49:19 r-15-VM Keepalived_vrrp[3682]:
> VRRP_Instance(inside_network) sending 0 priority
> Nov  1 00:50:25 r-15-VM Keepalived_vrrp[2179]: Netlink: filter function
> error
> Nov  1 00:50:25 r-15-VM Keepalived_healthcheckers[2178]: Netlink: filter
> function error
> Nov  1 00:50:45 r-15-VM Keepalived_healthcheckers[2178]: Netlink: filter
> function error
> Nov  1 00:50:45 r-15-VM Keepalived_vrrp[2179]: Netlink: filter function
> error
> Nov  1 00:50:45 r-15-VM Keepalived_healthcheckers[2178]: Netlink: filter
> function error
> Nov  1 00:50:45 r-15-VM Keepalived_vrrp[2179]: Netlink: filter function
> error
> 
> 
> Reported:
> https://issues.apache.org/jira/browse/CLOUDSTACK-9015
> 
> 
> Best regards.
> 
> ---
> Satoru Nakaya (Japan CloudStack User Group)

Re: [ACS460] QA days (part one)

[Remi Bergsma]

I just setup a QA_days channel we can use. It should be easy to add a hangout 
as well, should we want.



Regards,
Remi


On 15/10/15 11:04, "Raja Pullela"  wrote:

>+1
>and we can possibly use slack - using a separate channel or group? 
>
>-Original Message-
>From: Timothy Lothering [mailto:tlother...@datacentrix.co.za] 
>Sent: Thursday, October 15, 2015 12:19 PM
>To: users@cloudstack.apache.org; d...@cloudstack.apache.org
>Subject: RE: [ACS460] QA days (part one)
>
>I am in..
>
>Kind Regards,
>
>Timothy Lothering
>
>-Original Message-
>From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
>Sent: Thursday, 15 October 2015 2:01 AM
>To: d...@cloudstack.apache.org
>Cc: users@cloudstack.apache.org
>Subject: Re: [ACS460] QA days (part one)
>
>That works for me.
>
>On Wednesday, October 14, 2015, Pierre-Luc Dion  wrote:
>
>> Does anybody would be interested to participate to a global QA days 
>> for the coming release 4.6.0 ?
>>
>> The idea would be to do a full day hackathon (remote or via User
>> Groups) on testing of ACS 4.6.0 by using available online tools such 
>> as IRC, slack, GoToMeeting if we have access to one.  so I would be a 
>> good time to perform a lot of test over 4.6.0.  We would probably 
>> speedup PR that they when they would address bugs, or add tests.
>>
>> So the basic ID would be to:
>> - Test features that are important for you and are required for your 
>> environment, more if you can.
>> - document found issues into jira
>> - see if you can fix them then PR.
>> - how to improve automatic tests (marvin)
>> - maybe we could schedule few GoToWebinar session around Marvin that day ?
>>
>> Usual QA stuff, but online into an Hackathon formula.  Dates targets 
>> would be 2 days:  October 23rd and November 6th.
>>
>> Does anyone would have an idea on how to organize that? via 
>> meetup.com/eventbrite or something else?
>>
>> Cheers,
>>
>> PLD
>>
>
>
>--
>*Mike Tutkowski*
>*Senior CloudStack Developer, SolidFire Inc.*
>e: mike.tutkow...@solidfire.com
>o: 303.746.7302
>Advancing the way the world uses the cloud
>*™*
>Timothy Lothering
>Solutions Architect
>Managed Services
>
>T: +27877415535
>F: +27877415100
>C: +27824904099
>E: tlother...@datacentrix.co.za
>
>
>DISCLAIMER NOTICE: 
>
>Everything in this e-mail and any attachments relating to the official 
>business of Datacentrix Holdings Ltd. and its subsidiaries
>('Datacentrix') is proprietary to Datacentrix. It is confidential, legally 
>privileged and protected by law. Datacentrix does not own and endorse any 
>other content. Views and opinions are those of the sender unless clearly 
>stated as being that of Datacentrix. 
>The person addressed in the e-mail is the sole authorised recipient. Please 
>notify the sender immediately if it has unintentionally reached you and do not 
>read, disclose or use the content in any way. Datacentrix cannot assure that 
>the integrity of this communication has been maintained nor that it is free of 
>errors, virus, interception or interference.

Re: CloudStack 4.5.2 with tomcat6 out of memory

[Remi Bergsma]

Hi,

Just FYI, not sure if it is related: 
I also noticed that it reports “OutOfMemory” even when there is another issue, 
like exhausted file descriptors or too many processes. Try bumping those limits 
as well.

Regards,
Remi



On 15/10/15 10:32, "windyii"  wrote:

>Hi all,
>
> 
>
>Our CloudStack 4.5.2 with tomcat6 was constantly running out of memory in a
>few days. 
>
>We changed JAVA_OPS to "-Xmx4g" in tomcat6.conf. But it didn't help.
>
>We used apache benchmark to send 10 http requests to a fresh installed
>CloudStack 4.5.2 with no zone setup.
>
> ab -n 10 -c 1 http://localhost:8080/client/
>
>The CS always run out of memory after 35,000 requests.
>
>The same to a fresh CloudStack 4.3.0.
>
>A clean tomcat6 on another CentOS host passed the ab test.
>
>Finally, we installed tomcat7 and change CS to use tomcat7. Both CS 4.5.2
>and CS 4.3.0 passed ab test.
>
>We suppose it is a serious issue.
>
>Is there any idea?
>
> 
>
>Our setup:
>
>CS 4.5.2/Centos 6.5/Tomcat 6.0.24
>
>Tomcat 7.0.33
>
> 
>
>--
>
>Qian
>
> 
>

Re: KVM HA is broken, let's fix it

[Remi Bergsma]

Hi Lucian,

Can you please explain what the issue is with KVM HA? In my tests, HA starts 
all VMs just fine without the hypervisor coming back. At least that is on 
current 4.6. Assuming a cluster of multiple nodes of course. It will then do a 
neighbor check from another host in the same cluster. 

Also, malfunctioning NFS leads to corruption and therefore we fence a box when 
the shared storage is unreliable. Combining primary and secondary NFS is not a 
good idea for production in my opinion. 

I'm happy to help and if you have a scenario I can replay I will try that in my 
lab. 

Regards, Remi 

Sent from my iPhone

> On 10 Oct 2015, at 00:19, Nux!  wrote:
> 
> Hello, 
> 
> Following a recent thread on the users ml where slow NFS caused a mass 
> reboot, I have opened the following issue about improving HA on KVM.
> https://issues.apache.org/jira/browse/CLOUDSTACK-8943
> 
> I know there are many people around here who use KVM and are interested in a 
> more robust way of doing HA.
> 
> Please share your ideas, comments, suggestions, let's see what we can come up 
> with to make this better.
> 
> Regards,
> Lucian
> 
> --
> Sent from the Delta quadrant using Borg technology!
> 
> Nux!
> www.nux.ro

Re: System VM not starting

[Remi Bergsma]

Hi,

Is your secondary storage doing OK?

Unable to acquire lock on VMTemplateStoragePool: 97


It wants to copy the systemvm template from secondary storage to primary 
storage in order to start the system vms. Please check both storages can be 
mounted on your hypervisors.

Regards,
Remi



On 23/09/15 13:30, "Naveen V"  wrote:

>Hi All,
>
>I have a cloudstack management server 4.5 as Centos VM , and Host as xen
>server 6.2...
>
>System VM's not starting... below is the error logs
>
>
>com.cloud.exception.AgentUnavailableException: Resource [Host:1] is
>unreachable: Host 1: Unable to start instance due to Unable to acquire lock
>on VMTemplateStoragePool: 97
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1109)
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4481)
>
>at sun.reflect.GeneratedMethodAccessor216.invoke(Unknown Source)
>
>at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>at java.lang.reflect.Method.invoke(Method.java:606)
>
>at
>com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4637)
>
>at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
>
>at
>org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>
>at
>org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
>at
>org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
>at
>org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>
>at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
>at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>
>at
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
>at
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
>at java.lang.Thread.run(Thread.java:744)
>
>Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to
>acquire lock on VMTemplateStoragePool: 97
>
>at
>org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:488)
>
>at
>org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:745)
>
>at
>org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1252)
>
>at
>org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1322)
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:988)
>
>... 19 more
>
>
>
>
>
>
>Exception while trying to start console proxy
>
>com.cloud.exception.InsufficientServerCapacityException: Unable to create a
>deployment for VM[ConsoleProxy|v-39-VM]Scope=interface
>com.cloud.dc.DataCenter; id=2
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:947)
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4481)
>
>at sun.reflect.GeneratedMethodAccessor216.invoke(Unknown Source)
>
>at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>at java.lang.reflect.Method.invoke(Method.java:606)
>
>at
>com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>
>at
>com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4637)
>
>at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
>
>at
>org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>
>at
>org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
>at
>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
>at
>org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
>at
>org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>
>at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
>at 

Re: CS 4.5.2: all hosts reboot after 3 days at production

[Remi Bergsma]

Hi,

You cannot sync because that will also try to write to remote disks and that 
doesn’t work. Or else you wouldn’t be in trouble anyway. Before, we have seen 
situations where the box was supposed to be rebooted, but that took a long time 
due to the sync. Instead, you wait a little bit and then fence it. Otherwise 
your ring buffers will become full and disks will get corruption.

There are global settings to tweak the parameters, if I recall correctly.

This all gets less relevant due to XenHA. This process is smarter and also 
fences the box, always leaving behind log trails. Running XenServer without 
turning on XenHA is asking for trouble anyway. I always put XenHA to 180 
seconds.

Regards,
Remi




On 15/09/15 10:19, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:

>Abhinandan and Frank,
>
>1. xenheartbeat.sh is designed to monitor iSCSI and NFS mounts
>2. default installation monitors only presence of 
>/opt/cloud/bin/heartbeat local file. Administrator must run script 
>setup_heartbeat_file.sh with host UUID and SR UUID it wants to monitor 
>and then heartbeat file will contain information about what storage to 
>monitor.
>3. if p2. was set up, script will try to read 100 bytes from the 
>mounted storage to /dev/null and if read is successful withing 1 min. it 
>sleeps for 1 min. Otherwise it will report problem, exit endless cycle 
>and do reboot
>4. it does reboot by calling "echo b > /proc/sysrq-trigger". I am 
>not confident that such method is safe in terms of local disk writes. I 
>mean script log may not be flushed to hard drive and thus after reboot 
>admin may not see any problems in syslog, because local disk writes are 
>discarded.
>
>BR,
>
>Vadim.
>
>On 2015-09-15 10:41, Frank Louwers wrote:
>
>> Important correction: it monitors the health of the first primary NFS 
>> (or otherwise "distributed and mounted") filesystem. If you don't use 
>> NFS als (main) primary storage, it's safe to disable that reboot. If 
>> you know your NFS has "issues" from time to time, and have controls 
>> around that, yes, you can disable that...
>> 
>> Frank
>> 
>> On 15 Sep 2015, at 09:08, Abhinandan Prateek 
>> <abhinandan.prat...@shapeblue.com> wrote:
>> 
>> The heartbeat script monitors the health of the primary storage by 
>> using a timestamp that is written to each primary store.
>> In case the primary storage is unreachable it reboots the XenServer in 
>> order to protect the virtual machines from corruption.
>> 
>> On 14-Sep-2015, at 8:48 pm, Vadim Kimlaychuk <va...@kickcloud.net> 
>> wrote:
>> 
>> Remi,
>> 
>> I will definitely enable HA when find who is rebooting the host. I 
>> known circumstances when it happens and I know that it is 
>> storage-related. Hardware health is monitored by SNMP and there were no 
>> problems with temperature, CPU, RAM or HDD ranges. In case of HW 
>> failure I should theoretically have kernel panic or crash dumps. But 
>> there is none. Will experiment a bit.
>> 
>> Thank you,
>> 
>> Vadim.
>> 
>> On 2015-09-14 17:35, Remi Bergsma wrote:
>> 
>> Hi Vadim,
>> It can also be XenHA but I remember you already said it is off. Did you 
>> check the hardware health?
>> I'd recommend turning on XenHA as otherwise in case of a failure you 
>> will not have an automatic recovery.
>> Regards,
>> Remi
>> On 14/09/15 15:09, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:
>> Remi,
>> I have analyzed script xenheartbeat.sh and it seems it is useless,
>> because relies on file /opt/cloud/bin/heartbeat that has 0 length. It 
>> is
>> not set-up during installation and there is no such a step in
>> documentation for setting it up. Logically admin must run
>> "setup_heartbeat_file.sh" to make heartbeat work. If this file is 0
>> length then script checks nothing and log this message every minute:
>> Sep 14 04:43:53 xcp1 heartbeat: Problem with heartbeat, no iSCSI or NFS
>> mount defined in /opt/cloud/bin/heartbeat!
>> That means it can't reboot host, because it doesn't check
>> anything. Isn't it ?
>> Is there any other script that may reboot host if when there is a
>> problem with storage?
>> Vadim.
>> On 2015-09-14 15:40, Remi Bergsma wrote:
>> Hi Vadim,
>> This does indeed reboot a box, once storage fails:
>> echo b > /proc/sysrq-trigger
>> Removing it doesn't make sense, as there are serious issues once you
>> hit this code. I'd recommend making sure the storage is reliable.
>> Regards, Remi
>> On 14/0

Re: CS 4.5.2: all hosts reboot after 3 days at production

[Remi Bergsma]

Hi Vadim,

This does indeed reboot a box, once storage fails:
echo b > /proc/sysrq-trigger


Removing it doesn’t make sense, as there are serious issues once you hit this 
code. I’d recommend making sure the storage is reliable.

Regards, Remi



On 14/09/15 08:13, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:

>Remi,
>
>   I have analyzed situation and found that storage may cause problem 
>with host reboot as you wrote before in this thread. Reason for that -- 
>we do offline backups from NFS server at that time when hosts fail. 
>Basically we copy all files in primary and secondary storage offsite. 
>This process starts precisely at 00:00 and somewhere around 00:10 - 
>00:40 XenServer host starts to reboot.
>
>   Reading old threads I have found that 
>/opt/cloud/bin/xenheartbeat.sh may do this job. Particularly last lines 
>at my xenheartbeat.sh  are:
>
>   -
>   /usr/bin/logger -t heartbeat "Problem with $hb: not reachable for 
>$(($(date +%s) - $lastdate)) seconds, rebooting system!"
>   echo b > /proc/sysrq-trigger
>   -
>
>   The only "unclear" moment is -- I don't have such line in my logs. 
>May this command "echo b > /proc/sysrq-trigger" prevent from writing to 
>syslog file? Documentation says that it does reboot immediately without 
>synchronizing FS. It seems there is no other place that may do it, but 
>still I am not 100% sure.
>
>Vadim.
>
>On 2015-09-13 18:26, Vadim Kimlaychuk wrote:
>
>> Remi,
>> 
>> Thank you for hint. At least one problem is identified:
>> 
>> [root@xcp1 ~]# xe pool-⁠list params=all | grep -⁠E 
>> "ha-⁠enabled|ha-⁠config"
>> ha-⁠enabled ( RO): false
>> ha-⁠configuration ( RO):
>> 
>> Where should I look for storage errors? Host? Management server? I have 
>> checked /var/log/messages and there were only regular messages, no 
>> "fence" or "reboot" commands.
>> 
>> I have dedicated NFS server that should be accessible all the time (at 
>> least NIC interfaces are bonded in master-slave mode). Server is used 
>> for both primary and secondary storage.
>> 
>> Thanks,
>> 
>> Vadim.
>> 
>> On 2015-⁠09-⁠13 14:38, Remi Bergsma wrote:
>> 
>> Hi Vadim,
>> 
>> Not sure what the problem is. Although I do know that when shared 
>> storage is used, both CloudStack and XenServer will fence (reboot) the 
>> box to prevent corruption in case access to the network or the storage 
>> is not possible. What storage do you use?
>> 
>> What does this return on a XenServer?:
>> xe pool-⁠list params=all | grep -⁠E "ha-⁠enabled|ha-⁠config"
>> 
>> HA should be on, or else a hypervisor crash will not recover properly.
>> 
>> If you search the logs for Fence or reboot, does anything come back?
>> 
>> The logs you mention are nothing to worry about.
>> 
>> Can you tell us in some more details what happens and how we can 
>> reproduce it?
>> 
>> Regards,
>> Remi
>> 
>> -⁠-⁠-⁠-⁠-⁠Original Message-⁠-⁠-⁠-⁠-⁠
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: zondag 13 september 2015 9:32
>> To: users@cloudstack.apache.org
>> Cc: Remi Bergsma
>> Subject: Re: CS 4.5.2: all hosts reboot after 3 days at production
>> 
>> Hello Remi,
>> 
>> This issue has nothing to do with CS 4.5.2. We got host reboot after 
>> precisely 1 week with previous version of CS (4.5.1). Previous version 
>> has been working without restart for 106 days before. So it is not a 
>> software issue.
>> 
>> What does really make me unhappy -- accidental host reboot made entire 
>> cluster unusable. Cloudstack management server was up and running, 
>> second cluster node was up and running all the time and VM were 
>> transferred to the second host, but System VMs were not rebooted 
>> properly by CS and half of the network was down. SSVM and CPVM were in 
>> "disconnected" status. Client VMs were up, but couldn't connect to 
>> storage, because VRs were offline. Entire mess.
>> 
>> I have used planned maintenance mode before and cluster worked just 
>> perfect. We didn't have any single second downtime. But with accidental 
>> reboot there is no use of clusterization. :(
>> 
>> Vadim.
>> 
>> On 2015-⁠09-⁠08 09:35, Vadim Kimlaychuk wrote:
>> 
>> Hello Remi,
>> 
>> First of all I don't have /⁠var/⁠log/⁠xha.log file. I have examined 
>&

Re: CS 4.5.2: all hosts reboot after 3 days at production

[Remi Bergsma]

Hi Vadim,

It can also be XenHA but I remember you already said it is off. Did you check 
the hardware health?

I’d recommend turning on XenHA as otherwise in case of a failure you will not 
have an automatic recovery.

Regards,
Remi




On 14/09/15 15:09, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:

>Remi,
>
>   I have analyzed script xenheartbeat.sh and it seems it is useless, 
>because relies on file /opt/cloud/bin/heartbeat that has 0 length. It is 
>not set-up during installation and there is no such a step in 
>documentation for setting it up. Logically admin must run 
>"setup_heartbeat_file.sh" to make heartbeat work. If this file is 0 
>length then script checks nothing and log this message every minute:
>
>Sep 14 04:43:53 xcp1 heartbeat: Problem with heartbeat, no iSCSI or NFS 
>mount defined in /opt/cloud/bin/heartbeat!
>
>   That means it can't reboot host, because it doesn't check 
>anything. Isn't it ?
>
>   Is there any other script that may reboot host if when there is a 
>problem with storage?
>
>Vadim.
>
>
>
>
>On 2015-09-14 15:40, Remi Bergsma wrote:
>
>> Hi Vadim,
>> 
>> This does indeed reboot a box, once storage fails:
>> echo b > /proc/sysrq-trigger
>> 
>> Removing it doesn't make sense, as there are serious issues once you 
>> hit this code. I'd recommend making sure the storage is reliable.
>> 
>> Regards, Remi
>> 
>> On 14/09/15 08:13, "Vadim Kimlaychuk" <va...@kickcloud.net> wrote:
>> 
>> Remi,
>> 
>> I have analyzed situation and found that storage may cause problem
>> with host reboot as you wrote before in this thread. Reason for that --
>> we do offline backups from NFS server at that time when hosts fail.
>> Basically we copy all files in primary and secondary storage offsite.
>> This process starts precisely at 00:00 and somewhere around 00:10 -
>> 00:40 XenServer host starts to reboot.
>> 
>> Reading old threads I have found that
>> /opt/cloud/bin/xenheartbeat.sh may do this job. Particularly last lines
>> at my xenheartbeat.sh are:
>> 
>> -
>> /usr/bin/logger -t heartbeat "Problem with $hb: not reachable for
>> $(($(date +%s) - $lastdate)) seconds, rebooting system!"
>> echo b > /proc/sysrq-trigger
>> -
>> 
>> The only "unclear" moment is -- I don't have such line in my logs.
>> May this command "echo b > /proc/sysrq-trigger" prevent from writing to
>> syslog file? Documentation says that it does reboot immediately without
>> synchronizing FS. It seems there is no other place that may do it, but
>> still I am not 100% sure.
>> 
>> Vadim.
>> 
>> On 2015-09-13 18:26, Vadim Kimlaychuk wrote:
>> 
>> Remi,
>> 
>> Thank you for hint. At least one problem is identified:
>> 
>> [root@xcp1 ~]# xe pool-⁠list params=all | grep -⁠E
>> "ha-⁠enabled|ha-⁠config"
>> ha-⁠enabled ( RO): false
>> ha-⁠configuration ( RO):
>> 
>> Where should I look for storage errors? Host? Management server? I have
>> checked /var/log/messages and there were only regular messages, no
>> "fence" or "reboot" commands.
>> 
>> I have dedicated NFS server that should be accessible all the time (at
>> least NIC interfaces are bonded in master-slave mode). Server is used
>> for both primary and secondary storage.
>> 
>> Thanks,
>> 
>> Vadim.
>> 
>> On 2015-⁠09-⁠13 14:38, Remi Bergsma wrote:
>> 
>> Hi Vadim,
>> 
>> Not sure what the problem is. Although I do know that when shared
>> storage is used, both CloudStack and XenServer will fence (reboot) the
>> box to prevent corruption in case access to the network or the storage
>> is not possible. What storage do you use?
>> 
>> What does this return on a XenServer?:
>> xe pool-⁠list params=all | grep -⁠E "ha-⁠enabled|ha-⁠config"
>> 
>> HA should be on, or else a hypervisor crash will not recover properly.
>> 
>> If you search the logs for Fence or reboot, does anything come back?
>> 
>> The logs you mention are nothing to worry about.
>> 
>> Can you tell us in some more details what happens and how we can
>> reproduce it?
>> 
>> Regards,
>> Remi
>> 
>> -⁠-⁠-⁠-⁠-⁠Original Message-⁠-⁠-⁠-⁠-⁠
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: zondag 13 september 2015 9:32
>> To: users@cloudstack.apache.org
>> Cc: Remi Bergsma
>> Subject: Re: CS 4.5.2: all ho

Re: CS 4.5.2 Fails to Start.

[Remi Bergsma]

Hi,

The issue is already solved on 4.6 (which is the same as master now).

The two queries were replaced by this one 
(https://github.com/apache/cloudstack/pull/757/files):
UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE 
`name`="consoleproxy.url.domain" OR `name`="secstorage.ssl.cert.domain”;


We’re currently working on back porting that to 4.5.x as well. Not sure when 
4.5.3 will come, but if you do it manually it’s the same anyway.

Good luck with your go-live!

Regards,
Remi



On 13/09/15 18:20, "Keerthiraja SJ" <sjkeer...@gmail.com> wrote:

>I update the same on
>
>https://issues.apache.org/jira/browse/CLOUDSTACK-8836
>
>Thanks,
>Keerthi
>
>On Sun, Sep 13, 2015 at 9:44 PM, Keerthiraja SJ <sjkeer...@gmail.com> wrote:
>
>> Sorry pasted the wrong query.
>>
>>
>> #realhostip changes, before changing table and adding default value
>> UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE
>> `name`="consoleproxy.url.domain" OR `name`="consoleproxy.url.domain";
>> UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE
>> `name`="secstorage.ssl.cert.domain" OR `name`="secstorage.ssl.cert.domain";
>>
>> On Sun, Sep 13, 2015 at 9:41 PM, Keerthiraja SJ <sjkeer...@gmail.com>
>> wrote:
>>
>>> After I change the query on
>>> /usr/share/cloudstack-management/setup/db/schema-421to430.sql I deploy the
>>> database cleanly where I could able to proceed and started successfully.
>>>
>>> #realhostip changes, before changing table and adding default value
>>> UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE
>>> `name`="consoleproxy.url.domain" OR `name`="consoleproxy.url.domain";
>>> UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE
>>> `name`="consoleproxy.url.domain" OR `name`="secstorage.ssl.cert.domain";
>>>
>>>
>>> Will this bee patched soon on the upcoming version of 4.5.3 and also on
>>> 4.6
>>>
>>> Thanks,
>>> Keerthi
>>>
>>>
>>>
>>> On Sun, Sep 13, 2015 at 9:37 PM, Keerthiraja SJ <sjkeer...@gmail.com>
>>> wrote:
>>>
>>>> I really want to know after I comment this line and do the
>>>> database-setup will this effect the cloudstack once I build.
>>>>
>>>> I really not know what really this query use to do.
>>>>
>>>> Because I want to build a production environment right now so if I
>>>> comment this two query and do the database initialization
>>>> the cloudstack started without any issue.
>>>>
>>>> But will this will impact the CS after I deploy.
>>>>
>>>> Thanks,
>>>> Keerthi
>>>>
>>>> On Sun, Sep 13, 2015 at 9:02 PM, Keerthiraja SJ <sjkeer...@gmail.com>
>>>> wrote:
>>>>
>>>>> Even After I commented this line on MariaDB-server-10.0.21-1.el6.x86_64.
>>>>>
>>>>>
>>>>> #realhostip changes, before changing table and adding default value
>>>>> #UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
>>>>> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>>>>> `name`="consoleproxy.url.domain") AS `temptable` WHERE
>>>>> `temptable`.`name`="consoleproxy.url.domain")) WHERE
>>>>> `name`="consoleproxy.url.domain";
>>>>> #UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
>>>>> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>>>>> `name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
>>>>> `temptable`.`name`="secstorage.ssl.cert.domain")) WHERE
>>>>> `name`="secstorage.ssl.cert.domain";
>>>>>
>>>>>
>>>>> Still could see error during the start up with below error on
>>>>> catalina.out
>>>>>
>>>>> ERROR
>>>>> ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
>>>>> vm_template add size bigint unsigned
>>>>> ERROR [c.c.u.d.ScriptRunner] (main:null)
>>>>> com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate 
>>>>> column
>>>>> name 'size'
>>>>> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unab

RE: CS 4.5.2: all hosts reboot after 3 days at production

[Remi Bergsma]

Hi Vadim,

Not sure what the problem is. Although I do know that when shared storage is 
used, both CloudStack and XenServer will fence (reboot) the box to prevent 
corruption in case access to the network or the storage is not possible. What 
storage do you use?

What does this return on a XenServer?:
xe pool-list params=all | grep -E "ha-enabled|ha-config"

HA should be on, or else a hypervisor crash will not recover properly.

If you search the logs for Fence or reboot, does anything come back?

The logs you mention are nothing to worry about.

Can you tell us in some more details what happens and how we can reproduce it?

Regards,
Remi


-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net] 
Sent: zondag 13 september 2015 9:32
To: users@cloudstack.apache.org
Cc: Remi Bergsma
Subject: Re: CS 4.5.2: all hosts reboot after 3 days at production

Hello Remi,

 This issue has nothing to do with CS 4.5.2. We got host reboot after 
precisely 1 week with previous version of CS (4.5.1). Previous version has been 
working without restart for 106 days before. So it is not a software issue.

 What does really make me unhappy -- accidental host reboot made entire 
cluster unusable. Cloudstack management server was up and running, second 
cluster node was up and running all the time and VM were transferred to the 
second host, but System VMs were not rebooted properly by CS and half of the 
network was down. SSVM and CPVM were in "disconnected" status. Client VMs were 
up, but couldn't connect to storage, because VRs were offline. Entire mess.

 I have used planned maintenance mode before and cluster worked just 
perfect. We didn't have any single second downtime. But with accidental reboot 
there is no use of clusterization. :(

Vadim.

On 2015-09-08 09:35, Vadim Kimlaychuk wrote:

> Hello Remi,
> 
> First of all I don't have /var/log/xha.log file. I have examined logs 
> in detail and haven't found any trace that heartbeat has failed. The 
> only serious problem I have found in management logs before restart is 
> repeating many times error:
> 
> -⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠
> -⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠
> 2015-09-06 00:47:21,591 DEBUG [c.c.a.m.AgentManagerImpl]
> (RouterMonitor-1:ctx-2d67d422) Details from executing class
> com.cloud.agent.api.NetworkUsageCommand: Exception: 
> java.lang.Exception
> Message: vpc network usage plugin call failed
> Stack: java.lang.Exception: vpc network usage plugin call failed at
> com.cloud.hypervisor.xenserver.resource.XenServer56Resource.VPCNetwork
> Usage(XenServer56Resource.java:172)
> at
> com.cloud.hypervisor.xenserver.resource.XenServer56Resource.execute(Xe
> nServer56Resource.java:195)
> at
> com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeReq
> uest(XenServer56Resource.java:62)
> at
> com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRe
> quest(XenServer610Resource.java:87)
> at
> com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.execut
> eRequest(XenServer620SP1Resource.java:65)
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAge
> ntAttache.java:302)
> ...
> 
> -⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠
> -⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠
> 
> Just couple of seconds before XCP2 host restart:
> 
> -⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠
> -⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠-⁠
> 2015-09-06 00:48:27,884 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-83:ctx-ff822baf) Ping from 2(xcp1)
> 2015-09-06 00:48:27,884 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) Process host VM state report from 
> ping process. host: 2
> 2015-09-06 00:48:27,904 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) Process VM state report. host: 2, 
> number of records in report: 6
> 2015-09-06 00:48:27,904 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) VM state report. host: 2, vm id: 
> 85, power state: PowerOn
> 2015-09-06 00:48:27,907 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) VM power state does not change, 
> skip DB writing. vm id: 85
> 2015-09-06 00:48:27,907 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) VM state report. host: 2, vm id: 
> 1, power state: PowerOn
> 2015-09-06 00:48:27,910 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) VM power state does not change, 
> skip DB writing. vm id: 1
> 2015-09-06 00:48:27,910 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-83:ctx-ff822baf) VM state report. host: 2, vm i

Re: CS 4.5.2 Fails to Start.

[Remi Bergsma]

Hi Keerthi,

Did you clear the MySQL cloud db in between attempts?

I’m a bit confused. Are you using CentOS 6 or 7? First I thought CentOS 7, but 
now you show an CentOS 6 MariaDB package?
If you’re on CentOS 6 I’d recommend using the MySQL version that ships with it. 
Otherwise, the fix as described works, as long as you start clean.

Regards, Remi





On 13/09/15 17:32, "Keerthiraja SJ" <sjkeer...@gmail.com> wrote:

>Even After I commented this line on MariaDB-server-10.0.21-1.el6.x86_64.
>
>
>#realhostip changes, before changing table and adding default value
>#UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
>`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>`name`="consoleproxy.url.domain") AS `temptable` WHERE
>`temptable`.`name`="consoleproxy.url.domain")) WHERE
>`name`="consoleproxy.url.domain";
>#UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
>`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>`name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
>`temptable`.`name`="secstorage.ssl.cert.domain")) WHERE
>`name`="secstorage.ssl.cert.domain";
>
>
>Still could see error during the start up with below error on catalina.out
>
>ERROR
>ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
>vm_template add size bigint unsigned
>ERROR [c.c.u.d.ScriptRunner] (main:null)
>com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
>name 'size'
>ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
>script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
>com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
>name 'size'
>at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:185)
>
>
>ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
>database
>com.cloud.utils.exception.CloudRuntimeException: Unable to execute upgrade
>script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
>
>Thanks,
>Keerthi
>
>
>
>On Sat, Sep 12, 2015 at 1:13 PM, Remi Bergsma <rberg...@schubergphilis.com>
>wrote:
>
>> Hi,
>>
>> The root cause was recently fixed here:
>> https://github.com/apache/cloudstack/pull/757/files
>>
>> As a workaround you can either alter the query (as mentioned below) or
>> downgrade mariadb:
>>
>> systemctl stop mariadb
>> yum -y remove mariadb-libs
>> yum -y install mariadb-1:5.5.41-2.el7_0.x86_64
>> mariadb-server-1:5.5.41-2.el7_0.x86_64
>> systemctl start mariadb
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>> On 12 Sep 2015, at 00:59, giraffeg forestg <giraffefore...@gmail.com
>> <mailto:giraffefore...@gmail.com>> wrote:
>>
>> Hi
>>
>>
>> CLOUDSTACK-8212 might become your help.
>>
>> https://issues.apache.org/jira/browse/CLOUDSTACK-8212
>>
>>
>> 1. This is resolved by commenting out:
>> ---
>> [root@acs ~]# vi
>> /usr/share/cloudstack-management/setup/db/schema-421to430.sql
>>
>> :
>>
>> #realhostip changes, before changing table and adding default value
>> # UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
>> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>> `name`="consoleproxy.u
>> rl.domain") AS `temptable` WHERE
>> `temptable`.`name`="consoleproxy.url.domain")) WHERE
>> `name`="consoleproxy.url.domain";
>> # UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
>> `temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>> `name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
>> `temptable`.`name`="secstorage.ssl.cert.domain")) WHERE
>> `name`="secstorage.ssl.cert.domain";
>> ---
>>
>> and,
>>
>> 2. stop cloudsack-management & cloudsack-usage & mariadb
>> 3. initialize database
>> 4. cloudstack-setup-databases
>> 5. cloudstack-setup-management
>>
>>
>> I also the same problem has occurred.
>>
>> My environment:
>> CloudStack 4.5.2 (
>> http://packages.shapeblue.com/cloudstack/upstream/centos7/4.5)
>> CentOS 7.1.1503
>> mariadb-5.5.44-1
>>
>>
>>
>> ---
>> Satoru Nakaya
>>
>> Japan CloudStack User Group
>> http://cloudstack.jp/
>>
>>
>> 2015-09-11 23:11 GMT+09:00 Keerthiraja SJ <sjkeer...@gmail.com> sjkeer...@gmail.com>>:
>>
>

Re: Cloudstack 4.5.2 startup ERROR

[Remi Bergsma]

Hi,

Same issue as someone in another thread had. I'll copy/paste it here:

The root cause was recently fixed here:
https://github.com/apache/cloudstack/pull/757/files

As a workaround you can either alter the query (as the PR does) or downgrade 
mariadb:

systemctl stop mariadb
yum -y remove mariadb-libs
yum -y install mariadb-1:5.5.41-2.el7_0.x86_64 
mariadb-server-1:5.5.41-2.el7_0.x86_64
systemctl start mariadb

Regards, Remi

Sent from my iPhone

On 11 Sep 2015, at 12:23, Keerthiraja SJ 
> wrote:

During the fresh implementation I could see below error in catalina.out

Error
INFO  [c.c.u.DatabaseUpgradeChecker] (main:null) Database upgrade must be
performed from 4.0.0 to 4.5.2
ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
vm_template add size bigint unsigned
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
name 'size'
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
name 'size'


Kindly help me out right now I am doing production installation.


On Fri, Sep 11, 2015 at 3:34 PM, Keerthiraja SJ 
> wrote:

ariaDB [cloud]> select * from vm_template;

++-+---+--++--+-+-+--+++-+-++--+---+-+---+-+--+-+-+-+-++--+--+--+---+--+-+--+
| id | unique_name | name  |
uuid | public | featured | type| hvm |
bits |
url
| format | created | removed | account_id |
checksum | display_text  |
enable_password | enable_sshkey | guest_os_id | bootable | prepopulate |
cross_zones | extractable | hypervisor_type | source_template_id |
template_tag | sort_key | size | state | update_count | updated |
dynamically_scalable |

++-+---+--++--+-+-+--+++-+-++--+---+-+---+-+--+-+-+-+-++--+--+--+---+--+-+--+
|  1 | routing-1   | SystemVM Template (XenServer) |
cf459945-5868-11e5-9d7e-1458d04cf748 |  0 |0 | SYSTEM  |   0
|   64 |
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
| VHD| 2015-09-11 02:38:08 | NULL|  1 |
74b92f031cc5c2089ee89efb81344dcf | SystemVM Template (XenServer)
|   0 | 0 | 184 |1 |   0
|   1 |   0 | XenServer   |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|0 |
|  2 | centos53-x86_64 | CentOS 5.3(64-bit) no GUI (XenServer) |
cf45be09-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
|   64 |
http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2-f84755767aca.vhd.bz2
| VHD| 2015-09-11 02:38:08 | 2015-09-11 02:38:08 |  1 |
b63d854a9560c013142567bbae8d98cf | CentOS 5.3(64-bit) no GUI (XenServer)
|   0 | 0 |  12 |1 |   0
|   1 |   1 | XenServer   |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|0 |
|  3 | routing-3   | SystemVM Template (KVM)   |
cf45d927-5868-11e5-9d7e-1458d04cf748 |  0 |0 | SYSTEM  |   0
|   64 |
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2
| QCOW2  | 2015-09-11 02:38:08 | NULL|  1 |
85a1bed07bf43cbf022451cb2ecae4ff | SystemVM Template (KVM)
|   0 | 0 |  15 |1 |   0
|   1 |   0 | KVM |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|  

Re: CS 4.5.2 Fails to Start.

[Remi Bergsma]

Hi,

The root cause was recently fixed here:
https://github.com/apache/cloudstack/pull/757/files

As a workaround you can either alter the query (as mentioned below) or 
downgrade mariadb:

systemctl stop mariadb
yum -y remove mariadb-libs
yum -y install mariadb-1:5.5.41-2.el7_0.x86_64 
mariadb-server-1:5.5.41-2.el7_0.x86_64
systemctl start mariadb

Regards, Remi

Sent from my iPhone

On 12 Sep 2015, at 00:59, giraffeg forestg 
> wrote:

Hi


CLOUDSTACK-8212 might become your help.

https://issues.apache.org/jira/browse/CLOUDSTACK-8212


1. This is resolved by commenting out:
---
[root@acs ~]# vi
/usr/share/cloudstack-management/setup/db/schema-421to430.sql

:

#realhostip changes, before changing table and adding default value
# UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.u
rl.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) WHERE
`name`="consoleproxy.url.domain";
# UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
`temptable`.`name`="secstorage.ssl.cert.domain")) WHERE
`name`="secstorage.ssl.cert.domain";
---

and,

2. stop cloudsack-management & cloudsack-usage & mariadb
3. initialize database
4. cloudstack-setup-databases
5. cloudstack-setup-management


I also the same problem has occurred.

My environment:
CloudStack 4.5.2 (
http://packages.shapeblue.com/cloudstack/upstream/centos7/4.5)
CentOS 7.1.1503
mariadb-5.5.44-1



---
Satoru Nakaya

Japan CloudStack User Group
http://cloudstack.jp/


2015-09-11 23:11 GMT+09:00 Keerthiraja SJ 
>:

I really face this issue when I install on MariaDB. If I do the same on
MySQL this pass it.

On Fri, Sep 11, 2015 at 7:09 PM, Keerthiraja SJ 
>
wrote:

Hi All,

Today I tried to install the CS 4.5.2 on fresh box where I could able to
successfully deploy
the cloudstack-setup-databases.

After I tried number of times the fresh installation I could see the same
issue been reproducing it.

While stating the cloudstack servers I could see below error constantly.




*ERROR*ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: UPDATE
`cloud`.`configuration` SET value = CONCAT("*.",(SELECT
`temptable`.`value`
FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.url.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) WHERE
`name`="consoleproxy.url.domain"
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure

The last packet successfully received from the server was 25 milliseconds
ago.  The last packet sent successfully to the server was 25 milliseconds
ago.
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute
upgrade
script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure


Caused by: java.net.SocketException: Broken pipe
   ... 61 more
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
database
com.cloud.utils.exception.CloudRuntimeException: Unable to execute
upgrade
script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
   at

com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:311)

ERROR [c.c.u.d.DbUtil] (main:null) RELEASE_LOCK() throws exception
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure


I did this test number of times by allocating fresh box.

Thanks,
Keerthi

Re: VPC VPN Connectivity Issues

[Remi Bergsma]

@Jayapal can you verify VPN is supposed to work on Mac OSX or not?




On 10/09/15 01:47, "Jeremy Peterson" <jpeter...@acentek.net> wrote:

>So I'm still looking into this has anyone ever tried this?
>
>Do you have anyone I can talk to?
>
>I've been asking since 8.29.2015
>
>I guess the issue is on a Mac since my VPN network is 10.1.2.0/24 and my VPC 
>network is 192.168.2.0/24 he cannot connect.  
>I tested it out on windows 8, 7, 10, 8.1 all work as expected.
>
>I don't have a Mac I can test with so I was hoping someone here would have any 
>advise.
>
>Jeremy
>
>-Original Message-
>From: Jeremy Peterson [mailto:jpeter...@acentek.net] 
>Sent: Tuesday, September 8, 2015 8:12 AM
>To: users@cloudstack.apache.org
>Subject: RE: VPC VPN Connectivity Issues
>
>No my issue is not resolved I've been reaching out to the IRC channel and have 
>not received notification of anyone knowing what my issue could be.
>
>It would be great to get some traction this week on the issue.  I keep having 
>to open ACL for public access to the servers as this user is unable to get to 
>the server via VPN.
>
>Jeremy
>
>-Original Message-
>From: Remi Bergsma [mailto:rberg...@schubergphilis.com] 
>Sent: Saturday, September 5, 2015 10:11 AM
>To: <users@cloudstack.apache.org> <users@cloudstack.apache.org>
>Subject: Re: VPC VPN Connectivity Issues
>
>Hi Jeremy,
>
>Did you already solve your problem?
>
>Not sure if it is possible to use the IPSec tunnels from remote VPN. Firewall 
>might be too strict, but haven't looked yet. 
>
>Regards, Remi 
>
>Sent from my iPhone
>
>> On 29 Aug 2015, at 17:00, Jeremy Peterson <jpeter...@acentek.net> wrote:
>> 
>> I am not sure if this was asked or answered but googling has led me no where.
>> 
>> 
>> I am running cloudstack 4.5.0,  XenServer 6.5, Advanced networking w/ VLAN 
>> segmentation.
>> 
>> 
>> I have a VPC setup which i am using a IPSec tunnel back to a zywall firewall 
>> and a monowall firewall.
>> 
>> 
>> MonowallCloustack VPCzywall
>> 
>> 192.168.1.0/24192.168.2.0/24192.168.71.0/24
>> 
>> 
>> Tunnels are setup in vpc for both locations and servers in cloudstack can 
>> connect to the world and connect to the monowall and zywall networks.
>> 
>> 
>> Everything is fine with that but when I have a remote user that needs to VPN 
>> into the cloudstack VPC is where i am thrown into a whirlwind of questions.
>> 
>> 
>> I setup a VPN connection on the VR for the VPC.
>> 
>> I setup username/password.
>> 
>> 
>> The user sets up the connection on his Mac OSX and using split tunnel can 
>> connect to the VPN.
>> 
>> 
>> My VPN network is 10.1.2.0/24
>> 
>> 
>> He receives a 10.1.2.3 ip address.
>> 
>> 
>> He is unable to ping the IPSec Tunnel gateways 192.168.1.1 and 192.168.71.1.
>> 
>> 
>> He can get to the world as his default gateway is his router.
>> 
>> 
>> I switched to push all traffic over the VPN to remove the split tunnel.
>> 
>> 
>> He is able to ping the 10.1.2.1 gateway on the VR
>> 
>> 
>> He is able to ping his gateway the VPC router 10.1.2.1.
>> 
>> 
>> He is able to ping the VPC network's gateway 192.168.2.1
>> 
>> He is unable to get to the world.  I try to ping google dns 8.8.8.8 and it 
>> doesnt' get past the VR 10.1.2.1 in traceroutes.
>> 
>> I am looking for help on this as i'm confused.  If I change him back to a 
>> split tunnel as that would be prefered why is the tunnel not annoucing all 
>> networks know to the VR.
>> 
>> I was able to recreate this issue on windows 8.1.
>> 
>> ?Jeremy

Re: CS 4.5.2: all hosts reboot after 3 days at production

[Remi Bergsma]

Hi Vadim,

What kind of storage do you use? Can you show /var/log/xha.log (I think that is 
the name) please? It could be xen-ha that fences the box if the heartbeat 
cannot be written. 

You suggest it is CloudStack. Did you see anything in the mgt logs?

Regards, Remi 

Sent from my iPhone

> On 07 Sep 2015, at 08:26, Vadim Kimlaychuk  wrote:
> 
> Hello all,
> 
>I have experienced accidental cluster reboot 3 days after update to CS 
> 4.5.2. Cluster is XenServer 6.5 with SP1. Reboot has been started from slave 
> node and then - master.
> Syslog on slave shows only this:
> 
> Sep  6 00:47:05 xcp2 last message repeated 3 times
> Sep  6 00:47:15 xcp2 xenstored:  D12  write data/meminfo_free 
> 713732
> Sep  6 00:47:15 xcp2 xenstored:  A1564203 w event   
> /local/domain/12/data/meminfo_free /local/domain/12/data/meminfo_free
> Sep  6 00:47:15 xcp2 xenstored:  D12  write data/updated Sun Sep  
> 6 00:48:55 EEST 2015
> Sep  6 00:47:15 xcp2 xenstored:  A6   w event   
> /local/domain/12/data/updated /local/domain/12/data/updated
> Sep  6 00:47:15 xcp2 xenstored:  A10  w event   
> /local/domain/12/data/updated /local/domain/12/data/updated
> Sep  6 00:47:26 xcp2 dhclient: DHCPREQUEST on xenbr0 to 172.17.0.1 port 67 
> (xid=0x304ae9dc)
> Sep  6 00:47:27 xcp2 xapi: [ info|xcp2|462044 INET 
> 0.0.0.0:80|dispatch:host.call_plugin D:7593b578fada|taskhelper] task 
> host.call_plugin R:ddd3cc399f86 forwarded 
> (trackid=407f6adaa118a34f19eb1e29cd68a0e8)
> Sep  6 00:47:36 xcp2 dhclient: DHCPREQUEST on xenbr0 to 172.17.0.1 port 67 
> (xid=0x304ae9dc)
> Sep  6 00:48:18 xcp2 last message repeated 4 times
> Sep  6 00:48:25 xcp2 xenstored:  D1   write data/meminfo_free 
> 1740496
> Sep  6 00:48:25 xcp2 xenstored:  A1564203 w event   
> /local/domain/1/data/meminfo_free /local/domain/1/data/meminfo_free
> Sep  6 00:48:25 xcp2 xenstored:  D1   write data/updated Sat Sep  
> 5 21:50:07 EEST 2015
> Sep  6 00:48:25 xcp2 xenstored:  A6   w event   
> /local/domain/1/data/updated /local/domain/1/data/updated
> Sep  6 00:48:25 xcp2 xenstored:  A10  w event   
> /local/domain/1/data/updated /local/domain/1/data/updated
> Sep  6 00:48:26 xcp2 dhclient: DHCPREQUEST on xenbr0 to 172.17.0.1 port 67 
> (xid=0x304ae9dc)
> Sep  6 00:48:27 xcp2 xapi: [ info|xcp2|462044 INET 
> 0.0.0.0:80|dispatch:host.call_plugin D:f2c8987bc0ff|taskhelper] task 
> host.call_plugin R:b62d2d4f58eb forwarded 
> (trackid=e3d4ea00c96194830a7dbbfc35563a3c)
> Sep  6 00:48:38 xcp2 dhclient: DHCPREQUEST on xenbr0 to 172.17.0.1 port 67 
> (xid=0x304ae9dc)
> Sep 06 00:48:48 xcp2 syslogd 1.4.1: restart.
> Sep  6 00:48:48 xcp2 kernel: klogd 1.4.1, log source = /proc/kmsg started.
> Sep  6 00:48:48 xcp2 kernel: [0.00] Initializing cgroup subsys cpuset
> Sep  6 00:48:48 xcp2 kernel: [0.00] Initializing cgroup subsys cpu
> Sep  6 00:48:48 xcp2 kernel: [0.00] Initializing cgroup subsys cpuacct
> Sep  6 00:48:48 xcp2 kernel: [0.00] Linux version 3.10.0+2
> 
>   Can anyone help with diagnostics ?
> 
> Thank you,
> 
> Vadim.

Re: how the best way to upgrade KVM hosts (Centos 6.6 to Centos 7)

[Remi Bergsma]

Indeed. I will see if I can backport it to 4.5 next week. Until then, try this:

Open  "/etc/libvirt/qemu.conf" and remove this line:
"cgroup_controllers = [ \"cpu\" ]"

Then restart libvirtd and then the CloudStack agent. 

Regards, Remi


Sent from my iPhone

> On 03 Sep 2015, at 15:43, Erik Weber  wrote:
> 
> https://github.com/apache/cloudstack/pull/731 Should fix the error you see.
> 
> Haven't tried, but I guess you could apply it manually
> 
> -- 
> Erik
> 
> On Thu, Sep 3, 2015 at 3:40 PM, Luciano Castro 
> wrote:
> 
>> What is the  Best practises to upgrade KVM hosts?
>> 
>> I have 2 KVM hosts with Centos 6.6, and CS version 4.5.1.
>> 
>> I added a KVM host Centos 7 (I know that it´s not reccomended, need the
>> same OS in the cluster...)
>> 
>> My idea was migrate VM from Centos 6.6 to Centos 7.
>> 
>> When I tryed:
>> 
>> 2015-09-03 13:21:19,527 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (API-Job-Executor-48:ctx-9d01251f job-1469) Unexpected exception while
>> executing org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
>> com.cloud.utils.exception.CloudRuntimeException:
>> org.libvirt.LibvirtException: Controller 'cpuacct' is not wanted, but 'cpu'
>> is co-mounted: Invalid argument
>>at
>> 
>> com.cloud.vm.VirtualMachineManagerImpl.migrate(VirtualMachineManagerImpl.java:1962)
>>at
>> 
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrate(VirtualMachineManagerImpl.java:1860)
>>at
>> 
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrate(VirtualMachineManagerImpl.java:4504)
>>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>at
>> 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>at
>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>at java.lang.reflect.Method.invoke(Method.java:606)
>>at
>> 
>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>at
>> 
>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
>>at
>> com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
>>at
>> 
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>at
>> 
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>at
>> 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>at
>> 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>at
>> 
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>at
>> 
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>at
>> 
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>at
>> 
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>at
>> 
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>at java.lang.Thread.run(Thread.java:745)
>> 
>> 
>>I disabled the KVM Centos 6.6 hosts and I left just KVM centos 7. I
>> can´t instantiate new VM too:
>> 
>> 
>>2015-09-03 13:29:12,026 INFO  [o.a.c.a.c.a.v.DeployVMCmdByAdmin]
>> (API-Job-Executor-51:ctx-9033e7a8 job-1476 ctx-1ae168c3) Unable to create a
>> deployment for VM[User|i-2-153-VM]
>> com.cloud.exception.InsufficientServerCapacityException: Unable to create a
>> deployment for VM[User|i-2-153-VM]Scope=interface com.cloud.dc.DataCenter;
>> id=1
>>at
>> 
>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:214)
>>at
>> 
>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:200)
>>at
>> 
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3583)
>>at
>> 
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3227)
>>at
>> 
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3215)
>>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>at
>> 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>at
>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>at java.lang.reflect.Method.invoke(Method.java:606)
>>at
>> 
>> 

Re: CloudStack Templates (ready to use)

[Remi Bergsma]

Hi,

They have coud-init on board, if you check 'passwd enabled' when registering 
the template, CloudStack will generate a passwd when it deploys a new VM. I 
believe the default is 'password' but not 100%sure. 

Check how they are made here:
https://github.com/NuxRo/openvm/tree/master/kickstarts/vanilla/7

It's cool stuff :-)

Regards, Remi 

Sent from my iPhone

> On 04 Sep 2015, at 19:13, Sam Ceylani <s...@mistercertified.com> wrote:
> 
> I tried one of their Centos template and I think templates are based on ssh 
> key, couldn't login :( any info on this?
> 
> -Original Message-----
> From: Remi Bergsma [mailto:rberg...@schubergphilis.com] 
> Sent: Friday, September 04, 2015 1:11 PM
> To: <users@cloudstack.apache.org>
> Subject: Re: CloudStack Templates (ready to use)
> 
> Hi,
> 
> Please check this: http://dl.openvm.eu/cloudstack/
> 
> Regards, Remi 
> 
> Sent from my iPhone
> 
>> On 04 Sep 2015, at 18:41, Cristian Ciobanu <cristian.c@istream.today> wrote:
>> 
>> Hello,
>> 
>>   I need some KVM templates for cloudstack, i'm sure they exist for most 
>> used OS's, like CentOS 6, Debian, Ubuntu...
>> 
>>   Can someone provide me ? 
>> 
>> ( I don't understand why not marketplace is available ) for OS like those. 
>> even if i have to pay for will be ok for me, because i don't want to lose 
>> time create OS templates.
>> 
>> Thank you !
>> Cristian
>> 
>> 

Re: VPC VPN Connectivity Issues

[Remi Bergsma]

Hi Jeremy,

Did you already solve your problem?

Not sure if it is possible to use the IPSec tunnels from remote VPN. Firewall 
might be too strict, but haven't looked yet. 

Regards, Remi 

Sent from my iPhone

> On 29 Aug 2015, at 17:00, Jeremy Peterson  wrote:
> 
> I am not sure if this was asked or answered but googling has led me no where.
> 
> 
> I am running cloudstack 4.5.0,  XenServer 6.5, Advanced networking w/ VLAN 
> segmentation.
> 
> 
> I have a VPC setup which i am using a IPSec tunnel back to a zywall firewall 
> and a monowall firewall.
> 
> 
> MonowallCloustack VPCzywall
> 
> 192.168.1.0/24192.168.2.0/24192.168.71.0/24
> 
> 
> Tunnels are setup in vpc for both locations and servers in cloudstack can 
> connect to the world and connect to the monowall and zywall networks.
> 
> 
> Everything is fine with that but when I have a remote user that needs to VPN 
> into the cloudstack VPC is where i am thrown into a whirlwind of questions.
> 
> 
> I setup a VPN connection on the VR for the VPC.
> 
> I setup username/password.
> 
> 
> The user sets up the connection on his Mac OSX and using split tunnel can 
> connect to the VPN.
> 
> 
> My VPN network is 10.1.2.0/24
> 
> 
> He receives a 10.1.2.3 ip address.
> 
> 
> He is unable to ping the IPSec Tunnel gateways 192.168.1.1 and 192.168.71.1.
> 
> 
> He can get to the world as his default gateway is his router.
> 
> 
> I switched to push all traffic over the VPN to remove the split tunnel.
> 
> 
> He is able to ping the 10.1.2.1 gateway on the VR
> 
> 
> He is able to ping his gateway the VPC router 10.1.2.1.
> 
> 
> He is able to ping the VPC network's gateway 192.168.2.1
> 
> He is unable to get to the world.  I try to ping google dns 8.8.8.8 and it 
> doesnt' get past the VR 10.1.2.1 in traceroutes.
> 
> I am looking for help on this as i'm confused.  If I change him back to a 
> split tunnel as that would be prefered why is the tunnel not annoucing all 
> networks know to the VR.
> 
> I was able to recreate this issue on windows 8.1.
> 
> ?Jeremy

Re: CloudStack Templates (ready to use)

[Remi Bergsma]

Hi,

Please check this: http://dl.openvm.eu/cloudstack/

Regards, Remi 

Sent from my iPhone

> On 04 Sep 2015, at 18:41, Cristian Ciobanu  wrote:
> 
> Hello,
> 
>I need some KVM templates for cloudstack, i'm sure they exist for most 
> used OS's, like CentOS 6, Debian, Ubuntu...
> 
>Can someone provide me ? 
> 
> ( I don't understand why not marketplace is available ) for OS like those. 
> even if i have to pay for will be ok for me, because i don't want to lose 
> time create OS templates.
> 
> Thank you !
> Cristian
> 
>  

Re: Route out of band migration message

[Remi Bergsma]

Hi Martin,

It’s a bug which was fixed here:
https://github.com/apache/cloudstack/commit/3b3d2fc9d4dc068d42c6f63132518d9702cfb5d9

For now, you can ignore these alerts.

Regards,
Remi

From: Martin Emrich
Reply-To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Date: Thursday 27 August 2015 10:05
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Subject: Route out of band migration message

Hi!


Since upgrading from 4.4.3 to 4.4.4, I get an E-Mail like „An out of band 
migration of router i-11-413-VM(e7c09202-23de-4cae-b740-97dd0fea328d) was 
detected. No automated action was performed.“ Whenever I migrate a VM from one 
host to another.



But the machine mentioned is not a router but a normal instance… Any ideas?



Thanks,

Martin Emrich
Senior IT Administrator

Empolis Information Management GmbH | Europaallee 10 | 67657 Kaiserslautern | 
Germany
Phone +49 631 68037-71 | Fax +49 631 68037-77
martin.emr...@empolis.commailto:martin.emr...@empolis.com%0d

www.empolis.comhttp://www.empolis.com/
Sitz Kaiserslautern  | Amtsgericht Kaiserslautern HRB 31317
Geschäftsführer: Dr. Stefan Wess, Stefan Volland, Dr. Christian Schulmeyer, Dr. 
Peter Tepassé

SMART INFORMATION MANAGEMENT
Empolis-Lösungen befähigen Unternehmen und Organisationen, die exponentiell 
wachsende Menge
strukturierter und unstrukturierter Daten zu analysieren, zu interpretieren und 
automatisiert zu verarbeiten.
Sie nutzen damit ihr Wissenskapital, um unternehmenskritische Geschäftsprozesse 
zu optimieren.
Entscheider, Mitarbeiter und Kunden erhalten so stets situations- und 
aufgabengerecht genau die
Information, die für sie relevant ist.
Abonnieren Sie unseren 
Newsletterhttp://newsletter.empolis.com/art_resource.php?sid=si4n.23ctc3r | 
Folgen Sie uns auf Facebookhttp://www.facebook.com/EmpolisSoftware | Besuchen 
Sie uns auf YouTubehttp://www.youtube.com/EmpolisSoftware
[Signatur.Experton.DE]http://www.empolis.com/en/news-events/archiv/pressemitteilung-experton.html

Re: Urgent Issue : Cloudstack VM HA not working

[Remi Bergsma]

Hi,

Next to CloudStack reporting Up, also double check the management log en verify 
it can actually connect to the hypervisor and talk to it. 4.4.2 had issues with 
these kind of things.

What patches have you installed on xenserver?

Can you put the mgt logs somewhere so we can take a look?

Please consider upgrading as unfortunately 4.4.2 wasn't our best release. The 
latest 4.4.4 is great and has 100+ bugs fixed. I am not saying it will fix 
this, but it would be better anyway. 

Regards, Remi 


On 14 Aug 2015, at 23:36, Somesh Naidu somesh.na...@citrix.com wrote:

 in the cloudDB its running
 
 That would explain why HA did not trigger on the VM.
 
 Is the host marked as Up, as in connected to CS?
 
 Regards,
 Somesh
 
 
 -Original Message-
 From: Fedi Ben Ali [mailto:ben.ali.fe...@gmail.com] 
 Sent: Friday, August 14, 2015 5:23 PM
 To: users@cloudstack.apache.org
 Cc: prapul cool
 Subject: Re: Urgent Issue : Cloudstack VM HA not working
 
 hi,
 
 On the xencenter its halted and in the cloudDB its running.
 The vmsync process is not getting any information about the VM.
 
 2015-08-14 18:46 GMT+03:00 Somesh Naidu somesh.na...@citrix.com:
 
 Fedi,
 
 I am assuming VM has HA flag set in its Compute Offering.
 
 When you stop the VM from XenCenter, what state is it in XenSever (halted
 or does it disappear) and in Cloud DB (Running or Stopped)? What does
 vmsync for that host do with this VM (look at management server logs for
 this)?
 
 Regards,
 Somesh
 
 -Original Message-
 From: Fedi Ben Ali [mailto:ben.ali.fe...@gmail.com]
 Sent: Friday, August 14, 2015 7:59 AM
 To: users@cloudstack.apache.org
 Cc: prapul cool
 Subject: Re: Urgent Issue : Cloudstack VM HA not working
 
 Hi,
 
 thanks for your replys,
 but all those links are basically discribing how to do the pool-master
 failover (i already made those the configuration of xenserver ha ).
 but in my case i'm not recovering from a slave faillure ,even when i stop a
 vm from xencenter ,cloudstack do not start it as described in the
 documentation.
 
 Best regards.
 
 2015-08-14 12:26 GMT+03:00 Remi Bergsma rberg...@schubergphilis.com:
 
 Hi,
 
 This may also be of help:
 http://blog.remibergsma.com/2015/05/23/making-xenserver-and-cloudstack-sing-and-dance-together-again/
 
 I’d also consider upgrading to 4.4.4. I just did a 4.4.2 - 4.4.4 upgrade
 and it went without issues. It has many fixes over 4.4.2.
 
 Regards,
 Remi
 
 
 On 14 Aug 2015, at 08:05, prapul cool prapul_cool2...@yahoo.com.INVALID
 mailto:prapul_cool2...@yahoo.com.INVALID wrote:
 
 Hi ,From Xenserver6.2 onwards, you need to enabled native HA at pool
 level
 for cloudstack HA to work.please refer the link for more details.
 http://www.shapeblue.com/xenserver-native-ha-with-cloudstack/
 Regards,
 Prapul sriram,
 Cloud Architect,
 PSI Cloud Solutions,
 Psiclouds.comhttp://Psiclouds.com.
 
 
On Friday, 14 August 2015 3:31 AM, Fedi Ben Ali 
 ben.ali.fe...@gmail.commailto:ben.ali.fe...@gmail.com wrote:
 
 
 hello ,
 
 
 I'm working on cloudstack 4.4.2 and xenserver 6.2 cluster with 5 hosts, i
 deployed many virtual machines  with compute offerings having ha feature
 enabled.
 
 But when i stops one of the pools hosts , happens all VM steel set to
 running on cloudstack and no ha is done.
 
 Even when i stop a vm from the inside (setting command init 0 )
 ,cloudstack
 suppose to restart the VM ,but he is not doing so.
 
 This is very weird but can any one help ,this sooo urgent .
 
 Thx
 

Re: Urgent Issue : Cloudstack VM HA not working

[Remi Bergsma]

Hi,

This may also be of help:
http://blog.remibergsma.com/2015/05/23/making-xenserver-and-cloudstack-sing-and-dance-together-again/

I’d also consider upgrading to 4.4.4. I just did a 4.4.2 - 4.4.4 upgrade and 
it went without issues. It has many fixes over 4.4.2.

Regards,
Remi


On 14 Aug 2015, at 08:05, prapul cool 
prapul_cool2...@yahoo.com.INVALIDmailto:prapul_cool2...@yahoo.com.INVALID 
wrote:

Hi ,From Xenserver6.2 onwards, you need to enabled native HA at pool level for 
cloudstack HA to work.please refer the link for more 
details.http://www.shapeblue.com/xenserver-native-ha-with-cloudstack/
 Regards,
Prapul sriram,
Cloud Architect,
PSI Cloud Solutions,
Psiclouds.comhttp://Psiclouds.com.


On Friday, 14 August 2015 3:31 AM, Fedi Ben Ali 
ben.ali.fe...@gmail.commailto:ben.ali.fe...@gmail.com wrote:


hello ,


I'm working on cloudstack 4.4.2 and xenserver 6.2 cluster with 5 hosts, i
deployed many virtual machines  with compute offerings having ha feature
enabled.

But when i stops one of the pools hosts , happens all VM steel set to
running on cloudstack and no ha is done.

Even when i stop a vm from the inside (setting command init 0 ) ,cloudstack
suppose to restart the VM ,but he is not doing so.

This is very weird but can any one help ,this sooo urgent .

Thx

Re: How to delete a zone in database

[Remi Bergsma]

Update the expunging state to expunged and make sure the removed field is not 
null (enter today's date/time). 

That should do the trick. 

Regards, Remi 

 On 09 Aug 2015, at 06:36, Amir Abbasi abb...@tebyanidc.ir wrote:
 
 There is no null record for that zone, also state of all VM's are Expunging 
 and Destroyed!!
 
 -Original Message-
 From: Kiran manohar Chavala [mailto:kiranchav...@gmail.com] 
 Sent: Saturday, August 8, 2015 10:18 PM
 To: users@cloudstack.apache.org
 Subject: Re: How to delete a zone in database
 
 Hi Amir
 
 Pleas check  if there are any instances which ar
 
 
 mysqlselect id name,state from vm_instances where removed is null;
 
 If you get any id which is not removed, update the database
 
 mysqlupdate vm_instances set removed=now() where id in (select id from
 vm_instances where removed is null);
 
 Regards
 Kiran
 
 
 
 On Sat, Aug 8, 2015 at 1:05 PM, Amir Abbasi abb...@tebyanidc.ir wrote:
 
 Thanks, but I get the following error after removing the secondary storage:
 The zone is not deletable because there are virtual machines running 
 in this zone
 
 in  vm_instance table there are some instances in Expunging status, 
 does it caused the problem?
 -Original Message-
 From: Kiran manohar Chavala [mailto:kiranchav...@gmail.com]
 Sent: Wednesday, August 5, 2015 4:35 PM
 To: users@cloudstack.apache.org
 Subject: Re: How to delete a zone in database
 
 Hi Amir
 
 You can delete the templates present in secondary storage from the 
 database
 
 mysql  select  * from image_store where name=replace the name of 
 the secondary storage;
 
 note down the id
 
 
 mysql select * from template_store_ref where store_id=replace the id
 here;
 
 
 mysql delete from template_store_ref where store_id=replace the id
 mysql here;
 
 
 Then try to remove the secondary storage
 
 
 Regards
 
 Kiran Manohar
 
 Citrix systems
 On Aug 5, 2015 5:03 PM, Amir Abbasi abb...@tebyanidc.ir wrote:
 
 Hi All,
 
 
 
 All accounts, Domains and then hosts, clusters, pods, Primary 
 Storage have been removed but secondary storage could not be removed 
 and I face the following error:
 
 
 
 Cannot delete image store with active templates backup!
 
 
 
 I can see old templates of deleted accounts. How can I delete them 
 off from cloud database and then remove old zone?
 
 
 
 Thanks in advance
 

Re: cloudstack and vmware production?

[Remi Bergsma]

Hi,

I can only comment on the NSX part, as we do not use VMware as a hypervisor in 
production. 

NSX-mh is well supported, we run 1000s of VMs on KVM/XenServer with NSX since 
2012 and it rocks. VMware NSX-vsphere is not supported, this is a different 
product.

May I ask why you didn't consider KVM or XenServer? Many people in the 
community use this so getting help should be easy. 

But VMware as a hypervisor is supported. Maybe someone that runs this can share 
some thoughts/tips?

Regards, Remi 



 On 08 Aug 2015, at 08:44, Tejas Sheth tshet...@gmail.com wrote:
 
 Hello,
 
  We are planing to deploy cloudstack in production with VMware and
 cloudstack in large scale production environment (100+ accounts with 200+
 VMS) with advanced networking .
 
  We have evaluated multiple hypervisor and we have finalized VMware
 vsphere as hypervisor layer. I have following queries regarding stability.
 
  1) which vmware version and cloudstack version is integrates and
 maintains stability
 
  2) does anyone has tested VMware NSX with cloudstack?
 
 
  Really appreciate your advice in advance.
 
 Thanks,
 Tejas

Re: cloudstack and vmware production?

[Remi Bergsma]

Hi Tejas,

We do nested virtualization on KVM (based on CentOS 7.1). Never tried Hyper-v, 
but all other hypervisors work fine nested on KVM. 

Regards, Remi 

 On 08 Aug 2015, at 09:32, Tejas Sheth tshet...@gmail.com wrote:
 
 I am a big fan of kvm and xenserver too.
 In our requirement few account requires nested virtualization (hyper-v) for
 lab setup. Which need to be provisioned from cloudstack. Thats The reason
 behind vmware hypervisor.
 
 Thanks,
 Tejas
 On Aug 8, 2015 12:37 PM, Remi Bergsma rberg...@schubergphilis.com wrote:
 
 Hi,
 
 I can only comment on the NSX part, as we do not use VMware as a
 hypervisor in production.
 
 NSX-mh is well supported, we run 1000s of VMs on KVM/XenServer with NSX
 since 2012 and it rocks. VMware NSX-vsphere is not supported, this is a
 different product.
 
 May I ask why you didn't consider KVM or XenServer? Many people in the
 community use this so getting help should be easy.
 
 But VMware as a hypervisor is supported. Maybe someone that runs this can
 share some thoughts/tips?
 
 Regards, Remi
 
 
 
 On 08 Aug 2015, at 08:44, Tejas Sheth tshet...@gmail.com wrote:
 
 Hello,
 
 We are planing to deploy cloudstack in production with VMware and
 cloudstack in large scale production environment (100+ accounts with 200+
 VMS) with advanced networking .
 
 We have evaluated multiple hypervisor and we have finalized VMware
 vsphere as hypervisor layer. I have following queries regarding
 stability.
 
 1) which vmware version and cloudstack version is integrates and
 maintains stability
 
 2) does anyone has tested VMware NSX with cloudstack?
 
 
 Really appreciate your advice in advance.
 
 Thanks,
 Tejas
 

Re: cloudstack and vmware production?

[Remi Bergsma]

Hi Tejas,

Rohit recently blogged how to do that:
http://bhaisaab.org/logs/vmware-esxi-vcenter-on-kvm-cloudstack/

Regards, Remi 

 On 08 Aug 2015, at 10:07, Tejas Sheth tshet...@gmail.com wrote:
 
 Hello Remi,
 
 Anyway VMware hypervisor is a business decision. but I will definitely look
 in to KVM based nested hypervisor too.
 
  What is your qemu version?
  Have you tried vmware esxi as nested hypervisor?
 
 Thanks,
 Tejas
 
 
 
 On Sat, Aug 8, 2015 at 1:15 PM, Remi Bergsma rberg...@schubergphilis.com
 wrote:
 
 Hi Tejas,
 
 We do nested virtualization on KVM (based on CentOS 7.1). Never tried
 Hyper-v, but all other hypervisors work fine nested on KVM.
 
 Regards, Remi
 
 On 08 Aug 2015, at 09:32, Tejas Sheth tshet...@gmail.com wrote:
 
 I am a big fan of kvm and xenserver too.
 In our requirement few account requires nested virtualization (hyper-v)
 for
 lab setup. Which need to be provisioned from cloudstack. Thats The reason
 behind vmware hypervisor.
 
 Thanks,
 Tejas
 On Aug 8, 2015 12:37 PM, Remi Bergsma rberg...@schubergphilis.com
 wrote:
 
 Hi,
 
 I can only comment on the NSX part, as we do not use VMware as a
 hypervisor in production.
 
 NSX-mh is well supported, we run 1000s of VMs on KVM/XenServer with NSX
 since 2012 and it rocks. VMware NSX-vsphere is not supported, this is a
 different product.
 
 May I ask why you didn't consider KVM or XenServer? Many people in the
 community use this so getting help should be easy.
 
 But VMware as a hypervisor is supported. Maybe someone that runs this
 can
 share some thoughts/tips?
 
 Regards, Remi
 
 
 
 On 08 Aug 2015, at 08:44, Tejas Sheth tshet...@gmail.com wrote:
 
 Hello,
 
 We are planing to deploy cloudstack in production with VMware and
 cloudstack in large scale production environment (100+ accounts with
 200+
 VMS) with advanced networking .
 
 We have evaluated multiple hypervisor and we have finalized VMware
 vsphere as hypervisor layer. I have following queries regarding
 stability.
 
 1) which vmware version and cloudstack version is integrates and
 maintains stability
 
 2) does anyone has tested VMware NSX with cloudstack?
 
 
 Really appreciate your advice in advance.
 
 Thanks,
 Tejas
 

RE: cloudstack and vmware production?

[Remi Bergsma]

Hi Tejas,

I wouldn't recommend using 4.3.x for a new deployment. Even 4.4.x has been 
superseded by ACS 4.5. In fact, 4.5.2 will be released soon. A RC is expected 
in about a week and since some of us already run this in production, I think we 
can release it soon. If you still want to use 4.4, go for 4.4.4 (the latest 
release of 4.4). At work we run this in production and it is great. Although 
we're working towards upgrading to newer versions. Long story short: if you 
start, get the newest version that gets a lot of attention and is still 
maintained. Right now, this is 4.5.x.

You can get 4.5.1 here:
http://cloudstack.apt-get.eu/centos/4.5/

This is what will be 4.5.2 soon:
http://jenkins.buildacloud.org/view/4.5/job/package-rhel63-4.5/

If you encounter problems, let us know on d...@cloudstack.apache.org 

Regards,
Remi

-Original Message-
From: Tejas Sheth [mailto:tshet...@gmail.com] 
Sent: zaterdag 8 augustus 2015 11:11
To: users@cloudstack.apache.org
Subject: Re: cloudstack and vmware production?

Thanks Remi.

Hi Timothy,

  I would kink to know more of your VMware setup.
   1) Are you using CS 4.3.1 or 4.4.1.
   2) Have you faced any integration related issues in your VMware setup with 
CS?
   3) Are you using NFS or iSCSI as primary storage in VMware vsphere?
   4) are you using advanced networking?

Thanks
Tejas

On Sat, Aug 8, 2015 at 1:47 PM, Timothy Lothering  
tlother...@datacentrix.co.za wrote:

 Hello Remi,

 We use VMware ESXi 5.5 U2 (March 2015 Build), not NSX, we use DVS and SVS.
 Works like a charm. I also recommend you use VMXNET3   SCSI 
 Controllers on your OS Templates.

 One downside of VMware vs XenServer 6.2 (We run both), VMware takes 
 around 20min to deploy a 100GB VM, CXS takes about 5 min.

 Kind Regards,

 Timothy Lothering
 Timothy Lothering
 Solutions Architect
 Managed Services

 T: +27877415535
 F: +27877415100
 C: +27824904099
 E: tlother...@datacentrix.co.za


 DISCLAIMER NOTICE:

 Everything in this e-mail and any attachments relating to the official 
 business of Datacentrix Holdings Ltd. and its subsidiaries
 ('Datacentrix') is proprietary to Datacentrix. It is confidential, 
 legally privileged and protected by law. Datacentrix does not own and 
 endorse any other content. Views and opinions are those of the sender 
 unless clearly stated as being that of Datacentrix.
 The person addressed in the e-mail is the sole authorised recipient.
 Please notify the sender immediately if it has unintentionally reached 
 you and do not read, disclose or use the content in any way.
 Datacentrix cannot assure that the integrity of this communication has 
 been maintained nor that it is free of errors, virus, interception or 
 interference.
 -Original Message-
 From: Tejas Sheth [mailto:tshet...@gmail.com]
 Sent: Saturday, 08 August 2015 10:06 AM
 To: users@cloudstack.apache.org
 Subject: Re: cloudstack and vmware production?

 Hello Remi,

 Anyway VMware hypervisor is a business decision. but I will definitely 
 look in to KVM based nested hypervisor too.

   What is your qemu version?
   Have you tried vmware esxi as nested hypervisor?

 Thanks,
 Tejas



 On Sat, Aug 8, 2015 at 1:15 PM, Remi Bergsma 
 rberg...@schubergphilis.com
 wrote:

  Hi Tejas,
 
  We do nested virtualization on KVM (based on CentOS 7.1). Never 
  tried Hyper-v, but all other hypervisors work fine nested on KVM.
 
  Regards, Remi
 
   On 08 Aug 2015, at 09:32, Tejas Sheth tshet...@gmail.com wrote:
  
   I am a big fan of kvm and xenserver too.
   In our requirement few account requires nested virtualization
   (hyper-v)
  for
   lab setup. Which need to be provisioned from cloudstack. Thats The 
   reason behind vmware hypervisor.
  
   Thanks,
   Tejas
   On Aug 8, 2015 12:37 PM, Remi Bergsma
   rberg...@schubergphilis.com
  wrote:
  
   Hi,
  
   I can only comment on the NSX part, as we do not use VMware as a 
   hypervisor in production.
  
   NSX-mh is well supported, we run 1000s of VMs on KVM/XenServer 
   with NSX since 2012 and it rocks. VMware NSX-vsphere is not 
   supported, this is a different product.
  
   May I ask why you didn't consider KVM or XenServer? Many people 
   in the community use this so getting help should be easy.
  
   But VMware as a hypervisor is supported. Maybe someone that runs 
   this
  can
   share some thoughts/tips?
  
   Regards, Remi
  
  
  
   On 08 Aug 2015, at 08:44, Tejas Sheth tshet...@gmail.com wrote:
  
   Hello,
  
   We are planing to deploy cloudstack in production with VMware 
   and cloudstack in large scale production environment (100+ 
   accounts with
  200+
   VMS) with advanced networking .
  
   We have evaluated multiple hypervisor and we have finalized 
   VMware vsphere as hypervisor layer. I have following queries 
   regarding
   stability.
  
   1) which vmware version and cloudstack version is integrates and 
   maintains stability
  
   2) does anyone has tested VMware NSX with cloudstack?
  
  
   Really

Re: Urgent: VMs not migrated after putting Xenserver host in maintenance mode

[Remi Bergsma]

Hi Sonali,

What version of CloudStack do you use? We can then look at the source at line 
292 of DeploymentPlanningManagerImpl.java If I look at master, it indeed tries 
to do something with the compute offerings. Could you also post its specs 
(print the result of the select query where you set the field active). We might 
be able to tell what’s wrong with it.

As plan B, assuming you use a recent CloudStack version, you can use ‘xe 
vm-migrate’ to migrate VMs directly off of the hypervisor from the command line 
on the XenServer. Like this: xe vm-migrate vm=i-12-345-VM host=xen3

Recent versions of CloudStack will properly pick this up. When the VMS are 
gone, the hypervisor will enter maintenance mode just fine.

Regards,
Remi


 On 11 jul. 2015, at 09:42, Sonali Jadhav son...@servercentralen.se wrote:
 
 Can anyone help me please? 
 
 When I add xenserver host in maintenance, there are 3 VMs which are not 
 getting migrated to another host in cluster. 
 Other VMs were moved, but not these three. They both had computer offering 
 which was removed. But I undeleted those computer offerings, like Andrija 
 Panic suggested, changed their state to Active in  cloud.disk_offering table. 
 
 But still I am seeing following errors,  I am totally stuck, since I have 
 cluster of 4 xenservers, And I have upgraded 3 xenservers to 6.5, except this 
 one. And I can't reboot it for upgrade without moving these instances to 
 another host. 
 
 [o.a.c.f.j.i.AsyncJobManagerImpl] (HA-Worker-2:ctx-68459b74 work-73) Sync 
 job-4090 execution on object VmWorkJobQueue.32
 2015-07-09 14:27:00,908 INFO  [c.c.h.HighAvailabilityManagerImpl] 
 (HA-Worker-3:ctx-6ee7e62f work-74) Processing 
 HAWork[74-Migration-34-Running-Scheduled]
 2015-07-09 14:27:01,147 WARN  [o.a.c.f.j.AsyncJobExecutionContext] 
 (HA-Worker-3:ctx-6ee7e62f work-74) Job is executed without a context, setup 
 psudo job for the executing thread
 2015-07-09 14:27:01,162 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (HA-Worker-3:ctx-6ee7e62f work-74) Sync job-4091 execution on object 
 VmWorkJobQueue.34
 2015-07-09 14:27:01,191 DEBUG [c.c.r.ResourceManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Sent resource event 
 EVENT_PREPARE_MAINTENANCE_AFTER to listener CapacityManagerImpl
 2015-07-09 14:27:01,206 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Complete async 
 job-4088, jobStatus: SUCCEEDED, resultCode: 0, result: 
 org.apache.cloudstack.api.response.HostResponse/host/{id:c3c78959-6387-4cc9-8f59-23d44d2257a8,name:SeSolXS03,state:Up,disconnected:2015-07-03T12:13:06+0200,type:Routing,ipaddress:172.16.5.188,zoneid:1baf17c9-8325-4fa6-bffc-e502a33b578b,zonename:Solna,podid:07de38ee-b63f-4285-819c-8abbdc392ab0,podname:SeSolRack1,version:4.5.1,hypervisor:XenServer,cpusockets:2,cpunumber:24,cpuspeed:2400,cpuallocated:0%,cpuused:0%,cpuwithoverprovisioning:57600.0,networkkbsread:0,networkkbswrite:0,memorytotal:95574311424,memoryallocated:0,memoryused:13790400,capabilities:xen-3.0-x86_64
  , xen-3.0-x86_32p , hvm-3.0-x86_32 , hvm-3.0-x86_32p , 
 hvm-3.0-x86_64,lastpinged:1970-01-17T06:39:19+0100,managementserverid:59778234354585,clusterid:fe15e305-5c11-4785-a13d-e4581e23f5e7,clustername:SeSolCluster1,clustertype:CloudManaged,islocalstorageactive:false,created:2015-01-27T10:55:13+0100,events:ManagementServerDown;
  AgentConnected; Ping; Remove; AgentDisconnected; HostDown; 
 ShutdownRequested; StartAgentRebalance; 
 PingTimeout,resourcestate:PrepareForMaintenance,hypervisorversion:6.2.0,hahost:false,jobid:7ad72023-a16f-4abf-84a3-83dd0e9f6bfd,jobstatus:0}
 2015-07-09 14:27:01,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Publish async 
 job-4088 complete on message bus
 2015-07-09 14:27:01,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Wake up jobs 
 related to job-4088
 2015-07-09 14:27:01,209 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Update db status 
 for job-4088
 2015-07-09 14:27:01,211 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Wake up jobs joined 
 with job-4088 and disjoin all subjobs created from job- 4088
 2015-07-09 14:27:01,386 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088) Done executing 
 org.apache.cloudstack.api.command.admin.host.PrepareForMaintenanceCmd for 
 job-4088
 2015-07-09 14:27:01,389 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088) Remove job-4088 from job 
 monitoring
 2015-07-09 14:27:02,755 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (AsyncJobMgr-Heartbeat-1:ctx-1c99f7cd) Execute sync-queue item: 
 SyncQueueItemVO {id:2326, queueId: 251, contentType: AsyncJob, contentId: 
 4091, lastProcessMsid: 59778234354585, lastprocessNumber: 193, 
 lastProcessTime: Thu Jul 09 

Re: Urgent: VMs not migrated after putting Xenserver host in maintenance mode

[Remi Bergsma]

Hi,

Did you also set the ‘removed’ column back to NULL (instead of the date/time it 
was originally deleted)?

You can migrate directly from XenServer in 4.5.1, no problem. When the 
hypervisor connects to CloudStack again it will report its running VMs and 
update the data base. I guess there was a problem in 4.4.3 where out-of-band 
migrations would cause a reboot of a router. Not sure if it is also in 4.5.1. 
It’s fixed in 4.4.4 and also in the upcoming 4.5.2. If your remaining VMs are 
not routers, there is no issue. Otherwise you risk a reboot (which is quite 
fast anyway).

I’d first double check the disk offering, also check its tags etc. If that 
works, then migrate in CloudStack (as it is supposed to work). If not, you can 
do it directly from XenServer in order to empty your host and proceed with the 
migration. Once the migration is done, fix any remaining issues.

Hope this helps.

Regards,
Remi


 On 11 jul. 2015, at 12:57, Sonali Jadhav son...@servercentralen.se wrote:
 
 Hi I am using 4.5.1. That's why I am upgrading all xenservers to 6.5.
 
 I didn't knew that I can migrate vm from xenservers host itself. I thought 
 that would make cloudstack database inconsistent, since migration is not 
 initiated from cloudstack.
 
 And like I said before,  those vms have compute offering which was deleted,  
 but I undeleted them by setting status to active in disk_offering table
 
 Sent from my Sony Xperia™ smartphone
 
 
  Remi Bergsma wrote 
 
 Hi Sonali,
 
 What version of CloudStack do you use? We can then look at the source at line 
 292 of DeploymentPlanningManagerImpl.java If I look at master, it indeed 
 tries to do something with the compute offerings. Could you also post its 
 specs (print the result of the select query where you set the field active). 
 We might be able to tell what’s wrong with it.
 
 As plan B, assuming you use a recent CloudStack version, you can use ‘xe 
 vm-migrate’ to migrate VMs directly off of the hypervisor from the command 
 line on the XenServer. Like this: xe vm-migrate vm=i-12-345-VM host=xen3
 
 Recent versions of CloudStack will properly pick this up. When the VMS are 
 gone, the hypervisor will enter maintenance mode just fine.
 
 Regards,
 Remi
 
 
 On 11 jul. 2015, at 09:42, Sonali Jadhav son...@servercentralen.se wrote:
 
 Can anyone help me please?
 
 When I add xenserver host in maintenance, there are 3 VMs which are not 
 getting migrated to another host in cluster.
 Other VMs were moved, but not these three. They both had computer offering 
 which was removed. But I undeleted those computer offerings, like Andrija 
 Panic suggested, changed their state to Active in  cloud.disk_offering table.
 
 But still I am seeing following errors,  I am totally stuck, since I have 
 cluster of 4 xenservers, And I have upgraded 3 xenservers to 6.5, except 
 this one. And I can't reboot it for upgrade without moving these instances 
 to another host.
 
 [o.a.c.f.j.i.AsyncJobManagerImpl] (HA-Worker-2:ctx-68459b74 work-73) Sync 
 job-4090 execution on object VmWorkJobQueue.32
 2015-07-09 14:27:00,908 INFO  [c.c.h.HighAvailabilityManagerImpl] 
 (HA-Worker-3:ctx-6ee7e62f work-74) Processing 
 HAWork[74-Migration-34-Running-Scheduled]
 2015-07-09 14:27:01,147 WARN  [o.a.c.f.j.AsyncJobExecutionContext] 
 (HA-Worker-3:ctx-6ee7e62f work-74) Job is executed without a context, setup 
 psudo job for the executing thread
 2015-07-09 14:27:01,162 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (HA-Worker-3:ctx-6ee7e62f work-74) Sync job-4091 execution on object 
 VmWorkJobQueue.34
 2015-07-09 14:27:01,191 DEBUG [c.c.r.ResourceManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Sent resource 
 event EVENT_PREPARE_MAINTENANCE_AFTER to listener CapacityManagerImpl
 2015-07-09 14:27:01,206 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
 (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Complete async 
 job-4088, jobStatus: SUCCEEDED, resultCode: 0, result: 
 org.apache.cloudstack.api.response.HostResponse/host/{id:c3c78959-6387-4cc9-8f59-23d44d2257a8,name:SeSolXS03,state:Up,disconnected:2015-07-03T12:13:06+0200,type:Routing,ipaddress:172.16.5.188,zoneid:1baf17c9-8325-4fa6-bffc-e502a33b578b,zonename:Solna,podid:07de38ee-b63f-4285-819c-8abbdc392ab0,podname:SeSolRack1,version:4.5.1,hypervisor:XenServer,cpusockets:2,cpunumber:24,cpuspeed:2400,cpuallocated:0%,cpuused:0%,cpuwithoverprovisioning:57600.0,networkkbsread:0,networkkbswrite:0,memorytotal:95574311424,memoryallocated:0,memoryused:13790400,capabilities:xen-3.0-x86_64
  , xen-3.0-x86_32p , hvm-3.0-x86_32 , hvm-3.0-x86_32p , 
 hvm-3.0-x86_64,lastpinged:1970-01-17T06:39:19+0100,managementserverid:59778234354585,clusterid:fe15e305-5c11-4785-a13d-e4581e23f5e7,clustername:SeSolCluster1,clustertype:CloudManaged,islocalstorageactive:false,created:2015-01-27T10:55:13+0100,events:ManagementServerDown;
  AgentConnected; Ping; Remove; AgentDisconnected; HostDown; 
 ShutdownRequested; StartAgentRebalance

Re: Public IP range VLAN Tag

[Remi Bergsma]

Hi,

You could try specifying a Traffic Label that points to an interface that has 
no VLAN tag of its own. Then, when adding the different ip address spaces, 
specify the appropriate VLAN tag. CloudStack will then use the interface, and 
tag the traffic with the VLAN specified so your switching gear will pick it up 
nicely. Still, one can be untagged.

Regards,
Remi

 On 4 jul. 2015, at 05:55, Fedi Ben Ali ben.ali.fe...@gmail.com wrote:
 
 Hi,
 
 I'm working on a deploiement with two zones with advanced networking.
 i have a range public ip adresses that will be used for my both zones.
 
 i want to use a part of this range as my public range on the zones level
 and the rest will be set as portable ip's.
 
 i added the portable  ip range with vlan untagged ,but when i add the
 public range a get an error that says that the VLAN tag vlan://untagged is
 already being used for portable ip range in this region.
 
 on my hypervisor and network equipements my public network is VLAN tagged.
 
 
 Thx.

Re: Cloudstack physical network on xenserver

[Remi Bergsma]

Hi Vadim,

That depends on your upstream provider. In our case, we get a VLAN from 
upstream provider and send tagged packets (they take care of it from there). 
So, in that case the VLAN tagging is handy/required. If you need to send it 
untagged, then tagging it wont’t work indeed.

Regards,
Remi

 On 3 jul. 2015, at 09:08, Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote:
 
 Hello Fedi,
 
   Public traffic must me untagged because the next switch after yours 
 will not recognize it if it is tagged.  You need to untag public traffic 
 before sending out. To route internally - you need to tag it.   I also have 
 public traffic tagged internally and assign tag on ingress and remove tag on 
 egress traffic.  This is done by switch configuration.
 
   VLAN is used for isolation.  You can have same ip ranges on the same 
 physical networks without networks to be overlapped. 
 
 Vadim.
 
 -Original Message-
 From: Fedi Ben Ali [mailto:ben.ali.fe...@gmail.com] 
 Sent: Thursday, July 02, 2015 5:32 PM
 To: users@cloudstack.apache.org
 Subject: Cloudstack physical network on xenserver
 
 Hello,
 
 On my deploiement cloudstack 4.4 and xenservers 6.2. i have configured 
 multiple networks each one for a specific traffic type 
 (Public,management,storage,guest).
 
 these networks are isolated and vlan tagged ,so on my xenservers  i have the 
 4 networks each with a specific name label and pointing to a Vlan.
 
 when i added the public ip range ,i did not mention the VLAN number of my 
 public network.
 
 Can this cause issues or not ?
 
 and what is the pupose of putting the vlan number on the ip ranges ?
 
 Thx.

Re: [DISCUSS] 4.5.2 bugfix sprint

[Remi Bergsma]

Hi Rohit,

Could you see if you can add this bug fix as well? It fixes the X-Forwarded-For 
header in HAProxy.
https://github.com/apache/cloudstack/pull/549

Thanks,
Remi


 On 25 jun. 2015, at 21:35, Rohit Yadav rohit.ya...@shapeblue.com wrote:
 
 Hi all,
 
 Now that 4.4.4 has passed, I would like to start a 4.5.2 release effort soon. 
 Please share any blockers, critical issues and other problems you may have 
 discovered with 4.5.1 that we should try to fix in ACS 4.5.2.
 
 Thanks.
 
 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +91 88 262 30892 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab
 
 
 
 Find out more about ShapeBlue and our range of CloudStack related services
 
 IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Software 
 Engineeringhttp://shapeblue.com/cloudstack-software-engineering/
 CloudStack Infrastructure 
 Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training 
 Courseshttp://shapeblue.com/cloudstack-training/
 
 This email and any attachments to it may be confidential and are intended 
 solely for the use of the individual to whom it is addressed. Any views or 
 opinions expressed are solely those of the author and do not necessarily 
 represent those of Shape Blue Ltd or related companies. If you are not the 
 intended recipient of this email, you must neither take any action based upon 
 its contents, nor copy or show it to anyone. Please contact the sender if you 
 believe you have received this email in error. Shape Blue Ltd is a company 
 incorporated in England  Wales. ShapeBlue Services India LLP is a company 
 incorporated in India and is operated under license from Shape Blue Ltd. 
 Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
 operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
 registered by The Republic of South Africa and is traded under license from 
 Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Cloudstack physical network on xenserver

[Remi Bergsma]

Hi,

Your public network also has a Traffic Label, pointing towards a certain 
interface/bridge in XenServer. If you specify no vlan, CloudStack will assume 
it is untagged. You can then still point towards an interface/bridge that is 
tagged with a vlan. The alternative is to point towards a more generic 
interface/bridge (that has no vlan in XenServer) and specify a vlan tag in 
CloudStack. CloudStack will then create an the interface with the vlan on top 
of it. Be sure not to create a vlan tag ontop of interface/bridge that already 
has a vlan (as this will obviously not work).

Long story short: it depends on how your XenServers can plug vifs into the 
public network.

Regards,
Remi


 On 2 jul. 2015, at 16:31, Fedi Ben Ali ben.ali.fe...@gmail.com wrote:
 
 Hello,
 
 On my deploiement cloudstack 4.4 and xenservers 6.2. i have configured
 multiple networks each one for a specific traffic type
 (Public,management,storage,guest).
 
 these networks are isolated and vlan tagged ,so on my xenservers  i have
 the 4 networks each with a specific name label and pointing to a Vlan.
 
 when i added the public ip range ,i did not mention the VLAN number of my
 public network.
 
 Can this cause issues or not ?
 
 and what is the pupose of putting the vlan number on the ip ranges ?
 
 Thx.

Re: XenServer upgrade in CloudStack environment

[Remi Bergsma]

Yes, I think it does. This article was written before mayor changes were made 
(who elects the new poolmaster and such). Now that we should use XenServer 
poolHA, this procedure also should be altered accordingly. 

When I have some spare time, I’ll document how to properly do it with regards 
to poolHA being turned on. If you have questions before that, just ping me.

Regards,
Remi


 On 12 Jun 2015, at 13:31, Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote:
 
 Hi,
 
   I did the same as Martin at CS 4.5.1 and it went OK. Does this depend 
 on CS version?
 
 Vadim.
 
 -Original Message-
 From: Mārtiņš Jakubovičs [mailto:mart...@vertigs.lv] 
 Sent: Friday, June 12, 2015 10:40 AM
 To: users@cloudstack.apache.org
 Subject: Re: XenServer upgrade in CloudStack environment
 
 Hello,
 
 No, I didn't. Didn't know about such upgrade procedure. I will follow this 
 article next time.
 
 Thanks a lot!
 
 On 2015.06.12. 10:21, Praveen B wrote:
 Hi Martins,
 
 Have you unmanaged your xen cluster from cloudstack UI before xen upgrade?
 This is a mandatory step that disconnects all xen servers in the 
 cluster from while upgrade is going on.
 
 You can go through
 http://www.shapeblue.com/how-to-upgrade-an-apache-cloudstack-citrix-xe
 nserver-cluster/ KB article that explains xen cluster upgrade in 
 cloudstack.
 
 Thanks,
 Praveen Kumar,
 Founder, PSI Cloud Solutions
 
 On Fri, Jun 12, 2015 at 12:41 PM, Mārtiņš Jakubovičs 
 mart...@vertigs.lv
 wrote:
 
 Hello all,
 
 Yesterday I upgraded one of my CloudStack Cluster's which run on 
 XenServer. As XenServer dokumentation suggest, after applying 
 patches, need to restart a host, and first must be pool master 
 server. I set master server to maintenance mode in CS, when all 
 instances migrated I restarted a host. After some time I start to 
 receive e-mails from CS, that other hosts in cluster are down too, 
 not only a master server. My compute offerings are HA enabled so I 
 receive e-mails with failed restart attempt on HA instances. At 
 least, when master come online CS didn't restart any instances and I get 
 away with just a little scare.
 
 What is correct way to do upgrade no XenServer hosts in CloudStack 
 environment? Patches, like XS 6.2 SP1  
 http://support.citrix.com/article/CTX139788 require to restart pool 
 master first.
 
 I use ACS 4.3.2 with XenServer 6.2.
 
 Best regards,
 Martins
 
 

Re: ACS does shutdown some VMs

[Remi Bergsma]

Hi,

It’d double check the HA worker table to see if there are any left-over HA 
workers. Also, there could still be other jobs scheduled. If the API does not 
return anything useful, you may have a look at the DB itself.

I wrote scripts to easily display HA workers [1] and jobs [2] which may help 
you as well. You can also execute the queries yourself, see [3] and [4] to get 
an idea.

Regards,
Remi

[1] https://github.com/remibergsma/cloudstackOps/blob/master/listHAWorkers.py
[2] https://github.com/remibergsma/cloudstackOps/blob/master/listRunningJobs.py
[3] 
https://github.com/remibergsma/cloudstackOps/blob/master/cloudstackops/cloudstacksql.py#L76
[4] 
https://github.com/remibergsma/cloudstackOps/blob/master/cloudstackops/cloudstacksql.py#L109

On 23 Jun 2015, at 07:27, Tomasz Zięba 
t.a.zi...@gmail.commailto:t.a.zi...@gmail.com wrote:

What version of ACS ?

Regards,
Tomasz Zięba

Twitter: @TZieba
LinkedIn: 
pl.linkedin.com/pub/tomasz-zięba-ph-d/3b/7a8/ab6/http://pl.linkedin.com/pub/tomasz-zięba-ph-d/3b/7a8/ab6/
http://pl.linkedin.com/pub/tomasz-zi%C4%99ba-ph-d/3b/7a8/ab6/

sent from mobile
22 cze 2015 23:36 Jochim, Ingo 
ingo.joc...@bautzen-it.demailto:ingo.joc...@bautzen-it.de napisał(a):

Hello Andrei,

The VM is not a HA VM.

How can I check the queue?

cloudmonkey list asyncjobs ???

isdefault = False # does this mean it should be off ?

Regards,
Ingo



Von: Andrei Mikhailovsky [and...@arhont.commailto:and...@arhont.com]
Gesendet: Montag, 22. Juni 2015 22:58
An: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Betreff: Re: ACS does shutdown some VMs

Hi Ingo,

It might be an HA issue (check if these vms are set to HA). Also, it might
be a broken job. Check out the jobs in the queue.

Andrei



- Original Message -

From: Ingo Jochim 
ingo.joc...@bautzen-it.demailto:ingo.joc...@bautzen-it.de
To: users@cloudstack.apache.orgmailto:users@cloudstack.apache.org
Sent: Monday, 22 June, 2015 9:10:05 PM
Subject: ACS does shutdown some VMs

Hello all,

we have a strange problem here. There are a couple of running VMs.
As soon as ACS get's restarted it will start shutting down some of the VMs.
It happens with the same VMs always. We can start those VMs without
problems and they stay running.
Is there some kind of destination state which might be wrong in the
database?

Thank you in advance.
Ingo
--
This email was Virus checked by UTM 9. http://www.sophos.com


--
This email was Virus checked by UTM 9. http://www.sophos.com

Re: 4.5.1: VMsync issues with VRs?

[Remi Bergsma]

Hi René,

Thanks for bringing it up. I talked to Rohit and he pointed me towards:
https://issues.apache.org/jira/browse/CLOUDSTACK-7994

It seems it is done on purpose as a fix. I think we should discuss this on the 
dev-list ;-)

Regards,
Remi



On 03 Jun 2015, at 08:44, ilya 
ilya.mailing.li...@gmail.commailto:ilya.mailing.li...@gmail.com wrote:

Rene

Are you running Advanced Shared Zone?

Regards
ilya
On 6/1/15 7:57 AM, Rene Moser wrote:
Hi

Before I file a bug, I would like to give some of you the chance to
confirm an issue we faced during testing of 4.5.1.

Environment:

Hypervisor: VMware vsphere 5.1
CloudStack: 4.5.1 (upstream)
Networking: Advanced
VR: systemvm-4.5 (shapeblue)


Problem:

We tested the VM sync which worked as expected for VMs.

But after we migrated (computing only) a VR, the VR gets rebooted in
every case and we see this in the logs:

https://gist.githubusercontent.com/resmo/ce026c49373d54eb24e6/raw/1bf7d22c26fa07000cae5ab191e6a76d4b189fa7/gistfile1.txt


Expected:

VRs should not reboot after migration.


This would be a blocker for us. Could anyone confirm this?

Yours
René

Re: Change Cluster pool master

[Remi Bergsma]

Hi,

The commit was added to the 4.3 branch on Dec 3, 2014:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=305d8ae

CloudStack 4.3.2 was released in January 2015, so I would say it was
included.
https://blogs.apache.org/cloudstack/entry/announce_announcing_apache_cloudstack_4

Since XenServer itself is handling HA on the pool, I'd say you can safely
run 'xe pool-designate-new-master' to elect a new master.  CloudStack will
pick this up automatically.

Regards,
Remi





2015-05-28 9:33 GMT+02:00 Mārtiņš Jakubovičs mart...@vertigs.lv:

 I am running ASC 4.3.2 and XenServer 6.2 with XS62ESP1013 patch.


 On 2015.05.28. 10:30, Glenn Wagner wrote:

 Hello,

 What version of Xenserver and Cloudstack are you running?

 Glenn Wagner
 Senior Consultant, South Africa



 Phone: +27 21 527 0091 | Mobile: +27 73 917 4111

 glenn.wag...@shapeblue.com | www.shapeblue.com | Twitter:@shapeBlue
 ShapeBlue SA (Pty) Ltd, 2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset
 West, Cape Town 7130

 -Original Message-
 From: Mārtiņš Jakubovičs [mailto:mart...@vertigs.lv]
 Sent: 28 May 2015 09:09 AM
 To: users@cloudstack.apache.org
 Subject: Change Cluster pool master

 Hello,

 I want just to be sure.
 Is it safe change running cluster's XenServer's pool master (xe
 pool-designate-new-master host-uuid=uuid)?
 In XenServer pool without CloudStack it works great and without issues,
 but how about with CloudStack?
 Find out more about ShapeBlue and our range of CloudStack related services

 IaaS Cloud Design  Build
 http://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Software Engineering
 http://shapeblue.com/cloudstack-software-engineering/
 CloudStack Infrastructure Support
 http://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training Courses
 http://shapeblue.com/cloudstack-training/

 This email and any attachments to it may be confidential and are intended
 solely for the use of the individual to whom it is addressed. Any views or
 opinions expressed are solely those of the author and do not necessarily
 represent those of Shape Blue Ltd or related companies. If you are not the
 intended recipient of this email, you must neither take any action based
 upon its contents, nor copy or show it to anyone. Please contact the sender
 if you believe you have received this email in error. Shape Blue Ltd is a
 company incorporated in England  Wales. ShapeBlue Services India LLP is a
 company incorporated in India and is operated under license from Shape Blue
 Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
 and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
 a company registered by The Republic of South Africa and is traded under
 license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: ISO download Error

[Remi Bergsma]

Hi,

Could you post the cloud.log of the SSVM? That could bring some hints. You
can login using SSH from the hypervisor like this:
ssh -p 3922 -i ~/.ssh/cloud_rsa 169.254.x.x (get the ip from the UI/API).
Then look at /var/log/cloud.log

Also, what do the logs of your webserver say?
It sounds to me a 404 error really is a file-not-found served by the
webserver.

Could you also try one of the templates I suggested?

Regards,
Remi


2015-05-18 8:21 GMT+02:00 mer...@students.iitmandi.ac.in:

 Hi Remi,

 The ISO image that I used was freshly downloaded and put in my /var/www
 folder, whose path was mentioned by me during the upload.
 ie. http://IP/ubuntu-15.04...

 And still I received that the system cant download it.




  Hi Merlin,
 
  The guide you used, instructs you to add an ISO image and the url listed
  does not exist any more. Hence, the 404 error.
 
  Instead of using an ISO, I’d recommend uploading ready-to-go templates.
  You can download many different flavours here:
  http://dl.openvm.eu/cloudstack/ http://dl.openvm.eu/cloudstack/
 
  Regards,
  Remi
 
 
  On 15 May 2015, at 14:09 , mer...@students.iitmandi.ac.in wrote:
 
  Hi,
 
  I am using Cloudstack4.4.3 on a server system which is both the
  management
  and agent server. Installed and configured using this link
  :
 http://www.greenhills.co.uk/2015/02/23/cloudstack-4.4-single-server-on-ubuntu-14.04.1-with-kvm.html
 
  There is one zone, one pod with 5 IP's, one cluster and one host.
  When I try to download the default xs-tools.iso from the screen, I get
  an
  error:- unable to download xs.tools.iso as it resides on host and not on
  ssvm
 
  Similarly when I try to upload an iso image, in the tab Zones, under the
  status it reads:  HTTP Server returned 404 (expected 200 OK)
 
  I followed the guide in this link
  :
 https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting
 
  After logging into ssvm and running the script, there was no error or
  warning thrown, hence I checked the LOg:
 
  tail /var/log/cloud/cloud.out
  2015-05-15 09:19:40,908 INFO  [agent.transport.Request]
  (agentRequest-Handler-5:null) not building log message for '[{}]',
  _cmds.length == 1
  2015-05-15 09:19:40,908 DEBUG [cloud.agent.Agent]
  (agentRequest-Handler-5:null) Processing command:
  com.cloud.agent.api.GetStorageStatsCommand
  2015-05-15 09:19:40,908 INFO
  [storage.resource.NfsSecondaryStorageResource]
  (agentRequest-Handler-5:null) Determined host 10.8.15.5 corresponds to
  IP
  10.8.15.5
  2015-05-15 09:19:40,920 INFO  [agent.transport.Request]
  (agentRequest-Handler-5:null) not building log message for '[{}]',
  _cmds.length == 1
  2015-05-15 09:20:27,730 DEBUG [cloud.agent.Agent] (UgentTask-5:null)
  Sending ping: Seq 5-6:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
 
 [{com.cloud.agent.api.PingStorageCommand:{changes:{},hostType:Storage,hostId:5,wait:0}}]
  }
  2015-05-15 09:20:27,787 DEBUG [cloud.agent.Agent] (Agent-Handler-5:null)
  Received response: Seq 5-6:  { Ans: , MgmtId: 279278805450858, via: 5,
  Ver: v1, Flags: 100010,
 
 [{com.cloud.agent.api.PingAnswer:{_command:{hostType:Storage,hostId:5,wait:0},result:true,wait:0}}]
  }
  2015-05-15 09:20:41,024 INFO  [agent.transport.Request]
  (agentRequest-Handler-1:null) not building log message for '[{}]',
  _cmds.length == 1
  2015-05-15 09:20:41,025 DEBUG [cloud.agent.Agent]
  (agentRequest-Handler-1:null) Processing command:
  com.cloud.agent.api.GetStorageStatsCommand
  2015-05-15 09:20:41,025 INFO
  [storage.resource.NfsSecondaryStorageResource]
  (agentRequest-Handler-1:null) Determined host 10.8.15.5 corresponds to
  IP
  10.8.15.5
  2015-05-15 09:20:41,036 INFO  [agent.transport.Request]
  (agentRequest-Handler-1:null) not building log message for '[{}]',
  _cmds.length == 1
 
  Also checked the  for host file
  here is the entry :
 
  |  5 | s-4-VM | 38297028-25bb-4067-8387-6e27b1b4a90c | Up   |
  SecondaryStorageVM | 10.8.2.15  | 255.255.0.0 |
  06:39:4a:00:00:05   | 10.8.2.15  | 255.255.0.0 |
  06:39:4a:00:00:05   | NULL | NULL  |
  NULL
 |   NULL | 10.8.2.20 | 255.255.0.0|
  06:b8:2c:00:00:0a  |   NULL |  1 |  1 |NULL
  |
  NULL |  NULL | NoIqn | NULL| NULL| NULL   |
0 | NULL | 4.4.3   | NULL   |   NULL | NULL |
  s-4-VM-NfsSecondaryStorageResource|
  1
  | 0 |   0 | 1398129837 | 279278805450858 | 2015-05-15
  09:17:13
  | 2015-05-13 14:13:57 | NULL|   14 | Enabled
  | NULL  | NULL| Disabled |
 
 
  I am attaching the management server  log:
  tail /var/log/cloudstack/management/management-server.log
  2015-05-15 16:24:45,271 DEBUG
  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
  (RouterStatusMonitor-1:ctx-d47fda51) Found 0 networks to update RvR
  status.
  2015-05-15 

Re: ISO download Error

[Remi Bergsma]

Hi Merlin,

The guide you used, instructs you to add an ISO image and the url listed does 
not exist any more. Hence, the 404 error.

Instead of using an ISO, I’d recommend uploading ready-to-go templates. You can 
download many different flavours here:
http://dl.openvm.eu/cloudstack/ http://dl.openvm.eu/cloudstack/

Regards,
Remi


 On 15 May 2015, at 14:09 , mer...@students.iitmandi.ac.in wrote:
 
 Hi,
 
 I am using Cloudstack4.4.3 on a server system which is both the management
 and agent server. Installed and configured using this link
 :http://www.greenhills.co.uk/2015/02/23/cloudstack-4.4-single-server-on-ubuntu-14.04.1-with-kvm.html
 
 There is one zone, one pod with 5 IP's, one cluster and one host.
 When I try to download the default xs-tools.iso from the screen, I get an
 error:- unable to download xs.tools.iso as it resides on host and not on
 ssvm
 
 Similarly when I try to upload an iso image, in the tab Zones, under the
 status it reads:  HTTP Server returned 404 (expected 200 OK)
 
 I followed the guide in this link
 :https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting
 
 After logging into ssvm and running the script, there was no error or
 warning thrown, hence I checked the LOg:
 
 tail /var/log/cloud/cloud.out
 2015-05-15 09:19:40,908 INFO  [agent.transport.Request]
 (agentRequest-Handler-5:null) not building log message for '[{}]',
 _cmds.length == 1
 2015-05-15 09:19:40,908 DEBUG [cloud.agent.Agent]
 (agentRequest-Handler-5:null) Processing command:
 com.cloud.agent.api.GetStorageStatsCommand
 2015-05-15 09:19:40,908 INFO 
 [storage.resource.NfsSecondaryStorageResource]
 (agentRequest-Handler-5:null) Determined host 10.8.15.5 corresponds to IP
 10.8.15.5
 2015-05-15 09:19:40,920 INFO  [agent.transport.Request]
 (agentRequest-Handler-5:null) not building log message for '[{}]',
 _cmds.length == 1
 2015-05-15 09:20:27,730 DEBUG [cloud.agent.Agent] (UgentTask-5:null)
 Sending ping: Seq 5-6:  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11,
 [{com.cloud.agent.api.PingStorageCommand:{changes:{},hostType:Storage,hostId:5,wait:0}}]
 }
 2015-05-15 09:20:27,787 DEBUG [cloud.agent.Agent] (Agent-Handler-5:null)
 Received response: Seq 5-6:  { Ans: , MgmtId: 279278805450858, via: 5,
 Ver: v1, Flags: 100010,
 [{com.cloud.agent.api.PingAnswer:{_command:{hostType:Storage,hostId:5,wait:0},result:true,wait:0}}]
 }
 2015-05-15 09:20:41,024 INFO  [agent.transport.Request]
 (agentRequest-Handler-1:null) not building log message for '[{}]',
 _cmds.length == 1
 2015-05-15 09:20:41,025 DEBUG [cloud.agent.Agent]
 (agentRequest-Handler-1:null) Processing command:
 com.cloud.agent.api.GetStorageStatsCommand
 2015-05-15 09:20:41,025 INFO 
 [storage.resource.NfsSecondaryStorageResource]
 (agentRequest-Handler-1:null) Determined host 10.8.15.5 corresponds to IP
 10.8.15.5
 2015-05-15 09:20:41,036 INFO  [agent.transport.Request]
 (agentRequest-Handler-1:null) not building log message for '[{}]',
 _cmds.length == 1
 
 Also checked the  for host file
 here is the entry :
 
 |  5 | s-4-VM | 38297028-25bb-4067-8387-6e27b1b4a90c | Up   |
 SecondaryStorageVM | 10.8.2.15  | 255.255.0.0 |
 06:39:4a:00:00:05   | 10.8.2.15  | 255.255.0.0 |
 06:39:4a:00:00:05   | NULL | NULL  | NULL 
|   NULL | 10.8.2.20 | 255.255.0.0|
 06:b8:2c:00:00:0a  |   NULL |  1 |  1 |NULL |
 NULL |  NULL | NoIqn | NULL| NULL| NULL   |   
   0 | NULL | 4.4.3   | NULL   |   NULL | NULL |
 s-4-VM-NfsSecondaryStorageResource| 1
 | 0 |   0 | 1398129837 | 279278805450858 | 2015-05-15 09:17:13
 | 2015-05-13 14:13:57 | NULL|   14 | Enabled  
 | NULL  | NULL| Disabled |
 
 
 I am attaching the management server  log:
 tail /var/log/cloudstack/management/management-server.log
 2015-05-15 16:24:45,271 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
 (RouterStatusMonitor-1:ctx-d47fda51) Found 0 networks to update RvR
 status.
 2015-05-15 16:24:48,349 DEBUG [c.c.a.m.AgentManagerImpl]
 (AgentManager-Handler-13:null) Ping from 2
 2015-05-15 16:24:48,568 DEBUG [c.c.a.m.AgentManagerImpl]
 (AgentManager-Handler-15:null) Ping from 1
 2015-05-15 16:24:48,569 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
 (AgentManager-Handler-15:null) Process host VM state report from ping
 process. host: 1
 2015-05-15 16:24:48,576 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
 (AgentManager-Handler-15:null) Process VM state report. host: 1, number of
 records in report: 2
 2015-05-15 16:24:48,576 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
 (AgentManager-Handler-15:null) VM state report. host: 1, vm id: 2, power
 state: PowerOn
 2015-05-15 16:24:48,581 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
 (AgentManager-Handler-15:null) VM power state does not change, skip DB
 

Re: Recover from outage

[Remi Bergsma]

Hi Ian,

From experience I know that as soon as CloudStack talks to a hypervisor, it 
will get a report of all running VMs and update its database accordingly. Even 
if you migrate a VM from outside of CloudStack, it will just pick this up. 
Starting CloudStack should be safe I’d say. Monitor the HA worker table for any 
scheduled HA work. Then you’ll have an idea of what it will do. You can then 
always decide to stop it again.

Good luck!

Regards,
Remi


 On 11 May 2015, at 20:18 , Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote:
 
 Hello Ian,
 
  Cloudstack should get VM state from cloudstack agent 
 automatically.  Check running SSVM and proxy VM that agent status is 
 running.  It just takes some time. Whether CS will automatically start VM 
 depends on compute offering. If you have HA enabled than CS will try to start 
 VM in a case it thinks it is stopped by itself.  But this is normal 
 operational flow.  If you've had some trouble than it may be harder to fix. I 
 wouldn't dare to make chages to database directly anyway. Will try to clarify 
 that everything else works as it suppose to.  If you would like to experiment 
 on DB -- make a backup first. 
 
 Vadim.
 
 
 From: Ian Service iserv...@ts2.ca
 Sent: Monday, May 11, 2015 17:09
 To: users@cloudstack.apache.org
 Subject: Recover from outage
 
 My management server became disconnected from one of the clusters it
 manages yesterday evening.  I stopped the cloudstack-management process
 because in the past this has wreaked havoc on that cluster, restarting
 networks, bringing them up on different VLANs, causing unnecessary reboots
 on instances, etc.
 
 The database now shows most of the vm_instances as Stopped, even though
 they are still very much running in XenCenter.
 
 To get things back up and running, what's the recommended procedure to
 avoid the unnecessary outages that CloudStack has caused me in the past?
 
 If I simply start up cloudstack-management will it assess the currently
 running machines or try to start them all again because the database says
 they're stopped?
 
 If I update the database to set each machine that's actually running as
 Running and update host_id=last_host_id (as it appears to be null'd) would
 that make CloudStack just check that they're still running and move on?
 
 Any assistance/suggestions you can provide would be fantastic.
 
 Thanks,
 
 - Ian

Re: Migrating large volumes times out

[Remi Bergsma]

Hi Ian,

You could hit this change, also hit me (then documented it). This is from 
release notes:
Job timeouts are shorter than before
Please be aware that in 4.4 a bug is fixed (CLOUDSTACK-7595) that makes sure 
global settings ‘job.cancel.threshold.minutes’ and ‘job.expire.minutes’ are 
defined in minutes as they are supposed to be. Before, they were accidentally 
60x bigger than configured. This means previous versions had a much higher 
timeout. You might hit this timeout when migrating large disks or making big 
snapshots, etc.



Regards, Remi 



Sent from my iPhone

 On 07 May 2015, at 21:00, Ian Service iserv...@ts2.ca wrote:
 
 Thanks Geoff, looks like that's defaulted to 3 hours, definitely not the
 timeout I'm hitting.  I'm wondering if it's the migratewait setting, which
 is 1 hour.  It feels like it's shorter than that but I'll raise that one
 and see if I can get these 100GB volumes moved.
 
 - Ian
 
 On Thu, May 7, 2015 at 3:20 AM, Geoff Higginbottom 
 geoff.higginbot...@shapeblue.com wrote:
 
 Hi Ian,
 
 I think the global setting you are looking for is copy.volume.wait
 
 Regards
 
 Geoff Higginbottom
 CTO / Cloud Architect
 
 D: +44 20 3603 0542tel:+442036030542 | S: +44 20 3603 0540tel:
 +442036030540 | M: +447968161581tel:+447968161581
 
 geoff.higginbot...@shapeblue.commailto:geoff.higginbot...@shapeblue.com
 | www.shapeblue.comhtp://www.shapeblue.com/ | Twitter:@cloudstackguru
 https://twitter.com/#!/cloudstackguru
 
 ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
 4HSx-apple-data-detectors://5
 
 
 On 7 May 2015, at 01:50, Ian Service iserv...@ts2.camailto:
 iserv...@ts2.ca wrote:
 
 When migrating large Volumes between NFS hosts, I'm getting timeouts and
 the migration reverts back to the original host.
 
 Is there a setting I can raise so that it waits longer? I can see the data
 clearly still moving into the new primary storage, so I know it's working,
 just taking longer than the management server wants to wait.
 
 Running XenServer 6.2 SP1 and CloudStack 4.4.1
 
 Thanks,
 
 - Ian
 Find out more about ShapeBlue and our range of CloudStack related services
 
 IaaS Cloud Design  Build
 http://shapeblue.com/iaas-cloud-design-and-build//
 CSForge - rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Software Engineering
 http://shapeblue.com/cloudstack-software-engineering/
 CloudStack Infrastructure Support
 http://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training Courses
 http://shapeblue.com/cloudstack-training/
 
 This email and any attachments to it may be confidential and are intended
 solely for the use of the individual to whom it is addressed. Any views or
 opinions expressed are solely those of the author and do not necessarily
 represent those of Shape Blue Ltd or related companies. If you are not the
 intended recipient of this email, you must neither take any action based
 upon its contents, nor copy or show it to anyone. Please contact the sender
 if you believe you have received this email in error. Shape Blue Ltd is a
 company incorporated in England  Wales. ShapeBlue Services India LLP is a
 company incorporated in India and is operated under license from Shape Blue
 Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
 and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
 a company registered by The Republic of South Africa and is traded under
 license from Shape Blue Ltd. ShapeBlue is a registered trademark.
 

Re: libvirt exception

[Remi Bergsma]

Hi Mike,

Can you check if the agent has debug logging enabled in log4j.xml? If not, this 
enables it:
sed -i 's/INFO/DEBUG/g' /etc/cloudstack/agent/log4j-cloud.xml

Restart agent, then try again and we should see more logs. 

Regards,
Remi

Sent from my iPhone

 On 07 May 2015, at 22:30, Mike C mcrosson_cloudst...@nusku.net wrote:
 
 On 2015-05-07 16:23, Daan Hoogland wrote:
 To bad the agent didn't log a stack trace because the ms stacktrace is
 really only telling us that the agent failed to do the migration.
 
 Yeah, the following is what I have on the agent. There are a number of 
 records as I've tried doing the migration more than a few times.
 
 2015-05-07 14:51:50,183 INFO  [kvm.resource.LibvirtComputingResource] 
 (agentRequest-Handler-2:null) Migration thread for r-93-VM is done
 2015-05-07 14:54:01,921 INFO  [kvm.resource.LibvirtComputingResource] 
 (agentRequest-Handler-3:null) Live migration of instance r-93-VM initiated
 2015-05-07 14:54:02,222 INFO  [kvm.resource.LibvirtComputingResource] 
 (agentRequest-Handler-3:null) Migration thread for r-93-VM is done
 2015-05-07 16:02:16,208 INFO  [kvm.resource.LibvirtComputingResource] 
 (agentRequest-Handler-4:null) Live migration of instance r-93-VM initiated
 2015-05-07 16:02:16,510 INFO  [kvm.resource.LibvirtComputingResource] 
 (agentRequest-Handler-4:null) Migration thread for r-93-VM is done

Re: cloudstack kvm openvswitch

[Remi Bergsma]

Hi,

I recently worked on KVM with Open vSwitch, but controlled by NSX (aka
Nicira). Apart from the controller and some settings, it should be the same.

Some pointers:
http://docs.cloudstack.apache.org/en/latest/networking/ovs-plugin.html
https://cwiki.apache.org/confluence/display/CLOUDSTACK/KVM+with+OpenVSwitch
http://blog.remibergsma.com/2015/04/04/adding-a-kvm-cluster-with-nsx-networking-to-cloudstack/
(skip the NSX stuff)

It is not needed anymore to compile ovs yourself. I worked with CentOS6 and
7 and Ubuntu 14.04 out of the box. There is some extra work to get STT to
work, but since you do use GRE instead you can ignore it.

This is a script I wrote to help setup KVM/OVS/CloudStack in my lab to be
able to do quick POCs. It could help you too in setting up the bridges and
interfaces:
https://github.com/remibergsma/openvswitch-kvm-config

To answer your question about the tunnels: in my case they are created on
the fly. I would just give it a go and see if ovs creates any tunnels.

Hope this helps.

Regards,
Remi



2015-04-24 7:50 GMT+02:00 Ignazio Cassano ignaziocass...@gmail.com:

 Thanks a lot.
 What I need to know is how I must prepare kvm nodes for openvswitch: for
 example if I must create a gre tunnel between nodes or if it is enough
 adding an address on each openvswitch  bridge.
 Regards
 Il giorno 24/apr/2015 06:22, Sanjeev N sanj...@apache.org ha scritto:

  Hi ,
 
  We can't avoid configuring vlans on physical switched even if we use OVS
  instead of bridge more on KVM. One option would be to use GRE isolation
  instead of VLAN based in creating Physical network in a zone.
 
  -Sanjeev
 
  On Thu, Apr 23, 2015 at 4:05 PM, Ignazio Cassano 
 ignaziocass...@gmail.com
  
  wrote:
 
   Hi all,
   I would like to install a new cloudstack infrastracture with kvm nodes
  but
   I also would like to use OVS to configure guests vlan avoiding to
  configure
   them on
   physical switches.
   I am planning to user three kvm nodes but I do not know how prepare
 them
  to
   use OVS: must I create a gre tunnel between nodes ?
   Regards
  
 

ApacheCon

[Remi Bergsma]

Hi all,

If you happen to be at ApacheCon this week, it'd be cool to meet. I’m already 
in Austin with Funs and Daan. Just ping us!

I'll do a talk [1] about automating CloudStack operations that might be of 
interest.

See you there!

Regards,
Remi

[1] http://sched.co/2P8S

Re: Cloudstack and KVM clusters,

[Remi Bergsma]

Hi Rafael,

This is what I really like about KVM: CloudStack makes it a cluster :-) This 
prevents the “two captains” problem you sometimes see with for example 
XenServer. We’ve loads of XenServers running and right now we’re also looking 
into KVM. Have to say I really like it!

Regards,
Remi

On 31 Mar 2015, at 22:59, Simon Weller swel...@ena.com wrote:

 Rafael,
 
 KVM live migration really relies on whether the underlying shared storage 
 (and file system) supports the ability to provide data consistency during a 
 migration. You never ever want a situation where 2 hosts are able  to mount 
 and write to the same volume concurrently.
 
 You can live migrate in KVM today using the following underlying file 
 systems/methods:
 
 1. NFS
 2. CEPH
 3. Clustered Logical Volume Management (CLVM) on top of SAN exposed storage 
 via iSCSI,FC or FCOE.
 
 It's also possible to build your own storage driver and set a LUN to read 
 only on a particular host using your SANs API.
 
 Solidfire, Nexenta and Cloudbyte have also added storage drivers more 
 recently that may provide support for live migration, but as I'm not 
 personally familiar with these storage platforms, I'll leave it up to others 
 to comment if they wish.
 
 - Si
 
 
 
 
 
 
 From: Rafael Weingartner rafaelweingart...@gmail.com
 Sent: Tuesday, March 31, 2015 3:36 PM
 To: users@cloudstack.apache.org; d...@cloudstack.apache.org
 Subject: Cloudstack and KVM clusters,
 
 Hi folks,
 
 I was looking a matrix of Cloudstack compatibility matrix at
 http://pt.slideshare.net/TimMackey/hypervisor-31754727,
 
 Slide 25 seemed to show that we cannot have clusters of KVM in CS? Is that
 true? Is it possible to live migrate VMs between KVM hosts that are not
 clustered in CS?
 
 
 --
 Rafael Weingärtner