Re: CloudStack Collaboration Conference: The Agenda is Live

2021-10-01 Thread Will Stevens
Just to follow up on Ivet's email.

The schedule has been updated on the official website as well:
http://cloudstackcollab.org/#schedule

If you see any issues or changes you would like to make to your talk,
please email me and I will update the website accordingly.

Additionally, I don't have pictures for everyone, so if you are in
incognito mode, feel free to send me along your details.  Also, if I am
missing speakers, let me know as well.

Cheers,

*Will Stevens*
Chief Technology Officer
c 514.826.0190

<https://goo.gl/NYZ8KK>


On Fri, Oct 1, 2021 at 9:08 AM Ivet Petrova 
wrote:

> Hi again,
>
> Quick edit on previous email: The agenda will be visible for everyone
> after you register for the event.
> We will be very soon also posting the agenda on the official event website.
> But for now, please register to check all talks. And be sure you will be
> more than excited :)
>
> Kind regards,
>
>
>
>
> On 1 Oct 2021, at 14:56, Ivet Petrova  ivet.petr...@shapeblue.com>> wrote:
>
> Hi All,
>
> I am very excited to share that we have just published the agenda for the
> CloudStack Collaboration Conference!
> The full schedule + talks + info for speakers can be found here:
> https://events.hubilo.com/cloudstack-collaboration-conference/sessions
>
> Our target is to make the biggest online event for our community ever. So
> be sure you register now:
> https://events.hubilo.com/cloudstack-collaboration-conference/register
>
>
> Kind regards,
>
>
>


Re: Pictures from Past CloudStack events

2021-08-25 Thread Will Stevens
I will see what I can dig up in terms of pictures from the CCC event we ran
in 2016.  Here are the recordings for all the talks at that event though,
if that is at all helpful:
https://www.youtube.com/playlist?list=PLCfLScXpEyAS4YkJpeqDriP7JcU82Tx2r

On Fri, Aug 20, 2021 at 10:04 AM Ivet Petrova 
wrote:

> Hello all,
>
> I am working on the promotion of the CloudStack Collaboration Conference
> and I need your help.
> Can I ask all of you to send me images from past CloudStack events?
> Everything can work - people having talks, networking, bar photos.
>
> I will appreciate if you can send.
>
> Also reminding about the Call for Speakers:
> https://forms.gle/7f54knnnJToBj7zo8
>
> Kind regards,
>
>
>
>
>
>


Re: [DISCUSS] Terraform CloudStack provider

2021-04-15 Thread Will Stevens
Thanks for following up on this Rohit.

On Thu., Apr. 15, 2021, 4:53 a.m. Rohit Yadav, 
wrote:

> Hi All,
>
> Update - Peter and I had a call with Chris from Hashicorp to discuss the
> issue. They've agreed to relicense their terraform provider codebase to
> Apache License v2.0, following which we should be able to continue any
> further development, maintenance, and releases by the Apache CloudStack
> project much like the kubernetes provider codebase.
>
> I'll start a vote thread on the same shortly.
>
>
> Regards.
>
> 
> From: Rohit Yadav 
> Sent: Tuesday, March 30, 2021 14:52
> To: d...@cloudstack.apache.org ;
> users@cloudstack.apache.org 
> Subject: Re: [DISCUSS] Terraform CloudStack provider
>
> Hi Peter,
>
> I had explored the migration of repo, but before we do that we need to get
> the original authors to relicense the codebase to Apache License v2.0. I'll
> discuss this with Hashicorp authors and report back soon.
>
>
> Regards.
>
> 
> From: peter.murysh...@zv.fraunhofer.de 
> Sent: Monday, March 29, 2021 21:04
> To: d...@cloudstack.apache.org ;
> users@cloudstack.apache.org 
> Subject: AW: [DISCUSS] Terraform CloudStack provider
>
> Hi all,
>
> are there any updates regarding this topic i.e. migration of HashiCorp
> Terraform provider to Apache CloudStack, either registering it in
> HashiCorp's registry?
>
> kind regards
> Peter
> 
> Von: Rohit Yadav 
> Gesendet: Freitag, 29. Januar 2021 17:14:05
> An: Will Stevens; d...@cloudstack.apache.org
> Cc: users; Niclas Lindblom; Pierre-Luc Dion
> Betreff: Re: [DISCUSS] Terraform CloudStack provider
>
> Hi Wido, Will, PL, all,
>
> I think I can setup a repository and request ASF infra (who prefers a JIRA
> ticket) to enable PR/issue on it, anybody has an objection to a new
> apache/cloudstack-terraform repo to maintain the provider plugin?
>
>
> Regards.
>
> 
> From: Will Stevens 
> Sent: Friday, January 29, 2021 19:49
> To: d...@cloudstack.apache.org 
> Cc: users ; Rohit Yadav <
> rohit.ya...@shapeblue.com>; Niclas Lindblom ;
> Pierre-Luc Dion 
> Subject: Re: [DISCUSS] Terraform CloudStack provider
>
> Hey PLD,
> You may want to tune into this. I think you may be maintaining a fork
> based on this code, but I am not positive.
>
> On Fri., Jan. 29, 2021, 6:07 a.m. Wido den Hollander,  <mailto:w...@widodh.nl>> wrote:
>
>
> On 28/01/2021 10:55, Rohit Yadav wrote:
> > Agree we can ask that.
> >
>
> Is infra from ASF the place to ask this?
>
> Wido
>
> >
> > Regards.
> >
> > 
> > From: Wido den Hollander mailto:w...@widodh.nl>>
> > Sent: Wednesday, January 27, 2021 15:35
> > To: Niclas Lindblom  niclas_lindb...@icloud.com>>; users@cloudstack.apache.org users@cloudstack.apache.org>  users@cloudstack.apache.org>>
> > Cc: d...@cloudstack.apache.org<mailto:d...@cloudstack.apache.org> <
> d...@cloudstack.apache.org<mailto:d...@cloudstack.apache.org>>
> > Subject: Re: [DISCUSS] Terraform CloudStack provider
> >
> >
> >
> > On 1/27/21 12:18 AM, Niclas Lindblom wrote:
> >> I can confirm that the Terraform plugin is working if it is already
> installed, since it was archived it no longer automatically downloads when
> applying unless manually installed.
> >>
> >>  From the Hashicorp website, it appears it was archived when they moved
> all plugins to their registry and needs an owner and an email to Hashicorp
> to be moved into to the registry and supported again when running
> Terraform. I use it regularly but haven’t got the technical skills to
> maintain the code so been hoping this would be resolved.
> >>
> >
> > I mailed Hashicorp to ask about this:
> >
> > "Thanks for reaching out. The provider was archived because we launched
> > the Terraform Registry last year which allows vendors to host and
> > publish their own providers. We'd be happy to work with you to transfer
> > the repository over to a CloudStack Github organization where you can
> > build and publish releases to the registry.
> >
> > We'd also like to have CloudStack join our Technology partnership
> > program so I can mark your Terraform provider as verified."
> >
> > So I think we don't need to do much technology-wise.
> >
> > I don't use Terraform and don't have a major stake in it, but I would
> > hate to see the Provider being removed from Terraform.
> >
> 

Re: Cloudstack developer training

2021-03-08 Thread Will Stevens
Nice work team. This is an awesome contribution to the community.

Will

On Fri., Feb. 26, 2021, 10:43 a.m. Giles Sirett, 
wrote:

> Hi all
>
> One of the biggest challenges with Cloudstack is learning its architecture
> and codebase  - its big and its complicated. Onboarding new software
> engineers can be a daunting process.
> For the last 2 years, we at ShapeBlue have built up a set of resources to
> help us with onboarding on new engineers who will be working on Cloudstack.
>
> This has evolved into a self-study course that we call "hackerbook"- the
> logic being that it's a training course that gets engineers hands-on
> hacking in the code ASAP.  It's a mix of videos, exercises and other
> resources.
>
> Today, we've opensourced this resource in order to make it available to
> anybody who may want to learn to develop on Cloudstack.
>
> Feedback and improvement PRs will be warmly accepted
>
> Its currently sitting in a shapeblue repo, happy to move under ASF if
> anybody thinks that's important
>
> https://github.com/shapeblue/hackerbook
>
> Happy Hacking
>
> Kind regards
> Giles
>
>
> giles.sir...@shapeblue.com
> www.shapeblue.com
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>


Re: [DISCUSS] Terraform CloudStack provider

2021-01-30 Thread Will Stevens
I have no objection to that.

On Fri., Jan. 29, 2021, 11:14 a.m. Rohit Yadav, 
wrote:

> Hi Wido, Will, PL, all,
>
> I think I can setup a repository and request ASF infra (who prefers a JIRA
> ticket) to enable PR/issue on it, anybody has an objection to a new
> apache/cloudstack-terraform repo to maintain the provider plugin?
>
>
> Regards.
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> @shapeblue
>
>
>
> --
> *From:* Will Stevens 
> *Sent:* Friday, January 29, 2021 19:49
> *To:* d...@cloudstack.apache.org 
> *Cc:* users ; Rohit Yadav <
> rohit.ya...@shapeblue.com>; Niclas Lindblom ;
> Pierre-Luc Dion 
> *Subject:* Re: [DISCUSS] Terraform CloudStack provider
>
> Hey PLD,
> You may want to tune into this. I think you may be maintaining a fork
> based on this code, but I am not positive.
>
> On Fri., Jan. 29, 2021, 6:07 a.m. Wido den Hollander, 
> wrote:
>
>
>
> On 28/01/2021 10:55, Rohit Yadav wrote:
> > Agree we can ask that.
> >
>
> Is infra from ASF the place to ask this?
>
> Wido
>
> >
> > Regards.
> >
> > 
> > From: Wido den Hollander 
> > Sent: Wednesday, January 27, 2021 15:35
> > To: Niclas Lindblom ;
> users@cloudstack.apache.org 
> > Cc: d...@cloudstack.apache.org 
> > Subject: Re: [DISCUSS] Terraform CloudStack provider
> >
> >
> >
> > On 1/27/21 12:18 AM, Niclas Lindblom wrote:
> >> I can confirm that the Terraform plugin is working if it is already
> installed, since it was archived it no longer automatically downloads when
> applying unless manually installed.
> >>
> >>  From the Hashicorp website, it appears it was archived when they moved
> all plugins to their registry and needs an owner and an email to Hashicorp
> to be moved into to the registry and supported again when running
> Terraform. I use it regularly but haven’t got the technical skills to
> maintain the code so been hoping this would be resolved.
> >>
> >
> > I mailed Hashicorp to ask about this:
> >
> > "Thanks for reaching out. The provider was archived because we launched
> > the Terraform Registry last year which allows vendors to host and
> > publish their own providers. We'd be happy to work with you to transfer
> > the repository over to a CloudStack Github organization where you can
> > build and publish releases to the registry.
> >
> > We'd also like to have CloudStack join our Technology partnership
> > program so I can mark your Terraform provider as verified."
> >
> > So I think we don't need to do much technology-wise.
> >
> > I don't use Terraform and don't have a major stake in it, but I would
> > hate to see the Provider being removed from Terraform.
> >
> > Should we request https://github.com/apache/cloudstack-terraform at
> > infra and then host the Provider there?
> >
> > Wido
> >
> >> Niclas
> >>
> >>
> > rohit.ya...@shapeblue.com
> > www.shapeblue.com
> > 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> > @shapeblue
> >
> >
> >
> >> On 26 Jan 2021, at 18:33, christian.nieph...@zv.fraunhofer.de wrote:
> >>>
> >>>
> >>>
> >>>> On 26. Jan 2021, at 10:45, Wido den Hollander  wrote:
> >>>>
> >>>>
> >>>>
> >>>> On 1/26/21 10:40 AM, christian.nieph...@zv.fraunhofer.de wrote:
> >>>>> On 25. Jan 2021, at 12:40, Abhishek Kumar <
> abhishek.ku...@shapeblue.com> wrote:
> >>>>>>
> >>>>>> Hi all,
> >>>>>>
> >>>>>> Terraform CoudStack provider by Hashicorp is archived here
> https://github.com/hashicorp/terraform-provider-cloudstack
> >>>>>>
> >>>>>> Is anyone using or maintaining it?
> >>>>>
> >>>>> We are also using it heavily and are somewhat worried about the
> module being archived.
> >>>>
> >>>> Agreed. But do we know why this has been done? What needs to be done
> to
> >>>> un-archive it?
> >>>>
> >>>> If it's just a matter of some love and attention we can maybe arrange
> >>>> something.
> >>>>
> >>>> Is it technically broken or just abandoned?
> >>>
> >>> This is just an educated guess, but given that we're not experiencing
> any technical issues, I believe it has just been abandoned.
>

Re: [DISCUSS] Terraform CloudStack provider

2021-01-29 Thread Will Stevens
Hey PLD,
You may want to tune into this. I think you may be maintaining a fork based
on this code, but I am not positive.

On Fri., Jan. 29, 2021, 6:07 a.m. Wido den Hollander, 
wrote:

>
>
> On 28/01/2021 10:55, Rohit Yadav wrote:
> > Agree we can ask that.
> >
>
> Is infra from ASF the place to ask this?
>
> Wido
>
> >
> > Regards.
> >
> > 
> > From: Wido den Hollander 
> > Sent: Wednesday, January 27, 2021 15:35
> > To: Niclas Lindblom ;
> users@cloudstack.apache.org 
> > Cc: d...@cloudstack.apache.org 
> > Subject: Re: [DISCUSS] Terraform CloudStack provider
> >
> >
> >
> > On 1/27/21 12:18 AM, Niclas Lindblom wrote:
> >> I can confirm that the Terraform plugin is working if it is already
> installed, since it was archived it no longer automatically downloads when
> applying unless manually installed.
> >>
> >>  From the Hashicorp website, it appears it was archived when they moved
> all plugins to their registry and needs an owner and an email to Hashicorp
> to be moved into to the registry and supported again when running
> Terraform. I use it regularly but haven’t got the technical skills to
> maintain the code so been hoping this would be resolved.
> >>
> >
> > I mailed Hashicorp to ask about this:
> >
> > "Thanks for reaching out. The provider was archived because we launched
> > the Terraform Registry last year which allows vendors to host and
> > publish their own providers. We'd be happy to work with you to transfer
> > the repository over to a CloudStack Github organization where you can
> > build and publish releases to the registry.
> >
> > We'd also like to have CloudStack join our Technology partnership
> > program so I can mark your Terraform provider as verified."
> >
> > So I think we don't need to do much technology-wise.
> >
> > I don't use Terraform and don't have a major stake in it, but I would
> > hate to see the Provider being removed from Terraform.
> >
> > Should we request https://github.com/apache/cloudstack-terraform at
> > infra and then host the Provider there?
> >
> > Wido
> >
> >> Niclas
> >>
> >>
> > rohit.ya...@shapeblue.com
> > www.shapeblue.com
> > 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> > @shapeblue
> >
> >
> >
> >> On 26 Jan 2021, at 18:33, christian.nieph...@zv.fraunhofer.de wrote:
> >>>
> >>>
> >>>
>  On 26. Jan 2021, at 10:45, Wido den Hollander  wrote:
> 
> 
> 
>  On 1/26/21 10:40 AM, christian.nieph...@zv.fraunhofer.de wrote:
> > On 25. Jan 2021, at 12:40, Abhishek Kumar <
> abhishek.ku...@shapeblue.com> wrote:
> >>
> >> Hi all,
> >>
> >> Terraform CoudStack provider by Hashicorp is archived here
> https://github.com/hashicorp/terraform-provider-cloudstack
> >>
> >> Is anyone using or maintaining it?
> >
> > We are also using it heavily and are somewhat worried about the
> module being archived.
> 
>  Agreed. But do we know why this has been done? What needs to be done
> to
>  un-archive it?
> 
>  If it's just a matter of some love and attention we can maybe arrange
>  something.
> 
>  Is it technically broken or just abandoned?
> >>>
> >>> This is just an educated guess, but given that we're not experiencing
> any technical issues, I believe it has just been abandoned.
> >>>
> >>> Christian
> >>>
> >>>
> 
>  Wido
> 
> >
> >> We're aware of Ansible CloudStack module (
> https://docs.ansible.com/ansible/latest/scenario_guides/guide_cloudstack.html)
> but are there any other alternatives of Terraform that you may be using
> with CloudStack?
> >
> > The ansible module is working quite well. However, one of the
> advantage of terraform imho is that one can easily destroy defined
> infrastructure with one command, while with ansible 'the destrcution' needs
> to be implemented in the playbook. Another advantage is that (at least)
> Gitlab can now maintain terraform states, which quite nicely supports
> GitOps approaches.
> >
> > Cheers, Christian
> >
> >>
> >> Regards,
> >> Abhishek
> >>
> >> abhishek.ku...@shapeblue.com
> >> www.shapeblue.com
> >> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> >> @shapeblue
> >>
> >>
> >>
> >
> >>>
> >>
> >
>


Re: Billing cloudstack

2020-08-17 Thread Will Stevens
Hey Lucian,
We built CloudMC for this (and other reasons).  It supports billing in a
multi-level multi-tenant environment, such as resellers.  It handles the
consumption, pricing and metering, but doesn't hook into an invoicing
system (currently) as we have found that every customer has a
unique invoicing system.  CloudMC is in production, delivering cloud
products for a few different telcos, some of which are based on CloudStack.

If you would like more information, I can help set that up, but here is a
link for now: https://www.cloudmc.cloudops.com/

Cheers,

*Will Stevens*
Chief Technology Officer
c 514.826.0190

<https://goo.gl/NYZ8KK>


On Mon, Aug 17, 2020 at 11:34 AM  wrote:

> Hi,
>
> For the folks running and billing their own Cloudstacks, what do you
> use? Looking for a nice self-service solution (billing perspective).
> We run Ubersmith for other things, but it's not great with Cloudstack.
> I noticed HostBill has a module for it. Any opinions on this?
>
> Other ideas welcome, thanks!
>
> Lucian
>


Register for ApacheCon Montreal - TODAY!!!

2018-09-05 Thread Will Stevens
Hey Everyone,
With the event just over two weeks away, we have a special offer for you.
If you are coming to the event and you want to bring some additional
colleagues or customers, now is the time.

I have been working with the ApacheCon team at the Apache Foundation who
are organizing the event to help make this conference affordable to
everyone.  They have been very generous in offering a discount code on
registration to help support our community.

$375 USD!!! -
https://www.eventbrite.com/e/apachecon-north-america-2018-registration-43200327342?discount=TCPBW18

Reach out to your colleagues and customers and invite them to the event.

Looking forward to seeing you all in a couple weeks.

Cheers,

*Will Stevens*


* <http://ca.cloudstackcollab.org/>*


Marketing CCC Montreal

2018-03-22 Thread Will Stevens
Hey Everyone,
We need your help to promote the visibility of the CCC conference we are
running later this year in September.

I have put together an information website to help us promote the CCC:
http://ca.cloudstackcollab.org/

I will keep the website updated with additional detail as we get more
information.

*PLEASE NOTE: Call For Papers closes on March 30th.  Please get your topics
in ASAP.*  On that note, make sure the title of your talk includes the word
'CloudStack' so we are able to get the talk in the correct CCC track.

Additionally, in order to get more visibility for the event, please
consider adding the following footer to your email signature (ideally
linking to the CCC site).  The footer is available here:
http://ca.cloudstackcollab.org/img/ccc_mtl_footer.png

Let us know if you have any questions...

*Will Stevens*


* <http://ca.cloudstackcollab.org/>*


Re: [PROPOSE] EOL for supported OSes & Hypervisors

2018-01-11 Thread Will Stevens
I like this initiative.  I think this would be valuable to set an
expectation around supportability.

Cheers,

*Will Stevens*
CTO

<https://goo.gl/NYZ8KK>

On Thu, Jan 11, 2018 at 12:11 PM, Paul Angus <paul.an...@shapeblue.com>
wrote:

> I've cross-posted this as it ultimately effects users more than developers.
>
> I've created a wiki page with the EOL dates from the respective 'vendors'
> of our main supported hypervisors and mgmt. server OSes.
> I've taken End Of Life to be the end of 'mainstream' support i.e. the
> point at which updates to packages will no longer be available.  And part
> of the discussion should be whether this EOL date should be moved out to
> consider end of security patching instead.
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/
> WIP+-+UNOFFICIAL+-+PROPOSAL+-+EOL+Dates
>
> I would like to propose, that as part of the release notes for the
> forthcoming 4.11 release and as a general announcement, that we declare
> that:
>
>
>   *   For any OSes/Hypervisors that are already EOL - we will no longer
> test/support them from the first release after June 2018 (6 months from
> now). And they will be removed from codebase (mainly the database) in the
> first release after Sept 2018 (9 months from now).
>   *   We set End Of Support dates and Removal from Code dates for the
> remaining OSes/Hypervisors.  I propose that End Of Support should be the
> first release after EOL from the vendor, with code removal taking place in
> the first release which occurs after 6 months from 'vendor' EOL date.
>
> Thoughts please
>
>
> Kind regards,
>
> Paul Angus
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>


Re: DISCUSS : Vmware to Cloudstack migration support

2017-07-13 Thread Will Stevens
If you are going from VMware to CloudStack Managed VMware, this is
something I have done quite a bit.  I even built a tool to do this:
https://github.com/swill/migrate2cs

This is not a polished product.  Well, it is pretty polished once you get
it setup, but the setup is a bit complicated to get started.

If you would like to use it, let me know and I will do what I can to get
you setup.

*Will Stevens*
CTO

<https://goo.gl/NYZ8KK>

On Thu, Jul 13, 2017 at 9:52 AM, Shreya Nair <shreya.n...@opcito.com> wrote:

> Hello,
>
> *An update to the migration task:*
>
> We have installed Cloudstack onto a vm on VMware to work around the
> cross-hypervisor migration issue. Now the underlying hypervisor would be
> the ESXi server for both setups (VMware and Cloudstack).
>
> Currently, we create the corresponding equivalent infrastructure on
> CloudStack wrt vmware setup.  We create a zone, pod, cluster and host set
> up with the underlying network infrastructure. However, while setting up
> the storage (Primary storage at cluster-wide scope and Secondary storage at
> zone-wide) the documentation mentions the following warnings:
>
>
>- *Primary storage warning:*
>   - When using preallocated storage for primary storage, be sure there
>   is nothing on the storage (ex. you have an empty SAN volume or
> an empty NFS
>   share). Adding the storage to CloudStack will destroy any existing
> data.
>- *Secondary storage warning:*
>   - Ensure that nothing is stored on the server. Adding the server to
>   CloudStack will destroy any existing data.
>
>
> We have obtained the mysql dump of the datastore of the source VM on
> VMware. The datastore, as you may be aware, is a logical container that
> holds virtual machine files and other files necessary for VM operations. As
> such, it may be logically mapped to the Secondary storage setup in the
> CloudStack infrastructure.
>
> Would it be possible to use the mysql dump from source to update the
> Secondary storage?
>
> Thanks & Regards,
>
> Shreya
>
> On Fri, Jul 7, 2017 at 4:04 PM, Paul Angus <paul.an...@shapeblue.com>
> wrote:
>
> > Maybe you should try qemu-img instead.
> >
> >
> > Kind regards,
> >
> > Paul Angus
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> > From: Shreya Nair [mailto:shreya.n...@opcito.com]
> > Sent: 07 July 2017 11:30
> > To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> > Cc: Vinay Patil <vinay.pa...@opcito.com>; Siddheshwar More <
> > siddheshwar.m...@opcito.com>
> > Subject: Re: DISCUSS : Vmware to Cloudstack migration support
> >
> > Hi Paul,
> > We explored the XenConvert solution. The XenConvert utility has been
> > retired from XenServer 6.2 and upward. So the only solution would be
> using
> > an old copy or trial version of Xen Conversion Manager.
> >
> > Instead of the qemu-img utility, we used the VirtualBox VBoxManage.exe to
> > support conversion of *.VMDK file to VHD. This VHD file was used to
> create
> > a CS template and create an instance. However, the VM was unable to mount
> > the drives as it was unable to find xvdXX partitions
> >
> >
> > I get the following error on CS instance on boot:
> > [Inline image 2]
> >
> > and the logs shows us this:
> >
> > You might have to change the root from /dev/hd[a-d] to /dev/xvd[a-d]
> >
> >
> >
> > However, on using lsblk command on the source vmware instance, we
> realized
> > that the partitions on SCSI storage devices (Used by vmware) are named as
> > /dev/sdXX while Xen supports /dev/xvdXX.
> > [Inline image 1]
> >
> > Note: VMware tools has been removed from VM prior to migration
> >
> >
> >
> > Thanks & Regards,
> >
> > Shreya
> >
> > On Thu, Jul 6, 2017 at 12:17 AM, Paul Angus <paul.an...@shapeblue.com<
> > mailto:paul.an...@shapeblue.com>> wrote:
> > There used to be a XenConvert utility that you do that conversion for
> > you.  I'm not sure that its about anymore, but a bit of googling might
> dig
> > up a copy.
> >
> > Alternatively there are linux and Windows versions of qemu-img convert ,
> > which usually does a pretty good job of disk image conversions
> >
> > Otherwise you could use a P2V backup/recovery tool with an agent that
> runs
> > inside your VMs
> >
> >
> >
> > Kind regards,
> >
> > Paul Angus
> >
> > paul.an...@sh

Re: Private gateways - experience, anyone really using it ?

2017-05-03 Thread Will Stevens
Interesting.  I wonder if the limitations we are seeing are actually a UI
artifact and not actually an implementation artifact.  I will have to look
into that.  Thanks...  :)

*Will STEVENS*
Lead Developer

<https://goo.gl/NYZ8KK>

On Wed, May 3, 2017 at 11:32 AM, Simon Weller <swel...@ena.com> wrote:

> So we manage static routes within our middleware and UI (we don't use the
> ACS native UI), so I don't think we've experienced this.
>
> 
> From: williamstev...@gmail.com <williamstev...@gmail.com> on behalf of
> Will Stevens <wstev...@cloudops.com>
> Sent: Wednesday, May 3, 2017 10:26 AM
> To: d...@cloudstack.apache.org
> Cc: users@cloudstack.apache.org
> Subject: Re: Private gateways - experience, anyone really using it ?
>
> @sweller: I would be interested in the PG fixes you have done.  Anything
> related to overlapping routes?
>
> *Will STEVENS*
> Lead Developer
>
> <https://goo.gl/NYZ8KK>
> CloudOps | Managed Private Cloud | Managed Public Cloud | Cloud Building |
> Cloud Architecture | Cloud Migration<https://goo.gl/NYZ8KK>
> goo.gl
> We provide private, public and hybrid cloud solutions for businesses
> seeking to scale, and for enterprises making their move to the Cloud.
>
>
>
>
> On Wed, May 3, 2017 at 11:23 AM, Simon Weller <swel...@ena.com> wrote:
>
> > We use private gateways extensively with KVM and redundant VRs. We have
> > our own ACS 4.8 branch (https://github.com/myENA/
> > cloudstack/tree/release/ENA-4.8) with quite a number of backported fixes
> > that relate to PGs.
> >
> > As far as I'm aware, vxlan is not supported on PGs today. We would like
> to
> > see it though. Today we use vlans and connect a customer lan to a PG via
> > MPLS.
> >
> >
> > 
> > From: Andrija Panic <andrija.pa...@gmail.com>
> > Sent: Wednesday, May 3, 2017 10:09 AM
> > To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> > Subject: Private gateways - experience, anyone really using it ?
> >
> > Hi all,
> >
> > I'm interested to know if anyone is using private gatewyas in production,
> > and what are your experience with it, any undocumented limitations, etc ?
> >
> > I dont see iif t supports vxlans (perhaps will try to test it myself)
> >
> > I really would appreciate any feedback.
> >
> > Thanks,
> >
> > --
> >
> > Andrija Panić
> >
>


Re: Private gateways - experience, anyone really using it ?

2017-05-03 Thread Will Stevens
@sweller: I would be interested in the PG fixes you have done.  Anything
related to overlapping routes?

*Will STEVENS*
Lead Developer

<https://goo.gl/NYZ8KK>

On Wed, May 3, 2017 at 11:23 AM, Simon Weller <swel...@ena.com> wrote:

> We use private gateways extensively with KVM and redundant VRs. We have
> our own ACS 4.8 branch (https://github.com/myENA/
> cloudstack/tree/release/ENA-4.8) with quite a number of backported fixes
> that relate to PGs.
>
> As far as I'm aware, vxlan is not supported on PGs today. We would like to
> see it though. Today we use vlans and connect a customer lan to a PG via
> MPLS.
>
>
> 
> From: Andrija Panic <andrija.pa...@gmail.com>
> Sent: Wednesday, May 3, 2017 10:09 AM
> To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> Subject: Private gateways - experience, anyone really using it ?
>
> Hi all,
>
> I'm interested to know if anyone is using private gatewyas in production,
> and what are your experience with it, any undocumented limitations, etc ?
>
> I dont see iif t supports vxlans (perhaps will try to test it myself)
>
> I really would appreciate any feedback.
>
> Thanks,
>
> --
>
> Andrija Panić
>


Re: Private gateways - experience, anyone really using it ?

2017-05-03 Thread Will Stevens
​We have been using it quite a bit in production over the last 3+ years.
It works pretty well.  It is a pretty simple implementation, so it is
pretty stable.  I know my networking guys have some frustrations with the
limitations on the static routes.  No overlapping routes and things like
that which make things harder for them.  I have not gotten into the code to
try to see how hard that stuff is to 'fix'.

We are not using VXLAN (yet), so I can't really comment on anything on that
front.

In general, it is a very useful piece of kit in ACS and we leverage it
often when we have to do more complicated configurations, especially when
offering managed network services.​

Hope that helps...

*Will STEVENS*
Lead Developer

<https://goo.gl/NYZ8KK>

On Wed, May 3, 2017 at 11:09 AM, Andrija Panic <andrija.pa...@gmail.com>
wrote:

> Hi all,
>
> I'm interested to know if anyone is using private gatewyas in production,
> and what are your experience with it, any undocumented limitations, etc ?
>
> I dont see iif t supports vxlans (perhaps will try to test it myself)
>
> I really would appreciate any feedback.
>
> Thanks,
>
> --
>
> Andrija Panić
>


Register for CCC Miami

2017-04-03 Thread Will Stevens
Hello Everyone,
We are now into April and the CCC is starting to get closer.  If you have
not registered already, get on it before the pricing changes again.

The prices go up again on April 16th [1], so make sure you get your tickets
before then.

This is going to be a great event with a lot of opportunities to meet other
developers and users who successfully leverage Apache CloudStack in their
organizations.

There are still sponsorship opportunities [2], so please get in touch if
you are interested in sponsoring.

Looking forward to a lot of great conversations, ideas and collaboration.

See you in Miami,

*​**Will Stevens*

[1] http://us.cloudstackcollab.org/#attend
[
​2]
http://us.cloudstackcollab.org/#sponsors
​
​


Re: [VOTE] Retirement of midonet plugin

2017-03-29 Thread Will Stevens
+1

On Mar 29, 2017 2:36 AM, "Daan Hoogland" 
wrote:

> +1
>
> On 28/03/17 22:46, "Rafael Weingärtner" 
> wrote:
>
> Dear ACS fellows,
> We have discussed the retirement of Midonet plugin [*]. After quite
> some
> talk, we converged in a retirement process and it seems that we all
> agree
> that the Midonet plugin should be retired. So, to formalize things, we
> should vote Midonet retirement.
>
> All users and devs are welcome to vote here:
> [+1] I *do want to retire *the Midonet plugin
> [0] Whatever happens I am happy
> [-1] I *do not want to retire* the Midonet plugin
>
>
> [*] http://markmail.org/message/x6p3gnvqbbxcj6gs
>
> --
> Rafael Weingärtner
>
>
>
> daan.hoogl...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>


Welcoming Wido as the new ACS VP

2017-03-16 Thread Will Stevens
Hello Everyone,
It has been a pleasure working with you as the ACS VP over the past year.
I would like to say Thank You to everyone who has supported me in this role
and have supported the project as a whole.

It is my pleasure to announce that Wido den Hollander has been voted in to
replace me as the Apache Cloudstack VP in our annual VP rotation.  Wido has
a long history with the project and we are happy welcome him into this new
role.

Be sure to join us at CCC in Miami [1] so we can initiate him correctly
over many beers.  :)

Cheers,

*Will Stevens*

​[1] http://us.cloudstackcollab.org/​


CloudStack Collaboration Conference - Miami

2017-03-09 Thread Will Stevens
Hello,
Today the schedule [1] was posted for CCC in Miami.  We have a great line
up of talks, as well as training and a hackathon scheduled.  We are
expecting a large turnout to this event, so it will be a great opportunity
to network and interact with the community.

Register [2] before Sunday (March 12th) and save $200.

If you would like to sponsor this event, there are still sponsorship
opportunities [3].  We will be doing special promotion of our CCC sponsors
before and throughout the conference.  The earlier you sponsor the more
visibility you will get.

Speaking of which, I would like to give a big shoutout to ShapeBlue [4] who
is sponsoring the event.

Looking forward to seeing you all there.

[1] Schedule | http://us.cloudstackcollab.org/#schedule
[2] Register | http://us.cloudstackcollab.org/#attend
[3] Sponsor  | http://us.cloudstackcollab.org/#sponsors
[4] http://www.shapeblue.com/

*Will Stevens*


ONE DAY LEFT!!! Submit a CCC Talk for Miami TODAY!

2017-02-10 Thread Will Stevens
Hello Everyone,
We are now down to the wire.  Tomorrow the talk submissions close for the
CloudStack Collaboration Conference in Miami.  Go submit your talk...

It is going to be a great event with a lot of participation, so it is a
great opportunity to network and get exposure for your work.

Here is a little recap of some of the details:

*Talk Submission:*
Talk Submission Deadline: *Feb 11th, 2017*  [Submit a Talk
]
Accepted talks notification: *March 6, 2017*
Schedule Published: *March 9, 2017*

*Registration:*
*Early Registration:* through March 12, 2017
*Standard Registration:* March 13, 2017 - April 16, 2017
*Late Registration:* April 17, 2017 - Event Date
*Committer Registration:* Special pricing is available for active Apache
Committers. Please contact the event organizers for details.
*Speaker Registration:* One free registration is included with each
accepted talk. [Submit a Talk 
]

*Sponsorship:*
We would love to have your organization sponsor the event.  This is a great
opportunity for your organization to be featured in front of the Apache
CloudStack community.  If your organization is able to sponsor, please
review these details.  [Sponsorship
]

Looking forward to seeing you there.

Cheers,

Will


Re: CCC Miami Sponsor: ShapeBlue

2017-02-02 Thread Will Stevens
Hey Raj,
Ya, it is a little hard to know for sure, but we are making a big push for
this conference.  The last one was just an ApacheCon we tried to have a
small presence at, and we had a VERY small presence (as you know).  This
time we are actually running a CCC at the event, so we are focusing on
getting a lot more of the community there for this event.

We would love for you to sponsor and for your team to submit talks.
Looking forward to seeing you there.  :)

Cheers,

Will

On Sun, Jan 29, 2017 at 9:37 PM, Rajesh Ramchandani <
rajesh.ramchand...@accelerite.com> wrote:

> Hi Will -
>
>
> I was wondering if you could suggest what will be the
> attendance expectation at CCC? I am hoping it will be a lot more than the
> ApacheCon Europe last year. We would love to sponsor as long as we are able
> to rally our community members to attend. Thanks.
>
>
> Raj
>
>
> ------
> *From:* Will Stevens <sw...@apache.org>
> *Sent:* Sunday, January 29, 2017 10:05 AM
> *To:* market...@cloudstack.apache.org; users@cloudstack.apache.org;
> d...@cloudstack.apache.org
> *Subject:* CCC Miami Sponsor: ShapeBlue
>
> Please join me in welcoming ShapeBlue <http://www.shapeblue.com/> as the
> ShapeBlue - The CloudStack Company <http://www.shapeblue.com/>
> www.shapeblue.com
> Introduction Upgrading CloudStack can sometimes be a little daunting - but
> as the 5P's proverb goes - Proper Planning Prevents Poor Performance.
>
>
> first official sponsor of the CloudStack Collaboration Conference in
> Miami.  ShapeBlue has been a dedicated sponsor and Apache CloudStack
> supporter and we are thrilled to have them on board for this event.
>
> The CloudStack Collaboration Conference in Miami is being hosted by
> ApacheCon and it is shaping up to be a great event.  We are all looking
> forward to seeing you there.
>
> If you would like more information about the event, please checkout the
> event website: http://us.cloudstackcollab.org/
> Apache CloudStack Collaboration Conference - USA
> <http://us.cloudstackcollab.org/>
> us.cloudstackcollab.org
> Apache CloudStack Collaboration Conference hosted in Miami at ApacheCon.
>
>
>
> If you are interested in sponsoring the event, please review the
> sponsorship section: http://us.cloudstackcollab.org/#sponsors
> Apache CloudStack Collaboration Conference - USA
> <http://us.cloudstackcollab.org/#sponsors>
> us.cloudstackcollab.org
> Apache CloudStack Collaboration Conference hosted in Miami at ApacheCon.
>
>
>
> Thanks again for the support ShapeBlue and looking forward to seeing you at
> the event.
>
> Cheers,
>
> Will Stevens
> VP @ Apache CloudStack
>
> DISCLAIMER == This e-mail may contain privileged and confidential
> information which is the property of Accelerite, a Persistent Systems
> business. It is intended only for the use of the individual or entity to
> which it is addressed. If you are not the intended recipient, you are not
> authorized to read, retain, copy, print, distribute or use this message. If
> you have received this communication in error, please notify the sender and
> delete all copies of this message. Accelerite, a Persistent Systems
> business does not accept any liability for virus infected mails.
>


Re: CCC Miami Update

2017-01-29 Thread Will Stevens
​Please note that some of the other conferences being run at ApacheCon are
still in the planning phase, so please confirm with the organizers if you
are specifically interested in one of the other co-located events.​

On Sun, Jan 29, 2017 at 1:41 PM, Will Stevens <sw...@apache.org> wrote:

> Hello Everyone,
> I am sure most of you are aware at this point that a CloudStack
> Collaboration Conference (CCC) is being hosted in Miami on May 16-18 by
> ApacheCon.
>
> I urge you to consider joining us at this event.  Here are some of the
> important event details, but all the details can be found on our event
> website: *http://us.cloudstackcollab.org/
> <http://us.cloudstackcollab.org/>*
>
> *Deadline for talk submissions:* *February 11th, 2017*
> *Accepted talk notifications:* *March 6th, 2017*
> *Schedule published on: **March 9th, 2017*
>
> The event is being run as a collection of independently themed
> conferences.  Obviously, most of you will be specifically interested in the
> CloudStack Collaboration Conference, but your registration also gives you
> access to the other conference being run at the same time.  So far the
> other conferences include; 'Apache: Big Data', 'Apache: IoT', 'Flex Project
> Summit', 'Apache Traffic Server / Apache Traffic Control' and 'TomcatCon'.
>
> The earlier you register, the more you save, so get your registration in
> early.
>
> *Early Registration:* *until March 12, 2017*
> *Standard Registration:* *March 13, 2017 - April 16, 2017*
> *Late Registration:* *April 17, 2017 - Event Date*
> *Committer Registration:* Special pricing is available for active Apache
> Committers. Please contact the event organizers
> <eve...@linuxfoundation.org> for details.
> *Speaker Registration:* *One free registration is included with each
> accepted talk.*
>
> If you submit a talk <http://us.cloudstackcollab.org/#get-involved> and
> your talk is accepted, you will get one free registration per talk accepted.
>
> We are still looking for event sponsors, so if you are interested in
> sponsoring the event, please review the sponsorship details
> <http://us.cloudstackcollab.org/#sponsors>.
>
> If you have questions about anything, feel free to contact me directly and
> I will make sure you are connected with the right people.
>
> Looking forward to seeing you all in Miami.
>
> Cheers,
>
> Will
>


CCC Miami Update

2017-01-29 Thread Will Stevens
Hello Everyone,
I am sure most of you are aware at this point that a CloudStack
Collaboration Conference (CCC) is being hosted in Miami on May 16-18 by
ApacheCon.

I urge you to consider joining us at this event.  Here are some of the
important event details, but all the details can be found on our event
website: *http://us.cloudstackcollab.org/ *

*Deadline for talk submissions:* *February 11th, 2017*
*Accepted talk notifications:* *March 6th, 2017*
*Schedule published on: **March 9th, 2017*

The event is being run as a collection of independently themed
conferences.  Obviously, most of you will be specifically interested in the
CloudStack Collaboration Conference, but your registration also gives you
access to the other conference being run at the same time.  So far the
other conferences include; 'Apache: Big Data', 'Apache: IoT', 'Flex Project
Summit', 'Apache Traffic Server / Apache Traffic Control' and 'TomcatCon'.

The earlier you register, the more you save, so get your registration in
early.

*Early Registration:* *until March 12, 2017*
*Standard Registration:* *March 13, 2017 - April 16, 2017*
*Late Registration:* *April 17, 2017 - Event Date*
*Committer Registration:* Special pricing is available for active Apache
Committers. Please contact the event organizers 
for details.
*Speaker Registration:* *One free registration is included with each
accepted talk.*

If you submit a talk  and
your talk is accepted, you will get one free registration per talk accepted.

We are still looking for event sponsors, so if you are interested in
sponsoring the event, please review the sponsorship details
.

If you have questions about anything, feel free to contact me directly and
I will make sure you are connected with the right people.

Looking forward to seeing you all in Miami.

Cheers,

Will


CCC Miami Sponsor: ShapeBlue

2017-01-29 Thread Will Stevens
Please join me in welcoming ShapeBlue <http://www.shapeblue.com/> as the
first official sponsor of the CloudStack Collaboration Conference in
Miami.  ShapeBlue has been a dedicated sponsor and Apache CloudStack
supporter and we are thrilled to have them on board for this event.

The CloudStack Collaboration Conference in Miami is being hosted by
ApacheCon and it is shaping up to be a great event.  We are all looking
forward to seeing you there.

If you would like more information about the event, please checkout the
event website: http://us.cloudstackcollab.org/

If you are interested in sponsoring the event, please review the
sponsorship section: http://us.cloudstackcollab.org/#sponsors

Thanks again for the support ShapeBlue and looking forward to seeing you at
the event.

Cheers,

Will Stevens
VP @ Apache CloudStack


CloudStack Collab in Miami

2017-01-24 Thread Will Stevens
Hello Everyone,
It is that time of the year again.  We are into the thick of it planning
the next CloudStack Collaboration Conference (CCC).

We are happy to announce that the first CloudStack Collab of 2017 will be
taking place on May 16-18 in Miami.  CloudStack has partnered with
ApacheCon to bring you a great event.

More information about the conference is available here:
http://us.cloudstackcollab.org/

Here are some of the important details:

- The *speaker submission deadline is Feb 11th*, so get your talks in
early.  Details here: http://us.cloudstackcollab.org/#get-involved

- Registration will be taken care of by ApacheCon.  Details here:
http://us.cloudstackcollab.org/#attend

- Travel information and details about the venue can be found here:
http://us.cloudstackcollab.org/#location

- Consider sponsoring the event to make it even better. More info here:
http://us.cloudstackcollab.org/#sponsors

If you have any questions, please respond to this email and I will make
sure your questions are answered.

Looking forward to seeing you all in Miami...

Cheers,

Will


Re: Dedicated IP range for SSVM/CPVM

2017-01-16 Thread Will Stevens
Rene, this is probably not going to solve your problem, but I use this
trick for other use cases.  You can setup more than one range.  ACS seems
to always exhaust one range before moving on to the next range.  If it is a
new install, then you can do a range with only 2 IPs in it and make it
first.  Since the first two IPs which will be provisioned when ACS is setup
is the SSVM and CPVM, they will automatically take the two IPs from that
special range.

I am pretty sure I have tested this.  Later when other IPs have been used
from the other range, if you destroy the SSVM or CPVM, they will come back
up on one of the two IPs that they were on before because they will be free
again and they will be used first again.  If your system is really active,
then you will be in a race condition while the SSVM and CPVM get bounced to
get the same IPs back.

Anyway, I figured I would mention it because it may be a workaround you can
make use of.  I do this in dev/staging environments which need real public
IPs, but I don't need the SSVM and CPVM to have real public IPs.  This lets
me preserve two real public IPs by using private IPs for that first range
for the SSVM and CPVM.

Cheers,

*Will STEVENS*
Lead Developer

<https://goo.gl/NYZ8KK>

On Mon, Jan 16, 2017 at 11:37 PM, Nitin Kumar Maharana <
nitinkumar.mahar...@accelerite.com> wrote:

> Hi Rene,
>
> The default pool, which means are you mentioning the public IP range?
>
> If it is a public IP range, user VMs won’t be consuming any IP from there.
> Only system VMs(CPVM/SSVM/VR) will be consuming. VRs will be providing
> public access to the user VMs.
>
>
> Thanks,
> Nitin
> > On 16-Jan-2017, at 8:56 PM, Rene Moser <m...@renemoser.net> wrote:
> >
> > Hi
> >
> > We would like to make a change proposal for SSVM/CPVM.
> >
> > Currently, the SSVM/CPVM get an IP from the "default" pool of
> > vlaniprange which is the from the account "system"
> >
> >
> >  "vlaniprange": [
> >{
> >  "account": "system",
> >  "domain": "ROOT",
> >  "endip": "10.101.0.250",
> >  "forvirtualnetwork": true,
> >  "gateway": "10.101.0.1",
> >  "netmask": "255.255.255.0",
> >  "startip": "10.101.0.11",
> >  ...
> >
> >},
> >
> >
> >  "systemvm": [
> >{
> >  "activeviewersessions": 0,
> >  "gateway": "10.101.0.1",
> >  "hypervisor": "VMware",
> >  "id": "d9a8abe5-b1e0-47d6-8f39-01b48ff1e0fa",
> >  "name": "v-5877-VM",
> >  "privatenetmask": "255.255.255.0",
> >  "publicip": "10.101.0.113",
> >  "publicnetmask": "255.255.255.0",
> >  "state": "Running",
> >  ...
> >},
> >
> >
> > For security considerations we would like to define a dedicated IP range
> > for SSVM/CPVM, which, preferably, should not have any relation to the
> > default pool range.
> >
> > The default pool range should be used for userVMs only. To indicate the
> > use I propolse 2 new flags, which only considered for "account=system"
> > and indicate if the range can be used for userVMs or/and systemVMs.
> >
> > For backwards compatibility this would be the default
> >
> > "foruservms": true,
> > "forsystemvms": true,
> >
> >
> > to have a separate range for UserVMs/SystemVMs, it would look like
> >
> >
> >  "vlaniprange": [
> >{
> >  "account": "system",
> >  "domain": "ROOT",
> >  "foruservms": true,
> >  "forsystemvms": false,
> >  "endip": "192.160.123.250",
> >  "forvirtualnetwork": true,
> >  "gateway": "192.160.123.1",
> >  "netmask": "255.255.255.0",
> >  "startip": "192.160.123.11",
> >  ...
> >
> >},
> >
> >  "vlaniprange": [
> >{
> >  "account": "system",
> >  "domain": "ROOT",
> >  "foruservms": false,
> >  "forsystemvms": true,
> >  "endip": "10.101.0.250",
> >  "forvirtualnetwork": true,
> >  "gateway": "10.101.0.1",
> >  "netmask": "255.255.255.0",
> >  "startip": "10.101.0.11",
> >  ...
> >
> >},
> >
> >
> > Does anyone has see any conflicts with this proposal?
> >
> > Regards
> > René
> >
>
>
>
>
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which is
> the property of Accelerite, a Persistent Systems business. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Accelerite, a Persistent Systems business does not accept any
> liability for virus infected mails.
>


Welcoming Simon Weller & Paul Angus to the PMC

2017-01-13 Thread Will Stevens
Join me in welcoming Simon Weller and Paul Angus to the Apache CloudStack
PMC.  Both have been dedicated members of the community and it is with
great pleasure that we welcome them to the PMC.

Next time you see either of them, buy them a drink.  :)

Welcome guys...


Re: ACS 4.8.1: Virtual router - /var/log always full

2016-11-27 Thread Will Stevens
Are you using XenServer?  We recently found a bug in XenServer which has
similar characteristics.  I can put together details of the problem if
yes...

Cheers,

Will

*Will STEVENS*
Lead Developer

<https://goo.gl/NYZ8KK>

On Sun, Nov 27, 2016 at 11:36 PM, Cloud List <cloud-l...@sg.or.id> wrote:

> Dear all,
>
> Please ignore this, managed to find the reason - paswd_server_ip process is
> holding to a log file which has been deleted earlier to fix the disk space
> issue. Restarted the process and the disk space is fine now.
>
> ===
> passwd_se  2199   root1w  REG 254,10
> 171802407 15 /var/log/cloud.log (deleted)
> passwd_se  2199   root2w  REG 254,10
> 171802407 15 /var/log/cloud.log (deleted)
> passwd_se  2199   root3w  REG 254,10
> 171802407 15 /var/log/cloud.log (deleted)
> python 2202   root3w  REG 254,10
> 171802407 15 /var/log/cloud.log (deleted)
>
>  2199 ?S  0:00 /bin/bash /opt/cloud/bin/passwd_server_ip
> X.X.X.2 dummy
>  2202 ?S  7:13 python /opt/cloud/bin/passwd_server_ip.py
> X.X.X.2
> ===
>
> Thank you.
>
>
> On Mon, Nov 28, 2016 at 11:46 AM, Cloud List <cloud-l...@sg.or.id> wrote:
>
> > Dear all,
> >
> > After upgrading to ACS 4.8.1, one of our virtual router's /var/log
> > partition is always full and used up quite fast. This caused the VR not
> > able to serve DHCP and password requests from VM.
> >
> > root@r-4155-VM:/var/log# df -h
> > Filesystem  Size  Used Avail
> > Use% Mounted on
> > rootfs  461M  158M  280M
> > 37% /
> > udev 10M 0
> > 10M   0% /dev
> > tmpfs25M  236K
> > 25M   1% /run
> > /dev/disk/by-uuid/30c81d3d-ee9f-4a88-81c1-5f349b22ba1d  461M  158M  280M
> > 37% /
> > tmpfs   5.0M 0
> > 5.0M   0% /run/lock
> > tmpfs   157M 0
> > 157M   0% /run/shm
> > /dev/vda173M   23M   47M
> > 33% /boot
> > /dev/vda692M  5.6M
> > 81M   7% /home
> > /dev/vda8   184M  6.2M
> > 169M   4% /opt
> > /dev/vda11   92M  5.6M
> > 81M   7% /tmp
> > /dev/vda7   751M  493M  219M
> > 70% /usr
> > /dev/vda9   563M  282M  252M
> > 53% /var
> > /dev/vda10  184M  176M 0
> > 100% /var/log
> >
> > Even after rotating and clearing the logs, the usage of /var/log is only
> > 4.7M so I am not too sure where is the 176M coming from.
> >
> > root@r-4155-VM:/var/log# du -h
> > 1.0K./samba
> > 3.8M./sysstat
> > 68K ./apt
> > 7.0K./apache2
> > 3.0K./fsck
> > 317K./installer/cdebconf
> > 809K./installer
> > 1.0K./news
> > 12K ./lost+found
> > 1.0K./ntpstats
> > 4.7M.
> >
> > /dev/vda10  184M  175M  475K
> > 100% /var/log
> >
> > I would need to clear the logs and do a "service dnsmasq restart"
> > regularly to make the VR functioning again, which is quite troublesome.
> >
> > Any advice is greatly appreciated.
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
> >
>


Re: Fault percentage value of CPU usage in Cloud Platform

2016-11-22 Thread Will Stevens
gt; Good Morning,
> > >
> > > @Will- but we don't have support contract.
> > >
> > > @Bharat- True, but the allocated CPU percentage value is showing wrong
> in
> > > the Dashboard where as in Zone's Resources *(Path is: 'Infrastructure'
> ->
> > > 'Zones' -> 'click on desired zone name' -> 'Resources') *the percentage
> > > value is showing correct.
> > >
> > > Total CPU allocated is 800 GHz out of 2000 GHz. So that means the
> > > percentage value should be in 40% range but in my case it is showing
> 91%
> > in
> > > the Dashboard which leads in failing new deployments. But, the same
> value
> > > in Zone's Resources is showing accurate 40% value.
> > >
> > >
> > > But, for new VPS or VM deployments the cloud is preferring dashboard
> > > percentage value not the one which is there at Zone's Resources. So
> would
> > > you help me to fix this issue?
> > >
> > >
> > > Best Regards,
> > > Anil.
> > >
> > > On Mon, Nov 21, 2016 at 7:20 PM, Bharat Kumar <
> > bharat.ku...@accelerite.com
> > > >
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > There may be a difference in what you have allocated and what is
> being
> > > > actually used. The dashboard shows what is allocated.
> > > >
> > > > Regards,
> > > > Bharat.
> > > >
> > > > On 11/21/16, 9:44 PM, "williamstev...@gmail.com on behalf of Will
> > > > Stevens" <williamstev...@gmail.com on behalf of
> wstev...@cloudops.com>
> > > > wrote:
> > > >
> > > > >You will have to contact Accelerite for support with ACP (previously
> > > CCP).
> > > > >We have no visibility into the ACP code or how to support you.
> > > > >
> > > > >https://support.accelerite.com/hc/en-us
> > > > >
> > > > >Best of luck...
> > > > >
> > > > >*Will STEVENS*
> > > > >Lead Developer
> > > > >
> > > > ><https://goo.gl/NYZ8KK>
> > > > >
> > > > >On Mon, Nov 21, 2016 at 3:44 AM, anil lakineni <
> > > > >anilkumar459.lakin...@gmail.com> wrote:
> > > > >
> > > > >> Dear All,
> > > > >>
> > > > >> On CloudPlatform dashboard our CPU usage is showing wrong (high
> > -91%)
> > > > value
> > > > >> which in-turn not allowing us to provision new VMs. But, the fact
> is
> > > > only
> > > > >> 40% of the available CPU is utilized and Even in the Dashboard
> only
> > > > >> percentage calculation is showing false metric value, But Cpu
> usage
> > > > value
> > > > >> is showing accurate(800/2000 GHZ).
> > > > >>
> > > > >> In addition to that when we go to check the CPU status at Zones
> > level
> > > we
> > > > >> are seeing the accurate CPU usage percentage in all Zones, Only we
> > are
> > > > >> getting false usage percentage at dashboard level(which leads to
> > fail
> > > > the
> > > > >> new deployments).
> > > > >>
> > > > >> - Our CCP version is 4.5.0
> > > > >> - Hypervisors are Xen 6.2 & 6.5
> > > > >>
> > > > >> Please help me to sort out this issue and also let me know if any
> > > > >> additional information needed.
> > > > >>
> > > > >>
> > > > >> Best Regards,
> > > > >> Anil.
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > > > DISCLAIMER
> > > > ==
> > > > This e-mail may contain privileged and confidential information which
> > is
> > > > the property of Accelerite, a Persistent Systems business. It is
> > intended
> > > > only for the use of the individual or entity to which it is
> addressed.
> > If
> > > > you are not the intended recipient, you are not authorized to read,
> > > retain,
> > > > copy, print, distribute or use this message. If you have received
> this
> > > > communication in error, please notify the sender and delete all
> copies
> > of
> > > > this message. Accelerite, a Persistent Systems business does not
> accept
> > > any
> > > > liability for virus infected mails.
> > > >
> > >
> >
>


Re: Fault percentage value of CPU usage in Cloud Platform

2016-11-21 Thread Will Stevens
You will have to contact Accelerite for support with ACP (previously CCP).
We have no visibility into the ACP code or how to support you.

https://support.accelerite.com/hc/en-us

Best of luck...

*Will STEVENS*
Lead Developer

<https://goo.gl/NYZ8KK>

On Mon, Nov 21, 2016 at 3:44 AM, anil lakineni <
anilkumar459.lakin...@gmail.com> wrote:

> Dear All,
>
> On CloudPlatform dashboard our CPU usage is showing wrong (high -91%) value
> which in-turn not allowing us to provision new VMs. But, the fact is only
> 40% of the available CPU is utilized and Even in the Dashboard only
> percentage calculation is showing false metric value, But Cpu usage value
> is showing accurate(800/2000 GHZ).
>
> In addition to that when we go to check the CPU status at Zones level we
> are seeing the accurate CPU usage percentage in all Zones, Only we are
> getting false usage percentage at dashboard level(which leads to fail the
> new deployments).
>
> - Our CCP version is 4.5.0
> - Hypervisors are Xen 6.2 & 6.5
>
> Please help me to sort out this issue and also let me know if any
> additional information needed.
>
>
> Best Regards,
> Anil.
>


Re: Disable open inactive plugins: Contrail plugin

2016-10-28 Thread Will Stevens
Sorry Rohit, I was not clear. Yes, I agree with your approach. I just
wanted to make sure we didn't make assumptions about usage simply by recent
builds failing.

I think commenting them out for at least one or two releases before
removing them is the right approach.

On Oct 28, 2016 1:45 AM, "Rohit Yadav" <rohit.ya...@shapeblue.com> wrote:

> Will, you make a fair point and we should not be removing plugins just
> because they fail to build but that's NOT what I've said.
>
>
> Let me break down my arguments:
>
>
> - The only obligation project has is towards any CloudStack users who may
> be using these plugins, but given the state of the plugin it's highly
> unlikely that they are in production use. The purpose of this thread is to
> investigate and ask if there are any such users, so far I'm not hearing
> anything from any of those users.
>
>
> - If the vendors who had initially contributed the plugins are not
> maintaining them or are not responsive, the project should not be obligated
> towards maintaining a broken component that does not even build, and
> project should in that case work towards a plan to deprecate such plugins
> over time.
>
>
> - The first thing I'm proposing here is to comment those plugins in
> 'plugins/pom.xml' to exclude them in the default build process. The next
> steps could be to discuss deprecating and removing them from the codebase
> over time, this is open for discussion and should be discussed separately.
>
>
> - The specific plugin (contrail) also fails to build against JDK8
> that adds a roadblock to our plan to migrate to JDK8 in future.
>
>
> - Background: I checked with few people including original
> authors/contributors, the story I'm told is that several of the network
> plugins were created as a proof-of-concept or go-to-market tools, and did
> not take off or got attention from their vendors as they failed to
> achieve specific business goals. Given CloudStack has been user-driven
> (than vendor-driven) it is fair to conclude that several of the plugins are
> not maintained most-likely because nobody is using them.
>
>
> Regards.
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> @shapeblue
>
>
>
> --
> *From:* williamstev...@gmail.com <williamstev...@gmail.com> on behalf of
> Will Stevens <wstev...@cloudops.com>
> *Sent:* 27 October 2016 22:50:19
> *To:* d...@cloudstack.apache.org
> *Cc:* Rohit Yadav; users@cloudstack.apache.org
> *Subject:* Re: Disable open inactive plugins: Contrail plugin
>
> Just because recent builds are failing does not really mean that no one is
> using it.  In my experience working with different companies who have ACS
> in production, a lot of them are using much older versions of ACS (4.4 for
> example).  Only a subset of companies keep their ACS install "close" to
> master and they are likely 2 or 3 versions behind master as well.
>
> I would suggest we wait a bit to see if anyone from the users@ list pops
> up.
>
> I think we can probably disable Midonet. I think Contrail is more likely
> to have active users on previous versions.
>
>
>
>> I would be in favor. I think that nobody uses them since all recent
>> builds are failing, right?
>>
>> Your proposal seems good to me.
>>
>> Wido
>>
>> >
>> > Regards.
>> >
>> > rohit.ya...@shapeblue.com
>> > www.shapeblue.com
>> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> > @shapeblue
>> >
>> >
>> >
>>
>
>


Re: Cloud Platform Dashboard's System Capacity is not updated with newly added resources

2016-09-08 Thread Will Stevens
Well it works properly, just not the way people expect. The purpose of that
dashboard is to highlight the
​ cluster
​which is most likely to need capacity changes when doing capacity planning.

​Unfortunately CloudPlatform is behind CloudStack on these features.  In
CloudPlatform it is not possible to get a good summary of the capacity for
the different clusters/hosts.  You basically get the most used cluster and
the global summary, but you have to go and manually audit each host in the
Infrastructure tab to get a clearer picture.  CloudStack has some new
features which CloudPlatform does not which makes visualizing these details
easier in ACS.

​Cheers,

Will​

​

On Sep 8, 2016 2:28 AM, "anil lakineni" <anilkumar459.lakin...@gmail.com>
wrote:

> Hi Will,
>
> Thank you for your inputs and clarifications.
> Yes, I have already seen the reflected resources at Zone tab.
> I thought it was an issue with my CloudPlatform when those were not
> reflected at Dashboard, now i can leave this as the Dashboard wouldn't work
> properly in many cases.
>
> Regards,
> Anil.
>
> On Wed, Sep 7, 2016 at 4:05 PM, Will Stevens <williamstev...@gmail.com>
> wrote:
>
> > I don't have the ui in front of me, so I can't give you specifics.
> >
> > The dashboard does not work how most people expect. The dashboard only
> > shows the most used cluster, which is why it did not change. When you
> click
> > on the dashboard, it will take you to a second screen full of horizontal
> > bars. Those should reflect the total capacity of the system. Hope that
> > helps.
> >
> > Will
> >
> > On Sep 7, 2016 5:45 AM, "anil lakineni" <anilkumar459.lakin...@gmail.com
> >
> > wrote:
> >
> > Hi  All,
> >
> > Guys, Can any one help me on this issue.
> > *Newly added resources are not updated in the Dashboard's System Capacity
> > but those new resources are updated in Infrastructure tab's Zone
> > Resources(Infrastructure --> Zone --> Resources)*
> >
> > Thanks,
> > Anil.
> >
> > On Sun, Sep 4, 2016 at 12:13 PM, anil lakineni <
> > anilkumar459.lakin...@gmail.com> wrote:
> >
> > > Greetings All,
> > >
> > > Cloud Platform version is 4.5.0
> > > Existing Cloud Managed Hypervisor version is XenServer 6.2
> > > New Cloud Managed Hypervisor version is XenServer 6.5
> > >
> > > I have successfully added new cluster with Xen 6.5 into Cloud Platform
> > but
> > > the Dashboard's System Capacity is not updated with new resources
> (Except
> > > CPU and Memory resources), but I'm seeing storage resources are updated
> > > with new values.
> > >
> > >
> > > Also, I can see the newly updated resources in Infrastructure tab's
> Zone
> > > Resources(Infrastructure --> Zone --> Resources), but i can't see these
> > > resources in the Dashboard tab.
> > >
> > > Please can anyone suggest me that what I have been missing here to get
> > > changes updated in Dashboard.
> > >
> > > *P.S:* I have restarted Cloud Management service but no luck and I'm
> able
> > > to deploy new VM's in the newly added cluster.
> > >
> > > Looking forward for your valuable suggestions.
> > >
> > > Thanks,
> > > Anil.
> > >
> > >
> > >
> > >
> > >
> >
>


Re: CCC Brasil

2016-08-30 Thread Will Stevens
Marco, I heard rumors that you were trying to reschedule for November.  If
that is the case, I would suggest you push the reschedule farther in the
future for a couple reasons:
- ApacheCon is in November already in Europe so that makes travel to both
events very difficult.
- People traveling from India and some other places need about 45 days to
get a visa to travel, so we need to have set dates at least 2-3 months
prior to the event.

Let us know what your plans are.

Cheers,

Will

On Tue, Aug 16, 2016 at 11:32 AM, Marco Sinhoreli <
marco.sinhor...@shapeblue.com> wrote:

> All,
>
>
>
> I am very sorry to have to say that we have had to postpone the upcoming
> CCC conference in Sao Paluo.
>
>
>
> Over the past few months we have been working very hard with an events
> organiser to try and get the conference off the ground. Conferences are
> very expensive to stage here in Brasil so we were relying on a number of
> large sponsors. Unfortunately , we are unable to get enough sponsors for
> the proposed September dates due to multiple schedule conflicts.
>
>
>
> I appreciate that this is very late notice. Up until this week we were
> hoping to have enough sponsorship to run the event but we were also
> conscious that this would have left only a little time for CFP and people
> to make travel arrangements. We have therefore decided to cancel the
> September conference. We’re working with local sponsors and our venue hosts
> to try and find some dates either later in 2016 or in 2017.
>
>
> Best regards,
>
>
>
> *Marco Sinhoreli*
>
> Managing Consultant
>
> marco.sinhor...@shapeblue.com
>
> mobile: +55 21 98276 3636
>
>
>
> Praia de Botafogo 501, bloco 1 - sala 101 – Botafogo
>
> Rio de Janeiro, RJ - Brazil - CEP 22250-040
>
> office: + 55 21 2586 6390 | fax: +55 21 2586 6002
>
> http://www.shapeblue.com/ | twitter: @shapeblue
>


[ANNOUNCE] Apache CloudStack 4.9.0 Released!

2016-08-12 Thread Will Stevens
Hello Everyone,
I am happy to announce the 4.9.0 release of Apache CloudStack.

As the release manager for 4.9.0, I would like to say a big Thank You to
the community for supporting this release.  We were able to merge over 180
PRs and fixed more than 75 bugs with this version.

We had a period without a release manager earlier this year which impacted
our release cadence, but I am happy to report that this is being addressed
in the community.  You can expect a more active release cycle going forward
as well as the introduction of LTS releases.  If you would like more
information, please come join us on the dev@ list.

Release Download: https://cloudstack.apache.org/downloads.html

Release Notes:
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.9.0/

Cheers,

Will


Re: State of the S3 secondary storage

2016-07-19 Thread Will Stevens
Oh ya.  Gotta love NFS syncing to servers halfway around the world.  :P

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, Jul 19, 2016 at 4:06 PM, Syed Ahmed <sah...@cloudops.com> wrote:

> Right, but is that an artificial limitation imposed by Cloudstack of is
> there something that will break if we make NFS region wide? If not, we can
> look at moving the NFS to a region wide storage.
>
> -Syed
>
> On Tue, Jul 19, 2016 at 3:54 PM, Will Stevens <wstev...@cloudops.com>
> wrote:
>
> > Probably because ACS does not treat it as region wide, unlike the object
> > storage implementations.
> >
> > *Will STEVENS*
> > Lead Developer
> >
> > *CloudOps* *| *Cloud Solutions Experts
> > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
> > w cloudops.com *|* tw @CloudOps_
> >
> > On Tue, Jul 19, 2016 at 2:52 PM, Syed Ahmed <sah...@cloudops.com> wrote:
> >
> > > Is there a reason why NFS cannot be region-wide?
> > >
> > > -Syed
> > >
> > > On Tue, Jul 19, 2016 at 2:08 PM, Nux! <n...@li.nux.ro> wrote:
> > >
> > > > Thanks for your input guys.
> > > >
> > > > I think I'll stay with NFS for now after your replies, but it'd be
> > pretty
> > > > sweet the day when we'll be having region wide secondary storage.
> > > >
> > > > I'll need to think of another way to provide DR, perhaps some
> automatic
> > > > snapshot+download of sorts.
> > > >
> > > > Lucian
> > > >
> > > > --
> > > > Sent from the Delta quadrant using Borg technology!
> > > >
> > > > Nux!
> > > > www.nux.ro
> > > >
> > > > - Original Message -
> > > > > From: "Syed Ahmed" <sah...@cloudops.com>
> > > > > To: d...@cloudstack.apache.org
> > > > > Cc: "Nux!" <n...@li.nux.ro>, "Cloudstack Users List" <
> > > > users@cloudstack.apache.org>
> > > > > Sent: Tuesday, 19 July, 2016 17:06:52
> > > > > Subject: Re: State of the S3 secondary storage
> > > >
> > > > > As Will put it, the implementation for using Object store as
> > secondary
> > > > > storage relies on using Staging NFS. You would also loose the
> > > > functionality
> > > > > to do differential snapshots. All your snapshots will basically be
> > full
> > > > > volume snapshots. So, if you have a lot of snapshots being taken at
> > > > > scheduled intervals, you might end up with wasting a lot of space
> on
> > > your
> > > > > S3. Not to mention all of this has to go through the NFS which can
> > (an
> > > in
> > > > > our experience has) fill up preventing you from creating new VMs
> > > (because
> > > > > templates cannot be downloaded). However you do benefit from a
> region
> > > > wide
> > > > > Image store. We've worked around the NFS problem by basically
> having
> > > > > multiple staging NFS stores.
> > > > >
> > > > > I have plans to make Object stores better integrated in Cloudstack.
> > The
> > > > > holy grail would be to avoid staging NFS completely (or atleast in
> > the
> > > > > upload path). But for now we have to live with the limitations.
> > > > >
> > > > > -Syed
> > > > >
> > > > >
> > > > > On Tue, Jul 19, 2016 at 11:41 AM, Will Stevens <
> > wstev...@cloudops.com>
> > > > > wrote:
> > > > >
> > > > >> We are using Swift as secondary storage.  It also offers
> inter-zone
> > > > >> secondary storage.  We have had to do fixes to make it work
> > correctly,
> > > > but
> > > > >> we have pushed those fixes upstream so they are available in 4.9
> > (and
> > > > some
> > > > >> fixes earlier than that).
> > > > >>
> > > > >> Like Wido said, the staging NFS is still needed which is a real
> > > problem
> > > > >> with these implementations.  You end up copying the data many
> times
> > > and
> > > > you
> > > > >> will run into problems if you have lots of customers doing
> scheduled
> > > > >&

Re: State of the S3 secondary storage

2016-07-19 Thread Will Stevens
Probably because ACS does not treat it as region wide, unlike the object
storage implementations.

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, Jul 19, 2016 at 2:52 PM, Syed Ahmed <sah...@cloudops.com> wrote:

> Is there a reason why NFS cannot be region-wide?
>
> -Syed
>
> On Tue, Jul 19, 2016 at 2:08 PM, Nux! <n...@li.nux.ro> wrote:
>
> > Thanks for your input guys.
> >
> > I think I'll stay with NFS for now after your replies, but it'd be pretty
> > sweet the day when we'll be having region wide secondary storage.
> >
> > I'll need to think of another way to provide DR, perhaps some automatic
> > snapshot+download of sorts.
> >
> > Lucian
> >
> > --
> > Sent from the Delta quadrant using Borg technology!
> >
> > Nux!
> > www.nux.ro
> >
> > - Original Message -
> > > From: "Syed Ahmed" <sah...@cloudops.com>
> > > To: d...@cloudstack.apache.org
> > > Cc: "Nux!" <n...@li.nux.ro>, "Cloudstack Users List" <
> > users@cloudstack.apache.org>
> > > Sent: Tuesday, 19 July, 2016 17:06:52
> > > Subject: Re: State of the S3 secondary storage
> >
> > > As Will put it, the implementation for using Object store as secondary
> > > storage relies on using Staging NFS. You would also loose the
> > functionality
> > > to do differential snapshots. All your snapshots will basically be full
> > > volume snapshots. So, if you have a lot of snapshots being taken at
> > > scheduled intervals, you might end up with wasting a lot of space on
> your
> > > S3. Not to mention all of this has to go through the NFS which can (an
> in
> > > our experience has) fill up preventing you from creating new VMs
> (because
> > > templates cannot be downloaded). However you do benefit from a region
> > wide
> > > Image store. We've worked around the NFS problem by basically having
> > > multiple staging NFS stores.
> > >
> > > I have plans to make Object stores better integrated in Cloudstack. The
> > > holy grail would be to avoid staging NFS completely (or atleast in the
> > > upload path). But for now we have to live with the limitations.
> > >
> > > -Syed
> > >
> > >
> > > On Tue, Jul 19, 2016 at 11:41 AM, Will Stevens <wstev...@cloudops.com>
> > > wrote:
> > >
> > >> We are using Swift as secondary storage.  It also offers inter-zone
> > >> secondary storage.  We have had to do fixes to make it work correctly,
> > but
> > >> we have pushed those fixes upstream so they are available in 4.9 (and
> > some
> > >> fixes earlier than that).
> > >>
> > >> Like Wido said, the staging NFS is still needed which is a real
> problem
> > >> with these implementations.  You end up copying the data many times
> and
> > you
> > >> will run into problems if you have lots of customers doing scheduled
> > >> snapshots at the same time because you can fill your NFS staging area
> > >> unless you give it a lot of space to work with.
> > >>
> > >> The object storage integrations are working, but they are not designed
> > very
> > >> well at present.  You have code for both S3 and Swift basically just
> > >> separated with conditionals and much of the logic is shared.  This is
> > very
> > >> brittle because making changes in one integration can (and
> historically
> > >> has) broken the other implementation.  This is a relatively big
> problem
> > >> because most people working with either Swift or S3 will only have the
> > >> ability to test one of them, so they don't really have the ability to
> > test
> > >> if they have broken the other.  It does not help that there is Zero CI
> > >> coverage run for either the Swift or S3 integrations due to the
> > difficulty
> > >> building and tearing down object storage environments on the fly.
> > >>
> > >> All in all, yes they should be working, but expect a bit of a bumpy
> > road.
> > >>
> > >> Hope that helps,
> > >>
> > >> *Will STEVENS*
> > >> Lead Developer
> > >>
> > >> *CloudOps* *| *Cloud Solutions Experts
> > >> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
> > >> w cloudops.com *|* tw 

Re: State of the S3 secondary storage

2016-07-19 Thread Will Stevens
We are using Swift as secondary storage.  It also offers inter-zone
secondary storage.  We have had to do fixes to make it work correctly, but
we have pushed those fixes upstream so they are available in 4.9 (and some
fixes earlier than that).

Like Wido said, the staging NFS is still needed which is a real problem
with these implementations.  You end up copying the data many times and you
will run into problems if you have lots of customers doing scheduled
snapshots at the same time because you can fill your NFS staging area
unless you give it a lot of space to work with.

The object storage integrations are working, but they are not designed very
well at present.  You have code for both S3 and Swift basically just
separated with conditionals and much of the logic is shared.  This is very
brittle because making changes in one integration can (and historically
has) broken the other implementation.  This is a relatively big problem
because most people working with either Swift or S3 will only have the
ability to test one of them, so they don't really have the ability to test
if they have broken the other.  It does not help that there is Zero CI
coverage run for either the Swift or S3 integrations due to the difficulty
building and tearing down object storage environments on the fly.

All in all, yes they should be working, but expect a bit of a bumpy road.

Hope that helps,

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, Jul 19, 2016 at 11:26 AM, Wido den Hollander <w...@widodh.nl> wrote:

>
> > Op 19 juli 2016 om 14:38 schreef Nux! <n...@li.nux.ro>:
> >
> >
> > Hello,
> >
> > Could anyone summarise the state of S3 (and clones) for secondary
> storage?
> > I read at some point that it's the only secondary storage type supported
> inter-zone, so it would appeal from a DR pov, but not sure how mature it is
> or if there are any serious gotchas involved.
> >
>
> We have it running for our largest region (Amsterdam) with Ceph's RADOS
> Gateway as backend. We had some issues, but they seem to be fixed after our
> latest patches.
>
> You still need the staging NFS though, so that doesn't solve anything.
>
> Wido
>
> > Thanks
> > Lucian
> >
> > --
> > Sent from the Delta quadrant using Borg technology!
> >
> > Nux!
> > www.nux.ro
>


Re: Xenserver 6.5 live migration with local volumes

2016-06-26 Thread Will Stevens
Which hypervisor are you using?
On Jun 26, 2016 2:00 AM, "Remi Bergsma"  wrote:

> Hi Makrand,
>
> Thanks for the info. What I want is migrate a VM from one cluster (with
> cluster scope shared storage) to another one. The UI / API allows that (it
> says: storage migration required) but it doesn't work. The goal is to
> consolidate two half empty clusters into one and then reprovison the empty
> one.
>
> I was wondering whether others know this feature even works in which case
> my issue might be a local config issue or so.
>
> I'll try to reproduce in a test setup so that I can hook in the debugger
> and see what's going on.
>
> If there are tips please let me know :-)
>
> Thanks, Remi
>
> Sent from my iPhone
>
> > On 25 Jun 2016, at 17:41, Makrand  wrote:
> >
> > Hi Remi,
> >
> > If you're talking about common storage for all clusters, then its Zone
> wide
> > primary storage. I think it works pretty well, only if the new created VM
> > have disks already created on same new storage.
> >
> > With my previous employer, we rolled out zonewide primary (with cluster
> > level primary setup already in place) and it worked pretty good once we
> > vmotioned VMs from *cluster primary* to *Zone wide primary* and updated
> DB
> > (storage & volumes tables). (We eventually ditched Cluster primary).
> >
> > --
> > Best,
> > Makrand
> >
> >
> > On Fri, Jun 24, 2016 at 7:31 PM, Remi Bergsma <
> rberg...@schubergphilis.com>
> > wrote:
> >
> >> Hi Anshul,
> >>
> >> Thanks! Did you ever try live migrating from CloudStack with storage
> >> between clusters? I can't get that to work. I'll collect some details in
> >> the next days but was wondering if it was supposed to work.
> >>
> >> Regards, Remi
> >>
> >> Sent from my iPhone
> >>
>  On 24 Jun 2016, at 06:30, Anshul Gangwar <
> anshul.gang...@accelerite.com>
> >>> wrote:
> >>>
> >>> Created the PR https://github.com/apache/cloudstack/pull/1596.
> >>>
> >>> Regards,
> >>> Anshul
> >>>
> >>> On 24/06/16, 2:33 AM, "Dave Garbus"  wrote:
> >>>
> >>> Is there anybody that wants to take this on?
> >>>
> >>> Thanks,
> >>>
> >>> - Dave
> >>>
>  On May 24, 2016, at 10:57 AM, Dave Garbus 
> >> wrote:
> 
>  I updated the issue referenced in this email (
> >> https://issues.apache.org/jira/browse/CLOUDSTACK-9353) to include
> >> CloudStack 4.8 as an affected version. If we could at least get someone
> >> assigned to it, that’d be a good start.
> 
>  Thanks,
> 
>  - Dave
> 
>  On May 24, 2016, at 9:42 AM, Ivan Derbenev <
> >> ivan.derbe...@tech-corps.com>
> wrote:
> 
>  Is there a way I can fix this on my installation, without recompiling
> >> jar files?
> 
>  Regards,
>  IT engineer
>  Farheap, Russia
>  Ivan Derbenev
> 
>  -Original Message-
>  From: Koushik Das [mailto:koushik@accelerite.com]
>  Sent: Tuesday, May 24, 2016 2:06 PM
>  To: users@cloudstack.apache.org
>  Subject: Re: Xenserver 6.5 live migration with local volumes
> 
>  This is a product bug and needs to be fixed. There is some
> >> serialization issue that needs fixing.
> 
>  In the below code volumeToFiler is null as Map is not a serializable
> >> type. It needs to be replaced with getVolumeToFilerAsList() and then the
> >> data needs to be read appropriately.
> 
>  final Map volumeToFiler =
> >> command.getVolumeToFiler();
> 
>  -Koushik
> 
>  On 24/05/16, 3:23 PM, "Ivan Derbenev"  >> > wrote:
> 
>  Hello!
>  After the migration onto XS 6.5 (and installing all the updates) and
> CS
>  4.8 I can't migrate VMs with Local Storage
> 
>  The issue is similar to this:
>  https://issues.apache.org/jira/browse/CLOUDSTACK-9353, but it doesn't
> >> have any solutions Any ideas?
> 
>  Errors:
> 
>  2016-05-24 12:10:16,440 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>  (DirectAgentCronJob-26:ctx-ab4250ff) (logid:4fa92c13) Done with
> process
>  of VM state report. host: 136592
>  2016-05-24 12:10:16,450 DEBUG [c.c.h.x.r.CitrixResourceBase]
>  (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Looking for network
>  named cloud-main
>  2016-05-24 12:10:16,466 DEBUG [c.c.h.x.r.XsLocalNetwork]
>  (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Found a network called
>  cloud-main on host=10.7.130.103;
>  Network=9632020b-4d98-1bed-9ae8-477e0993cab0;
>  pif=3c7d1121-2bde-26cf-9478-18e51ffca75f
>  2016-05-24 12:10:16,477 DEBUG [c.c.h.x.r.CitrixResourceBase]
>  (DirectAgent-132:ctx-a97d60fa) (logid:8748bffe) Creating VLAN 1007 on
>  host 10.7.130.103 on device eth0
>  2016-05-24 12:10:17,163 DEBUG 

Re: Failing to enable SSL/HTTPS on console proxy vm

2016-06-16 Thread Will Stevens
That's in global settings I presume?
On Jun 16, 2016 12:19 PM, "Nux!" <n...@li.nux.ro> wrote:

> Dammit, I was missing the consoleproxy.url.domain! What an idiot ...
> Works just fine now.
>
> Will, it can be done, don't give up! :)
>
> Thanks Andy!
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> - Original Message -
> > From: "Andy Dills" <a...@xecu.net>
> > To: users@cloudstack.apache.org
> > Cc: d...@cloudstack.apache.org
> > Sent: Thursday, 16 June, 2016 17:10:55
> > Subject: Re: Failing to enable SSL/HTTPS on console proxy vm
>
> > I have this working perfectly.
> >
> > Couple of key things that are not mentioned in the
> > documentation:
> >
> > - You need to set consoleproxy.url.domain to *.domain.com for whatever
> domain
> > you're using. Do this before re-uploading your SSL certificate. The SSL
> upload
> > dialogue doesn't set this value as it should.
> >
> > - You need a wildcard certificate for that domain.
> >
> > Assuming you setup the proper DNS records, it should then work.
> >
> > I'm open to follow up questions if anybody is struggling with this.
> >
> > Thanks,
> > Andy
> >
> > Sent from my iPhone
> >
> >> On Jun 16, 2016, at 12:01 PM, Will Stevens <wstev...@cloudops.com>
> wrote:
> >>
> >> We have been having issues with this for as long as I can remember (on
> both
> >> ACS and CCP).  In order to get it to work you have to 'trust unsafe
> >> scripts' or whatever by clicking the shield in the URL bar in the top
> right
> >> (maybe that is chrome).
> >>
> >> I don't know that there is a solution, but if there is, I am all ears...
> >>
> >> *Will STEVENS*
> >> Lead Developer
> >>
> >> *CloudOps* *| *Cloud Solutions Experts
> >> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
> >> w cloudops.com *|* tw @CloudOps_
> >>
> >>> On Thu, Jun 16, 2016 at 11:54 AM, Nux! <n...@li.nux.ro> wrote:
> >>>
> >>> Hi,
> >>>
> >>> Is there any particular voodoo involved in getting the $subject to work
> >>> correctly on 4.8.0?
> >>> I've uploaded the Comodo wildcard cabundle, crt and key in the
> >>> Infrastructure page, the systemvms have rebooted.
> >>> They came back fine and nothing dodgy in the logs, but when I open the
> >>> console of a VM Firefox will say there are insecure contents loaded and
> >>> will not display the terminal ajax thingy.
> >>> View source shoes an iframe linking http://1.2.3.4 instead of
> >>> https://1-2-3-4.wildcarddomain.tld.
> >>>
> >>> Apache HTTPD and Tomcat had no issues with these certs.
> >>>
> >>> Is there something that I am missing?
> >>>
> >>> Thanks
> >>>
> >>>
> >>> --
> >>> Sent from the Delta quadrant using Borg technology!
> >>>
> >>> Nux!
> >>> www.nux.ro
>


Re: Failing to enable SSL/HTTPS on console proxy vm

2016-06-16 Thread Will Stevens
We have been having issues with this for as long as I can remember (on both
ACS and CCP).  In order to get it to work you have to 'trust unsafe
scripts' or whatever by clicking the shield in the URL bar in the top right
(maybe that is chrome).

I don't know that there is a solution, but if there is, I am all ears...

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Thu, Jun 16, 2016 at 11:54 AM, Nux! <n...@li.nux.ro> wrote:

> Hi,
>
> Is there any particular voodoo involved in getting the $subject to work
> correctly on 4.8.0?
> I've uploaded the Comodo wildcard cabundle, crt and key in the
> Infrastructure page, the systemvms have rebooted.
> They came back fine and nothing dodgy in the logs, but when I open the
> console of a VM Firefox will say there are insecure contents loaded and
> will not display the terminal ajax thingy.
> View source shoes an iframe linking http://1.2.3.4 instead of
> https://1-2-3-4.wildcarddomain.tld.
>
> Apache HTTPD and Tomcat had no issues with these certs.
>
> Is there something that I am missing?
>
> Thanks
>
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>


CloudStack Collab MTL - Day 1 - #ccc2016mtl

2016-06-01 Thread Will Stevens
Hi all,

#ccc2016mtl is off to great start!  We had a productive round table
discussion this afternoon.  You can find the notes from the discussion here
[1] and the recording of the session will be posted soon.

Tomorrow's talks will be live streamed and recorded. You can watch them
here: http://ca.cloudstackcollab.org/#stream.

The agenda for the stream can be find in the schedule:
http://ca.cloudstackcollab.org/#schedule.

Please note that the times in the schedule are for the EDT timezone.

If you have any questions for the speakers, please post them in the
#ccc2016mtl CloudStack Slack channel [2] or on Twitter with #ccc2016mtl [3].

See you tomorrow!

[1]
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Collaboration+Conference%3A+Montreal+2016
[2] https://apachecloudstack.slack.com/messages/ccc2016mtl/
[3] https://twitter.com/search?q=%23ccc2016mtl


Re: [ANNOUNCE] Will Stevens as new Apache CloudStack VP

2016-05-19 Thread Will Stevens
Thank you all for the well wishes.  :)

Thank you Seb for all the hard work you have put into this project.  You
have enabled us to make larger strides forward and we all really appreciate
that.  Thanks...  

On Thu, May 19, 2016 at 10:56 AM, Giles Sirett <giles.sir...@shapeblue.com>
wrote:

> Sebastien - thank you for your drive, dedication and hard work over the
> last year
>
> Will - many congratulations - keep up the good work !
>
> Kind Regards
> Giles
>
> giles.sir...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com]
> Sent: 19 May 2016 07:57
> To: d...@cloudstack.apache.org; market...@cloudstack.apache.org;
> users@cloudstack.apache.org
> Subject: [ANNOUNCE] Will Stevens as new Apache CloudStack VP
>
> Morning Everyone,
>
> Yesterday at the ASF board meeting, the board passed the resolution making
> Will Stevens the new Vice President of the Apache CloudStack project.
>
> Join me in congratulating Will on this appointment, wish him luck and
> bring your unwavering support !
>
> You may have noticed that Will took on RM duties for the new releases
> going forward and has also taken a very active role to finish bringing us
> to github based  workflow and CI. Will has some updates on that front that
> I am sure you will all like.
>
> -Sebastien
> Former VP CloudStack
>


Re: Organizing CCCNA16 Hackathon

2016-05-05 Thread Will Stevens
Hey John,
Thanks for the initiative.  We will be focusing the hackathon mainly around
testing.  I will be setting up full environments for the teams to work with
and those details will be made available on the day of the hackathon.

I think it is a good idea to have a general theme for the hackathon to help
focus us on getting actionable work done.

I like the idea of having topics submitted early and teams getting
organized prior to the actual hackathon.

Cheers,

Will

On Thu, May 5, 2016 at 10:23 AM, John Burwell 
wrote:

> All,
>
> In advance of the CCNA16 Hackathon on Wednesday, 1 June 2016, it seems
> like it would be wise to organize the topics which people are interested in
> addressing.  My thought is anyone may suggest a topic and/or register their
> interest in a topic.  Also, since there will likely be a number of people
> unable to physically attend, we can create a Google Hangout for each
> group.  Hopefully, by organizing the topics in advance and broadcasting our
> work, we can further extend participation across the community.
>
> To begin organizing topics, I have created a public Google Spreadsheet [1]
> with columns for group name, organizer/proposer,  interested participants,
> and a Hangout URL.  If you would like to propose a topic, create a new row
> with the name of the group, your name and email, and a Hangout URL
> (instructions[2]).  If you are interested in one or more topics, please add
> your name and email to the row.  I would also like to propose that we
> record the Hangout sessions (upload location TBD), and that the organizer
> of the topic report any results of their efforts with a URL of the
> recording back to dev@.
>
> Finally, I have included users@ and marketing@ as they may also wish to
> participate.
>
> Thanks,
> -John
>
> [1]:
> https://docs.google.com/spreadsheets/d/14U0E1YpgZvsBc88SHVojo-XzOLAKs-WFEkMxXlrAl_o/edit#gid=0
> [2]: https://support.google.com/hangouts/answer/3111943?hl=en
>
>
>
>
>
> john.burw...@shapeblue.com
> www.shapeblue.com
> @shapeblue
>


Re: CloudStack Logging

2016-04-19 Thread Will Stevens
Thanks Paul.  Are you looking for only logs with errors or are you just
looking for just any management server logs?

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, Apr 19, 2016 at 11:45 AM, Paul Angus <paul.an...@shapeblue.com>
wrote:

> Thanks Will,
>
> As far as I know anything sensitive is removed or obfuscated (vcenter
> password displayed as h**).  IP addresses and hostnames are shown.
> Users may want to use a tool like SED to replace IP addresses or internal
> domain names
>
> http://forums.qrz.com/index.php?threads/remove-ip-addresses-from-log-files.204196/
>
>
> Kind regards,
>
> Paul Angus
>
> Regards,
>
> Paul Angus
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
> -Original Message-
> From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On
> Behalf Of Will Stevens
> Sent: 19 April 2016 16:40
> To: d...@cloudstack.apache.org
> Cc: users@cloudstack.apache.org
> Subject: Re: CloudStack Logging
>
> I like this initiative Paul.  I just wanted to check with you.  Do you
> know if there is any confidential information like credentials or the like
> that is logged in the management server log?  I thought we had done a push
> at one point to make sure no sensitive data was logged, but I don't
> remember for sure.  I think knowing the answer to this will help people
> feel more comfortable uploading logs.
>
> Thanks for the valuable initiative...
>
> *Will STEVENS*
> Lead Developer
>
> *CloudOps* *| *Cloud Solutions Experts
> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw
> @CloudOps_
>
> On Tue, Apr 19, 2016 at 11:34 AM, Paul Angus <paul.an...@shapeblue.com>
> wrote:
>
> > Hi All,
> >
> > I'm running an initiative to improve CloudStack logging.  I'm going to
> > be analysing logs and re-categorising the DEBUG, INFO, WARN and ERROR
> > where appropriate such that we can reduce the default logging level to
> > INFO without losing important troubleshooting information, while at
> > the same time making the management-server log far more readable for
> > operational admins.
> >
> > To achieve this I need logs to work with.
> >
> > Please could anyone interested upload logs to:
> > https://shapeblue.brickftp.com
> >
> > The logs will be treated in the strictest confidence and public
> > download of the logs will not be available.
> > I'm especially interested in logs which you found particularly
> > difficult to read or specific messages which you think are
> > misscategorised
> >
> > If you wish, put comments at the top of the logs or send a message
> > directly or via the mailing lists pointing out specific issues.
> > Please compress the logs!
> >
> > Kind regards,
> >
> > Paul Angus
> >
> >
> > Regards,
> >
> > Paul Angus
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
> >
>


Re: CloudStack Logging

2016-04-19 Thread Will Stevens
I like this initiative Paul.  I just wanted to check with you.  Do you know
if there is any confidential information like credentials or the like that
is logged in the management server log?  I thought we had done a push at
one point to make sure no sensitive data was logged, but I don't remember
for sure.  I think knowing the answer to this will help people feel more
comfortable uploading logs.

Thanks for the valuable initiative...

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, Apr 19, 2016 at 11:34 AM, Paul Angus <paul.an...@shapeblue.com>
wrote:

> Hi All,
>
> I'm running an initiative to improve CloudStack logging.  I'm going to be
> analysing logs and re-categorising the DEBUG, INFO, WARN and ERROR where
> appropriate such that we can reduce the default logging level to INFO
> without losing important troubleshooting information, while at the same
> time making the management-server log far more readable for operational
> admins.
>
> To achieve this I need logs to work with.
>
> Please could anyone interested upload logs to:
> https://shapeblue.brickftp.com
>
> The logs will be treated in the strictest confidence and public download
> of the logs will not be available.
> I'm especially interested in logs which you found particularly difficult
> to read or specific messages which you think are misscategorised
>
> If you wish, put comments at the top of the logs or send a message
> directly or via the mailing lists pointing out specific issues.
> Please compress the logs!
>
> Kind regards,
>
> Paul Angus
>
>
> Regards,
>
> Paul Angus
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>


Re: or website

2015-03-05 Thread Will Stevens
I don't think that Ian was suggesting that we get rid of that wording
completely.  I think he was saying that we could supplement that message
with some more interesting marketing that will better illustrate the value
proposition of ACS and how it is differentiated.

Will


*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Thu, Mar 5, 2015 at 4:46 PM, Sally Khudairi 
sallykhuda...@yahoo.com.invalid wrote:

 NOT SO FAST.
 Whilst it's old hat to us, it's still relevant.
 Per the 2015 Linux Jobs Report published yesterday:
 The rise of open cloud platforms is creating even more demand for Linux
 professionals with the right expertise. Forty-two percent of hiring
 managers say that experience in OpenStack and CloudStack will have a major
 impact on their hiring decisions...

 So I think it _is_ important that we keep Open Source Cloud Computing,
 but perhaps augment to more closely align with our Just Works and related
 campaigns/taglines.
 Whilst we may need a bit of Botox, it's not necessary to have a complete
 overhaul.
 Thanks for including us in the dialogue, Ian g
 Cheers,Sally
   From: Ian Rae i...@cloudops.com
  To: d...@cloudstack.apache.org d...@cloudstack.apache.org
 Cc: users@cloudstack.apache.org users@cloudstack.apache.org; 
 market...@cloudstack.apache.org market...@cloudstack.apache.org
  Sent: Thursday, 5 March 2015, 11:41
  Subject: Re: or website

 Recommend we start with the purpose of the website. If only informational
 and logistics, documentation and code then perhaps it doesn't matter. But I
 think there is a greater purpose.
 I would argue it not only represents our project and community, but
 communicates our project and community to the rest of the world and to some
 extent aligns the community itself.
 So I agree with Seb that having a modern, professional, ideally attractive
 design is very important. Equally important that the vision, mission of the
 community be clear and accessible, and ideally, exciting! What problem does
 CloudStack solve better than anything else? Does it solve it in the way the
 market is looking for (i.e. costs nothing for a complete product that works
 out of box, vendor neutral, runs easily and reliably and can be upgraded
 for long term supportability).
 Today if you glance at the site you see Open Source Cloud Computing. I'm
 not sure that's very helpful in an age where everything is moving to open
 source and cloud computing no longer seems to mean in the market what it
 did in 2008 (pretty much every web or mobile app or hosting services seems
 to be cloud).
 Cross posting this discussion to marketing, hopefully this can intersect
 with renewed investment by the community members to make CloudStack more
 accessible to the rest of the world and thus bring more participants to the
 community.
 Ian
 On Thu, Mar 5, 2015 at 11:22 AM, Rohit Yadav rohit.ya...@shapeblue.com
 wrote:

 Hi Sebastien,

 I really like the initiative, while cms.apache.org is handy I think the
 gh-pages repo looks neat plus we can continue to use git and not archaic
 svn :)

 I think we can then perhaps have an automated way to build the gh-pages
 branch and copy the htmls to cms etc. Should we also use Jekyll based
 website since the link (http://apache.github.io/cloudstack/) will be
 built automatically by Github (need to confirm, if it allows for non-master
 branches)? I’ve some Jekyll based experience, my website too is hosted on
 Github and uses Jekyll.

  On 05-Mar-2015, at 8:01 pm, Sebastien Goasguen run...@gmail.com wrote:
 
  Hi,
 
  The website has been bugging me greatly, it's not up to par with today's
 website and does not portray our project in a good way.
 
  I decided to try something quick. I created a gh-pages branch in our
 repo, orphaned from the rest of the code based and pushed that.
  It shows up on github due to the mirroring:
 
  https://github.com/apache/cloudstack/tree/gh-pages
 
  And it builds:
 
  https://github.com/apache/cloudstack/tree/gh-pages
 
  I believe that's nice, it allows us to keep the website under ASF root
 repo but the mirroring allows us to use github pages.
  That means we can take pull requests to build our website instead of
 using svn or the apache CMS.
 
  Any amazing web designer on these lists who wants to take a crack at a
 modern design for cloudstack ?
 
  thanks,
 
  -sebastien

 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +91 88 262 30892 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab



 Find out more about ShapeBlue and our range of CloudStack related services

 IaaS Cloud Design  Build
 http://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Software Engineering
 http://shapeblue.com/cloudstack-software-engineering/
 CloudStack

Re: or website

2015-03-05 Thread Will Stevens
No risk of bikeshedding.  We are all working in the same direction.  :)

This thread has the tall order of trying to align the technical improvement
of how we actually manage and deliver the website as well as making it
easier for us to better market the strengths of ACS.  This is not always
easy because the people in the best position to add the marketing flare are
usually not the same people who actually maintain the technical
implementation of the site.

All constructive feedback is helpful in this process.  :)

Will

On Mar 5, 2015 4:56 PM, Sally Khudairi s...@apache.org wrote:

 Thanks, Will.

 Right: I got that. I just wanted to make sure that we remain objective
 with our introspection.

 I'll step aside now for fear of triggering semantic bikeshedding. Feel
 free to ping if you need anything from the ASF side.

 Warmly,
 Sally


 = = = = =
 vox +1 617 921 8656
 off2 +1 646 583 3362
 skype sallykhudairi

   --
  *From:* Will Stevens wstev...@cloudops.com
 *To:* d...@cloudstack.apache.org d...@cloudstack.apache.org; Sally
 Khudairi sallykhuda...@yahoo.com
 *Cc:* market...@cloudstack.apache.org market...@cloudstack.apache.org;
 users@cloudstack.apache.org users@cloudstack.apache.org
 *Sent:* Thursday, 5 March 2015, 16:51
 *Subject:* Re: or website

 I don't think that Ian was suggesting that we get rid of that wording
 completely.  I think he was saying that we could supplement that message
 with some more interesting marketing that will better illustrate the value
 proposition of ACS and how it is differentiated.

 Will


 *Will STEVENS*
 Lead Developer

 *CloudOps* *| *Cloud Solutions Experts
 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
 w cloudops.com *|* tw @CloudOps_



 On Thu, Mar 5, 2015 at 4:46 PM, Sally Khudairi 
 sallykhuda...@yahoo.com.invalid wrote:

 NOT SO FAST.
 Whilst it's old hat to us, it's still relevant.
 Per the 2015 Linux Jobs Report published yesterday:
 The rise of open cloud platforms is creating even more demand for Linux
 professionals with the right expertise. Forty-two percent of hiring
 managers say that experience in OpenStack and CloudStack will have a major
 impact on their hiring decisions...

 So I think it _is_ important that we keep Open Source Cloud Computing,
 but perhaps augment to more closely align with our Just Works and related
 campaigns/taglines.
 Whilst we may need a bit of Botox, it's not necessary to have a complete
 overhaul.
 Thanks for including us in the dialogue, Ian g
 Cheers,Sally
   From: Ian Rae i...@cloudops.com
  To: d...@cloudstack.apache.org d...@cloudstack.apache.org
 Cc: users@cloudstack.apache.org users@cloudstack.apache.org; 
 market...@cloudstack.apache.org market...@cloudstack.apache.org
  Sent: Thursday, 5 March 2015, 11:41
  Subject: Re: or website

 Recommend we start with the purpose of the website. If only informational
 and logistics, documentation and code then perhaps it doesn't matter. But I
 think there is a greater purpose.
 I would argue it not only represents our project and community, but
 communicates our project and community to the rest of the world and to some
 extent aligns the community itself.
 So I agree with Seb that having a modern, professional, ideally attractive
 design is very important. Equally important that the vision, mission of the
 community be clear and accessible, and ideally, exciting! What problem does
 CloudStack solve better than anything else? Does it solve it in the way the
 market is looking for (i.e. costs nothing for a complete product that works
 out of box, vendor neutral, runs easily and reliably and can be upgraded
 for long term supportability).
 Today if you glance at the site you see Open Source Cloud Computing. I'm
 not sure that's very helpful in an age where everything is moving to open
 source and cloud computing no longer seems to mean in the market what it
 did in 2008 (pretty much every web or mobile app or hosting services seems
 to be cloud).
 Cross posting this discussion to marketing, hopefully this can intersect
 with renewed investment by the community members to make CloudStack more
 accessible to the rest of the world and thus bring more participants to the
 community.
 Ian
 On Thu, Mar 5, 2015 at 11:22 AM, Rohit Yadav rohit.ya...@shapeblue.com
 wrote:

 Hi Sebastien,

 I really like the initiative, while cms.apache.org is handy I think the
 gh-pages repo looks neat plus we can continue to use git and not archaic
 svn :)

 I think we can then perhaps have an automated way to build the gh-pages
 branch and copy the htmls to cms etc. Should we also use Jekyll based
 website since the link (http://apache.github.io/cloudstack/) will be
 built automatically by Github (need to confirm, if it allows for non-master
 branches)? I’ve some Jekyll based experience, my website too is hosted on
 Github and uses Jekyll.

  On 05-Mar-2015, at 8:01 pm, Sebastien Goasguen run...@gmail.com wrote:
 
  Hi,
 
  The website has been bugging me greatly

Re: Network QoS (not bandwidth limiting)

2015-02-27 Thread Will Stevens
This email has been starred in my inbox for a week and I have only just had
a chance to get all the way through it.

I have spent quite a bit of time in ACS networking.  I build the Palo Alto
Networks integration and acted as a technical advisor for Syed's work on
the NetScaler SSL Termination feature.

So just addressing QoS in ACS in general.  So instead of just limiting
bandwidth, we would be guaranteeing a specific rate as well.  This problem
is relatively complicated because usually ACS does not have orchestration
capabilities to the edge network it is implemented in.  Usually, the ACS
'public' traffic is handed off to spine switches and we lose control of the
networking before the traffic even gets out of the datacenter.  If that
spine is overloaded, there is no way that you can guarantee a QoS.  Are you
guys looking for just adding QoS to the edge that we can control?

I would argue that for an enterprise it would probably be valuable to be
able to support QoS to the edge of the orchestration reach.  A lot of
enterprise workloads are not actually as concerned about the speed of the
public link as much as the speed of the interconnections between different
guest networks.  That then brings up the fact that it is quite difficult to
be able to even support inter-guest networking communication without going
through the public link.

I also think that the fact that the VR is considered ephemeral has its
limitations and I have to admit that I have struggled with that one.  For
the Palo Alto firewall, it supports a lot more features than ACS
networking.  When I tell a customer using it that they can't make changes
on the PA for a specific network and expect the change to persist and not
cause problems, I usually get blank stares.  But if the network is
created, why wouldn't it be persistent for the life of the network?.  Just
giving an option for persistent VRs would be a big step.

I have my own list of things that I would love to see addressed:
- Ordering firewall rules.
- Automatic VPC IP range provisioning (including the possibility to have
non-overlapping IP ranges).
etc...

As to not rant, I will leave it there.  I am interested in this topic for
sure.  Being a developer who has worked in this code base, I can assure you
that some of the features/functionality we are discussing here is quite
difficult technically given the current code base.  For some of these
things to be implemented we would need to do a major refactor of the
networking code base (which may be needed at this point anyway).

To Paul's point, I do agree that user groups to understand what features
are most important to the community would be valuable.  This conversation
needs to include developers too though because even though in theory
'anything is possible', in reality we have to be very smart about how we
approach major changes to the core components like this.  Especially since
this functionality has been extensively plugged into.  Maintaining the
validity of existing plugins when doing a rewrite is very important (or at
least getting those plugins updated to work with the new approach).  The
major problem there is most of us don't even have access to the majority of
those networking devices to test and validate their functionality.

Something that concerns me about the user group approach is that it is
really nice that people can agree that there is a demand for some
functionality, but without the means to actually implement the
functionality, where does it go from there?  Unless someone just steps up
and funds the development outright, I expect a lot of people will get
behind the conversation and the idea, but getting dedicated resources on
the projects will be a harder problem.  Yes, if we can get good
communication and some sort of consensus together, that is the required
first step.  I think at some point we will need to address the elephant in
the room of how does that actually translate into implementation.

Sorry for the wall-of-text...

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, Feb 24, 2015 at 4:52 AM, Paul Angus paul.an...@shapeblue.com
wrote:

 Hi Adrian,

 Obviously I have to pick you up on not including the rant tag, so I
 can't tell where it started :)
 Otherwise I'm pretty much in complete agreement.

 The community is probably too developer focused and for the project to
 stay relevant we probably need to redress that balance. What we really need
 are user-community driven features and far more user-input into the feature
 development process, and I agree that means making it more friendly to
 non-developers.  I'm not anti-developer, some of my best friends are
 developers :) but due to the job description, they don't tend to spend a
 lot of time consuming the product that they build especially not in the
 multitude of ways and users could be using them (SBP excepted).

 I won't go into a lengthy