Re: No IP assigned to VM instance even though UI/router says otherwise

[Wei ZHOU]

Hi Rishi,

If you want to create a template manually, you can refer to
https://docs.cloudstack.apache.org/en/4.19.0.1/adminguide/templates/_create_linux.html
Some users use packer to build templates automatically, for example
https://github.com/PCextreme/packer-templates


-Wei


On Sun, Apr 28, 2024 at 8:24 PM Rishi Misra  wrote:
>
> Thank you Wei - since I am testing it on a different architecture, is there
> a way of creating my own templates (similar to Centos templates) ?
>
> On Sun, Apr 28, 2024 at 2:08 PM Wei ZHOU  wrote:
>
> > Hi Rishi,
> >
> > The systemvm template is not used for user vms. As you have noticed,
> > the network interfaces are configured by cloudstack , dhcp does not
> > work.
> > You can test with the built-in Centos 5 templates. You can also try
> > the templates on http://dl.openvm.eu/cloudstack/ (provided by NuxRo)
> >
> > -Wei
> >
> > On Sun, Apr 28, 2024 at 7:30 PM Rishi Misra 
> > wrote:
> > >
> > > Hi there,
> > >
> > > I am trying to understand why a VM instance created by Cloudstack does
> > not
> > > get an IP address in "Basic network" configuration. Interestingly, unter
> > > the "instances" page UI shows an IP assigned to my VM instance.
> > > Furthermore, the router VM adds an entry for my VM/IP in its "/etc/hosts"
> > > entry.
> > >
> > > However, when I try to ping/access the VM it does not have any IP
> > > associated with it.  It almost looks like it never picked up an IP from
> > the
> > > DHCP server running on the router.
> > >
> > > After investigating a bit I found that new VM instances use default.sh
> > > <
> > https://github.com/apache/cloudstack/blob/main/systemvm/debian/opt/cloud/bin/setup/default.sh
> > >
> > > as part of initialization which does not define any interfaces which in
> > > turn causes this issue.  I can get around it by manually adding an entry
> > in
> > > the "/etc/networking/interface" file which works well, however the
> > > interface is reset once the machine is rebooted (as part of cloud init).
> > >
> > > What could be going on here? I am using the same qcow2 image for SystemVM
> > > and User template.
> > >
> > > Thanks.
> >

Re: No IP assigned to VM instance even though UI/router says otherwise

[Wei ZHOU]

Hi Rishi,

The systemvm template is not used for user vms. As you have noticed,
the network interfaces are configured by cloudstack , dhcp does not
work.
You can test with the built-in Centos 5 templates. You can also try
the templates on http://dl.openvm.eu/cloudstack/ (provided by NuxRo)

-Wei

On Sun, Apr 28, 2024 at 7:30 PM Rishi Misra  wrote:
>
> Hi there,
>
> I am trying to understand why a VM instance created by Cloudstack does not
> get an IP address in "Basic network" configuration. Interestingly, unter
> the "instances" page UI shows an IP assigned to my VM instance.
> Furthermore, the router VM adds an entry for my VM/IP in its "/etc/hosts"
> entry.
>
> However, when I try to ping/access the VM it does not have any IP
> associated with it.  It almost looks like it never picked up an IP from the
> DHCP server running on the router.
>
> After investigating a bit I found that new VM instances use default.sh
> 
> as part of initialization which does not define any interfaces which in
> turn causes this issue.  I can get around it by manually adding an entry in
> the "/etc/networking/interface" file which works well, however the
> interface is reset once the machine is rebooted (as part of cloud init).
>
> What could be going on here? I am using the same qcow2 image for SystemVM
> and User template.
>
> Thanks.

Re: Shared guest network assigned to multiple domains

[Wei ZHOU]

Hi Pearl and Ruben,

I think the main issue is that both networks (same gateway/cidr but
under different accounts) should work. Pearl's idea is good, we can
add some steps as below

- backup the database
- remove a Free IP from `user_ip_address` table
- create a shared network with startip/endip = FreeIP, and same vlan,
choose skipping the vlan check
- get the id of the new vlan from `vlan` table, update the ip4_range
of new vlan to same
- get the id of network from `networks` table
- If VR is needed, update `vlan_db_id` and `network_id` of a Free IP
to the new network/vlan so the new network has 2 IPs (1 for VR, 1 for
VM)
- assign Vm to the new account by API,  the Free IP will be assigned to the VM
- update `vlan_db_id` and `network_id` of the old vm IP to the new network/vlan
- update vm IP to the old vm IP
- start the VM



I have not tested it yet.


Kind regards,
Wei




On Fri, Apr 26, 2024 at 5:06 PM Pearl d'Silva
 wrote:
>
> I did not hit the issue with overlapping IP ranges as the network in the 
> destination domain / account was initially created with a different vlan and 
> then they were updated (or swapped) with the VLAN in the source domain. 
> However, I did not test with IPv6.
>
>
>
>
>
>
> 
> From: Ruben Bosch 
> Sent: April 26, 2024 10:58 AM
> To: users@cloudstack.apache.org 
> Subject: Re: Shared guest network assigned to multiple domains
>
> Hi Pearl,
>
> Thanks for the suggestion. Yes, assignVirtualMachine is an option, but in
> this case the used network is not accessible by the destination
> domain/account. Creating the same network twice also doesn't seem like an
> option due to NetUtils.ipRangesOverlap. It also seems to not be a
> possibility to create the same network without filling in the start/end IPs
> for IPv4, because then another error is triggered for the IPv6 range
> overlapping "The IPv6 range with tag: 1000 already has IPs that overlap
> with the new range." (tested on 4.18.1). The VXLAN ID in this case remains
> the same and the VLAN ID overlap check is disabled.
>
> Regards,
>
> Ruben Bosch
>
> On Fri, Apr 26, 2024 at 4:21 PM Pearl d'Silva 
> wrote:
>
> > Hi Ruben,
> >
> > Have you tried the 'Assign Instance to Another Account'
> > (assignVirtualMachine API) operation on the stopped VMs. This would help in
> > moving the VM(s) from one domain/account to another. I did a small test to
> > see if we could preserve the IP and it seemed to work but I may be wrong in
> > my understanding. This was my setup:
> >
> > VM1 in domain /ROOT/dom1 deployed in shared network shdom1 with vlan: 700
> > with CIDR: 10.70.70.1/24
> >
> > Created another domain /ROOT/dom2 and created a shared network shdom2 in
> > this domain with vlan, say: 701 with CIDR: 10.70.70.1/24
> >
> > swap the vlans via DB updated:
> > update networks set broadcast_uri = "vlan://701" where id = ;
> > update networks set broadcast_uri = "vlan://700" where id = ;
> > update vlan set vlan_id = 701 where id = ;
> > update vlan set vlan_id = 700 where id = ;
> >
> > Stop the VM(s) in /ROOT/dom1 domain that need to be moved, and then use
> > the Assign Instance to another Account to move VM to the destination domain
> > and account.
> >
> > Regards,
> > Pearl
> >
> >
> >
> > 
> > From: Ruben Bosch 
> > Sent: April 26, 2024 9:26 AM
> > To: users@cloudstack.apache.org 
> > Subject: Re: Shared guest network assigned to multiple domains
> >
> > Wei, the use cases may vary. In some cases it will be moved completely to a
> > different domain+account, in other cases not.
> >
> > On Fri, Apr 26, 2024 at 2:48 PM Wei ZHOU  wrote:
> >
> > > Hi Ruben,
> > >
> > > Will you move all VMs on the network to another account, or just some
> > > of the VMs ?
> > >
> > > -Wei
> > >
> > > On Fri, Apr 26, 2024 at 2:44 PM Ruben Bosch 
> > wrote:
> > > >
> > > > Thanks Daan :-) Hope there are others with some ideas as well!
> > > >
> > > > On Fri, Apr 26, 2024 at 2:42 PM Daan Hoogland  > >
> > > > wrote:
> > > >
> > > > > ok, from what I know now I have exhausted my clues. Hope you get your
> > > > > migration done expediently.
> > > > >
> > > > > On Fri, Apr 26, 2024 at 2:29 PM Ruben Bosch 
> > > wrote:
> > > > > >
> > > > > > Hmm, that might be possible. However we would like to automate as
> > > much as
> > > > > >

Re: Shared guest network assigned to multiple domains

[Wei ZHOU]

Hi Ruben,

Will you move all VMs on the network to another account, or just some
of the VMs ?

-Wei

On Fri, Apr 26, 2024 at 2:44 PM Ruben Bosch  wrote:
>
> Thanks Daan :-) Hope there are others with some ideas as well!
>
> On Fri, Apr 26, 2024 at 2:42 PM Daan Hoogland 
> wrote:
>
> > ok, from what I know now I have exhausted my clues. Hope you get your
> > migration done expediently.
> >
> > On Fri, Apr 26, 2024 at 2:29 PM Ruben Bosch  wrote:
> > >
> > > Hmm, that might be possible. However we would like to automate as much as
> > > possible. Changing existing IPs to unused ones is not an option, no.
> > >
> > > On Fri, Apr 26, 2024 at 2:25 PM Daan Hoogland 
> > > wrote:
> > >
> > > > ok, and you probably can't redistribute the IPs in the domain or
> > > > define the order of migration to be in line with the range?
> > > >
> > > > On Fri, Apr 26, 2024 at 2:01 PM Ruben Bosch 
> > wrote:
> > > > >
> > > > > The target domain already exists with VMs running in it
> > > > >
> > > > > On Fri, Apr 26, 2024 at 1:46 PM Daan Hoogland <
> > daan.hoogl...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > so probably a stupoid suggestion, but why ot rename the domain
> > then?
> > > > > >
> > > > > > On Fri, Apr 26, 2024 at 1:04 PM Ruben Bosch 
> > > > wrote:
> > > > > > >
> > > > > > > Hi Daan, cases may vary. For our first migration in the end all
> > VMs
> > > > will
> > > > > > > move to the other domain.
> > > > > > >
> > > > > > > On Fri, Apr 26, 2024 at 12:32 PM Daan Hoogland <
> > > > daan.hoogl...@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Ruben, do you need to move domainA completely to domainB or do
> > you
> > > > > > > > need to move *some* VMs from it?
> > > > > > > >
> > > > > > > > On Fri, Apr 26, 2024 at 11:00 AM Ruben Bosch <
> > ruben.bo...@cldin.eu
> > > > >
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > Hi all,
> > > > > > > > >
> > > > > > > > > We're looking into the following. We are using advanced
> > > > networking
> > > > > > on ACS
> > > > > > > > > 4.16.1 (upgrading soon to 4.18.1). We have a guest network
> > that
> > > > is
> > > > > > > > assigned
> > > > > > > > > to a specific domain A (ROOT/foo/domainA). Now we will need
> > to
> > > > move
> > > > > > VMs
> > > > > > > > > from domain A to domain B (ROOT/bar/domainB) while
> > preserving IP
> > > > > > > > addresses.
> > > > > > > > > We are exploring our options on how to make this a seamless
> > > > > > transition.
> > > > > > > > We
> > > > > > > > > have found that:
> > > > > > > > >
> > > > > > > > > - we cannot add the network with the same parameters again,
> > as it
> > > > > > fails
> > > > > > > > on
> > > > > > > > > IP address start/end overlap check
> > > > > > > > > - we cannot add the extra domain in the "domain_network_ref"
> > > > table
> > > > > > as it
> > > > > > > > > yields no result
> > > > > > > > > - we can assign the domain to ROOT and ensure no other users
> > can
> > > > > > claim
> > > > > > > > IPs
> > > > > > > > > by updating "state" in "user_ip_address"
> > > > > > > > >
> > > > > > > > > Are there any other options available that we can think of?
> > I'm
> > > > > > looking
> > > > > > > > > forward to your input.
> > > > > > > > >
> > > > > > > > > Kind regards,
> > > > > > > > >
> > > > > > > > > Ruben Bosch
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Daan
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Daan
> > > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Daan
> > > >
> >
> >
> >
> > --
> > Daan
> >

Re: Move VM to other account

[Wei ZHOU]

Indeed, this needs to be improved.

Which cloudstack version do you use ?

Please check the network, server/disk offerings, templates, etc


Kind regards,
Wei

On Tue, Apr 23, 2024 at 12:48 PM Jimmy Huybrechts  wrote:
>
> Hi,
>
> I mentioned it before but again running in the same issue with a different 
> account.. how to see WHY an account cannot be moved to a different account.
>
> 2024-04-23 12:34:22,614 ERROR [o.a.c.a.c.a.v.AssignVMCmd] 
> (qtp1789718525-7698:ctx-b0881a99 ctx-be595b24) (logid:2fe13e1b) Failed to 
> move vm due to: [Ljava.lang.StackTraceElement;@313bdb0e
> 2024-04-23 12:34:22,614 INFO  [c.c.a.ApiServer] 
> (qtp1789718525-7698:ctx-b0881a99 ctx-be595b24) (logid:2fe13e1b) Failed to 
> move vm due to Account 
> [{"accountName":"cidX","id":14,"uuid":"6d2dd50e-10c8-4c86-955c-85a6d99140d8"}]
>  does not have permission to operate with resource
>
> That error is just plain useless, it’s the same as saying I won’t move but 
> I’m not telling you why, go find out yourself.
>
> It has access to the template under shared, it can see the network, I can 
> even create an instance under that account with exactly the same options and 
> yet I can’t move it from the domain admin account to a user account because 
> of that nothing saying entry.
>
> Above that it does some checks but these are all within limits.
>
> --
> Jimmy

Re: Router has failing health checks -System Alerts

[Wei ZHOU]

You can go to the "Health checks" tab in the VR page, it will tell you
the free space in the VR.


-Wei

On Tue, Apr 23, 2024 at 11:28 AM Raghava Yerubandi
 wrote:
>
> Hello Community,
>
> We are getting a system alert stating that  *Router
> 360417e0-48a7-4467-9098-0cac656da27a has failing checks:
> disk_space_check.py *in our environment.
>
> Can anyone suggest to me what the problem is & where we can troubleshoot it.
>
> we are using ACS - 4.16

Re: Storage pool stucks in initialized

[Wei ZHOU]

Hi,

Please check if package "libvirt-daemon-driver-storage-rbd" has been
installed on all hosts


-Wei

On Mon, Apr 22, 2024 at 9:16 AM Mevludin Blazevic
 wrote:
>
> Hi all,
>
> I tried to add a second Zone-wide storage pool (Ceph-RBD), which fails
> with notification "Request failed". The strange thing is that only some
> KVM host have added the storage pool and some did not. In addition, no
> erros or exception were logged in the management-server logs. Are there
> similar experiences?
>
> Mevludin
>
>

Re: RVR's in master/master state

[Wei ZHOU]

Hi Gary,

Thanks for the sharing

I recall a similar issue caused by a multicast configuration (not the
same):
https://github.com/apache/cloudstack/issues/7838#issuecomment-1722697352

anyone facing the similar issue could check the multicast configurations.


Kind regards,
Wei



On Fri, Apr 19, 2024 at 6:20 PM Gary Dixon 
wrote:

> Hi Daan
>
> Sorry - I forgot to post back what the issue turned out to be.
>
> We had a power outage in our building where our Dev environment is racked.
> After doing some tcp dumps on some vxlan interfaces I was seeing lots of
> bad checksums.
> Our Network engineer swore that the switches we're all OK but after
> re-applying the multicast config on the switches - all of the RVR's came
> back into a stable Master/Backup state across all VPC's.
> Hope this helps others if they are seeing strange behaviour with VPC RVR's
> when using VXLAN guest isolation
>
> BR
>
> Gary
>
>
>
> Gary Dixon
> Quadris Cloud Manager
> +44 (0) 161 537 4980 <+44%20(0)%20161%20537%204980>
>  +44 (0) 7989 717661 <+44%20(0)%207989%20717661>
> gary.di...@quadris.co.uk
> www.quadris.com
> Innovation House, 12‑13 Bredbury Business Park
> Bredbury Park Way, Bredbury, Stockport, SK6 2SN
> -Original Message-
> From: Daan Hoogland 
> Sent: Friday, April 19, 2024 3:08 PM
> To: users@cloudstack.apache.org
> Subject: Re: RVR's in master/master state
>
> sorry no one could help you Gary,
> Have you gotten any further on this issue?
>
> On Fri, Apr 5, 2024 at 4:59 PM Gary Dixon  >
> wrote:
>
> > HI all
> >
> >
> >
> > ACS 4.15.2
> >
> > Ubuntu 20.04
> >
> > KVM
> >
> > Adv Zone no sec groups
> >
> >
> >
> > We recently had to move all of our dev ACS environment virtual
> > management and mysql servers to a new isolated subnet for security
> reasons.
> >
> >
> >
> > Since then all of the VPC RVR’s are in master/master mode.
> >
> > If I restart a VPC with cleanup the RVR’s come back into a
> > master/backup state for a few minutes but then go into master/master
> > state rendering the VPC useless.
> >
> >
> >
> > In the cloud.log on one of the RVR’s it is full of these errors:
> >
> > “2024-04-05 14:51:43,843 ERROR Not able to setup source-nat for a
> > regular router yet”
> >
> >
> >
> > Can anyone point me in the right direction to resolve this issue ?
> >
> > Are there other logs I could look at or services on the RVR’s to check ?
> >
> >
> >
> > BR
> >
> >
> >
> > Gary
> >
> >
> > Gary Dixon
> > Quadris Cloud Manager
> > +44 (0) 161 537 4980 <+44%20(0)%20161%20537%204980>
> > +44 (0) 7989 717661 <+44%20(0)%207989%20717661>
> > gary.di...@quadris.co.uk
> > http://www.q/
> > uadris.com%2F=05%7C02%7CGary.Dixon%40quadris.co.uk%7C6d453f64080c
> > 449f243d08dc607a6e5c%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C6384
> > 91326163464980%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2l
> > uMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C=tKsAdO2jZBj5qeL
> > CsCSOX0zLNsvyrXSeY7PegUCOBhE%3D=0
> > Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way,
> > Bredbury, Stockport, SK6 2SN
> >
>
>
> --
> Daan
>

Re: CloudStack managing KVM Hypervisors on multiple architectures?

[Wei ZHOU]

different clusters should be fine.

maybe @Rohit Yadav can give some advice.


-Wei

On Fri, Apr 19, 2024 at 4:56 PM Daan Hoogland  wrote:
>
> good point Rishi,
> I think you would have to separate the hardware into different
> clusters at least, but maybe even separate zones. I never heard of
> anybody doing a setup like yours.
>
> On Wed, Apr 10, 2024 at 6:56 PM Rishi Misra  
> wrote:
> >
> > Can a CloudStack instance running on x86 manage deployments on both x86 and
> > Raspberry Pi (or any other archs)?
> >
> > I am not sure how it will affect management SystemVMs given the different
> > archs in the mix?
> >
> > Any pointers are greatly appreciated.
> >
> > Thanks!
>
>
>
> --
> Daan

Re: Deployment of VNF appliance without VR

[Wei ZHOU]

Hi,

You can deploy the VNF appliance on a shared network as the first network

-Wei

On Fri, Apr 19, 2024 at 3:38 PM Kaushik Bora
 wrote:
>
> Dear Community,
>
>
>
>We have been going through the VNF appliance deployment which is
> available in release 4.19.0. We have successfully tested the VNF deployment
> scenario with the Virtual Router. However, want to evaluate if the VNF
> appliance can be deployed without the Virtual Router as well, any guidance
> from the community to evaluate the use case(VNF without the VR) is highly
> appreciated.
>
>
>
> Thanks & Regards,
>
> Kaushik Bora
>
> +91-9711100076
>
>
>
>
> --
> This message is intended only for the use of the individual or entity to
> which it is addressed and may contain confidential and/or privileged
> information. If you are not the intended recipient, please delete the
> original message and any copy of it from your computer system. You are
> hereby notified that any dissemination, distribution or copying of this
> communication is strictly prohibited unless proper authorization has been
> obtained for such action. If you have received this communication in error,
> please notify the sender immediately. Although IndiQus attempts to sweep
> e-mail and attachments for viruses, it does not guarantee that both are
> virus-free and accepts no liability for any damage sustained as a result of
> viruses.

Re: Migration status of instance

[Wei ZHOU]

Hi,

You can check the migration progress via "virsh domjobinfo" command on
the source host of the vm.

for example, the output of vm migration to another storage

$ date;virsh domjobinfo i-2-1338-VM

Thu Apr 18 19:19:06 UTC 2024
Job type: Unbounded
Operation:Outgoing migration
Time elapsed: 2740 ms
Data processed:   235.875 MiB
Data remaining:   71.938 MiB
Data total:   307.812 MiB
File processed:   235.875 MiB
File remaining:   71.938 MiB
File total:   307.812 MiB

Thu Apr 18 19:19:07 UTC 2024
Job type: Unbounded
Operation:Outgoing migration
Time elapsed: 3797 ms
Data processed:   552.908 MiB
Data remaining:   190.426 MiB
Data total:   824.633 MiB
Memory processed: 245.095 MiB
Memory remaining: 190.426 MiB
Memory total: 516.820 MiB
Memory bandwidth: 251.917 MiB/s
Dirty rate:   0pages/s
Page size:4096 bytes
Iteration:1
Postcopy requests: 0
File processed:   307.812 MiB
File remaining:   0.000 B
File total:   307.812 MiB
Constant pages:   20980
Normal pages: 62576
Normal data:  244.438 MiB
Expected downtime: 300  ms
Setup time:   11   ms
Compression cache: 64.000 MiB
Compressed data:  0.000 B
Compressed pages: 0
Compression cache misses: 0
Compression overflows: 0



-Wei

On Wed, Apr 17, 2024 at 11:36 PM Jimmy Huybrechts  wrote:
>
> Hi,
>
> I was migration a pretty big VM between hosts (using local storage) and while 
> in the end that works fine.
>
> Is there any way to see a kind of status? In the GUI I can see it starts and 
> finishes which is nice but of little use in this case.
> I tried looking at some logs but now where does it give any status or 
> progress.
>
> On the server it goes out off I can see in the log:
> INFO  [resource.wrapper.LibvirtMigrateCommandWrapper] 
> (agentRequest-Handler-5:) (logid:90c561c8) Waiting for migration of i-8-63-VM 
> to complete, waited 1549000ms
>
> But that’s it.
>
> How does the migration look like?
>
> --
> Jimmy

Re: CentOS 7 ? kernel 3.10.0-1160.. really?

[Wei ZHOU]

ok, that's good to know
you can try advanced zones with vxlan.


-Wei

On Thu, Apr 18, 2024 at 5:22 PM Embedded  wrote:
>
>
>
>
> On Thursday 18 April 2024 09:28:42 PM (+07:00), Wei ZHOU wrote:
>
> > You can configure vxlan device in the kvm hosts, and test the connectivity.
> > I doubt if your switch ports have been configured to support vxlan.
> >
>
> vxlan worked fine across multiple xcp-ng hosts on same network previously.
> and just got 4 nodes in the lab up and k8s 1.28 running, almalinux 8 seems to 
> work ok
>
> moving on to colo
>
> > -Wei
> >
> > On Thursday, April 18, 2024, Embedded  wrote:
> >
> > >
> > >
> > >
> > > On Thursday 18 April 2024 08:18:18 PM (+07:00), Wei ZHOU wrote:
> > >
> > > > > as my servers with kvm do have 2 nics, the managment server only has
> > > one.
> > > >
> > > > It is fine.
> > > >
> > > > > second to that i dont control the network infrastructure, its in a
> > > colo, therefore no vlans.
> > > >
> > > > That's the main problem. if you cannot use vlan, you cannot use the
> > > > isolated networks.
> > > > shared network is the only option for you. but then static nat/source
> > > > nat features are impossible.
> > > > just my opinion.
> > >
> > > though couldnt i use vxlan to achieve the same results ?? i dont need
> > > upstream vlan configuration for that
> > >
> > > >
> > > >
> > > > -Wei
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Apr 18, 2024 at 3:01 PM Embedded 
> > > wrote:
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thursday 18 April 2024 07:43:26 PM (+07:00), Wei ZHOU wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I have seen your question regarding networking in another thread.
> > > > > > Based on your infrastructure (servers with only 1 nics and vlan is
> > > not
> > > > > > supported), the only option is Basic zone.
> > > > > > To use Advanced zone (or with security groups), servers should have
> > > at
> > > > > > least two nics and vlan should be supported.
> > > > > >
> > > > > > To be frank, you should have a better network design before 
> > > > > > deploying
> > > > > > cloudstack or any other cloud orchestrations.
> > > > >
> > > > > correct me if im wrong, however is it true only kvm hosts should have
> > > 2 nics??
> > > > > of does the network manager host also require two nics, ? as my
> > > servers with
> > > > > kvm do have 2 nics, the managment server only has one. second to that
> > > i dont
> > > > > control the network infrastructure, its in a colo, therefore no vlans.
> > > and im not
> > > > > seeing anywhere in the install guide the 2 nic requirement.
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > -Wei
> > > > > >
> > > > > >
> > > > > > On Thu, Apr 18, 2024 at 2:16 PM Embedded
> > >  wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thursday 18 April 2024 07:03:06 PM (+07:00), Wei ZHOU wrote:
> > > > > > >
> > > > > > > > sorry, the compatibility matrix of latest 4.19.0.1
> > > > > > > > https://docs.cloudstack.apache.org/en/4.19.0.1/
> > > releasenotes/compat.html
> > > > > > > >
> > > > > > >
> > > > > > > Thanks, Ive become a pro at installing cs on Debian and Ubuntu,
> > > did it like 30 times over the past days
> > > > > > > but cant seem to get networking right for what i need, always
> > > iptables or something not working so I
> > > > > > > figured id try what the guide says in quick start to see if that
> > > even works. Having real troubles getting this deployed.
> > > > > > >
> > > > > > > > -Wei
> > > > > > > >
> > > > > > > > On Thu, Apr 18, 2024 at 2:02 PM Wei ZHOU 
> > > wrote:
> > > > > > > > >
> > > > > > > > > Please check the compatibility issue
> > > > > > > > > https://docs.cloudstack.apache.org/en/4.19.0.0/
> > > releasenotes/compat.html
> > > > > > > > >
> > > > > > > > > -Wei
> > > > > > > > >
> > > > > > > > > On Thu, Apr 18, 2024 at 1:58 PM Embedded
> > >  wrote:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > wait, what... 4.19 install guide says use CentOS 7... which
> > > is like kernel
> > > > > > > > > > 3.10.0-1160, 2020-11-12, 2020-09-29...
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > seriously? is there anything newer more modern recommended
> > > that is know to
> > > > > > > > > > work? Rocky/Alma Centos8/9 ?
> > > > > > > > > > --
> > > > > > > > > > Sent with Vivaldi Mail. Download Vivaldi for free at
> > > vivaldi.com
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> > > > > >
> > > > >
> > > > > --
> > > > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> > > >
> > >
> > > --
> > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> > >
> >
>
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: CentOS 7 ? kernel 3.10.0-1160.. really?

[Wei ZHOU]

You can configure vxlan device in the kvm hosts, and test the connectivity.
I doubt if your switch ports have been configured to support vxlan.

-Wei

On Thursday, April 18, 2024, Embedded  wrote:

>
>
>
> On Thursday 18 April 2024 08:18:18 PM (+07:00), Wei ZHOU wrote:
>
> > > as my servers with kvm do have 2 nics, the managment server only has
> one.
> >
> > It is fine.
> >
> > > second to that i dont control the network infrastructure, its in a
> colo, therefore no vlans.
> >
> > That's the main problem. if you cannot use vlan, you cannot use the
> > isolated networks.
> > shared network is the only option for you. but then static nat/source
> > nat features are impossible.
> > just my opinion.
>
> though couldnt i use vxlan to achieve the same results ?? i dont need
> upstream vlan configuration for that
>
> >
> >
> > -Wei
> >
> >
> >
> >
> > On Thu, Apr 18, 2024 at 3:01 PM Embedded 
> wrote:
> > >
> > >
> > >
> > >
> > > On Thursday 18 April 2024 07:43:26 PM (+07:00), Wei ZHOU wrote:
> > >
> > > > Hi,
> > > >
> > > > I have seen your question regarding networking in another thread.
> > > > Based on your infrastructure (servers with only 1 nics and vlan is
> not
> > > > supported), the only option is Basic zone.
> > > > To use Advanced zone (or with security groups), servers should have
> at
> > > > least two nics and vlan should be supported.
> > > >
> > > > To be frank, you should have a better network design before deploying
> > > > cloudstack or any other cloud orchestrations.
> > >
> > > correct me if im wrong, however is it true only kvm hosts should have
> 2 nics??
> > > of does the network manager host also require two nics, ? as my
> servers with
> > > kvm do have 2 nics, the managment server only has one. second to that
> i dont
> > > control the network infrastructure, its in a colo, therefore no vlans.
> and im not
> > > seeing anywhere in the install guide the 2 nic requirement.
> > >
> > > >
> > > >
> > > >
> > > > -Wei
> > > >
> > > >
> > > > On Thu, Apr 18, 2024 at 2:16 PM Embedded
>  wrote:
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thursday 18 April 2024 07:03:06 PM (+07:00), Wei ZHOU wrote:
> > > > >
> > > > > > sorry, the compatibility matrix of latest 4.19.0.1
> > > > > > https://docs.cloudstack.apache.org/en/4.19.0.1/
> releasenotes/compat.html
> > > > > >
> > > > >
> > > > > Thanks, Ive become a pro at installing cs on Debian and Ubuntu,
> did it like 30 times over the past days
> > > > > but cant seem to get networking right for what i need, always
> iptables or something not working so I
> > > > > figured id try what the guide says in quick start to see if that
> even works. Having real troubles getting this deployed.
> > > > >
> > > > > > -Wei
> > > > > >
> > > > > > On Thu, Apr 18, 2024 at 2:02 PM Wei ZHOU 
> wrote:
> > > > > > >
> > > > > > > Please check the compatibility issue
> > > > > > > https://docs.cloudstack.apache.org/en/4.19.0.0/
> releasenotes/compat.html
> > > > > > >
> > > > > > > -Wei
> > > > > > >
> > > > > > > On Thu, Apr 18, 2024 at 1:58 PM Embedded
>  wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > > wait, what... 4.19 install guide says use CentOS 7... which
> is like kernel
> > > > > > > > 3.10.0-1160, 2020-11-12, 2020-09-29...
> > > > > > > >
> > > > > > > >
> > > > > > > > seriously? is there anything newer more modern recommended
> that is know to
> > > > > > > > work? Rocky/Alma Centos8/9 ?
> > > > > > > > --
> > > > > > > > Sent with Vivaldi Mail. Download Vivaldi for free at
> vivaldi.com
> > > > > >
> > > > >
> > > > > --
> > > > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> > > >
> > >
> > > --
> > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> >
>
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
>

Re: CentOS 7 ? kernel 3.10.0-1160.. really?

[Wei ZHOU]

> as my servers with kvm do have 2 nics, the managment server only has one.

It is fine.

> second to that i dont control the network infrastructure, its in a colo, 
> therefore no vlans.

That's the main problem. if you cannot use vlan, you cannot use the
isolated networks.
shared network is the only option for you. but then static nat/source
nat features are impossible.
just my opinion.


-Wei




On Thu, Apr 18, 2024 at 3:01 PM Embedded  wrote:
>
>
>
>
> On Thursday 18 April 2024 07:43:26 PM (+07:00), Wei ZHOU wrote:
>
> > Hi,
> >
> > I have seen your question regarding networking in another thread.
> > Based on your infrastructure (servers with only 1 nics and vlan is not
> > supported), the only option is Basic zone.
> > To use Advanced zone (or with security groups), servers should have at
> > least two nics and vlan should be supported.
> >
> > To be frank, you should have a better network design before deploying
> > cloudstack or any other cloud orchestrations.
>
> correct me if im wrong, however is it true only kvm hosts should have 2 nics??
> of does the network manager host also require two nics, ? as my servers with
> kvm do have 2 nics, the managment server only has one. second to that i dont
> control the network infrastructure, its in a colo, therefore no vlans. and im 
> not
> seeing anywhere in the install guide the 2 nic requirement.
>
> >
> >
> >
> > -Wei
> >
> >
> > On Thu, Apr 18, 2024 at 2:16 PM Embedded  
> > wrote:
> > >
> > >
> > >
> > >
> > > On Thursday 18 April 2024 07:03:06 PM (+07:00), Wei ZHOU wrote:
> > >
> > > > sorry, the compatibility matrix of latest 4.19.0.1
> > > > https://docs.cloudstack.apache.org/en/4.19.0.1/releasenotes/compat.html
> > > >
> > >
> > > Thanks, Ive become a pro at installing cs on Debian and Ubuntu, did it 
> > > like 30 times over the past days
> > > but cant seem to get networking right for what i need, always iptables or 
> > > something not working so I
> > > figured id try what the guide says in quick start to see if that even 
> > > works. Having real troubles getting this deployed.
> > >
> > > > -Wei
> > > >
> > > > On Thu, Apr 18, 2024 at 2:02 PM Wei ZHOU  wrote:
> > > > >
> > > > > Please check the compatibility issue
> > > > > https://docs.cloudstack.apache.org/en/4.19.0.0/releasenotes/compat.html
> > > > >
> > > > > -Wei
> > > > >
> > > > > On Thu, Apr 18, 2024 at 1:58 PM Embedded 
> > > > >  wrote:
> > > > > >
> > > > > >
> > > > > > wait, what... 4.19 install guide says use CentOS 7... which is like 
> > > > > > kernel
> > > > > > 3.10.0-1160, 2020-11-12, 2020-09-29...
> > > > > >
> > > > > >
> > > > > > seriously? is there anything newer more modern recommended that is 
> > > > > > know to
> > > > > > work? Rocky/Alma Centos8/9 ?
> > > > > > --
> > > > > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> > > >
> > >
> > > --
> > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> >
>
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: CentOS 7 ? kernel 3.10.0-1160.. really?

[Wei ZHOU]

Hi,

I have seen your question regarding networking in another thread.
Based on your infrastructure (servers with only 1 nics and vlan is not
supported), the only option is Basic zone.
To use Advanced zone (or with security groups), servers should have at
least two nics and vlan should be supported.

To be frank, you should have a better network design before deploying
cloudstack or any other cloud orchestrations.



-Wei


On Thu, Apr 18, 2024 at 2:16 PM Embedded  wrote:
>
>
>
>
> On Thursday 18 April 2024 07:03:06 PM (+07:00), Wei ZHOU wrote:
>
> > sorry, the compatibility matrix of latest 4.19.0.1
> > https://docs.cloudstack.apache.org/en/4.19.0.1/releasenotes/compat.html
> >
>
> Thanks, Ive become a pro at installing cs on Debian and Ubuntu, did it like 
> 30 times over the past days
> but cant seem to get networking right for what i need, always iptables or 
> something not working so I
> figured id try what the guide says in quick start to see if that even works. 
> Having real troubles getting this deployed.
>
> > -Wei
> >
> > On Thu, Apr 18, 2024 at 2:02 PM Wei ZHOU  wrote:
> > >
> > > Please check the compatibility issue
> > > https://docs.cloudstack.apache.org/en/4.19.0.0/releasenotes/compat.html
> > >
> > > -Wei
> > >
> > > On Thu, Apr 18, 2024 at 1:58 PM Embedded  
> > > wrote:
> > > >
> > > >
> > > > wait, what... 4.19 install guide says use CentOS 7... which is like 
> > > > kernel
> > > > 3.10.0-1160, 2020-11-12, 2020-09-29...
> > > >
> > > >
> > > > seriously? is there anything newer more modern recommended that is know 
> > > > to
> > > > work? Rocky/Alma Centos8/9 ?
> > > > --
> > > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> >
>
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: CentOS 7 ? kernel 3.10.0-1160.. really?

[Wei ZHOU]

sorry, the compatibility matrix of latest 4.19.0.1
https://docs.cloudstack.apache.org/en/4.19.0.1/releasenotes/compat.html

-Wei

On Thu, Apr 18, 2024 at 2:02 PM Wei ZHOU  wrote:
>
> Please check the compatibility issue
> https://docs.cloudstack.apache.org/en/4.19.0.0/releasenotes/compat.html
>
> -Wei
>
> On Thu, Apr 18, 2024 at 1:58 PM Embedded  wrote:
> >
> >
> > wait, what... 4.19 install guide says use CentOS 7... which is like kernel
> > 3.10.0-1160, 2020-11-12, 2020-09-29...
> >
> >
> > seriously? is there anything newer more modern recommended that is know to
> > work? Rocky/Alma Centos8/9 ?
> > --
> > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: CentOS 7 ? kernel 3.10.0-1160.. really?

[Wei ZHOU]

Please check the compatibility issue
https://docs.cloudstack.apache.org/en/4.19.0.0/releasenotes/compat.html

-Wei

On Thu, Apr 18, 2024 at 1:58 PM Embedded  wrote:
>
>
> wait, what... 4.19 install guide says use CentOS 7... which is like kernel
> 3.10.0-1160, 2020-11-12, 2020-09-29...
>
>
> seriously? is there anything newer more modern recommended that is know to
> work? Rocky/Alma Centos8/9 ?
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: confusing cloudstack networking

[Wei ZHOU]

you do not need cloudstack virtual router to provide dhcp/dns service, right ?

If you use an advanced zone, you can create a shared network without
any service, then the VMs will get dhcp from your router, not
cloudstack virtual router.

-Wei

On Wed, Apr 17, 2024 at 9:03 AM Embedded  wrote:
>
>
> ok is there any way to tell vms just to get a dhcp ip off the local lan 
> without the router in the mix??
>
> everything in the lab lan is 192.168.10.xxx
>
> On Wednesday 17 April 2024 01:40:30 PM (+07:00), Wei ZHOU wrote:
>
> > Hi,
> >
> > cloud0 is the control network of virtual routers and system vms.
> > The IP of cloud0 is configured as 169.254.0.1/16 by default.
> >
> >
> > -Wei
> >
> >
> >
> > On Wed, Apr 17, 2024 at 7:41 AM Embedded  
> > wrote:
> > >
> > > cloudstack seems to be confusing networking on a lab install ... vms come
> > > up but
> > > the ip they have appears to be on the other side instead of the router
> > > side, i noticed
> > > cloud0 is using a 169.xxx IP address, where this is a flat 192.168.10.xxx
> > > network
> > >
> > > root@cs:~# brctl show
> > > bridge name bridge id   STP enabled interfaces
> > > cloud0  8000.7623b36199a8   no  vnet0
> > > vnet3
> > > vnet7
> > > cloudbr08000.266873c8a6be   no  eno1
> > > vnet1
> > > vnet2
> > > vnet4
> > > vnet5
> > > vnet6
> > > vnet7
> > >
> > >
> > >
> > > 5: cloudbr0:  mtu 1500 qdisc noqueue 
> > > state
> > > UP group default qlen 1000
> > >  link/ether 26:68:73:c8:a6:be brd ff:ff:ff:ff:ff:ff
> > >  inet 192.168.10.10/24 brd 192.168.10.255 scope global cloudbr0
> > > valid_lft forever preferred_lft forever
> > >  inet6 fe80::2468:73ff:fec8:a6be/64 scope link
> > > valid_lft forever preferred_lft forever
> > > 7: cloud0:  mtu 1500 qdisc noqueue state
> > > UP group default qlen 1000
> > >  link/ether 76:23:b3:61:99:a8 brd ff:ff:ff:ff:ff:ff
> > >  inet 169.254.0.1/16 scope global cloud0
> > > valid_lft forever preferred_lft forever
> > >  inet6 fe80::7423:b3ff:fe61:99a8/64 scope link
> > > valid_lft forever preferred_lft forever
> > > --
> > > Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com
> >
>
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: confusing cloudstack networking

[Wei ZHOU]

Hi,

cloud0 is the control network of virtual routers and system vms.
The IP of cloud0 is configured as 169.254.0.1/16 by default.


-Wei



On Wed, Apr 17, 2024 at 7:41 AM Embedded  wrote:
>
> cloudstack seems to be confusing networking on a lab install ... vms come
> up but
> the ip they have appears to be on the other side instead of the router
> side, i noticed
> cloud0 is using a 169.xxx IP address, where this is a flat 192.168.10.xxx
> network
>
> root@cs:~# brctl show
> bridge name bridge id   STP enabled interfaces
> cloud0  8000.7623b36199a8   no  vnet0
> vnet3
> vnet7
> cloudbr08000.266873c8a6be   no  eno1
> vnet1
> vnet2
> vnet4
> vnet5
> vnet6
> vnet7
>
>
>
> 5: cloudbr0:  mtu 1500 qdisc noqueue state
> UP group default qlen 1000
>  link/ether 26:68:73:c8:a6:be brd ff:ff:ff:ff:ff:ff
>  inet 192.168.10.10/24 brd 192.168.10.255 scope global cloudbr0
> valid_lft forever preferred_lft forever
>  inet6 fe80::2468:73ff:fec8:a6be/64 scope link
> valid_lft forever preferred_lft forever
> 7: cloud0:  mtu 1500 qdisc noqueue state
> UP group default qlen 1000
>  link/ether 76:23:b3:61:99:a8 brd ff:ff:ff:ff:ff:ff
>  inet 169.254.0.1/16 scope global cloud0
> valid_lft forever preferred_lft forever
>  inet6 fe80::7423:b3ff:fe61:99a8/64 scope link
> valid_lft forever preferred_lft forever
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: How to achieve VNF without VR

[Wei ZHOU]

You may refer to
https://www.shapeblue.com/vnf-appliance-integration-deep-dive/



On Monday, April 15, 2024, Gaurav Shrivastava
 wrote:

> Hi Team,
>
>
> Is there any way to achieve VNF without VR. If there are any steps or
> documentation that I can follow please let me know.
>
> I am using CloudStack 4.19.0.1
>
>
> Regards
> Gaurav
>
> --
> This message is intended only for the use of the individual or entity to
> which it is addressed and may contain confidential and/or privileged
> information. If you are not the intended recipient, please delete the
> original message and any copy of it from your computer system. You are
> hereby notified that any dissemination, distribution or copying of this
> communication is strictly prohibited unless proper authorization has been
> obtained for such action. If you have received this communication in
> error,
> please notify the sender immediately. Although IndiQus attempts to sweep
> e-mail and attachments for viruses, it does not guarantee that both are
> virus-free and accepts no liability for any damage sustained as a result
> of
> viruses.
>

Re: cloudstack on debian 10/11

[Wei ZHOU]

Is eth0 added to cloudbr0 bridge ?

-Wei

On Mon, Apr 15, 2024 at 1:14 PM lists  wrote:
>
>
>
>
> I did in fact get a debian 11 install up and running pretty much as a 
> management server and almost good as a host. Have to figure out why the 
> cloidbr0 is on a 169.xxx adress and why no centos template was downloaded. 
> Systemvms came up without a problem.
>
>
>
>
>
>
>
>
>
>
>
>
>
> >
> > On Apr 15, 2024 at 3:58 PM, Nuxwrote:
> >
> >
> >  Found some notes on Debian here, there could be others..
> > https://gist.github.com/rohityadavcloud/fc401a0fe8e8ea16b4b3a4e3d149ce0c
> >
> > On 2024-04-15 09:54, Nux wrote:
> > >  Not as yet, no formal support for Debian.
> > >  That said, this could change in the future..
> > >  If you're a keen Debianista then it might be worth having a go
> > >  nevertheless, it might just work or with minimum changes.
> > >
> > >
> > >  On 2024-04-13 10:49, Embedded wrote:
> > >>  the install guide states Preferred: CentOS/RHEL 7.2+ or Ubuntu
> > >>  16.04(.2) or higher
> > >>
> > >>
> > >>  would this include say debian 10/11 as a manager / and host/kvm
> > >>  hypervisor ???
> >
>

Re: ACS 4.16 - Change SystemVM template for CKS

[Wei ZHOU]

9.28MB
> > 175a472c5f77: Loading layer
> > [==>] 299B/299B
> > a8764e32e9fe: Loading layer
> > [==>] 613B/613B
> > Loaded image: weaveworks/weave-npc:2.8.1
> > net.bridge.bridge-nf-call-iptables = 1
> > [init] Using Kubernetes version: v1.28.4
> > [preflight] Running pre-flight checks
> > error execution phase preflight: [preflight] Some fatal errors occurred:
> > [ERROR CRI]: container runtime is not running: output:
> > time="2024-04-11T15:33:26Z" level=fatal msg="validate service connection:
> > validate CRI v1 runtime API for endpoint
> > \"unix:///var/run/containerd/containerd.sock\": rpc error: code =
> > Unimplemented desc = unknown service runtime.v1.RuntimeService"
> > , error: exit status 1
> > [preflight] If you know what you are doing, you can make a check non-fatal
> > with `--ignore-preflight-errors=...`
> > To see the stack trace of this error execute with --v=5 or higher
> > [init] Using Kubernetes version: v1.28.4
> > [preflight] Running pre-flight checks
> > error execution phase preflight: [preflight] Some fatal errors occurred:
> > [ERROR CRI]: container runtime is not running: output:
> > time="2024-04-11T15:33:26Z" level=fatal msg="validate service connection:
> > validate CRI v1 runtime API for endpoint
> > \"unix:///var/run/containerd/containerd.sock\": rpc error: code =
> > Unimplemented desc = unknown service runtime.v1.RuntimeService"
> > , error: exit status 1
> > [preflight] If you know what you are doing, you can make a check non-fatal
> > with `--ignore-preflight-errors=...`
> > To see the stack trace of this error execute with --v=5 or higher
> > [init] Using Kubernetes version: v1.28.4
> > [preflight] Running pre-flight checks
> > error execution phase preflight: [preflight] Some fatal errors occurred:
> > [ERROR CRI]: container runtime is not running: output:
> > time="2024-04-11T15:33:27Z" level=fatal msg="validate service connection:
> > validate CRI v1 runtime API for endpoint
> > \"unix:///var/run/containerd/containerd.sock\": rpc error: code =
> > Unimplemented desc = unknown service runtime.v1.RuntimeService"
> > , error: exit status 1
> > [preflight] If you know what you are doing, you can make a check non-fatal
> > with `--ignore-preflight-errors=...`
> > To see the stack trace of this error execute with --v=5 or higher
> > Error: kubeadm init failed!
> >
> >
> >
> >
> >
> > Le jeu. 11 avr. 2024 à 17:19, Wei ZHOU  a écrit :
> >
> >> Hi,
> >>
> >> Please refer to
> >> https://github.com/apache/cloudstack/issues/8681#issuecomment-1999083241
> >>
> >> The containerd in 4.16/4.17 sysyemvm template is too old.
> >>
> >> -Wei
> >>
> >>
> >> On Thursday, April 11, 2024, benoit lair  wrote:
> >>
> >> > Hi Rohit,
> >> >
> >> > I already tested with different iso from cloudstack from CKS repos,
> >> > It is ok with ACS 4.16 with community iso 1.23.3 but it fails from
> >> 1.24.0
> >> > and following others versions
> >> >
> >> > I tried to do an upgrade from 1.23.3 with 1.24.0, it fails,
> >> > I tried to bootstrap a k8s cluster with 1.24.0, also with 1.25 or 1.27.3
> >> > and 1.28.4
> >> >
> >> > Last try, i tested k8s community iso 1.25.0
> >> > in CS UI it saying   "Create Kubernetes Cluster k8s-cks-cl16 in
> >> progress"
> >> > and it fails
> >> > If i try to ssh on control node with VR_Pub_IP port 
> >> > i have nothing in execution
> >> >
> >> > If i try manual install :
> >> > core@k8s-cks-cl16-control-18eccd0c12c:~$ sudo
> >> /opt/bin/setup-kube-system
> >> > mount: /mnt/k8sdisk: /dev/sr0 already mounted on /mnt/k8sdisk.
> >> > Installing binaries from /mnt/k8sdisk/
> >> > 5b1fa8e3e100: Loading layer
> >> > [==>]  803.8kB/803.8kB
> >> > 39c831b1aa26: Loading layer
> >> > [==>]  26.25MB/26.25MB
> >> > Loaded image: apache/cloudstack-kubernetes-autoscaler:latest
> >> > 417cb9b79ade: Loading layer
> >> > [==>]  657.7kB/657.7kB
> >&g

Re: CreateBackupCmd not starting due to "Cannot find login credentials for HYPERVISOR"

[Wei ZHOU]

The username/password is missing if host is added with sshkey or by
configuring agent.properties.

Users can update the username/password by api or cloudmonkey
https://cloudstack.apache.org/api/apidocs-4.19/apis/updateHostPassword.html


-Wei

On Thursday, April 11, 2024, Slavka Peleva 
wrote:

> Hi Andreas,
>
> The Networker plugin is trying to get the credentials for the host from the
> DB table `host_details` and if one is missing - username/password - you
> will get this error message. If only the password is missing from the table
> for that host, maybe you have added the host with the ssh key.
>
> Best regards,
> Slavka
>
> On Wed, Apr 10, 2024 at 9:02 PM Andreas S. Kerber 
> wrote:
>
> > Hi,
> >
> > I'm trying to get VM backups of 2 node KVM cluster working (using
> > networker). Wwhen trying to start a backup I'm immediatly getting a error
> > message about missing hypervisor login credentials. Maybe I overlooked
> > someting in the documentation but I can't figure out where these login
> > credentials are configured. Can anybody give me a hint?
> >
> >
> > Here's the log of one of my CreateBackupCmd Jobs:
> >
> > 2024-04-10 17:41:10,476 INFO  [o.a.c.f.j.i.AsyncJobMonitor]
> > (API-Job-Executor-30:ctx-c3bb37fe job-1549) (logid:b1913df8) Add
> job-1549
> > into job monitoring
> >
> > 2024-04-10 17:41:10,482 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (qtp1278254413-402:ctx-dddc56ad ctx-33b958e5) (logid:1dda45c8) submit
> async
> > job-1549, details: AsyncJobVO: {id:1549, userId: 4, accountId: 4,
> > instanceType: Backup, instanceId: 81, cmd:
> > org.apache.cloudstack.api.command.user.backup.CreateBackupCmd, cmdInfo:
> > {"virtualmachineid":"e338c774-6693-485f-9746-e3d172665af5","
> response":"json","ctxUserId":"4","httpmethod":"GET","
> ctxStartEventId":"3293","id":"81","ctxDetails":"{\"interface
> > com.cloud.vm.VirtualMachine\":\"e338c774-6693-485f-9746-
> e3d172665af5\"}","ctxAccountId":"4","cmdEventType":"BACKUP.CREATE"},
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 345049358837, completeMsid: null, lastUpdated:
> > null, lastPolled: null, created: null, removed: null}
> >
> > 2024-04-10 17:41:10,485 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-30:ctx-c3bb37fe job-1549) (logid:e4d20d53) Executing
> > AsyncJobVO: {id:1549, userId: 4, accountId: 4, instanceType: Backup,
> > instanceId: 81, cmd:
> > org.apache.cloudstack.api.command.user.backup.CreateBackupCmd, cmdInfo:
> > {"virtualmachineid":"e338c774-6693-485f-9746-e3d172665af5","
> response":"json","ctxUserId":"4","httpmethod":"GET","
> ctxStartEventId":"3293","id":"81","ctxDetails":"{\"interface
> > com.cloud.vm.VirtualMachine\":\"e338c774-6693-485f-9746-
> e3d172665af5\"}","ctxAccountId":"4","cmdEventType":"BACKUP.CREATE"},
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 345049358837, completeMsid: null, lastUpdated:
> > null, lastPolled: null, created: null, removed: null}
> >
> > 2024-04-10 17:41:10,519 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-30:ctx-c3bb37fe job-1549) (logid:e4d20d53) Complete
> async
> > job-1549, jobStatus: FAILED, resultCode: 530, result:
> > org.apache.cloudstack.api.response.ExceptionResponse/
> null/{"uuidList":[],"errorcode":"530","errortext":"Cannot
> > find login credentials for HYPERVISOR df99ba84-7814-47b8-aa99-
> dd9553c56b4c"}
> >
> > {...}
> > 2024-04-10 17:41:10,528 INFO  [o.a.c.f.j.i.AsyncJobMonitor]
> > (API-Job-Executor-30:ctx-c3bb37fe job-1549) (logid:e4d20d53) Remove
> > job-1549 from job monitoring
> >
> >
> > (local)  > list backupofferings
> > {
> >   "backupoffering": [
> > {
> >   "allowuserdrivenbackups": true,
> >   "created": "2024-04-10T17:08:37+0200",
> >   "description": "Networker Instance Backup - 30 days retention",
> >   "externalid": "57.0.53.26.0.0.0.0.0.130.19.102.213.182.20.91",
> >   "id": "8373b357-6b3f-41d9-8054-873914e95476",
> >   "name": "Networker Instance Backup",
> >   "zoneid": "c65618bc-0dcf-4f8a-b365-6b0c11750091",
> >   "zonename": "RZKE1"
> > }
> >   ],
> >   "count": 1
> > }
> >
> >
> > (local)  > list hosts id=df99ba84-7814-47b8-aa99-dd9553c56b4c
> > {
> >   "count": 1,
> >   "host": [
> > {
> >   "capabilities": "hvm,snapshot",
> >   "clusterid": "19939e9e-7588-47e0-82f5-3cd6a634723a",
> >   "clustername": "RZKE1_Cluster03",
> >   "clustertype": "CloudManaged",
> >   "cpuallocated": "4.51%",
> >   "cpuallocatedpercentage": "4.51%",
> >   "cpuallocatedvalue": 13000,
> >   "cpuallocatedwithoverprovisioning": "4.51%",
> >   "cpuloadaverage": 0.73,
> >   "cpunumber": 96,
> >   "cpusockets": 2,
> >   "cpuspeed": 3000,
> >   "cpuused": "0.6%",
> >   "cpuwithoverprovisioning": "288000",
> >   "created": "2024-03-05T17:16:05+0100",
> >   "details": {
> > "Host.OS": "Red Hat Enterprise Linux",
> > 

Re: ACS 4.16 - Change SystemVM template for CKS

[Wei ZHOU]

Hi,

Please refer to
https://github.com/apache/cloudstack/issues/8681#issuecomment-1999083241

The containerd in 4.16/4.17 sysyemvm template is too old.

-Wei


On Thursday, April 11, 2024, benoit lair  wrote:

> Hi Rohit,
>
> I already tested with different iso from cloudstack from CKS repos,
> It is ok with ACS 4.16 with community iso 1.23.3 but it fails from 1.24.0
> and following others versions
>
> I tried to do an upgrade from 1.23.3 with 1.24.0, it fails,
> I tried to bootstrap a k8s cluster with 1.24.0, also with 1.25 or 1.27.3
> and 1.28.4
>
> Last try, i tested k8s community iso 1.25.0
> in CS UI it saying   "Create Kubernetes Cluster k8s-cks-cl16 in progress"
> and it fails
> If i try to ssh on control node with VR_Pub_IP port 
> i have nothing in execution
>
> If i try manual install :
> core@k8s-cks-cl16-control-18eccd0c12c:~$ sudo /opt/bin/setup-kube-system
> mount: /mnt/k8sdisk: /dev/sr0 already mounted on /mnt/k8sdisk.
> Installing binaries from /mnt/k8sdisk/
> 5b1fa8e3e100: Loading layer
> [==>]  803.8kB/803.8kB
> 39c831b1aa26: Loading layer
> [==>]  26.25MB/26.25MB
> Loaded image: apache/cloudstack-kubernetes-autoscaler:latest
> 417cb9b79ade: Loading layer
> [==>]  657.7kB/657.7kB
> 8d323b160d65: Loading layer
> [==>]  24.95MB/24.95MB
> Loaded image: apache/cloudstack-kubernetes-provider:v1.0.0
> 256bc5c338a6: Loading layer
> [==>]  122.2kB/122.2kB
> df1818f16337: Loading layer
> [==>]  14.71MB/14.71MB
> Loaded image: registry.k8s.io/coredns/coredns:v1.9.3
> bd8a70623766: Loading layer
> [==>]  75.78MB/75.78MB
> c88361932af5: Loading layer
> [==>] 508B/508B
> Loaded image: kubernetesui/dashboard:v2.7.0
> 0b031aac6569: Loading layer
> [==>]804kB/804kB
> cc0597072b83: Loading layer
> [==>]  1.076MB/1.076MB
> 5a8045f731fc: Loading layer
> [==>]  90.58MB/90.58MB
> f5a5ef1a005f: Loading layer
> [==>]  1.188MB/1.188MB
> 5cf3bfe5417d: Loading layer
> [==>]  8.506MB/8.506MB
> Loaded image: registry.k8s.io/etcd:3.5.4-0
> 8d7366c22fd8: Loading layer
> [==>]  804.1kB/804.1kB
> 7d5f5bba7c45: Loading layer
> [==>]  694.9kB/694.9kB
> 8154c9483a6c: Loading layer
> [==>]  32.72MB/32.72MB
> Loaded image: registry.k8s.io/kube-apiserver:v1.25.0
> c5f1a47b47bc: Loading layer
> [==>]  29.76MB/29.76MB
> Loaded image: registry.k8s.io/kube-controller-manager:v1.25.0
> e4d19dd12df2: Loading layer
> [==>]  7.631MB/7.631MB
> ba3637ccd78a: Loading layer
> [==>]  12.63MB/12.63MB
> Loaded image: registry.k8s.io/kube-proxy:v1.25.0
> 026969d859f7: Loading layer
> [==>]  14.29MB/14.29MB
> Loaded image: registry.k8s.io/kube-scheduler:v1.25.0
> d01384fea991: Loading layer
> [==>]  19.74MB/19.74MB
> bcec7eb9e567: Loading layer
> [==>] 530B/530B
> Loaded image: kubernetesui/metrics-scraper:v1.0.8
> 961e93cda9dd: Loading layer
> [==>]307kB/307kB
> Loaded image: registry.k8s.io/pause:3.8
> 1b3ee35aacca: Loading layer
> [==>]  2.796MB/2.796MB
> 17d89e2a5199: Loading layer
> [==>]  7.425MB/7.425MB
> 148b94859892: Loading layer
> [==>]8.1MB/8.1MB
> dbea472c1ced: Loading layer
> [==>]  4.376MB/4.376MB
> e81f1a367c17: Loading layer
> [==>] 131B/131B
> 351848f6b295: Loading layer
> [==>]  8.216MB/8.216MB
> Loaded image: weaveworks/weave-kube:latest
> b20f7ff12b24: Loading layer
> [==>]  727.9kB/727.9kB
> 1d49e386162e: Loading layer
> [==>]  9.281MB/9.281MB
> 20145eeac146: Loading layer
> [==>] 297B/297B
> d4cc72748587: Loading layer
> [==>] 

Re: CPU compatibility

[Wei ZHOU]

Hi,

Wido has given a talk "How to Re-use Old Hardware with CloudStack.
Saving Money and the Environment"  in CCC 2023.
If you are interested, please watch the video on
https://www.youtube.com/watch?v=KAJCkC00tzQ  (starts at 11:41)


-Wei

On Wed, Apr 10, 2024 at 5:49 PM R A  wrote:
>
> Hi,
>
> is it also problematic migrating to different CPUs of same Family? For 
> example from Epyc 9654 to Epyc 9754 ?
>
> So you recommend to make a cluster for each CPU Type ? Can you define the 
> migration peer for hosts? For example having them all one cluster but define 
> somehow that migration should be done between hosts of same CPU?
>
> BR
>
> -Original Message-
> From: Guto Veronezi 
> Sent: Mittwoch, 10. April 2024 00:14
> To: users@cloudstack.apache.org
> Subject: Re: CPU compatibility
>
> Hello Steve,
>
> For CloudStack, it does not matter if you have hosts with different 
> processors; however, this is a recommendation regarding how virtualization 
> systems work; therefore, this discussion happens aside from CloudStack.
>
> When we are dealing with different processors, we are dealing with different 
> flags, instructions, clocks, and so on. For processors of the same family, 
> but of different generations, we can level the instructions to the lowest 
> common denominator (limit the instructions to the older generation); however, 
> it starts to get tricky when we are dealing with different families. For 
> instance, if you deploy a guest VM in a host with Xeon Silver and try to 
> migrate it to a Xeon Gold, the OS of your guest, which already knows the Xeon 
> Silver instructions, might not adapt to the instructions of the new host 
> (Xeon Gold). Therefore, in these cases, you will face problems in the guest 
> VM.
>
> If you are aware of the differences between the processors and that mixing 
> different types can cause problems, then you can create a cluster mixing 
> them; however, it is not recommended.
>
> For KVM, the parameter is defined in ACS; on the other hand, for XenServer 
> and VMware this kind of setup is done in the cluster in XenServer or vCenter.
>
> It is also important to bear in mind that, even though you level the 
> instruction sets between the different processors in the host operating 
> system, you might still suffer some issues due to clock differences when you 
> migrate a VM from a faster CPU to a slower CPU and vice versa.
>
> Best regards,
> Daniel Salvador (gutoveronezi)
>
> On 09/04/2024 18:58, Wei ZHOU wrote:
> > Hi,
> >
> > You can use a custom cpu model which is supported by both cpu processors.
> >
> > Please refer to
> > https://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/k
> > vm.html#configure-cpu-model-for-kvm-guest-optional
> >
> > -Wei
> >
> >
> > On Tuesday, April 9, 2024, S.Fuller  wrote:
> >
> >> The Cloudstack Install Guide has the following statement - "All hosts
> >> within a cluster must be homogenous. The CPUs must be of the same
> >> type, count, and feature flags"
> >>
> >> Obviously this means we can't mix Intel and AMD CPUs within the same
> >> cluster. However, for a cluster with Intel CPUs, how much if any
> >> leeway is there within this statement? If I have two 20 Core Xeon
> >> Silver 4316  CPUs on one host and two 20 Core Xeon Silver 4416 CPUs
> >> in another, is that close enough? I'm looking to add capacity to an
> >> existing cluster, and am trying to figure out how "picky" Cloudstack is 
> >> about this.
> >>
> >>
> >>
> >> Steve Fuller
> >> steveful...@gmail.com
> >>

Re: Download the CSP - xcp-ng 8.2

[Wei ZHOU]

Hi,

XCP-NG 8.2 is supported by CloudStack.

Please refer to
https://docs.cloudstack.apache.org/en/4.19.0.1/releasenotes/compat.html#supported-hypervisor-versions


-Wei

On Wed, Apr 10, 2024 at 7:51 AM Embedded  wrote:
>
> is this still viable for XCP-NG 8.2 ? this documentation seems quite dated
>
> For XenServer 6.0.2, 6.0, 5.6 SP2:
>
> Download the CSP software onto the XenServer host from one of the following
> links:
>
> For XenServer 6.0.2:
>
> http://download.cloud.com/releases/3.0.1/XS-6.0.2/xenserver-cloud-supp.tgz
>
> For XenServer 5.6 SP2:
>
> http://download.cloud.com/releases/2.2.0/xenserver-cloud-supp.tgz
>
> For XenServer 6.0:
>
> http://download.cloud.com/releases/3.0/xenserver-cloud-supp.tgz
>
> Extract the file:
>
> # tar xf xenserver-cloud-supp.tgz
> Run the following script:
>
> # xe-install-supplemental-pack xenserver-cloud-supp.iso
> --
> Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

Re: CPU compatibility

[Wei ZHOU]

Hi,

You can use a custom cpu model which is supported by both cpu processors.

Please refer to
https://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html#configure-cpu-model-for-kvm-guest-optional

-Wei


On Tuesday, April 9, 2024, S.Fuller  wrote:

> The Cloudstack Install Guide has the following statement - "All hosts
> within a cluster must be homogenous. The CPUs must be of the same type,
> count, and feature flags"
>
> Obviously this means we can't mix Intel and AMD CPUs within the same
> cluster. However, for a cluster with Intel CPUs, how much if any leeway is
> there within this statement? If I have two 20 Core Xeon Silver 4316  CPUs
> on one host and two 20 Core Xeon Silver 4416 CPUs in another, is that close
> enough? I'm looking to add capacity to an existing cluster, and am trying
> to figure out how "picky" Cloudstack is about this.
>
>
>
> Steve Fuller
> steveful...@gmail.com
>

Re: cloudstack 4.19 filesize mismatch

[Wei ZHOU]

The error could also be caused by SQL exceptions

-Wei

On Tue, Apr 9, 2024 at 3:44 PM Francisco Arencibia Quesada
 wrote:
>
> now a different one :(
>
> cloudstack-management.service - CloudStack Management Server
>  Loaded: loaded (/lib/systemd/system/cloudstack-management.service;
> enabled; vendor preset: enabled)
>  Active: active (running) since Tue 2024-04-09 13:24:05 UTC; 15min ago
>Main PID: 26006 (java)
>   Tasks: 40 (limit: 4677)
>  Memory: 972.5M
>  CGroup: /system.slice/cloudstack-management.service
>  └─26006 /usr/bin/java
> -Djava.security.properties=/etc/cloudstack/management/java.security.ciphers
> -Djava.awt.headless=true -Dcom.sun.management.jmxremote=false -Xmx2G
> -XX:+UseParallelGC -XX:MaxGCPauseMillis=500 -XX:+HeapDump>
>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading
> module context [redfish] from URL
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.1.jar!/META-INF/cl>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading
> module context [redfish] from URL
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.1.jar!/META-INF/cl>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading
> module context [redfish] from URL
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.1.jar!/META-INF/cl>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading
> module context [redfish] from URL
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.1.jar!/META-INF/cl>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading
> module context [redfish] from URL
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.1.jar!/META-INF/cl>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading
> module context [redfish] from URL
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.1.jar!/META-INF/cl>
> Apr 09 13:24:53 ubuntu-focal java[26006]: WARN
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to
> start module [redfish] due to: [Error creating bean with name
> 'org.springframework.beans.factory.config.PropertyPla>
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Starting
> module [system].
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) (logid:) Starting
> CloudStack Components
> Apr 09 13:24:53 ubuntu-focal java[26006]: INFO
>  [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) (logid:) Done Starting
> CloudStack Components
>
> On Tue, Apr 9, 2024 at 12:11 PM Wei ZHOU  wrote:
>
> > It looks like db.properties is not configured correctly.
> > The mgmt server cannot connect the database.
> >
> > -Wei
> >
> > On Tue, Apr 9, 2024 at 11:46 AM Francisco Arencibia Quesada
> >  wrote:
> > >
> > > Hi Wei,
> > >
> > > this is it:
> > > 2024-04-09 09:35:18,507 DEBUG [c.c.u.d.DbProperties] (main:null) (logid:)
> > > DB properties were already loaded
> > > 2024-04-09 09:35:18,508 INFO  [c.c.u.d.T.Transaction] (main:null)
> > (logid:)
> > > Is Data Base High Availiability enabled? Ans : false
> > > 2024-04-09 09:35:18,508 INFO  [c.c.u.d.T.Transaction] (main:null)
> > (logid:)
> > > Using the following URI to connect to cloud database
> > >
> > [jdbc:mysql://localhost:3306/cloud?autoReconnect=true=517=true=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC].
> > > 2024-04-09 09:35:18,514 DEBUG [c.c.u.d.DriverLoader] (main:null) (logid:)
> > > Successfully loaded DB driver com.mysql.cj.jdbc.Driver
> > > 2024-04-09 09:35:18,535 INFO  [c.c.u.d.T.Transaction] (main:null)
> > (logid:)
> > > Using the following URI to connect to usage database
> > >
> > [jdbc:mysql://localhost:3306/cloud_usage?autoReconnect=true=UTC].
> > > 2024-04-09 09:35:18,536 DEBUG [c.c.u.d.DriverLoader] (main:null) (logid:)
> > > DB driver com.mysql.cj.jdbc.Driver was already loaded.
> > > 2024-04-09 09:35:18,540 DEBUG [c.c.u.d.DriverLoader] (main:null) (logid:)
> > > DB driver com.mysql.cj.jdbc.Driver was already loaded.
> > > 2024-04-09 09

Re: cloudstack 4.19 filesize mismatch

[Wei ZHOU]

bstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1372)
> at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1222)
> at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:582)
> at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
> at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:955)
> at
> org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:920)
> at
> org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:583)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:171)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:140)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:271)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:276)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:259)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:128)
> at
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:78)
> at
> org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37)
> at
> org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:70)
> at
> org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:57)
> at
> org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:61)
> at
> org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:52)
> at
> org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1073)
> at
> org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:572)
> at
> org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:1002)
> at
> org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:765)
> at
> org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
> at
> org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1449)
> at
> org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1414)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
> at
> org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
> at
> org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524)
> /SQL
>
> On Tue, Apr 9, 2024 at 11:40 AM Wei ZHOU  wrote:
>
> > The SQLException may tell what's wrong.
> > Can you share ?
> >
> > -Wei
> >
> > On Tue, Apr 9, 2024 at 11:23 AM Francisco Arencibia Quesada
> >  wrote:
> > >
> > > indeed Wei, SQLException.
> > > It is such a weird thing that was working 2days ago, now SQLException :(.
> > >
> > >
> > > Regards
> > >
> > > On Tue, Apr 9, 2024 at 10:53 AM Wei ZHOU  wrote:
> > >
> > > > Hi Francisco,
> > > >
> > > > Please check the database connection, and also check if there is
> > > > SQLException in the management-server.log
> > > >
> > > > -Wei
> > > >
> &g

Re: cloudstack 4.19 filesize mismatch

[Wei ZHOU]

The SQLException may tell what's wrong.
Can you share ?

-Wei

On Tue, Apr 9, 2024 at 11:23 AM Francisco Arencibia Quesada
 wrote:
>
> indeed Wei, SQLException.
> It is such a weird thing that was working 2days ago, now SQLException :(.
>
>
> Regards
>
> On Tue, Apr 9, 2024 at 10:53 AM Wei ZHOU  wrote:
>
> > Hi Francisco,
> >
> > Please check the database connection, and also check if there is
> > SQLException in the management-server.log
> >
> > -Wei
> >
> >
> > On Tue, Apr 9, 2024 at 10:44 AM Francisco Arencibia Quesada
> >  wrote:
> > >
> > > with ubuntu and 4.19 I'm having this issue
> > > https://github.com/apache/cloudstack/issues/8218
> > > 503 error.
> > >
> > > Please let us know something about this issue.
> > >
> > > Regards
> > >
> > > On Tue, Apr 9, 2024 at 9:39 AM Alex Paul 
> > > wrote:
> > >
> > > > Hi Community,
> > > >
> > > > Tried with centos 7,  upgrade is failing
> > > >
> > > > 
> > > > cloudstack-management-4.18.1.1 FAILED
> > > >==-]  23 MB/s | 1.8 GB  00:00:00 ETA
> > > >
> > > >
> > http://download.cloudstack.org/centos/7/4.18/cloudstack-management-4.18.1.1-1.el7.x86_64.rpm
> > > > :
> > > > [Errno -1] Package does not match intended download. Suggestion: run
> > yum
> > > > --enablerepo=cloudstack clean metadata
> > > > 
> > > >
> > > > Cleaning yum metadata does not help
> > > >
> > > > Alex
> > > >
> > > >
> > > >
> > > > On Thu, Apr 4, 2024 at 2:52 AM Francisco Arencibia Quesada <
> > > > arencibia.franci...@gmail.com> wrote:
> > > >
> > > > > Thanks a lot guys, now it works like a charm.
> > > > >
> > > > >
> > > > > Kind regards
> > > > >
> > > > > On Wed, Apr 3, 2024 at 8:37 PM Wei ZHOU 
> > wrote:
> > > > >
> > > > > > Thanks a lot @Rohit Yadav
> > > > > >
> > > > > > I am able to upgrade from 4.18.0.0 to 4.18.1.1 then to 4.19.0.1 on
> > > > > > both ubuntu and rocky8 hosts.
> > > > > >
> > > > > > -Wei
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Apr 3, 2024 at 7:49 PM Rohit Yadav <
> > rohit.ya...@shapeblue.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > Thanks for checking - could you try again, I've purged the old
> > cdn
> > > > > > cache. It should be fixed now.
> > > > > > >
> > > > > > >
> > > > > > > Regards.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > 
> > > > > > > From: Francisco Arencibia Quesada  > >
> > > > > > > Sent: Wednesday, April 3, 2024 21:55
> > > > > > > To: users@cloudstack.apache.org 
> > > > > > > Subject: Re: cloudstack 4.19 filesize mismatch
> > > > > > >
> > > > > > > now are failing both 4.18 and 4.19
> > > > > > >
> > > > > > > Regards
> > > > > > >
> > > > > > > On Wed, Apr 3, 2024 at 6:13 PM Rohit Yadav <
> > > > rohit.ya...@shapeblue.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi Francisco,
> > > > > > > >
> > > > > > > > The repo CDN is being updated, sometimes files are out of
> > sync. Can
> > > > > you
> > > > > > > > run apt-get update and try again and keep us posted if you
> > still
> > > > face
> > > > > > the
> > > > > > > > issue.
> > > > > > > >
> > > > > > > > Regards.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > 
> > > > > > > > From: Francisco Arencibia Quesada <
> > arencibia.franci...@gmail.com>
> > > 

Re: cloudstack 4.19 filesize mismatch

[Wei ZHOU]

Hi Francisco,

Please check the database connection, and also check if there is
SQLException in the management-server.log

-Wei


On Tue, Apr 9, 2024 at 10:44 AM Francisco Arencibia Quesada
 wrote:
>
> with ubuntu and 4.19 I'm having this issue
> https://github.com/apache/cloudstack/issues/8218
> 503 error.
>
> Please let us know something about this issue.
>
> Regards
>
> On Tue, Apr 9, 2024 at 9:39 AM Alex Paul 
> wrote:
>
> > Hi Community,
> >
> > Tried with centos 7,  upgrade is failing
> >
> > 
> > cloudstack-management-4.18.1.1 FAILED
> >==-]  23 MB/s | 1.8 GB  00:00:00 ETA
> >
> > http://download.cloudstack.org/centos/7/4.18/cloudstack-management-4.18.1.1-1.el7.x86_64.rpm
> > :
> > [Errno -1] Package does not match intended download. Suggestion: run yum
> > --enablerepo=cloudstack clean metadata
> > 
> >
> > Cleaning yum metadata does not help
> >
> > Alex
> >
> >
> >
> > On Thu, Apr 4, 2024 at 2:52 AM Francisco Arencibia Quesada <
> > arencibia.franci...@gmail.com> wrote:
> >
> > > Thanks a lot guys, now it works like a charm.
> > >
> > >
> > > Kind regards
> > >
> > > On Wed, Apr 3, 2024 at 8:37 PM Wei ZHOU  wrote:
> > >
> > > > Thanks a lot @Rohit Yadav
> > > >
> > > > I am able to upgrade from 4.18.0.0 to 4.18.1.1 then to 4.19.0.1 on
> > > > both ubuntu and rocky8 hosts.
> > > >
> > > > -Wei
> > > >
> > > >
> > > >
> > > > On Wed, Apr 3, 2024 at 7:49 PM Rohit Yadav 
> > > > wrote:
> > > > >
> > > > > Thanks for checking - could you try again, I've purged the old cdn
> > > > cache. It should be fixed now.
> > > > >
> > > > >
> > > > > Regards.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > 
> > > > > From: Francisco Arencibia Quesada 
> > > > > Sent: Wednesday, April 3, 2024 21:55
> > > > > To: users@cloudstack.apache.org 
> > > > > Subject: Re: cloudstack 4.19 filesize mismatch
> > > > >
> > > > > now are failing both 4.18 and 4.19
> > > > >
> > > > > Regards
> > > > >
> > > > > On Wed, Apr 3, 2024 at 6:13 PM Rohit Yadav <
> > rohit.ya...@shapeblue.com>
> > > > > wrote:
> > > > >
> > > > > > Hi Francisco,
> > > > > >
> > > > > > The repo CDN is being updated, sometimes files are out of sync. Can
> > > you
> > > > > > run apt-get update and try again and keep us posted if you still
> > face
> > > > the
> > > > > > issue.
> > > > > >
> > > > > > Regards.
> > > > > >
> > > > > >
> > > > > >
> > > > > > 
> > > > > > From: Francisco Arencibia Quesada 
> > > > > > Sent: Wednesday, April 3, 2024 8:39:23 PM
> > > > > > To: users@cloudstack.apache.org 
> > > > > > Subject: cloudstack 4.19 filesize mismatch
> > > > > >
> > > > > > Good morning guys,
> > > > > >
> > > > > > I want to report an issue with deb packages for 4.19 release.
> > > > > >
> > > > > > Please see details below:
> > > > > >
> > > > > > https://pastes.io/utzcxtyako-to check all output
> > > > > >
> > > > > > Get:1 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > > > > > cloudstack-common all 4.19.0.1 [117 MB]
> > > > > > Err:1 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > > > > > cloudstack-common all 4.19.0.1
> > > > > >   File has unexpected size (116922362 != 116919496). Mirror sync in
> > > > > > progress? [IP: 195.181.167.51 443]
> > > > > >   Hashes of expected file:
> > > > > >-
> > > > > >
> > > > > >
> > > >
> > >
> > SHA512:00d5571a65ef8029ce668fe2f8769326253615a282e0c6b155410460e7b3d288b062b1d434962b98b26b2be764867010c42fcf39f6ebae68b1bc7e43ea523894
> > > > > >-
> > > > > >
> > > SH

Re: cloudstack 4.19 filesize mismatch

[Wei ZHOU]

Hi Alex,

It works for me.

Can you run "yum clean all" and retry ?

-Wei

On Tue, Apr 9, 2024 at 9:39 AM Alex Paul  wrote:
>
> Hi Community,
>
> Tried with centos 7,  upgrade is failing
>
> 
> cloudstack-management-4.18.1.1 FAILED
>==-]  23 MB/s | 1.8 GB  00:00:00 ETA
> http://download.cloudstack.org/centos/7/4.18/cloudstack-management-4.18.1.1-1.el7.x86_64.rpm:
> [Errno -1] Package does not match intended download. Suggestion: run yum
> --enablerepo=cloudstack clean metadata
> 
>
> Cleaning yum metadata does not help
>
> Alex
>
>
>
> On Thu, Apr 4, 2024 at 2:52 AM Francisco Arencibia Quesada <
> arencibia.franci...@gmail.com> wrote:
>
> > Thanks a lot guys, now it works like a charm.
> >
> >
> > Kind regards
> >
> > On Wed, Apr 3, 2024 at 8:37 PM Wei ZHOU  wrote:
> >
> > > Thanks a lot @Rohit Yadav
> > >
> > > I am able to upgrade from 4.18.0.0 to 4.18.1.1 then to 4.19.0.1 on
> > > both ubuntu and rocky8 hosts.
> > >
> > > -Wei
> > >
> > >
> > >
> > > On Wed, Apr 3, 2024 at 7:49 PM Rohit Yadav 
> > > wrote:
> > > >
> > > > Thanks for checking - could you try again, I've purged the old cdn
> > > cache. It should be fixed now.
> > > >
> > > >
> > > > Regards.
> > > >
> > > >
> > > >
> > > >
> > > > 
> > > > From: Francisco Arencibia Quesada 
> > > > Sent: Wednesday, April 3, 2024 21:55
> > > > To: users@cloudstack.apache.org 
> > > > Subject: Re: cloudstack 4.19 filesize mismatch
> > > >
> > > > now are failing both 4.18 and 4.19
> > > >
> > > > Regards
> > > >
> > > > On Wed, Apr 3, 2024 at 6:13 PM Rohit Yadav 
> > > > wrote:
> > > >
> > > > > Hi Francisco,
> > > > >
> > > > > The repo CDN is being updated, sometimes files are out of sync. Can
> > you
> > > > > run apt-get update and try again and keep us posted if you still face
> > > the
> > > > > issue.
> > > > >
> > > > > Regards.
> > > > >
> > > > >
> > > > >
> > > > > 
> > > > > From: Francisco Arencibia Quesada 
> > > > > Sent: Wednesday, April 3, 2024 8:39:23 PM
> > > > > To: users@cloudstack.apache.org 
> > > > > Subject: cloudstack 4.19 filesize mismatch
> > > > >
> > > > > Good morning guys,
> > > > >
> > > > > I want to report an issue with deb packages for 4.19 release.
> > > > >
> > > > > Please see details below:
> > > > >
> > > > > https://pastes.io/utzcxtyako-to check all output
> > > > >
> > > > > Get:1 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > > > > cloudstack-common all 4.19.0.1 [117 MB]
> > > > > Err:1 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > > > > cloudstack-common all 4.19.0.1
> > > > >   File has unexpected size (116922362 != 116919496). Mirror sync in
> > > > > progress? [IP: 195.181.167.51 443]
> > > > >   Hashes of expected file:
> > > > >-
> > > > >
> > > > >
> > >
> > SHA512:00d5571a65ef8029ce668fe2f8769326253615a282e0c6b155410460e7b3d288b062b1d434962b98b26b2be764867010c42fcf39f6ebae68b1bc7e43ea523894
> > > > >-
> > > > >
> > SHA256:1f0805bfe95351fe30b55999235fc0e398201d1e3131ad7fd1538ef1b7a144be
> > > > >- SHA1:496ff9dffbd6299d1efa0b1c788318fbb04c57fa [weak]
> > > > >- MD5Sum:f162ade7affd9f8a5b8f358e1674f25f [weak]
> > > > >- Filesize:116919496 [weak]
> > > > > Get:2 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > > > > cloudstack-management all 4.19.0.1 [1441 MB]
> > > > > Err:2 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > > > > cloudstack-management all 4.19.0.1
> > > > >   File has unexpected size (1440658214 != 1440655316). Mirror sync in
> > > > > progress? [IP: 195.181.167.51 443]
> > > > >   Hashes of expected file:
> > > > >-
> > > > >
> > > > >
> > >
> > SHA512:352a5133cc06

Re: systemvms for 4.19.1

[Wei ZHOU]

it still uses 4.19.0.0 systemvm template

-Wei

On Wednesday, April 3, 2024, Francisco Arencibia Quesada <
arencibia.franci...@gmail.com> wrote:

> Good evening guys,
>
> Where can I find the systemvms for 4.19.1?
> I can't find it here :
> http://packages.shapeblue.com/systemvmtemplate/4.19/
>
>
> Thank you in advance
> Kind regards
> --
> *Francisco Arencibia Quesada.*
> *DevOps Engineer*
>

Re: cloudstack 4.19 filesize mismatch

[Wei ZHOU]

Thanks a lot @Rohit Yadav

I am able to upgrade from 4.18.0.0 to 4.18.1.1 then to 4.19.0.1 on
both ubuntu and rocky8 hosts.

-Wei



On Wed, Apr 3, 2024 at 7:49 PM Rohit Yadav  wrote:
>
> Thanks for checking - could you try again, I've purged the old cdn cache. It 
> should be fixed now.
>
>
> Regards.
>
>
>
>
> 
> From: Francisco Arencibia Quesada 
> Sent: Wednesday, April 3, 2024 21:55
> To: users@cloudstack.apache.org 
> Subject: Re: cloudstack 4.19 filesize mismatch
>
> now are failing both 4.18 and 4.19
>
> Regards
>
> On Wed, Apr 3, 2024 at 6:13 PM Rohit Yadav 
> wrote:
>
> > Hi Francisco,
> >
> > The repo CDN is being updated, sometimes files are out of sync. Can you
> > run apt-get update and try again and keep us posted if you still face the
> > issue.
> >
> > Regards.
> >
> >
> >
> > 
> > From: Francisco Arencibia Quesada 
> > Sent: Wednesday, April 3, 2024 8:39:23 PM
> > To: users@cloudstack.apache.org 
> > Subject: cloudstack 4.19 filesize mismatch
> >
> > Good morning guys,
> >
> > I want to report an issue with deb packages for 4.19 release.
> >
> > Please see details below:
> >
> > https://pastes.io/utzcxtyako-to check all output
> >
> > Get:1 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > cloudstack-common all 4.19.0.1 [117 MB]
> > Err:1 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > cloudstack-common all 4.19.0.1
> >   File has unexpected size (116922362 != 116919496). Mirror sync in
> > progress? [IP: 195.181.167.51 443]
> >   Hashes of expected file:
> >-
> >
> > SHA512:00d5571a65ef8029ce668fe2f8769326253615a282e0c6b155410460e7b3d288b062b1d434962b98b26b2be764867010c42fcf39f6ebae68b1bc7e43ea523894
> >-
> > SHA256:1f0805bfe95351fe30b55999235fc0e398201d1e3131ad7fd1538ef1b7a144be
> >- SHA1:496ff9dffbd6299d1efa0b1c788318fbb04c57fa [weak]
> >- MD5Sum:f162ade7affd9f8a5b8f358e1674f25f [weak]
> >- Filesize:116919496 [weak]
> > Get:2 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > cloudstack-management all 4.19.0.1 [1441 MB]
> > Err:2 https://download.cloudstack.org/ubuntu jammy/4.19 all
> > cloudstack-management all 4.19.0.1
> >   File has unexpected size (1440658214 != 1440655316). Mirror sync in
> > progress? [IP: 195.181.167.51 443]
> >   Hashes of expected file:
> >-
> >
> > SHA512:352a5133cc06b5ca05b097b9dce9e7d670ec89b7602729a9557f69876fe9f8dba568e0008065535c7f3daed4651a97deb18be1849e8bc64459784ba0ed9e20b3
> >-
> > SHA256:2f2216acda05088ec39c0157c09e0169fa9b5d30dbeb15cb074e743785f5a6ab
> >- SHA1:31a04c5f4b271d7bf4cb0919293b3df0fa27e4c1 [weak]
> >- MD5Sum:f8ce84b0b14e6ef64d235e78ee2a8af6 [weak]
> >- Filesize:1440655316 [weak]
> > E: Failed to fetch
> >
> > https://download.cloudstack.org/ubuntu/dists/jammy/4.19/pool/cloudstack-common_4.19.0.1_all.deb
> >  File has unexpected size (116922362 != 116919496). Mirror sync in
> > progress? [IP: 195.181.167.51 443]
> >Hashes of expected file:
> > -
> >
> > SHA512:00d5571a65ef8029ce668fe2f8769326253615a282e0c6b155410460e7b3d288b062b1d434962b98b26b2be764867010c42fcf39f6ebae68b1bc7e43ea523894
> > -
> > SHA256:1f0805bfe95351fe30b55999235fc0e398201d1e3131ad7fd1538ef1b7a144be
> > - SHA1:496ff9dffbd6299d1efa0b1c788318fbb04c57fa [weak]
> > - MD5Sum:f162ade7affd9f8a5b8f358e1674f25f [weak]
> > - Filesize:116919496 [weak]
> > E: Failed to fetch
> >
> > https://download.cloudstack.org/ubuntu/dists/jammy/4.19/pool/cloudstack-management_4.19.0.1_all.deb
> >  File has unexpected size (1440658214 != 1440655316). Mirror sync in
> > progress? [IP: 195.181.167.51 443]
> >Hashes of expected file:
> > -
> >
> > SHA512:352a5133cc06b5ca05b097b9dce9e7d670ec89b7602729a9557f69876fe9f8dba568e0008065535c7f3daed4651a97deb18be1849e8bc64459784ba0ed9e20b3
> > -
> > SHA256:2f2216acda05088ec39c0157c09e0169fa9b5d30dbeb15cb074e743785f5a6ab
> > - SHA1:31a04c5f4b271d7bf4cb0919293b3df0fa27e4c1 [weak]
> > - MD5Sum:f8ce84b0b14e6ef64d235e78ee2a8af6 [weak]
> > - Filesize:1440655316 [weak]
> >
> > Kind regards
> >
> > --
> > *Francisco Arencibia Quesada.*
> > *DevOps Engineer*
> >
>
>
> --
> *Francisco Arencibia Quesada.*
> *DevOps Engineer*

Re: any qcow2 pfsense image public available?

[Wei ZHOU]

I have built some pfsense templates in the development of VNF integration.
Just follow the steps, you should be able to create pfsense templates in 30
minutes.

You can deploy VNF appliances with vnf nics in multiple VPC tiers.

-Wei

On Saturday, March 30, 2024, Ricardo Pertuz
 wrote:

> Thanks for your prompt reply, this tutorial allow deploy a pfsense vnf
> template into a VPC deployment? can I have with 3 tiers?
>
>
> Atte,
>
> Ricardo Pertuz
>
>
> On 30 Mar 2024 at 11:39 AM -0500, Jayanth Babu A 
> ,
> wrote:
> > Not sure if I know anyone who does it anymore. I still see that creating
> a template from ISO is a safe bet [1] though you mentioned that you'd want
> to skip them.
> >
> > [1] https://www.shapeblue.com/vnf-appliance-integration-deep-dive/
> >
> > Thanks,
> > Jayanth
> >
> >
> > 
> > From: Ricardo Pertuz 
> > Sent: Saturday, March 30, 2024 10:01:00 pm
> > To: users@cloudstack.apache.org 
> > Subject: any qcow2 pfsense image public available?
> >
> > Hi community
> >
> > Is there any qcow2 pfsense image for VNF public available to do a POC?
> We want to skip the ISO steps
> >
> > Regards!
> >
> >
> >
> > Ricardo Pertuz
> >
> >
> >
> > Disclaimer *** This e-mail contains PRIVILEGED AND CONFIDENTIAL
> INFORMATION intended solely for the use of the addressee(s). If you are not
> the intended recipient, please notify the sender by e-mail and delete the
> original message. Further, you are not authorised to copy, disclose, or
> distribute this e-mail or its contents to any other person and any such
> actions are unlawful and strictly prohibited. This e-mail may contain
> viruses. NxtGen Datacenter & Cloud Technologies Private Ltd ("NxtGen") has
> taken every reasonable precaution to minimize this risk but is not liable
> for any damage you may sustain as a result of any virus in this e-mail. You
> should carry out your own virus checks before opening the e-mail or
> attachment. NxtGen reserves the right to monitor and review the content of
> all messages sent to or from this e-mail address. Messages sent to or from
> this e-mail address may be stored on the NxtGen e-mail system. *** End of
> Disclaimer ***NXTGEN***
>

Re: some button labels not displaying correctly in the UI 4.19

[Wei ZHOU]

It seems like an issue with browser cache.
try incognito mode, or clean the browser cache.

-Wei

On Fri, Mar 29, 2024 at 5:55 PM Marcus Torres  wrote:
>
> Hi!
> First off i would like to tip my hat to everyone involved in the release of
> 4.19.0. The major new features and changes just put cloudstack over the top
> in terms of functionality and feature sets compared to competitive
> platforms. It's quite amazing.
>
> After ugpgrading to 4.19.0 (management server first, usage second,
> hypervisors third, then restart of all services), i noticed some of the new
> buttons in the UI display 'label.x' instead of a proper title ? or is it
> like that intentionally?
> For instance, drilling down to a cluster view, for the DRS tab it shows
> 'label.drs' and if i click that tab , the button to generate a plan is
> labeled 'label.drs.generate.plan' instead of 'Generate DRS Plan' as the
> release screenshots show. I'm seeing the same thing with label.bucks and
> label.object.storage.
>
> The buttons work, just a display issue it seems. I have screenshots if
> needeed

Re: Build own debs

[Wei ZHOU]

Hi Jimmy,

By default No. It is simple to build with vmware plugin

1. install dependencies locally (the .m2 directory is mounted to the
docker container).

git clone https://github.com/shapeblue/cloudstack-nonoss.git nonoss
cd nonoss && bash -x install-non-oss.sh && cd ..

2. add the following before build-deb.sh

export ACS_BUILD_OPTS='-Dnoredist -Dsystemvm-kvm -Dsystemvm-xen
-Dsystemvm-vmware'

it should work


-Wei

On Thu, Mar 28, 2024 at 4:19 PM Jimmy Huybrechts  wrote:
>
> Hi Wei,
>
> Would that be including the vmware plugins etc?
>
> --
> Jimmy
>
> Van: Wei ZHOU 
> Datum: donderdag, 28 maart 2024 om 14:18
> Aan: users@cloudstack.apache.org 
> Onderwerp: Re: Build own debs
> You can build packages in a docker image, for example for 4.18.1.0
>
> cd /tmp
> git clone -b 4.18.1.0 https://github.com/apache/cloudstack.git cloudstack
> docker run -ti \
> -v /tmp:/src \
> -v ~/.m2:/.m2/ \
> ubuntu:22.04 \
> /bin/bash -c "export DEBIAN_FRONTEND=noninteractive && apt-get update \
> && apt-get install -y dpkg-dev python2 python3 debhelper
> openjdk-11-jdk genisoimage python3-mysql.connector maven lsb-release
> devscripts python-setuptools python3-setuptools \
> && curl -sL https://deb.nodesource.com/setup_14.x | bash - \
> && apt-get install -y nodejs \
> && /src/cloudstack/packaging/build-deb.sh"
>
>
> -Wei
>
> On Thu, Mar 28, 2024 at 11:25 AM Jimmy Huybrechts  
> wrote:
> >
> > Hi,
> >
> > Is there maybe a more up to date version of the build your own debs? I see 
> > the one in the docs goes up to ubuntu 18 and java 8, while we are now at 
> > java 11. So I don’t know if the dependencies have changed and all.
> >
> > --
> > Jimmy

Re: Build own debs

[Wei ZHOU]

You can build packages in a docker image, for example for 4.18.1.0

cd /tmp
git clone -b 4.18.1.0 https://github.com/apache/cloudstack.git cloudstack
docker run -ti \
-v /tmp:/src \
-v ~/.m2:/.m2/ \
ubuntu:22.04 \
/bin/bash -c "export DEBIAN_FRONTEND=noninteractive && apt-get update \
&& apt-get install -y dpkg-dev python2 python3 debhelper
openjdk-11-jdk genisoimage python3-mysql.connector maven lsb-release
devscripts python-setuptools python3-setuptools \
&& curl -sL https://deb.nodesource.com/setup_14.x | bash - \
&& apt-get install -y nodejs \
&& /src/cloudstack/packaging/build-deb.sh"


-Wei

On Thu, Mar 28, 2024 at 11:25 AM Jimmy Huybrechts  wrote:
>
> Hi,
>
> Is there maybe a more up to date version of the build your own debs? I see 
> the one in the docs goes up to ubuntu 18 and java 8, while we are now at java 
> 11. So I don’t know if the dependencies have changed and all.
>
> --
> Jimmy

Re: [VOTE] Release Apache CloudStack CloudMonkey 6.4.0 - RC1

[Wei ZHOU]

+1 (binding)

Tested zone creation, vm and volume , CKS life cycles.

-Wei

On Thu, Mar 21, 2024 at 11:39 AM Rohit Yadav  wrote:
>
> Hi All,
>
> I've created a v6.4.0 release of CloudMonkey, with the following
> artifacts up for a vote:
>
> Git Branch and commit SHA:
> https://github.com/apache/cloudstack-cloudmonkey/commit/df65df7cfe331c5af5d39743717e3d58df921a48
>
> Commit:
> df65df7cfe331c5af5d39743717e3d58df921a48
>
> GitHub pre-release (contains changelog,
> artifacts/binaries to test, checksums/usage details):
> https://github.com/apache/cloudstack-cloudmonkey/releases/tag/6.4.0
>
> Source release (checksums and signatures are available at the same
> location):
> https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-6.4.0/
>
> PGP release keys (signed using 5ED1E1122DC5E8A4A45112C2484248210EE3D884)
> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
> The vote will be open until 27th March, 2024.
>
> For sanity in tallying the vote, can PMC members please be sure to
> indicate "(binding)" with their vote?
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove (and the reason why)
>
> Convenience binaries are available from here:
> https://github.com/apache/cloudstack-cloudmonkey/releases/tag/6.4.0
>
> Regards.

Re: Migrate migrated instance to another host

[Wei ZHOU]

Hi,

/var/log/cloudstack/management/management-server.log
please note the log file is rotated everyday.

-Wei

On Sat, Mar 23, 2024 at 9:34 AM Jimmy Huybrechts  wrote:
>
> Hi Wei,
>
> I can, if you tell me where to look as I couldn’t find anything on them in 
> the logs.
>
> --
> Jimmy
>
> Van: Wei ZHOU 
> Datum: vrijdag, 22 maart 2024 om 16:15
> Aan: users@cloudstack.apache.org 
> Onderwerp: Re: Migrate migrated instance to another host
> Can you share the logs of vm migration and vm import ?
>
>
> On Fri, Mar 22, 2024 at 3:55 PM Jimmy Huybrechts  wrote:
> >
> > I’ve migrated vm’s from a remote KVM host which worked fine and they run on 
> > Cloudstack now.
> >
> > However, I just tried migrating one from one cloudstack host to another, 
> > just like with instances made from a cloudstack host and it’s not moving 
> > but ending up with an error.
> >
> > This is displayed in the webgui:
> > Failed to migrate VM [VM instance 
> > {"id":109,"instanceName":"i-8-108-VM","type":"User","uuid":"2fbb0d84-7ea2-4092-aa5d-25a53eb3cda2"}]
> >  along with its volumes due to [java.lang.NullPointerException].
> >
> > Now I’m trying to see in what log the complete error would be but I’m 
> > coming up blank on which log I need.
> >
> > Instances created natively in Cloudstack are migrating just fine, it’s only 
> > the ones that came from the remote KVM host before.
> >
> > --
> > Jimmy

Re: Still struggling for steps to build pls help

[Wei ZHOU]

a. You do not need to configure it (nobody configures manually). Your
issue is unrelated to the beans. The bean errors are misleading.

b. Jetty, not tomcat

c. the default http port is 8080 in /etc/cloudstack/management/server.properties



-Wei


On Sat, Mar 23, 2024 at 7:59 AM Wingrunt Platform  wrote:
>
> Just a few more questions.
> a. You seem to have webApplicationContext.xml directive in your web.xml. Is
> this to be available somewhere ? IF so where should it be ? if we install
> directory apt install ?
> b. The run time is an app server which I believe is tomcat for CS 4.19 . Is
> this correct ?
> c. My understanding is that you have embedded this within your CS which
> opens port 8080. Right ?
>
> Thank you
> Best
> RSK
> [Opensource will never die, even if you stab a thousand times; or place a
> blue mirror to reflect the make believe sky]
>
>
>
> On Fri, Mar 22, 2024 at 5:54 PM Wingrunt Platform 
> wrote:
>
> > @Pearl d'Silva Thank you.
> > Yes Db host same as management server both pointing to localhost. Also
> > tried specifically pointing to  cloud management ip No luck
> > @Wei ZHOU  Thanks to you too.
> >
> > Thank you so much. Hopefully I will get there soon.
> >
> > Best
> > RSK
> >
> >
> > On Fri, Mar 22, 2024 at 8:45 AM Pearl d'Silva 
> > wrote:
> >
> >> Is your database running on the same server / host on which you are
> >> trying to deploy the CloudStack setup? Can you verify the values of :
> >> db.cloud.host - this should point to the DB host
> >> cluster.node.IP - should point to the Management server (or the proper
> >> loopback address)
> >>
> >> in the ./client/conf/db.properties.in file and rebuild the code if
> >> you've built and deployed CloudStack from source. If you've set it up using
> >> packages, verify the above mentioned values in
> >> /etc/cloudstack/management/db.properties and restart the Management server
> >> if anything is changed in the file.
> >>
> >> Regards,
> >>
> >>
> >>
> >> 
> >> From: Wingrunt Platform 
> >> Sent: March 21, 2024 4:06 PM
> >> To: users@cloudstack.apache.org 
> >> Subject: Re: Still struggling for steps to build pls help
> >>
> >> A friendly reminder. Racing against time :)
> >> Thank you so much.
> >> RSK
> >>
> >> On Wed, Mar 20, 2024 at 5:37 PM Wingrunt Platform 
> >> wrote:
> >>
> >> > Copied below - th management-server.log.
> >> > Looking forward to hearing from you.
> >> >
> >> >
> >> > 2024-03-20 17:17:18,407 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Trying to obtain module [nested-cloudstack]
> >> context.
> >> > 2024-03-20 17:17:18,407 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Trying to load module [nested-cloudstack] context.
> >> > 2024-03-20 17:17:18,407 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Loading module context [nested-cloudstack] from URL
> >> >
> >> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/nested-cloudstack/spring-nested-cloudstack-context.xml]
> >> > 2024-03-20 17:17:18,407 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Loading module context [nested-cloudstack] from URL
> >> >
> >> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/outofbandmanagement/spring-core-lifecycle-outofbandmanagement-context-inheritable.xml]
> >> > 2024-03-20 17:17:18,407 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Loading module context [nested-cloudstack] from URL
> >> >
> >> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/core/spring-core-lifecycle-core-context-inheritable.xml]
> >> > 2024-03-20 17:17:18,407 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Loading module context [nested-cloudstack] from URL
> >> >
> >> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-core-system-context-inheritable.xml]
> >> > 2024-03-20 17:17:18,407 INFO  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> >> > (main:null) (logid:) Loading module context [nested-cloudstack] from URL
> >> >
> >> [jar:file:/usr/s

Re: Still struggling for steps to build pls help

[Wei ZHOU]

>From my experience, the error is mostly caused by misconfigurations, like
Pearl said.
it is better to check the db.properties

Please also check if any "Exception" log before the bean errors.

-Wei


On Friday, March 22, 2024, Pearl d'Silva  wrote:

> Is your database running on the same server / host on which you are trying
> to deploy the CloudStack setup? Can you verify the values of :
> db.cloud.host - this should point to the DB host
> cluster.node.IP - should point to the Management server (or the proper
> loopback address)
>
> in the ./client/conf/db.properties.in file and rebuild the code if you've
> built and deployed CloudStack from source. If you've set it up using
> packages, verify the above mentioned values in
> /etc/cloudstack/management/db.properties and restart the Management
> server if anything is changed in the file.
>
> Regards,
>
>
>
> 
>
>

Re: Migrate migrated instance to another host

[Wei ZHOU]

Can you share the logs of vm migration and vm import ?


On Fri, Mar 22, 2024 at 3:55 PM Jimmy Huybrechts  wrote:
>
> I’ve migrated vm’s from a remote KVM host which worked fine and they run on 
> Cloudstack now.
>
> However, I just tried migrating one from one cloudstack host to another, just 
> like with instances made from a cloudstack host and it’s not moving but 
> ending up with an error.
>
> This is displayed in the webgui:
> Failed to migrate VM [VM instance 
> {"id":109,"instanceName":"i-8-108-VM","type":"User","uuid":"2fbb0d84-7ea2-4092-aa5d-25a53eb3cda2"}]
>  along with its volumes due to [java.lang.NullPointerException].
>
> Now I’m trying to see in what log the complete error would be but I’m coming 
> up blank on which log I need.
>
> Instances created natively in Cloudstack are migrating just fine, it’s only 
> the ones that came from the remote KVM host before.
>
> --
> Jimmy

Re: Still struggling for steps to build pls help

[Wei ZHOU]

You can refer to another page in the same repository As Pearl mentioned.

https://github.com/shapeblue/hackerbook/blob/main/2-dev.md#cloudstack-packaging

If you want to support VMware, please add "noredist" flag. The dependecies
need to be installed.

-Wei


On Wednesday, March 20, 2024, Wingrunt Platform  wrote:

> Any help with this please ? Documentation could be much better I think.
> Please let me know how to go about this. OR a source compile is currently
> not supported ? Thank you Regards, RSK
>
> On Tue, Mar 19, 2024 at 3:19 PM Wingrunt Platform 
> wrote:
>
> > Hi Team,
> > I am tasked with evaluation of cloudstack and others such as openstack. I
> > was able to get through with openstack but not cloudstack. I tried all
> that
> > is in README . My versions
> > a. cloudstack 4.19
> > b. Java (tried 1.8 as per readme and also Java 11 and 17)
> > c. It breaks at gmaven in package cloud-engine-schma
> > d. Changed it to gmavenplus as there is no support for gmaven as of now.
> > e. Groovy included in the pom
> > f. Maven version 3.6.3
> >
> > I was able to install mysql appropriate version specified in README and
> in
> > the online apache cloudstack docs. DBs are in good condition.
> > It wouldn't build successfully with
> > maven -P deps (This as per online somebody has said you have moved away
> > from this since 4.11 ?
> > also tried that in README including -DskipTests
> >
> > Any latest documents that can help me build. Any help appreciated.
> >
> > Thank you,
> > Regards,
> > RSK
> >
>

Re: cpuwithoverprovisioning incorrect

[Wei ZHOU]

global setting: configuration table
cluster setting: cluster_details table

-Wei


On Monday, March 18, 2024, Francisco Arencibia Quesada <
arencibia.franci...@gmail.com> wrote:

> I need to check if this is being set in the database, do you know what
> table is holding cpu.overprovisioning.factor values?
>
> Thanks in advance :)
>
>
> On Thu, Mar 14, 2024 at 1:40 PM Francisco Arencibia Quesada <
> arencibia.franci...@gmail.com> wrote:
>
> > it seems that in beta environment is not multiplying by 5
> >
> > On Thu, Mar 14, 2024 at 12:26 PM Wei ZHOU  wrote:
> >
> >> the issue is that cpunumber is wrong, not cpuwithoverprovisioning,
> right ?
> >>
> >> -Wei
> >>
> >> On Thu, Mar 14, 2024 at 12:15 PM Francisco Arencibia Quesada
> >>  wrote:
> >> >
> >> > This prod that is ok
> >> > 48*2993*5=718320
> >> >
> >> > CPUNUMBER | CPUSPEED | CPUWITHOVERPROVISIONING |
> >> > +---+--+-+
> >> > |48 | 2993 |718320.0 |
> >> >
> >> >
> >> >
> >> > beta environment is wrong
> >> > 120*2000*5=120
> >> > +---+--+---------+
> >> > | CPUNUMBER | CPUSPEED | CPUWITHOVERPROVISIONING |
> >> > +---+--+-+
> >> > |   120 | 2000 |  24 |
> >> >
> >> >
> >> > regards
> >> >
> >> >
> >> >
> >> > On Thu, Mar 14, 2024 at 11:57 AM Wei ZHOU 
> >> wrote:
> >> >
> >> > > then it seems correct
> >> > >
> >> > > 24 (cpu cores) * 2000 (cpu clock speed in mhz) * 5 (over
> provisioning
> >> > > factor) = 24 (cpuwithoverprovisioning)
> >> > >
> >> > >
> >> > > -Wei
> >> > >
> >> > >
> >> > > On Thu, Mar 14, 2024 at 11:52 AM Francisco Arencibia Quesada
> >> > >  wrote:
> >> > > >
> >> > > > yes 24 cores.
> >> > > >
> >> > > > On Thu, Mar 14, 2024 at 11:33 AM Wei ZHOU 
> >> wrote:
> >> > > >
> >> > >
> >> >
> >> >
> >> > --
> >> > *Francisco Arencibia Quesada.*
> >> > *DevOps Engineer*
> >>
> >
> >
> > --
> > *Francisco Arencibia Quesada.*
> > *DevOps Engineer*
> >
>
>
> --
> *Francisco Arencibia Quesada.*
> *DevOps Engineer*
>

Re: send keyboard commands via websocket

[Wei ZHOU]

It looks like the connection is not established.

Does the VNC client support websocket ? What websocket URL does the
VNC client connect to ?



-Wei

On Mon, Mar 18, 2024 at 1:35 PM  wrote:
>
> It does not matter which commands I am sending, I run into the same error.
>
> I created a small go program which uses github.com/mitchellh/go-vnc to 
> establish connection.
> I use this map for keyboard commands: 
> https://github.com/qemu/qemu/blob/master/ui/vnc_keysym.h
>
> Is there a working program out there which works and I can test with?
>
> Regards,
> Swen
>
>
> -Ursprüngliche Nachricht-
> Von: Wei ZHOU 
> Gesendet: Montag, 18. März 2024 12:43
> An: users@cloudstack.apache.org
> Betreff: Re: send keyboard commands via websocket
>
> What keyboard command do you use?
>
> -Wei
>
> On Mon, Mar 18, 2024 at 12:39 PM  wrote:
> >
> > Does anybody have any idea? When I try to do this I get this error:
> > no suitable auth schemes found. server supported: []byte{0x13}
> >
> > regards,
> > Swen
> >
> > -Ursprüngliche Nachricht-
> > Von: m...@swen.io 
> > Gesendet: Montag, 11. März 2024 12:34
> > An: users@cloudstack.apache.org
> > Betreff: send keyboard commands via websocket
> >
> > Hello,
> >
> > did somebody sucssefully send keyboard commands via websocket to noVNC?
> >
> > I create websocket connection data via api createConsoleEndpoint and I
> > am also able to connect via websocket client (Firefox Weasel) to it.
> >
> > I also see via tcpdump on the console proxy system vm incoming
> > traffic. But I was not able to send any keyboard commands via
> > websocket ton the VNC console.
> >
> > Does anybody know how to send keyboard commands via a websocket client
> > to the console of an instance?
> >
> >
> >
> > Regards,
> >
> > Swen
> >
> >
> >
>
>

Re: send keyboard commands via websocket

[Wei ZHOU]

What keyboard command do you use?

-Wei

On Mon, Mar 18, 2024 at 12:39 PM  wrote:
>
> Does anybody have any idea? When I try to do this I get this error:
> no suitable auth schemes found. server supported: []byte{0x13}
>
> regards,
> Swen
>
> -Ursprüngliche Nachricht-
> Von: m...@swen.io 
> Gesendet: Montag, 11. März 2024 12:34
> An: users@cloudstack.apache.org
> Betreff: send keyboard commands via websocket
>
> Hello,
>
> did somebody sucssefully send keyboard commands via websocket to noVNC?
>
> I create websocket connection data via api createConsoleEndpoint and I am
> also able to connect via websocket client (Firefox Weasel) to it.
>
> I also see via tcpdump on the console proxy system vm incoming traffic. But
> I was not able to send any keyboard commands via websocket ton the VNC
> console.
>
> Does anybody know how to send keyboard commands via a websocket client to
> the console of an instance?
>
>
>
> Regards,
>
> Swen
>
>
>

Re: cpuwithoverprovisioning incorrect

[Wei ZHOU]

the issue is that cpunumber is wrong, not cpuwithoverprovisioning, right ?

-Wei

On Thu, Mar 14, 2024 at 12:15 PM Francisco Arencibia Quesada
 wrote:
>
> This prod that is ok
> 48*2993*5=718320
>
> CPUNUMBER | CPUSPEED | CPUWITHOVERPROVISIONING |
> +---+--+-+
> |48 | 2993 |718320.0 |
>
>
>
> beta environment is wrong
> 120*2000*5=120
> +---+--+-+
> | CPUNUMBER | CPUSPEED | CPUWITHOVERPROVISIONING |
> +---+--+-+
> |   120 | 2000 |  24 |
>
>
> regards
>
>
>
> On Thu, Mar 14, 2024 at 11:57 AM Wei ZHOU  wrote:
>
> > then it seems correct
> >
> > 24 (cpu cores) * 2000 (cpu clock speed in mhz) * 5 (over provisioning
> > factor) = 24 (cpuwithoverprovisioning)
> >
> >
> > -Wei
> >
> >
> > On Thu, Mar 14, 2024 at 11:52 AM Francisco Arencibia Quesada
> >  wrote:
> > >
> > > yes 24 cores.
> > >
> > > On Thu, Mar 14, 2024 at 11:33 AM Wei ZHOU  wrote:
> > >
> >
>
>
> --
> *Francisco Arencibia Quesada.*
> *DevOps Engineer*

Re: cpuwithoverprovisioning incorrect

[Wei ZHOU]

then it seems correct

24 (cpu cores) * 2000 (cpu clock speed in mhz) * 5 (over provisioning
factor) = 24 (cpuwithoverprovisioning)


-Wei


On Thu, Mar 14, 2024 at 11:52 AM Francisco Arencibia Quesada
 wrote:
>
> yes 24 cores.
>
> On Thu, Mar 14, 2024 at 11:33 AM Wei ZHOU  wrote:
>

Re: cpuwithoverprovisioning incorrect

[Wei ZHOU]

It looks like cpunumber has already consider the cpu.overprovisioning.factor

How many cpu cores does the host have ? 24 ?

-Wei


On Thu, Mar 14, 2024 at 11:23 AM Francisco Arencibia Quesada
 wrote:
>
> hi wei,
> I have just checked and in both cases overprovisioning is 5.
>
> What else should I do?
> We have XCP-ng clusters running.
>
> Regards
>
> On Thu, Mar 14, 2024 at 11:16 AM Wei ZHOU  wrote:
>
> > "cpu.overprovisioning.factor" is a cluster-scope setting.
> > Can you please check both the global and cluster settings ?
> >
> > -Wei
> >
> > On Thu, Mar 14, 2024 at 11:08 AM Francisco Arencibia Quesada
> >  wrote:
> > >
> > > Good morning guys,
> > >  the value I'm having for cpuwithoverprovisioning is wrong, it should be
> > > multiplied by 5.
> > > I don't know if this is a bug in cloudstack 4.18.1 or what. Could you
> > > please guys, run the query in your cloudstack and send me the output? any
> > > version >=4.18.1
> > >
> > > *cloudmonkey list hosts
> > > filter=cpunumber,cpuspeed,name,cpuwithoverprovisioning*
> > >
> > >
> > > [root@localhost ~]# cloudmonkey list hosts
> > > filter=cpunumber,cpuspeed,name,cpuwithoverprovisioning
> > > count = 15
> > > host:
> > > +-+---+-+--+
> > > | cpuwithoverprovisioning | cpunumber |   name  | cpuspeed |
> > > +-+---+-+--+
> > > |  24 |120| srppdc5001 |   2000   |
> > > | |   |s-8618-VM|  |
> > > | |   |s-8619-VM|  |
> > > | |   |v-14498-VM   |  |
> > > | |   |v-14499-VM   |  |
> > > | |   |v-14501-VM   |  |
> > > | |   |s-14500-VM   |  |
> > > | |   |s-14502-VM   |  |
> > > | |   |s-14504-VM   |  |
> > > |  252000 |120|  SRPBOXVPDC3006 |   2100   |
> > > | |   |v-14522-VM   |  |
> > > | |   |s-14523-VM   |  |
> > > | |   |v-14416-VM   |  |
> > > | |   |s-14415-VM   |  |
> > > |  252000 |120| srppdc5007 |   2100   |
> > > +-+---+-+--+
> > >
> > > Thank you in advance.
> > > Kind Regards.
> > >
> > > --
> > > *Francisco Arencibia Quesada.*
> > > *DevOps Engineer*
> >
>
>
> --
> *Francisco Arencibia Quesada.*
> *DevOps Engineer*

Re: cpuwithoverprovisioning incorrect

[Wei ZHOU]

"cpu.overprovisioning.factor" is a cluster-scope setting.
Can you please check both the global and cluster settings ?

-Wei

On Thu, Mar 14, 2024 at 11:08 AM Francisco Arencibia Quesada
 wrote:
>
> Good morning guys,
>  the value I'm having for cpuwithoverprovisioning is wrong, it should be
> multiplied by 5.
> I don't know if this is a bug in cloudstack 4.18.1 or what. Could you
> please guys, run the query in your cloudstack and send me the output? any
> version >=4.18.1
>
> *cloudmonkey list hosts
> filter=cpunumber,cpuspeed,name,cpuwithoverprovisioning*
>
>
> [root@localhost ~]# cloudmonkey list hosts
> filter=cpunumber,cpuspeed,name,cpuwithoverprovisioning
> count = 15
> host:
> +-+---+-+--+
> | cpuwithoverprovisioning | cpunumber |   name  | cpuspeed |
> +-+---+-+--+
> |  24 |120| srppdc5001 |   2000   |
> | |   |s-8618-VM|  |
> | |   |s-8619-VM|  |
> | |   |v-14498-VM   |  |
> | |   |v-14499-VM   |  |
> | |   |v-14501-VM   |  |
> | |   |s-14500-VM   |  |
> | |   |s-14502-VM   |  |
> | |   |s-14504-VM   |  |
> |  252000 |120|  SRPBOXVPDC3006 |   2100   |
> | |   |v-14522-VM   |  |
> | |   |s-14523-VM   |  |
> | |   |v-14416-VM   |  |
> | |   |s-14415-VM   |  |
> |  252000 |120| srppdc5007 |   2100   |
> +-+---+-+--+
>
> Thank you in advance.
> Kind Regards.
>
> --
> *Francisco Arencibia Quesada.*
> *DevOps Engineer*

Re: CPU topology

[Wei ZHOU]

Hi,

Sorry the vm setting name is "cpucorepersocket", not "cpucorespersocket"


-Wei

On Tue, Mar 12, 2024 at 9:53 AM Gary Dixon 
wrote:

> Hi Wei
>
> I tried setting cpucorespersocket to 8 on a VM with 8vCPU but it has still
> put them across 2 sockets?
>
> Heres some of the xml output:
>
> 8388608
> 8
> 
> 264
> 
> ..
> 
> 
> 
> ...
>
> Any ideas what I am doing wrong?
>
> BR
>
> Gary
>
> Gary Dixon
> Quadris Cloud Manager
> +44 (0) 161 537 4980 <+44%20(0)%20161%20537%204980>
>  +44 (0) 7989 717661 <+44%20(0)%207989%20717661>
> gary.di...@quadris.co.uk
> www.quadris.com
> Innovation House, 12‑13 Bredbury Business Park
> Bredbury Park Way, Bredbury, Stockport, SK6 2SN
> -Original Message-
> From: Wei ZHOU 
> Sent: Monday, March 11, 2024 5:29 PM
> To: users@cloudstack.apache.org
> Subject: Re: CPU topology
>
> Stop the vm
> Add a vm setting cpucorespersocket
> Start the vm
>
> -Wei
>
>
> On Monday, March 11, 2024, Gary Dixon 
> wrote:
>
> >
> >
> > Meant to have stated here that our ACS version is 4.15.2 Hi
> >
> > ACS 4.1.2
> > KVM on Ubuntu 20.04
> > Hosts are Dell R7525 AMD EPYC dual socket 32 core CPU’s
> >
> > Is there a VM setting that can over-ride the CPU topology?
> >
> > It seems that when we have a VM with less than 8 vCPU – the domain xml
> > of a VM shows the CPU topology as a single socket.
> > However between 8 and 16 vCPU’s it shows the topology as having 2
> > sockets and 16 or more vCPUs shows 4 sockets.
> > I have tried using a VM setting of cpuSocket = 1on a VM with 8vCPU’s
> > but it is ignored and continues to use a topology with 2 sockets
> >
> > BR
> >
> > Gary
> >
> >
> > [cid:image161185.png@43BB5413.7EEF77E3]
> > Gary Dixon
> > Quadris Cloud Manager
> > [cid:image347717.png@8A941AE6.9AE8C0C0]
> > +44 (0) 161 537 4980
> > +44 (0) 7989 717661
> > [cid:image253845.png@DEB7B540.7BE6A036]
> > gary.di...@quadris.co.uk<mailto:gary.di...@quadris.co.uk>
> > [cid:image058514.png@B54F0EC3.D31BE611]
> > http://www.q/
> > uadris.com%2F=05%7C02%7CGary.Dixon%40quadris.co.uk%7Ca277409825e3
> > 4aaf0d0c08dc41f0e5ee%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C6384
> > 57750109219152%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2l
> > uMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C=YgDCwDD5fCOV9ZT
> > WmqURHVoTP9sNAsxyiqgtn%2FYaAtY%3D=0<https://eur01.safelinks.p/
> > rotection.outlook.com/?url=http%3A%2F%2Fwww.quadris.com%2F=05%7C0
> > 2%7CGary.Dixon%40quadris.co.uk%7Ca277409825e34aaf0d0c08dc41f0e5ee%7Cf1
> > d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C638457750109228420%7CUnknown%
> > 7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJX
> > VCI6Mn0%3D%7C0%7C%7C%7C=jOqpTPry%2FCm4zAUenX2SFUtrfzzt8WF3CgnDj%
> > 2FbM2B4%3D=0> [cid:image187233.png@747A4F03.8BAA600C]
> > Innovation House, 12‑13 Bredbury Business Park Bredbury Park Way,
> > Bredbury, Stockport, SK6 2SN
> >
> >
>

Re: CPU topology

[Wei ZHOU]

Stop the vm
Add a vm setting cpucorespersocket
Start the vm

-Wei


On Monday, March 11, 2024, Gary Dixon 
wrote:

>
>
> Meant to have stated here that our ACS version is 4.15.2
> Hi
>
> ACS 4.1.2
> KVM on Ubuntu 20.04
> Hosts are Dell R7525 AMD EPYC dual socket 32 core CPU’s
>
> Is there a VM setting that can over-ride the CPU topology?
>
> It seems that when we have a VM with less than 8 vCPU – the domain xml of
> a VM shows the CPU topology as a single socket.
> However between 8 and 16 vCPU’s it shows the topology as having 2 sockets
> and 16 or more vCPUs shows 4 sockets.
> I have tried using a VM setting of cpuSocket = 1on a VM with 8vCPU’s  but
> it is ignored and continues to use a topology with 2 sockets
>
> BR
>
> Gary
>
>
> [cid:image161185.png@43BB5413.7EEF77E3]
> Gary Dixon
> Quadris Cloud Manager
> [cid:image347717.png@8A941AE6.9AE8C0C0]
> +44 (0) 161 537 4980
>  +44 (0) 7989 717661
> [cid:image253845.png@DEB7B540.7BE6A036]
> gary.di...@quadris.co.uk
> [cid:image058514.png@B54F0EC3.D31BE611]
> www.quadris.com
> [cid:image187233.png@747A4F03.8BAA600C]
> Innovation House, 12‑13 Bredbury Business Park
> Bredbury Park Way, Bredbury, Stockport, SK6 2SN
>
>

Re: Advice about advanced zone with security groups

[Wei ZHOU]

For the shared networks with SG, the IPs should have public access.
similar as Public IPs in the advanced zone (without SG).

-Wei

On Mon, Mar 11, 2024 at 5:10 PM Tomas Leypold  wrote:
>
> Hi,
>
> I am new to CloudStack and am trying to create a POC. I am having a problem 
> with Core/Advanced with security groups enabled. With security groups 
> enabled, it seems that the system VM can't connect to the internet. I am 
> getting a "No route to host (Host unreachable)" message in the default 
> template, which I think is because there is no "Public traffic type" with 
> security groups. So, does the advanced zone with security groups work 
> differently than advanced without security groups? I couldn't find anything 
> in the docs, and all the tutorials I found are using advanced without 
> security groups which is working fine for me. Thanks!
>
> Regards,
> Tomas Leypold
>

Re: DDOS Attacks from my virtual Router

[Wei ZHOU]

oh, the first two rules should not exist


-Wei


On Mon, Mar 11, 2024 at 2:04 PM Wei ZHOU  wrote:

> Hi,
>
> The port 53 should be allowed for only the guest network
>
> root@r-4-VM:~# iptables-save |grep "port 53"
> -A INPUT -d 10.111.17.4/32 -i eth0 -p tcp -m tcp --dport 53 -j ACCEPT
> -A INPUT -d 10.111.17.4/32 -i eth0 -p udp -m udp --dport 53 -j ACCEPT
> -A INPUT -s 10.111.16.0/20 -i eth0 -p udp -m udp --dport 53 -j ACCEPT
> -A INPUT -s 10.111.16.0/20 -i eth0 -p tcp -m tcp --dport 53 -j ACCEPT
>
>
> -Wei
>
>
>

Re: DDOS Attacks from my virtual Router

[Wei ZHOU]

% confirm that *unassigned* IP addresses CANNOT reach the
> apache.org hosts via Nux tests. So its ONLY the assigned IPs that can do
> so.
>
> Please let me know what your thoughts are and anyway I need to go about
> this?
> On 3/11/24 12:09, Nux wrote:
>
> I have seen this in the past where port 53 was open on these public IPs on
> the VR and was indeed leading to amplification attack.
>
> It's super easy to verify, from some 3rd party IP that you know is not
> whitelisted anywhere in your firewall or cloudstack, run a host or dig
> command that unallocated IP. If it replies, there is a problem.
>
> dig @IP apache.org a
> host apache.org IP
>
>
>
> On 2024-03-11 07:43, Granwille Strauss wrote:
>
> Hi Guys
>
> I ended updating to 4.19 and updated all SystemVMs and routers
> accordingly. DC has just informed me again that there is amplified
> DDOS attacks originating from my virtual router and from an IP address
> that's assigned to no instance or systemvm but shows via UI its
> assigned.
>
> Any ideas what I can try to stop this?
> On 2/12/24 21:30, Wei ZHOU wrote:
>
> cloudstack 4.19.0.0 has been released recently, which contains a new
> systemvm template. You can upgrade.
>
> -Wei
>
> 在 2024年2月12日星期一，Granwille Strauss
>   写道：
>
> Update:
>
> So since I ran updates for dnsmasq in all system vms, the issue
> seems to
> be solved. Our DC hasn't complained again. So it seems the vm
> templates
> need an update?
> On 2/9/24 10:29, Jayanth Reddy wrote:
>
> Please capture on 53/UDP as most of the DNS stack uses UDP by
> default.
>
> I looked the screenshot, No NAME means that the IP hasn't
> undergone STATIC NAT to a VM, which is okay wherein perhaps there
> could be port forwards or Load Balancer instead. The VR should
> assign the IP on its interface if it is acquired in the network.
> If I may ask, how are you concluding that IPs are unassigned
> elsewhere, have you performed basic reachability tests? Your case
> could be one of the below
>
> 1. That IP could be SNAT for that network.
> 2. Or there was an assignment to one of the VMs previously as
> STATIC NAT and later released. Please check your events.
>
> Get Outlook for Android<https://aka.ms/AAb9ysg> <https://aka.ms/AAb9ysg>
> [1]
> <https://aka.ms/AAb9ysg> <https://aka.ms/AAb9ysg> [1]
>
> 
> From: Granwille Strauss  
>  
> Sent: Friday, February 9, 2024 1:40:05 pm
> To: users@cloudstack.apache.org 
> 
>  
> Cc: Jayanth Reddy 
> 
>  ; Wei ZHOU
>  
>  
> Subject: Re: DDOS Attacks from my virtual Router
>
> I run version 4.18.1.0  currently, oddly there was an update for
> dnsmasq so I applied them to all systemvms. I clean restarted the
> guest networks and so far everything seems to be running fine. If
> I pick up issues, I will destroy the routers so that cloudstack
> can recreate them again.
>
> In the meantime, I am running the tcpdump as recommended in the
> vritual router and will keep an eye on it, as mentioned there
> seems to be no movement on port 53 so far and I also asked the DC
> to provide an update on this after the changes I have applied.
>
> In any case, attached is a screenshot of the IP address that are
> allocated but zero VM associated, I checked all of them and these
> IPs show up no where. I have no loadbalancers, proxies nothing.
> Just simple setup, with two virtual routers, one SSVM and one
> Consolevm. The rest are VM instances. I am going to check the git
> url you provided and query the DB to see what these are.
>
> On 2/9/24 09:53, Jayanth Reddy wrote:
>
> Hi,
> Allocated means that it is assigned somewhere. You'll need to
> check the Public IP Address tab. Use the shared GH issue for
> exceptional case.
>
> The VR does bind only on the internal network. No, manually
> updating packages on VRs and System VMs might produce strange
> results. Please provision them again.
>
> Thanks
>
> Get Outlook for Android<https://aka.ms/AAb9ysg> <https://aka.ms/AAb9ysg>
> [1]
> <https://aka.ms/AAb9ysg> <https://aka.ms/AAb9ysg> [1]
> <https://aka.ms/AAb9ysg> <https://aka.ms/AAb9ysg> [1]
> <https://aka.ms/AAb9ysg> <https://aka.ms/AAb9ysg> [1]
>
> 
> From: Granwille Strauss  
>  
> <mailto:granwi...@namhost.com> 
>  
> Sent: Friday, February 9, 2024 1:10:32 pm
> To:
> users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
> 
>  
>  
>  
> <mailto:users@cloudstack.apache.org> 
>  
> Cc: Wei ZHOU  
>  
> <mailto:ustcweiz...@gmail.com> 
>  ;
> jayanthreddy5...@gmail.com<mailto:jayan

Re: DDOS Attacks from my virtual Router

[Wei ZHOU]

I remember it as well.
The issue should have been fixed many years ago. see
https://github.com/apache/cloudstack/pull/1663

-Wei

On Mon, Mar 11, 2024 at 11:09 AM Nux  wrote:
>
> I have seen this in the past where port 53 was open on these public IPs
> on the VR and was indeed leading to amplification attack.
>
> It's super easy to verify, from some 3rd party IP that you know is not
> whitelisted anywhere in your firewall or cloudstack, run a host or dig
> command that unallocated IP. If it replies, there is a problem.
>
> dig @IP apache.org a
> host apache.org IP
>
>
>

Re: CKS with K8s Offering N/w

[Wei ZHOU]

Hi,

If you access port 443 from other hosts (not controller), you need to
specify the listen address.
for example "--address 0.0.0.0"


-Wei

On Mon, Mar 11, 2024 at 10:35 AM Bharat Bhushan Saini
 wrote:
>
> Hi Wei,
>
>
>
> I fired below command,
>
> kubectl --kubeconfig kube.conf port-forward deployment/cloud 443:31009
>
>
>
> Just FYI, application uses a tls and it is also configured.
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
>
>
> From: Wei ZHOU 
> Date: Monday, 11 March 2024 at 1:18 PM
> To: users@cloudstack.apache.org 
> Subject: Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any 
> action, replying, clicking any link or opening any attachment.
>
>
> Hi,
>
> Can you please share the command you run ?
>
> -Wei
>
> On Mon, Mar 11, 2024 at 8:43 AM Bharat Bhushan Saini
>  wrote:
>
> > Hi Community,
> >
> >
> >
> > I understand that if I want to use CKS service then I have to pass VLAN in
> > my network. I am trying to achieve that.
> >
> >
> >
> > But in meanwhile time I expose the service as a nodeport to access the
> > dashboard of my application on shared network. It is accessible over the
> > IP(http) of control node but I want to access it through https. The service
> > was running on nodeport with 31009 port but over the https it shows
> >
> >
> >
> > *   Trying 10.x.x.185:31009...
> >
> > * Connected to k8scstack.internal.kloudspot.com (10.x.x.185) port 31009
> > (#0)
> >
> > * ALPN, offering h2
> >
> > * ALPN, offering http/1.1
> >
> > * successfully set certificate verify locations:
> >
> > *  CAfile: /etc/ssl/certs/ca-certificates.crt
> >
> > *  CApath: /etc/ssl/certs
> >
> > * TLSv1.3 (OUT), TLS handshake, Client hello (1):
> >
> > * error:1408F10B:SSL routines:ssl3_get_record:wrong version number
> >
> > * Closing connection 0
> >
> > curl: (35) error:1408F10B:SSL routines:ssl3_get_record:wrong version number
> >
> >
> >
> > After port forwarding for the particular service 443:31009, encountered
> > with the below error,
> >
> >
> >
> > *   Trying 10.1.10.185:443...
> >
> > * connect to 10.1.10.185 port 443 failed: Connection refused
> >
> > * Failed to connect to k8scstack.internal.kloudspot.com port 443:
> > Connection refused
> >
> > * Closing connection 0
> >
> > curl: (7) Failed to connect to k8scstack.internal.kloudspot.com port 443:
> > Connection refused
> >
> >
> >
> > Can anyone pls suggest to move forward for that.
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_2373681320]
> >
> >
> >
> > *From: *Jayanth Babu A 
> > *Date: *Friday, 1 March 2024 at 11:25 PM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: CKS with K8s Offering N/w
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > +1
> >
> > Bharat, see if you can start using the isolated network to get the full
> > experience of CKS. In shared network you should only rely on connecting to
> > node ports or have an external load balancer (outside of CloudStack)
> > balance the traffic to the node ports where any service like traefik runs.
> >
> > Thanks,
> > Jayanth
> >
> > 
> > From: Wei ZHOU 
> > Sent: Friday, March 1, 2024 11:20:09 pm
> > To: users@cloudstack.apache.org 
> > Subject: Re: CKS with K8s Offering N/w
> >
> > Hi,
> >
> > Just my 2 cents.
> >
> > If you use NodePort, you need to know which worker node the pod is runing
> > on. It is a problem if there are multiple nodes. To solve this problem,
> > LoadBalancer can be used. cloudstack creates a load balancing rule to the
> > NodePort of all worker nodes. So the service can be accessible no matter
> > where the pod is. However, this only works with Isolated networks, as
> > shared networks do not support Load Balancer.
> >
> > traefik may work for you, I did not look into it yet. Another way is as I
> > have suggested, use kubectl port-forward to access the services with
> > ClusterIP.
> >
> > -Wei
> >
> >
> > On Friday, March 1, 2024, Bharat Bhushan Saini
> >  

Re: DDOS Attacks from my virtual Router

[Wei ZHOU]

In my opinion, one of your VMs is compromised.

If you are able to access the hosts, you can check the statistics of
the virtual nics of the VMs in the network.

vmname=i-xx-yyy-VM
nics=$(virsh domiflist $vmname |awk '{print $1}' |grep vnet)
for nic in $nics;do
  virsh domifstat $vmname $nic |grep tx_bytes
done



-Wei

On Mon, Mar 11, 2024 at 8:44 AM Granwille Strauss  wrote:
>
> Hi Guys
>
> I ended updating to 4.19 and updated all SystemVMs and routers accordingly. 
> DC has just informed me again that there is amplified DDOS attacks 
> originating from my virtual router and from an IP address that's assigned to 
> no instance or systemvm but shows via UI its assigned.
>
> Any ideas what I can try to stop this?
>
>

Re: CKS with K8s Offering N/w

[Wei ZHOU]

Hi,

Can you please share the command you run ?

-Wei

On Mon, Mar 11, 2024 at 8:43 AM Bharat Bhushan Saini
 wrote:

> Hi Community,
>
>
>
> I understand that if I want to use CKS service then I have to pass VLAN in
> my network. I am trying to achieve that.
>
>
>
> But in meanwhile time I expose the service as a nodeport to access the
> dashboard of my application on shared network. It is accessible over the
> IP(http) of control node but I want to access it through https. The service
> was running on nodeport with 31009 port but over the https it shows
>
>
>
> *   Trying 10.x.x.185:31009...
>
> * Connected to k8scstack.internal.kloudspot.com (10.x.x.185) port 31009
> (#0)
>
> * ALPN, offering h2
>
> * ALPN, offering http/1.1
>
> * successfully set certificate verify locations:
>
> *  CAfile: /etc/ssl/certs/ca-certificates.crt
>
> *  CApath: /etc/ssl/certs
>
> * TLSv1.3 (OUT), TLS handshake, Client hello (1):
>
> * error:1408F10B:SSL routines:ssl3_get_record:wrong version number
>
> * Closing connection 0
>
> curl: (35) error:1408F10B:SSL routines:ssl3_get_record:wrong version number
>
>
>
> After port forwarding for the particular service 443:31009, encountered
> with the below error,
>
>
>
> *   Trying 10.1.10.185:443...
>
> * connect to 10.1.10.185 port 443 failed: Connection refused
>
> * Failed to connect to k8scstack.internal.kloudspot.com port 443:
> Connection refused
>
> * Closing connection 0
>
> curl: (7) Failed to connect to k8scstack.internal.kloudspot.com port 443:
> Connection refused
>
>
>
> Can anyone pls suggest to move forward for that.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2373681320]
>
>
>
> *From: *Jayanth Babu A 
> *Date: *Friday, 1 March 2024 at 11:25 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> +1
>
> Bharat, see if you can start using the isolated network to get the full
> experience of CKS. In shared network you should only rely on connecting to
> node ports or have an external load balancer (outside of CloudStack)
> balance the traffic to the node ports where any service like traefik runs.
>
> Thanks,
> Jayanth
>
> 
> From: Wei ZHOU 
> Sent: Friday, March 1, 2024 11:20:09 pm
> To: users@cloudstack.apache.org 
> Subject: Re: CKS with K8s Offering N/w
>
> Hi,
>
> Just my 2 cents.
>
> If you use NodePort, you need to know which worker node the pod is runing
> on. It is a problem if there are multiple nodes. To solve this problem,
> LoadBalancer can be used. cloudstack creates a load balancing rule to the
> NodePort of all worker nodes. So the service can be accessible no matter
> where the pod is. However, this only works with Isolated networks, as
> shared networks do not support Load Balancer.
>
> traefik may work for you, I did not look into it yet. Another way is as I
> have suggested, use kubectl port-forward to access the services with
> ClusterIP.
>
> -Wei
>
>
> On Friday, March 1, 2024, Bharat Bhushan Saini
>  wrote:
>
> > Hi Jayanth,
> >
> >
> >
> > Just as an query I want to know that when the cluster run on shared
> > network the traefik-ingress-controller is required to access the
> > application externally else nodeport defind is enough for that.
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_3414558938]
> >
> >
> >
> > *From: *Jayanth Babu A 
> > *Date: *Friday, 1 March 2024 at 9:09 PM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: CKS with K8s Offering N/w
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > Hi Bharat,
> >
> > I don't seem to understand your question. Would you please explain in
> more
> > detail?
> >
> > Thanks,
> > Jayanth
> >
> > 
> > From: Bharat Bhushan Saini 
> > Sent: Friday, March 1, 2024 3:15:18 pm
> > To: users@cloudstack.apache.org 
> > Subject: Re: CKS with K8s Offering N/w
> >
> > Hi Wei,
> >
> > In shared n/w the traefik ingress is needed or only nodeport is enough
> for
> > that!
> >
> > Thanks and Regards,
> > Bharat Saini
> 

Re: CSEUG - September, Germany

[Wei ZHOU]

Great!

Thanks Swen!

-Wei


On Tuesday, March 5, 2024, Ivet Petrova  wrote:

> Hi all,
>
> Will be Frankfurt. Swen from proIO is really excited to help us organise,
> so we have somebody on place to support, which is really cool.
>
> Best regards,
>
>
>
>
> On 1 Mar 2024, at 11:06, Wido den Hollander  wrote:
>
>
>
> Op 28/02/2024 om 16:29 schreef Ivet Petrova:
> Hi all,
> I would like to propose to organise the CSEUG next meeting on September
> 12th in Germany.
> I already had a few informal conversations with community members in
> Germany, who are willing to help.
> Do you all think the date is OK and we can meet there?
>
> Works for me on 12-09. Just wondering, Germany is big, which city are we
> looking at?
>
> Frankfurt? Berlin? München? Düsseldorf? :-)
>
> Wido
>
> I consider the usual formal of half day talks and will need 5-6 speakers
> on place.
> Best regards,
>
>
>

Re: Network Issue with Cluster

[Wei ZHOU]

If you use shared network, it is definitely a network issue, as Cloudstack
only provides dns/dhcp/userdata service for shared networks.

-Wei


On Friday, March 1, 2024, Bharat Bhushan Saini
 wrote:

> Hi Jayanth,
>
>
>
> As per my analysis, I think some latches has been with cloudstack. This is
> why because the IP on MS is working file but the IP which is allocated to
> the VM or cluster having issue. It is dropping the ICMP.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3250556292]
>
>
>
>
>

Re: CKS with K8s Offering N/w

[Wei ZHOU]

Hi,

Just my 2 cents.

If you use NodePort, you need to know which worker node the pod is runing
on. It is a problem if there are multiple nodes. To solve this problem,
LoadBalancer can be used. cloudstack creates a load balancing rule to the
NodePort of all worker nodes. So the service can be accessible no matter
where the pod is. However, this only works with Isolated networks, as
shared networks do not support Load Balancer.

traefik may work for you, I did not look into it yet. Another way is as I
have suggested, use kubectl port-forward to access the services with
ClusterIP.

-Wei


On Friday, March 1, 2024, Bharat Bhushan Saini
 wrote:

> Hi Jayanth,
>
>
>
> Just as an query I want to know that when the cluster run on shared
> network the traefik-ingress-controller is required to access the
> application externally else nodeport defind is enough for that.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3414558938]
>
>
>
> *From: *Jayanth Babu A 
> *Date: *Friday, 1 March 2024 at 9:09 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hi Bharat,
>
> I don't seem to understand your question. Would you please explain in more
> detail?
>
> Thanks,
> Jayanth
>
> 
> From: Bharat Bhushan Saini 
> Sent: Friday, March 1, 2024 3:15:18 pm
> To: users@cloudstack.apache.org 
> Subject: Re: CKS with K8s Offering N/w
>
> Hi Wei,
>
> In shared n/w the traefik ingress is needed or only nodeport is enough for
> that!
>
> Thanks and Regards,
> Bharat Saini
>
> [signature_1176335358]
>
> From: Wei ZHOU 
> Date: Friday, 1 March 2024 at 1:59 PM
> To: users@cloudstack.apache.org 
> Subject: Re: CKS with K8s Offering N/w
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hi Bharat,
>
> If you deploy a CKS cluster on an isolated network, please ensure the
> public Ips (which include the endpoint IP of the CKS cluster, and Load
> balancer IPs) are reachable from the management server.
> The management server configures the k8s nodes (controller/worker) via the
> port -222x of endpoint IP.
>
> If you deploy a CKS cluster on a shared network, Load balancer is not
> supported.
> If you create a K8s service with nodeport, you can access it by  IP>:.
> If clusterIP is used, to access the service, you need to run "kubectl
> port-forward" on the controller node.
>
>
> -Wei
>
>

Re: CKS with K8s Offering N/w

[Wei ZHOU]

Hi Bharat,

If you deploy a CKS cluster on an isolated network, please ensure the
public Ips (which include the endpoint IP of the CKS cluster, and Load
balancer IPs) are reachable from the management server.
The management server configures the k8s nodes (controller/worker) via the
port -222x of endpoint IP.

If you deploy a CKS cluster on a shared network, Load balancer is not
supported.
If you create a K8s service with nodeport, you can access it by :.
If clusterIP is used, to access the service, you need to run "kubectl
port-forward" on the controller node.


-Wei



On Fri, Mar 1, 2024 at 7:08 AM Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> I deployed cloudstack 4.18.1 on ubuntu 22.04 LTS on a standalone server
> with kvm,nfs consist.
>
>
>
> I already tested some vm’s on the cloudstack on a shared network with
> untagged vlan because what IP range I have that was bridged with the
> private n/w and natting is enabled on that. On shared n/w I am able to
> access internet but in isolated or L2 config it can’t.
>
>
>
> As per your suggestion, I tried with create default k8s n/w and also
> create a network which have the same config of default k8s n/w but I untag
> the vlan in that n/w. Both was not working.
>
> On shared n/w I a able to spawn the cluster and also able to login with
> key and also deploy an application but the containers was running on the
> Cluster IP.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2926674288]
>
>
>

Re: CKS with K8s Offering N/w

[Wei ZHOU]

Hi Bharat,

In my opinion, most of the CKS issues you have are caused by your network
configuration.

Please share more details of your environments, as much as possible.

-Wei

On Thu, Feb 29, 2024 at 5:45 PM Bharat Bhushan Saini
 wrote:

> Hi All,
>
>
>
> Now the cluster goes in error state. Please refer logs as below
>
>
>
> 2024-02-29 13:25:05,774 ERROR [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Failed to setup Kubernetes cluster : *kspot* in usable state as unable to
> access control node VMs of the cluster
>
> 2024-02-29 13:25:11,900 INFO  [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Detached Kubernetes binaries from VM : *kspot*-control-18df4d40038 in the
> Kubernetes cluster : *kspot*
>
> 2024-02-29 13:25:12,804 INFO  [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Detached Kubernetes binaries from VM : *kspot*-node-18df4d4562b in the
> Kubernetes cluster : *kspot*
>
> 2024-02-29 13:25:12,806 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-54:ctx-7e86c22d job-777) (logid:458f275d) Complete async
> job-777, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Failed
> to setup Kubernetes cluster : *kspot* in usable state as unable to access
> control node VMs of the cluster"}
>
> 2024-02-29 13:34:31,962 DEBUG [c.c.a.t.Request]
> (RouterStatusMonitor-1:ctx-6890fa84) (logid:7daaca79) Seq
> 10-2919458458442974958
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3007469423]
>
>
>
> *From: *Bharat Bhushan Saini 
> *Date: *Thursday, 29 February 2024 at 5:09 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
>
> Hi Wei,
>
>
>
> I truncate the mysql database table of kubernetes_cluster.
>
>
>
> Now the cluster is stucked in the starting state.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_17144652]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Thursday, 29 February 2024 at 4:52 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> The endpoint is automatically set by cloudstack, if the CKS cluster is
> created successfully.
>
> If the endpoint is empty, it means the CKS cluster is not setup well, you'd
> better remove it if it is not in use.
>
> -Wei
>
> On Thu, Feb 29, 2024 at 12:17 PM Bharat Bhushan Saini
>  wrote:
>
> > Hi Wei,
> >
> >
> >
> > Last record is empty but new one also having the same endpoint with alert
> > condition. Can I delete first the new cluster then empty the table,
> should
> > it work?
> >
> > If it is then how we will manage multiple cluster!
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_3652424534]
> >
> >
> >
> > *From: *Wei ZHOU 
> > *Date: *Thursday, 29 February 2024 at 4:34 PM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: CKS with K8s Offering N/w
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > Yes,
> >
> > They are the Kubernetes API server endpoint of CKS clusters.
> >
> > Is the endpoint of the last record empty ?
> >
> > -Wei
> >
> > On Thu, Feb 29, 2024 at 11:58 AM Bharat Bhushan Saini
> >  wrote:
> >
> > > Hi Wei,
> > >
> > >
> > >
> > > It show different IP instead of management
> > >
> > > mysql> select endpoint from kubernetes_cluster;
> > >
> > > +--+
> > >
> > > | endpoint |
> > >
> > > +--+
> > >
> > > | https://10.x.x.87:6443/  |
> > >
> > > | https://10.x.x.87:6443/  |
> > >
> > > | https://10.x.x.87:6443/  |
> > >
> > > | https://10.x.x.

Re: CKS with K8s Offering N/w

[Wei ZHOU]

The endpoint is automatically set by cloudstack, if the CKS cluster is
created successfully.

If the endpoint is empty, it means the CKS cluster is not setup well, you'd
better remove it if it is not in use.

-Wei

On Thu, Feb 29, 2024 at 12:17 PM Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> Last record is empty but new one also having the same endpoint with alert
> condition. Can I delete first the new cluster then empty the table, should
> it work?
>
> If it is then how we will manage multiple cluster!
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3652424534]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Thursday, 29 February 2024 at 4:34 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Yes,
>
> They are the Kubernetes API server endpoint of CKS clusters.
>
> Is the endpoint of the last record empty ?
>
> -Wei
>
> On Thu, Feb 29, 2024 at 11:58 AM Bharat Bhushan Saini
>  wrote:
>
> > Hi Wei,
> >
> >
> >
> > It show different IP instead of management
> >
> > mysql> select endpoint from kubernetes_cluster;
> >
> > +--+
> >
> > | endpoint |
> >
> > +--+
> >
> > | https://10.x.x.87:6443/  |
> >
> > | https://10.x.x.87:6443/  |
> >
> > | https://10.x.x.87:6443/  |
> >
> > | https://10.x.x.87:6443/  |
> >
> > |  |
> >
> > +--+
> >
> >
> >
> >
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_3154659082]
> >
> >
> >
> > *From: *Wei ZHOU 
> > *Date: *Thursday, 29 February 2024 at 4:15 PM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: CKS with K8s Offering N/w
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > It is not related to the endpoint.url in the global setting.
> >
> > The endpoint of the CKS cluster is invalid. You can check mysql by
> "select
> > endpoint from kubernetes_cluster;"
> > I guess your CKS cluster was not created successfully.
> >
> > -Wei
> >
> >
> >
> > On Thu, Feb 29, 2024 at 11:40 AM Bharat Bhushan Saini
> >  wrote:
> >
> > > Hi All,
> > >
> > >
> > >
> > > I started a cluster with Network offering by k8s. It shows API endpoint
> > > error as below
> > >
> > > 2024-02-29 10:25:13,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > (API-Job-Executor-38:ctx-f6f75d23 job-719) (logid:7e7e617f) Complete
> > async
> > > job-719, jobStatus: FAILED, resultCode: 530, result:
> > >
> >
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Kubernetes
> > > cluster : *kspot* has invalid API endpoint. Can not verify if cluster
> is
> > > in ready state"}
> > >
> > >
> > >
> > > The endpoint.url was set as
> > > https://cloudstack.inte.example.com:8443/client/api
> > >
> > >
> > >
> > > Thanks and Regards,
> > >
> > > Bharat Saini
> > >
> > >
> > >
> > > [image: signature_2879974955]
> > >
> > > --- Disclaimer: --
> > > This message and its contents are intended solely for the designated
> > > addressee and are proprietary to Kloudspot. The information in this
> email
> > > is meant exclusively for Kloudspot business use. Any use by individuals
> > > other than the addressee constitutes misuse and an infringement of
> > > Kloudspot's proprietary rights. If you are not the intended recipient,
> > > please return this email to the sender. Kloudspot cannot guarantee the
> > > security or error-free transmission of e-mail communications.
> Information
> > > could be intercepted, corrupted, lost, destroyed, arrive late or
> > > incomplete, or contain viruses. Therefore, Kloudspot shall not be
> liable
> > > for any issues arising from the transmission of this email.
> > >
>

Re: CKS with K8s Offering N/w

[Wei ZHOU]

Yes,

They are the Kubernetes API server endpoint of CKS clusters.

Is the endpoint of the last record empty ?

-Wei

On Thu, Feb 29, 2024 at 11:58 AM Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> It show different IP instead of management
>
> mysql> select endpoint from kubernetes_cluster;
>
> +--+
>
> | endpoint |
>
> +--+
>
> | https://10.x.x.87:6443/  |
>
> | https://10.x.x.87:6443/  |
>
> | https://10.x.x.87:6443/  |
>
> | https://10.x.x.87:6443/  |
>
> |  |
>
> +--+
>
>
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3154659082]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Thursday, 29 February 2024 at 4:15 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> It is not related to the endpoint.url in the global setting.
>
> The endpoint of the CKS cluster is invalid. You can check mysql by "select
> endpoint from kubernetes_cluster;"
> I guess your CKS cluster was not created successfully.
>
> -Wei
>
>
>
> On Thu, Feb 29, 2024 at 11:40 AM Bharat Bhushan Saini
>  wrote:
>
> > Hi All,
> >
> >
> >
> > I started a cluster with Network offering by k8s. It shows API endpoint
> > error as below
> >
> > 2024-02-29 10:25:13,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-38:ctx-f6f75d23 job-719) (logid:7e7e617f) Complete
> async
> > job-719, jobStatus: FAILED, resultCode: 530, result:
> >
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Kubernetes
> > cluster : *kspot* has invalid API endpoint. Can not verify if cluster is
> > in ready state"}
> >
> >
> >
> > The endpoint.url was set as
> > https://cloudstack.inte.example.com:8443/client/api
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_2879974955]
> >
> > --- Disclaimer: --
> > This message and its contents are intended solely for the designated
> > addressee and are proprietary to Kloudspot. The information in this email
> > is meant exclusively for Kloudspot business use. Any use by individuals
> > other than the addressee constitutes misuse and an infringement of
> > Kloudspot's proprietary rights. If you are not the intended recipient,
> > please return this email to the sender. Kloudspot cannot guarantee the
> > security or error-free transmission of e-mail communications. Information
> > could be intercepted, corrupted, lost, destroyed, arrive late or
> > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> > for any issues arising from the transmission of this email.
> >
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: Storage in avoid set

[Wei ZHOU]

oyAsIs":"false"}},"executeInSequence":"true","options":{},"options2":{},"wait":"0","bypassHostMaintenance":"false"}}]
> > } to 33622688187677 2024-02-27 11:24:04,451 DEBUG [c.c.a.t.Request]
> > (AgentManager-Handler-3:null) (logid:) Seq 1-7417428586279207196:
> > Processing: { Ans: , MgmtId: 187740248600989, via: 1, Ver: v1, Flags:
> 110,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":"false","details":"com.cloud.utils.exception.CloudRuntimeException:
> > *Catch Exception com.xensource.xenapi.Types$UuidInvalid :VDI getByUuid
> for
> > uuid: 44b911df-3138-414b-9604-e7254372ad9b failed due to The uuid you
> > supplied was invalid."*,"wait":"0","bypassHostMaintenance":"false"}}] }
> >
> >
> > On Thu, Feb 29, 2024 at 10:16 AM Slavka Peleva 
> > wrote:
> >
> > > Hi Alex,
> > >
> > > I'm unfamiliar with Xen, but can you check if the template
> > `44b911df-3138-414b-9604-e7254372ad9b`
> > > exists in your primary storage?  On every first deployment of a VM
> with a
> > > new template, CS copies the template from secondary storage to the
> > primary.
> > > The template may be missing on primary (for some reason) but CloudStack
> > > keeps the info for the record in the database and tries to create a
> > volume
> > > from it.
> > >
> > > Best regards,
> > > Slavka
> > >
> > > On Thu, Feb 29, 2024 at 8:49 AM Joan g  wrote:
> > >
> > >> Hi Wei,
> > >>
> > >> Storage also does not have any tags. Attaching logs
> > >>
> > >> Alex
> > >>
> > >> On Thu, Feb 29, 2024 at 12:09 AM Wei ZHOU 
> > wrote:
> > >>
> > >>> Hi Alex,
> > >>>
> > >>> The tags are the disk offering tags.
> > >>>
> > >>> Anyway , can you share the full log of the job ?
> > >>>
> > >>> -Wei
> > >>>
> > >>> On Wed, Feb 28, 2024 at 6:47 PM Alex Paul <
> alex.chris.jun...@gmail.com
> > >
> > >>> wrote:
> > >>>
> > >>> > Hi Wei,
> > >>> >
> > >>> > No tags are there. I think in logs also its not printing  to any
> > tags:
> > >>> >
> > >>> >
> > >>> > Found pools [[Pool[1|PreSetup]]] that match with tags [[]].
> > >>> >
> > >>> > The VM deployments were fine 2 days before. All in a sudden it
> > started
> > >>> > failing.
> > >>> >
> > >>> >
> > >>> > Alex
> > >>> >
> > >>> > On Wednesday, February 28, 2024, Wei ZHOU 
> > >>> wrote:
> > >>> >
> > >>> > > Agree.
> > >>> > >
> > >>> > > Please also check if the pool has any tags.
> > >>> > >
> > >>> > > -Wei
> > >>> > >
> > >>> > > On Wed, Feb 28, 2024 at 5:31 PM Slavka Peleva
> > >>> >  > >>> > > >
> > >>> > > wrote:
> > >>> > >
> > >>> > > > Hi Alex,
> > >>> > > >
> > >>> > > > Sorry for the question but is it possible that the cluster is
> > >>> > disabled? I
> > >>> > > > have faced a similar problem before while testing.
> > >>> > > >
> > >>> > > > Best regards,
> > >>> > > > Slavka
> > >>> > > >
> > >>> > > > On Wed, Feb 28, 2024 at 5:15 PM Alex Paul <
> > >>> alex.chris.jun...@gmail.com
> > >>> > >
> > >>> > > > wrote:
> > >>> > > >
> > >>> > > > > Hi Swen,
> > >>> > > > >
> > >>> > > > > Yes, only 3TB used out of 15TB and double checked the
> threshold
> > >>> is at
> > >>> > > > 85%.
> > >>> > > > > :(
> > >>> > > > >
> > >>> > > > > Alex
> > >>> > > > >
> > >>> > > > > On Wed, Feb 28, 2024 at 7:32 PM  wrote:
&

Re: CKS with K8s Offering N/w

[Wei ZHOU]

It is not related to the endpoint.url in the global setting.

The endpoint of the CKS cluster is invalid. You can check mysql by "select
endpoint from kubernetes_cluster;"
I guess your CKS cluster was not created successfully.

-Wei



On Thu, Feb 29, 2024 at 11:40 AM Bharat Bhushan Saini
 wrote:

> Hi All,
>
>
>
> I started a cluster with Network offering by k8s. It shows API endpoint
> error as below
>
> 2024-02-29 10:25:13,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-38:ctx-f6f75d23 job-719) (logid:7e7e617f) Complete async
> job-719, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Kubernetes
> cluster : *kspot* has invalid API endpoint. Can not verify if cluster is
> in ready state"}
>
>
>
> The endpoint.url was set as
> https://cloudstack.inte.example.com:8443/client/api
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2879974955]
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: Import from external host

[Wei ZHOU]

right, cloudsack-agent is not needed on the remote server.
However, cloudstack selects a host (already managed by cloudstack) to
connect to the libvirt daemon (listen on port 16509) of the remote server
to get all the vms.
You can search "GetRemoteVms" in the management server log.

-Wei

On Wed, Feb 28, 2024 at 7:08 PM Jimmy Huybrechts 
wrote:

> Hmm wait you need the cloudagent on the remote host as well? I would have
> expected that not be needed right?
> Which log should I look at? The management-server log? As I didn’t see
> anything in there except for what I did include.
>
> --
> Jimmy
>
> Van: Wei ZHOU 
> Datum: woensdag, 28 februari 2024 om 17:15
> Aan: users@cloudstack.apache.org 
> Onderwerp: Re: Import from external host
> Any exception in the log?
>
> I wonder if it is similar as
> https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570
>
> -Wei
>
> On Wednesday, February 28, 2024, Jimmy Huybrechts 
> wrote:
>
> > I’m trying to import vm’s from an external KVM host. I built a test KVM
> > host with 5 virtual machines of which 4 are on and one is off.
> > Libvirt is listening on tcp port 16509.
> >
> > When trying to fetch instances I get “Request failed. (530) Error while
> > listing remote Vms”
> >
> > As host I’m using the KVM host IP of course, and the user and password
> are
> > that of my root user. (opened root access for this case).
> >
> > Is there some log I can see as to why I get that error? On the
> > management-server log I only see:
> > [28/Feb/2024:16:00:09 +] "GET /client/api/?zoneid=00122c1c-
> > 89ae-4fbf-8424-e8619a787d39=1=10=
> >
> KVMHOSTIP=root=PASSWORDFORHOST=kvm=listVmsForImport=json
> > HTTP/1.1" 530 124
> >
> > --
> > Jimmy
> >
>

Re: Storage in avoid set

[Wei ZHOU]

Hi Alex,

The tags are the disk offering tags.

Anyway , can you share the full log of the job ?

-Wei

On Wed, Feb 28, 2024 at 6:47 PM Alex Paul 
wrote:

> Hi Wei,
>
> No tags are there. I think in logs also its not printing  to any tags:
>
>
> Found pools [[Pool[1|PreSetup]]] that match with tags [[]].
>
> The VM deployments were fine 2 days before. All in a sudden it started
> failing.
>
>
> Alex
>
> On Wednesday, February 28, 2024, Wei ZHOU  wrote:
>
> > Agree.
> >
> > Please also check if the pool has any tags.
> >
> > -Wei
> >
> > On Wed, Feb 28, 2024 at 5:31 PM Slavka Peleva
>  > >
> > wrote:
> >
> > > Hi Alex,
> > >
> > > Sorry for the question but is it possible that the cluster is
> disabled? I
> > > have faced a similar problem before while testing.
> > >
> > > Best regards,
> > > Slavka
> > >
> > > On Wed, Feb 28, 2024 at 5:15 PM Alex Paul  >
> > > wrote:
> > >
> > > > Hi Swen,
> > > >
> > > > Yes, only 3TB used out of 15TB and double checked the threshold is at
> > > 85%.
> > > > :(
> > > >
> > > > Alex
> > > >
> > > > On Wed, Feb 28, 2024 at 7:32 PM  wrote:
> > > >
> > > > > Hi Alex,
> > > > >
> > > > > is there enough free space on the storage? Check your thresholds in
> > > > global
> > > > > settings.
> > > > >
> > > > > Regards,
> > > > > Swen
> > > > >
> > > > > -Ursprüngliche Nachricht-
> > > > > Von: Alex Paul 
> > > > > Gesendet: Mittwoch, 28. Februar 2024 14:24
> > > > > An: users@cloudstack.apache.org
> > > > > Betreff: Storage in avoid set
> > > > >
> > > > > Hello Team,
> > > > >
> > > > > We've encountered an issue with our cloudstack setup on 3 XCP-ng
> > hosts.
> > > > > Suddenly, VM deployments are failing.
> > > > >
> > > > > Our configuration includes a primary storage of type 'presetup'
> using
> > > > HBA.
> > > > > Interestingly, the storage functions properly in the XEN cluster,
> > > > allowing
> > > > > us to deploy VMs directly in xen.
> > > > >
> > > > > However, in cloudstack, deployments are failing with the following
> > > logs:
> > > > > "StoragePool is in avoid set, skipping this pool."
> > > > >
> > > > > Could someone please provide guidance on why it's in the avoid set
> > and
> > > > how
> > > > > we can remove it from there?
> > > > >
> > > > > Full logs are provided below for reference.
> > > > >
> > > > >
> > > > > 024-02-27 11:24:04,879 DEBUG
> > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671
> > > > >  ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod
> [1]
> > > and
> > > > > cluster [1]. Disabled pools will be ignored.
> > > > > 2024-02-27 11:24:04,881 DEBUG
> > > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671
> > > > >  ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]]
> that
> > > > > match with tags [[]].
> > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.
> > AbstractStoragePoolAllocator]
> > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx
> > > > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable,
> > name:
> > > > > CLOUDSTACKVOL1 ,poolId: 1
> > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.
> > AbstractStoragePoolAllocator]
> > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool
> > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.
> > AbstractStoragePoolAllocator]
> > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0]
> > > > > suitable storage pools [[]].
> > > > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.
> > AbstractSt

Re: Storage in avoid set

[Wei ZHOU]

Agree.

Please also check if the pool has any tags.

-Wei

On Wed, Feb 28, 2024 at 5:31 PM Slavka Peleva 
wrote:

> Hi Alex,
>
> Sorry for the question but is it possible that the cluster is disabled? I
> have faced a similar problem before while testing.
>
> Best regards,
> Slavka
>
> On Wed, Feb 28, 2024 at 5:15 PM Alex Paul 
> wrote:
>
> > Hi Swen,
> >
> > Yes, only 3TB used out of 15TB and double checked the threshold is at
> 85%.
> > :(
> >
> > Alex
> >
> > On Wed, Feb 28, 2024 at 7:32 PM  wrote:
> >
> > > Hi Alex,
> > >
> > > is there enough free space on the storage? Check your thresholds in
> > global
> > > settings.
> > >
> > > Regards,
> > > Swen
> > >
> > > -Ursprüngliche Nachricht-
> > > Von: Alex Paul 
> > > Gesendet: Mittwoch, 28. Februar 2024 14:24
> > > An: users@cloudstack.apache.org
> > > Betreff: Storage in avoid set
> > >
> > > Hello Team,
> > >
> > > We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts.
> > > Suddenly, VM deployments are failing.
> > >
> > > Our configuration includes a primary storage of type 'presetup' using
> > HBA.
> > > Interestingly, the storage functions properly in the XEN cluster,
> > allowing
> > > us to deploy VMs directly in xen.
> > >
> > > However, in cloudstack, deployments are failing with the following
> logs:
> > > "StoragePool is in avoid set, skipping this pool."
> > >
> > > Could someone please provide guidance on why it's in the avoid set and
> > how
> > > we can remove it from there?
> > >
> > > Full logs are provided below for reference.
> > >
> > >
> > > 024-02-27 11:24:04,879 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671
> > >  ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1]
> and
> > > cluster [1]. Disabled pools will be ignored.
> > > 2024-02-27 11:24:04,881 DEBUG
> > [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671
> > >  ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that
> > > match with tags [[]].
> > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx
> > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name:
> > > CLOUDSTACKVOL1 ,poolId: 1
> > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool
> > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0]
> > > suitable storage pools [[]].
> > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable
> > > storage pools [[]].
> > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) No suitable pools found for volume:
> > > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1
> > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) No suitable pools found
> > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) No suitable storagePools found under this Cluster: 1
> > > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) Could not find suitable Deployment Destination for
> this
> > > VM under any clusters, returning.
> > > 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) Searching all possible resources under this Zone: 1
> > > 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) Listing clusters in order of aggregate capacity, that
> > > have (at least one host with) enough CPU and RAM capacity under this
> > Zone: 1
> > > 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) Removing from the clusterId list these clusters from
> > avoid
> > > set: [1]
> > > 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner]
> > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21)
> > > (logid:97976fdd) No clusters found after removing disabled clusters and
> > > clusters 

Re: Import from external host

[Wei ZHOU]

Any exception in the log?

I wonder if it is similar as
https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570

-Wei

On Wednesday, February 28, 2024, Jimmy Huybrechts 
wrote:

> I’m trying to import vm’s from an external KVM host. I built a test KVM
> host with 5 virtual machines of which 4 are on and one is off.
> Libvirt is listening on tcp port 16509.
>
> When trying to fetch instances I get “Request failed. (530) Error while
> listing remote Vms”
>
> As host I’m using the KVM host IP of course, and the user and password are
> that of my root user. (opened root access for this case).
>
> Is there some log I can see as to why I get that error? On the
> management-server log I only see:
> [28/Feb/2024:16:00:09 +] "GET /client/api/?zoneid=00122c1c-
> 89ae-4fbf-8424-e8619a787d39=1=10=
> KVMHOSTIP=root=PASSWORDFORHOST=kvm=listVmsForImport=json
> HTTP/1.1" 530 124
>
> --
> Jimmy
>

Re: CKS Storage Provisioner Info

[Wei ZHOU]

Hi,

Are you using a Shared network ? If yes, it will not work

-Wei

On Wed, Feb 28, 2024 at 11:17 AM Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> Just to inform you that I am able to ping management ip from a pod which I
> deployed for testing.
>
> Please refer below logs
>
>
>
> ping 10.x.xx.101
>
> PING 10.x.xx.101 (10.x.xx.101) 56(84) bytes of data.
>
> 64 bytes from 10.x.xx.101: icmp_seq=1 ttl=63 time=0.430 ms
>
> 64 bytes from 10.x.xx.101: icmp_seq=2 ttl=63 time=0.420 ms
>
> ^C
>
> --- 10.x.xx.101 ping statistics ---
>
> 2 packets transmitted, 2 received, 0% packet loss, time 1014ms
>
> rtt min/avg/max/mdev = 0.420/0.425/0.430/0.005 ms
>
>
>
> Also I done some more changes now the error was some different. Please
> have a look below
>
>
>
> Error syncing load balancer: failed to ensure load balancer: error
> associating new IP address: CloudStack API error 431 (CSExceptionErrorCode:
> 4350): Associate IP address can only be called on the shared networks in
> the advanced zone with Firewall/Source Nat/Static Nat/Port Forwarding/Load
> balancing services enabled
>
>
>
> @Jayanth,@Vivek, please have a look on that.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_1434537425]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Wednesday, 28 February 2024 at 1:21 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS Storage Provisioner Info
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hi,
>
> The CloudStack management server must be accessible from the pod
> "cloud-controller-manager" in the CKS cluster.
>
> It looks like the issue is caused by your network configuration, not
> CloudStack.
>
> -Wei
>
> On Wed, Feb 28, 2024 at 7:19 AM Bharat Bhushan Saini
>  wrote:
>
> > Hi Kiran,
> >
> >
> >
> > I used a private ip range which is bridged in my internal organisation
> > network.
> >
> >
> >
> > JUST FYI, I also tested a simple deployment but it is also didn’t took
> > external ip.
> >
> >
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: CKS Storage Provisioner Info

[Wei ZHOU]

Hi,

The CloudStack management server must be accessible from the pod
"cloud-controller-manager" in the CKS cluster.

It looks like the issue is caused by your network configuration, not
CloudStack.

-Wei

On Wed, Feb 28, 2024 at 7:19 AM Bharat Bhushan Saini
 wrote:

> Hi Kiran,
>
>
>
> I used a private ip range which is bridged in my internal organisation
> network.
>
>
>
> JUST FYI, I also tested a simple deployment but it is also didn’t took
> external ip.
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>

Re: delete old SystemVM Templates

[Wei ZHOU]

No, you are free to remove any template which is not used any more.
for SYSTEM templates, there is a check to guard the templates to be removed
by mistake. so you need to change the type to USER then remove it.

-Wei

On Tue, Feb 27, 2024 at 5:04 PM  wrote:

> Thx! Is there any reason to keep old templates when no instance is using
> it anymore?
>
> -Ursprüngliche Nachricht-----
> Von: Wei ZHOU 
> Gesendet: Dienstag, 27. Februar 2024 16:58
> An: users@cloudstack.apache.org
> Betreff: Re: delete old SystemVM Templates
>
> if it is not needed, of course you can remove it
> - update template type to USER
> - delete the template from zones
>
>
> -Wei
>
> On Tue, Feb 27, 2024 at 4:56 PM  wrote:
>
> > Hello,
> >
> > is it possible to delete old, not used anymore, SystemVM Templates via
> UI?
> > And does it make sense to delete them?
> >
> > After upgrading from 4.18.1.0 to 4.19.0.0 we do have 2 systemvm
> > templates registered (as expected) in our CS. The first one is called
> > "SystemVM Template (KVM)" and the other one is called
> "systemvm-kvm-4.19.0".
> >
> > router.template.kvm points to the new systemvm-kvm-4.19.0 one.
> > SystemVM Template (KVM) is not being used by any instance and/or
> > router. When I try to delete it via UI, I get: "Error The DomR
> > template cannot be deleted." I did not try to force it.
> >
> > Should you cleaup your templates or do you just leave it there?
> >
> >
> >
> > Regards,
> >
> > Swen
> >
> >
>
>
>

Re: delete old SystemVM Templates

[Wei ZHOU]

if it is not needed, of course you can remove it
- update template type to USER
- delete the template from zones


-Wei

On Tue, Feb 27, 2024 at 4:56 PM  wrote:

> Hello,
>
> is it possible to delete old, not used anymore, SystemVM Templates via UI?
> And does it make sense to delete them?
>
> After upgrading from 4.18.1.0 to 4.19.0.0 we do have 2 systemvm templates
> registered (as expected) in our CS. The first one is called "SystemVM
> Template (KVM)" and the other one is called "systemvm-kvm-4.19.0".
>
> router.template.kvm points to the new systemvm-kvm-4.19.0 one. SystemVM
> Template (KVM) is not being used by any instance and/or router. When I try
> to delete it via UI, I get: "Error The DomR template cannot be deleted." I
> did not try to force it.
>
> Should you cleaup your templates or do you just leave it there?
>
>
>
> Regards,
>
> Swen
>
>

Re: Advice Needed: Connecting VPCs Across Different Account

[Wei ZHOU]

private gateways with the same vlan is better.
However, you need an admin user to configure the private gateways.

-Wei

On Tue, Feb 27, 2024 at 2:09 PM Palash Biswas  wrote:

> Hi everyone,
>
> I'm seeking advice on the best method to connect VPCs across different
> accounts. Should I use a private gateway or a site-to-site VPN?
>
> I have two accounts and want to establish communication between the VPC in
> Account A and the VPC in Account B.
>
> Thanks,
> Palash Biswas
>

Re: How to create one network per project using as few public addresses as possible?

[Wei ZHOU]

Unfortunately vpc source NAT IP cannot be used by any vpc tiers for any
purposes (load balance or port FORWARDING, Static NAT).
You need to acquire a new public IP.

-Wei


On Monday, February 26, 2024, Jorge Luiz Correa
 wrote:

> Returning to this topic with the 4.19 release,  I can create a domain VPC
> and tiers in each project connected to this domain VPC. Each tier has its
> ACL rules. This is ok to filter Egress traffic, for example.  But, I
> couldn't find a way to configure port forward in VPC (Ingress). Is there in
> GUI?
>
> For example, in Networks > Public IP addresses -> choose any isolated
> network. I can see options like "Details, Firewall, Port forwarding, Load
> balancing, VPN, Events, Comments".
>
> When a tier is created its public IP is also listed in Networks > Public IP
> addresses. But, when I click on the public IP address from the VPC the
> options are only "Details, VPN".
>
> How can I configure ingress options, as port forwarding? For example, I
> need to forward ports 80 and 443 to a specific VM in some tier.
>
> Thank you!
>
>
> Em qua., 29 de nov. de 2023 às 14:50, Jorge Luiz Correa <
> jorge.l.cor...@embrapa.br> escreveu:
>
> > Hi Gabriel! This is exactly what I was looking for. I couldn't find this
> > request in github when looking for something. Thank you for sharing.
> >
> > No problem in creating through the API. So, I'll wait for the test
> > results. If you could share with us, I would appreciate. And thank you so
> > much for these tests!
> >
> > :)
> >
> > Em qua., 29 de nov. de 2023 às 10:01, Gabriel Ortiga Fernandes <
> > gabriel.ort...@hotmail.com> escreveu:
> >
> >> Hello Jorge,
> >>
> >> A soon as release 4.19 is launched, the feature of Domain VPCs(
> >> https://github.com/apache/cloudstack/pull/7153) will be available,
> which
> >> will allow users and operators to create tiers to VPCs for any account
> (or
> >> in your case project) to which the VPC owner has access, regardless of
> >> domain, thus, allowing all the projects to share a single VR.
> >>
> >> For now, this feature is not available in the GUI; however, you can
> >> create a tier through the API 'createNetwork', informing both the
> projectId
> >> and vpcId.
> >>
> >> This feature has been tested using accounts, but not projects, so I will
> >> run some tests in the next few days and give you an answer regarding its
> >> viability.
> >>
> >> Kind regards,
> >>
> >> GaOrtiga
> >>
> >> PS: This email will probably be a duplicate since I tried sending it
> >> through a different provider, but it took too long, so I am sending this
> >> again to save time.
> >>
> >
>
> --
> __
> Aviso de confidencialidade
>
> Esta mensagem da
> Empresa  Brasileira de Pesquisa  Agropecuaria (Embrapa), empresa publica
> federal  regida pelo disposto  na Lei Federal no. 5.851,  de 7 de dezembro
> de 1972,  e  enviada exclusivamente  a seu destinatario e pode conter
> informacoes  confidenciais, protegidas  por sigilo profissional.  Sua
> utilizacao desautorizada  e ilegal e  sujeita o infrator as penas da lei.
> Se voce  a recebeu indevidamente, queira, por gentileza, reenvia-la ao
> emitente, esclarecendo o equivoco.
>
> Confidentiality note
>
> This message from
> Empresa  Brasileira de Pesquisa  Agropecuaria (Embrapa), a government
> company  established under  Brazilian law (5.851/72), is directed
> exclusively to  its addressee  and may contain confidential data,
> protected under  professional secrecy  rules. Its unauthorized  use is
> illegal and  may subject the transgressor to the law's penalties. If you
> are not the addressee, please send it back, elucidating the failure.
>

Re: Cloudstack 4.19 / Ubuntu 22.04 fresh install fails

[Wei ZHOU]

Can you check if there are SQLException in the log ?

-Wei

On Mon, Feb 26, 2024 at 2:45 PM Ishan Talathi  wrote:

> Hello,
>
> Setup is as follows -
>
> Ubuntu 22.04 fresh VM
> Cloudstack 4.19
> MySQL 8 ( same node as management )
>
> After deploying, cloudstack-management fails to start with recurring errors
> like below -
>
>
> 2024-02-26 13:28:52,565 WARN  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Failed to start module [vmware-storage] due to: [Error
> creating bean with name
> 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0'
> defined in URL
>
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]:
> Cannot resolve reference to bean 'DefaultConfigResources' while setting
> bean property 'locations'; nested exception is
> org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean
> named 'DefaultConfigResources' available].
> 2024-02-26 13:28:52,566 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) module start failure of module [vmware-storage] was
> due to:
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name
> 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0'
> defined in URL
>
> [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]:
> Cannot resolve reference to bean 'DefaultConfigResources' while setting
> bean property 'locations'; nested exception is
> org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean
> named 'DefaultConfigResources' available
> at
>
> org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:342)
> at
>
> org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:113)
> at
>
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1707)
> at
>
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1452)
> at
>
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
> at
>
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
> at
>
> org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
> at
>
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
> at
>
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
> at
>
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:213)
> at
>
> org.springframework.context.support.PostProcessorRegistrationDelegate.invokeBeanFactoryPostProcessors(PostProcessorRegistrationDelegate.java:171)
> at
>
> org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:748)
> at
>
> org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:564)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:171)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:140)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:271)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:276)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:276)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:276)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:276)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:276)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:259)
> at
>
> org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:128)
> at
>
> 

Re: new committer: Vishesh Jindal (vishesh)

[Wei ZHOU]

Congratulations Vishesh!



On Monday, February 26, 2024, Daan Hoogland  wrote:

> users and devs,
>
> The Project Management Committee (PMC) for Apache CloudStack
> has invited Vishesh Jindal to become a committer and we are pleased
> to announce that they have accepted.
>
> Being a committer enables easier contribution to the
> project since there is no need to go via the patch
> submission process. This should enable better productivity.
>
> Please join me in congratulating Vishesh.
>
> --
> on behalf of the PMC, Daan
>

Re: Failed to decrypt DB password from db.properties

[Wei ZHOU]

Can you test the decryption manually?
Refer to
https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=235837182#NewdatabaseencryptioncipherAeadBase64Encryptor-6.1Usage

-Wei

On Sunday, February 25, 2024, steve savio 
wrote:

> /etc/cloudstack/management/key contains the secret key so I'm not
> comfortable sharing the contents.
> But below are the contents of /etc/cloudstack/management/db.properties
> with the encrypted secret and password values redacted.
>
>
> cluster.node.IP=127.0.1.1
> cluster.servlet.port=9090
> region.id=1
>
> # CloudStack database settings
> db.cloud.username=cloud
> db.cloud.password=ENC([REDACTED])
> db.cloud.host=localhost
> db.cloud.driver=jdbc:mysql
> db.cloud.port=3306
> db.cloud.name=cloud
>
> # Connection URI to the database "cloud". When this property is set, only
> the following properties will be used along with it: db.cloud.maxActive,
> db.cloud.maxIdle, db.cloud.maxWait, db.cloud.username, db.cloud.password,
> db.cloud.driver, db.cloud.validationQuery, db.cloud.isolation.level. Other
> properties will be ignored.
> db.cloud.uri=
>
>
> # CloudStack database tuning parameters
> db.cloud.maxActive=250
> db.cloud.maxIdle=30
> db.cloud.maxWait=1
> db.cloud.validationQuery=SELECT 1
> db.cloud.testOnBorrow=true
> db.cloud.testWhileIdle=true
> db.cloud.timeBetweenEvictionRunsMillis=4
> db.cloud.minEvictableIdleTimeMillis=24
> db.cloud.poolPreparedStatements=false
> db.cloud.url.params=prepStmtCacheSize=517=true&
> sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_
> IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&
> serverTimezone=UTC
>
> # CloudStack database SSL settings
> db.cloud.useSSL=false
> db.cloud.keyStore=
> db.cloud.keyStorePassword=
> db.cloud.trustStore=
> db.cloud.trustStorePassword=
>
> # Encryption Settings
> db.cloud.encryption.type=file
> db.cloud.encrypt.secret=ENC([REDACTED])
> db.cloud.encryptor.version=V2
>
> # usage database settings
> db.usage.username=cloud
> db.usage.password=ENC([REDACTED])
> db.usage.host=localhost
> db.usage.driver=jdbc:mysql
> db.usage.port=3306
> db.usage.name=cloud_usage
>
> # Connection URI to the database "usage". When this property is set, only
> the following properties will be used along with it: db.usage.maxActive,
> db.cloud.maxIdle, db.cloud.maxWait, db.usage.username, db.usage.password,
> db.usage.driver, db.usage.validationQuery, db.usage.isolation.level. Other
> properties will be ignored.
> db.usage.uri=
>
>
> # usage database tuning parameters
> db.usage.maxActive=100
> db.usage.maxIdle=30
> db.usage.maxWait=1
> db.usage.url.params=serverTimezone=UTC
>
> # Simulator database settings
> db.simulator.username=cloud
> db.simulator.password=cloud
> db.simulator.host=localhost
> db.simulator.driver=jdbc:mysql
> db.simulator.port=3306
> db.simulator.name=simulator
> db.simulator.maxActive=250
> db.simulator.maxIdle=30
> db.simulator.maxWait=1
> db.simulator.autoReconnect=true
>
> # Connection URI to the database "simulator". When this property is set,
> only the following properties will be used along with it:
> db.simulator.host, db.simulator.port, db.simulator.name,
> db.simulator.autoReconnect. Other properties will be ignored.
> db.simulator.uri=
>
>
> # High Availability And Cluster Properties
> db.ha.enabled=false
> db.ha.loadBalanceStrategy=com.cloud.utils.db.StaticStrategy
> # cloud stack Database
> db.cloud.replicas=localhost,localhost
> db.cloud.autoReconnect=true
> db.cloud.failOverReadOnly=false
> db.cloud.reconnectAtTxEnd=true
> db.cloud.autoReconnectForPools=true
> db.cloud.secondsBeforeRetrySource=3600
> db.cloud.queriesBeforeRetrySource=5000
> db.cloud.initialTimeout=3600
>
> #usage Database
> db.usage.replicas=localhost,localhost
> db.usage.autoReconnect=true
> db.usage.failOverReadOnly=false
> db.usage.reconnectAtTxEnd=true
> db.usage.autoReconnectForPools=true
> db.usage.secondsBeforeRetrySource=3600
> db.usage.queriesBeforeRetrySource=5000
> db.usage.initialTimeout=3600
>
> On Sun, 25 Feb 2024 at 23:23, Wei ZHOU  wrote:
>
> > Can you share the content of files "key" and "db.properties" in
> > /etc/cloudstack/management ?
> >
> > -Wei
> >
> > On Sun, Feb 25, 2024 at 8:12 PM steve savio  >
> > wrote:
> >
> > > Hello,
> > >
> > > I'm looking to try out CloudStack and have been following the guide on
> > > getting a single node setup going at
> > >
> > >
> > https://docs.cloudstack.apache.org/en/latest/installguide/management-

Re: Failed to decrypt DB password from db.properties

[Wei ZHOU]

Can you share the content of files "key" and "db.properties" in
/etc/cloudstack/management ?

-Wei

On Sun, Feb 25, 2024 at 8:12 PM steve savio 
wrote:

> Hello,
>
> I'm looking to try out CloudStack and have been following the guide on
> getting a single node setup going at
>
> https://docs.cloudstack.apache.org/en/latest/installguide/management-server/index.html
> .
>
> But I've run into an issue while trying to set up the system VM template -
> the
>
> https://docs.cloudstack.apache.org/en/latest/installguide/management-server/index.html#prepare-the-system-vm-template
>
> I run
>
>  sudo
>
> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt
> -m /mnt/secondary -u
>
> http://download.cloudstack.org/systemvm/4.19/systemvmtemplate-4.19.0-kvm.qcow2.bz2
> -h
> 
> kvm -F
>
> and get a couple of warnings related to log4j and protobuf and then a
> failure message
>
> log4j:WARN No appenders could be found for logger
> (com.cloud.utils.crypt.CloudStackEncryptor).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> WARNING: An illegal reflective access operation has occurred
> WARNING: Illegal reflective access by com.google.protobuf.UnsafeUtil
> (file:/usr/share/cloudstack-common/lib/cloudstack-utils.jar) to field
> java.nio.Buffer.address
> WARNING: Please consider reporting this to the maintainers of
> com.google.protobuf.UnsafeUtil
> WARNING: Use --illegal-access=warn to enable warnings of further illegal
> reflective access operations
> WARNING: All illegal access operations will be denied in a future release
> Exception in thread "main" com.cloud.utils.exception.CloudRuntimeException:
> Failed to decrypt value: +BIIn*
> at
>
> com.cloud.utils.crypt.CloudStackEncryptor.decrypt(CloudStackEncryptor.java:104)
> at com.cloud.utils.crypt.EncryptionCLI.main(EncryptionCLI.java:68)
> Failed to decrypt DB password from db.properties
> Installation failed
>
>
>
> Not exactly sure if there's a previous step I missed but I'm completely new
> to CloudStack so any help is welcome.
>
> The system I'm using is running
> - Ubuntu 22.04
> - MySQL 8.0.36
> - OpenJDK version "11.0.21" 2023-10-17
>
> Not sure if it's noteworthy but I did create the database and users
> manually and then ran the
> ` cloudstack-setup-databases` with then ` --schema-only` option.
>

Re: CKS Storage Provisioner Info

[Wei ZHOU]

+1

Or  use the api key of "admin" user.

-Wei

On Sun, Feb 25, 2024 at 7:57 PM Jayanth Reddy 
wrote:

> Hello Bharat,
> With your login as "admin" user, you should be able to generate keys for
> any user. Please do the below
>
> 1. Go to "Accounts"
> 2. Select the account named "admin"
> 3. Scroll down and click "users"
> 4. Select the "admin-kubeadmin" user
> 5. Then select the button for generation of keys.
>
> Please let me know if that helps.
>
> Thanks,
> Jayanth
>
> Sent from Outlook for Android
>
>
>

Re: CKS Storage Provisioner Info

[Wei ZHOU]

It is just used to access cloudstack API via api key and secret key.
Its password is a random UUID.

-Wei



On Sun, Feb 25, 2024 at 3:29 PM Bharat Bhushan Saini
 wrote:

> Hi All,
>
>
>
> Somebody Please share the default credentials for the admin-kubeadmin user.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2022216497]
>
>
>
> *From: *Bharat Bhushan Saini 
> *Date: *Friday, 23 February 2024 at 3:14 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS Storage Provisioner Info
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
>
> Hi Community/Vivek,
>
>
>
> I created a discussion form on github discussion.
>
>
>
> Kindly check the information at
> https://github.com/apache/cloudstack/issues/8695
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2677501444]
>
>
>
> *From: *Vivek Kumar 
> *Date: *Friday, 23 February 2024 at 12:50 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CKS Storage Provisioner Info
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hello Bharat,
>
> Can you try to install plugin manually and see if that works or not.
>
>
> Vivek Kumar
> Sr. Manager - Cloud & DevOps
> TechOps | Indiqus Technologies
>
> vivek.ku...@indiqus.com  >
> www.indiqus.com 
>
>
>
>
> > On 23-Feb-2024, at 11:16 AM, Bharat Bhushan Saini
>  wrote:
> >
> > Hi Wei/Vivek/Kiran,
> >
> > Kindly lookout in this.
> >
> > Thanks and Regards,
> > Bharat Saini
> >
> >
> >
> > From: Bharat Bhushan Saini  mailto:bharat.sa...@kloudspot.com.INVALID
> >>
> > Date: Friday, 23 February 2024 at 12:56 AM
> > To: users@cloudstack.apache.org  >  mailto:users@cloudstack.apache.org >>
> > Subject: Re: CKS Storage Provisioner Info
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
> >
> > Hi Vivek,
> >
> > I deployed cloudstack with version 4.18.1.
> > I think it should be present in this version.
> >
> > Thanks and Regards,
> > Bharat Saini
> >
> >
> >
> > From: Vivek Kumar  mailto:vivek.ku...@indiqus.com.INVALID >>
> > Date: Friday, 23 February 2024 at 12:48 AM
> > To: users@cloudstack.apache.org  >  mailto:users@cloudstack.apache.org >>
> > Subject: Re: CKS Storage Provisioner Info
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
> >
> >
> > Hello Bharat,
> >
> > Then you will have to deploy the cloudstack-kubernetes-provider, however
> after 4.16, it’s automatically deployed, Follow the instruction in the link
> -https://github.com/apache/cloudstack-kubernetes-provider
> >
> >
> > 1- Create a file called - cloud-config and put the below information - (
> you can create an user under your account and provide it’s apikey and
> secret key )
> >
> >
> > [Global]
> > api-url = 
> > api-key = 
> > secret-key = 
> >
> >
> > 2- kubectl -n kube-system create secret generic cloudstack-secret
> --from-file=cloud-config
> > 3- then deploy the controller -
> >
> > You can then use the provided example deployment.yaml <
> https://github.com/apache/cloudstack-kubernetes-provider/blob/main/deployment.yaml>
> to deploy the controller:
> >
> > kubectl apply -f deployment.yaml
> >
> >
> >
> >
> > Vivek Kumar
> > Sr. Manager - Cloud & DevOps
> > TechOps | Indiqus Technologies
> >
> > vivek.ku...@indiqus.com  >  >
> > www.indiqus.com  <
> https://www.indiqus.com/>
> >
> >
> >
> >
> > > On 23-Feb-2024, at 12:08 AM, Bharat Bhushan Saini
>  mailto:bharat.sa...@kloudspot.com.INVALID
> >> wrote:
> > >
> > > Hi Vivek,
> > >
> > > I am glad and thankful to you for sharing the information, for the
> configuration of CSI driver.
> > >
> > > But I didn’t have cloudstack-secret in my cluster, sharing the details
> below
> > >
> > > cloud@Kspot-App-control-18dd041902a:~$ kubectl get secret
> cloudstack-secret -n kube-system
> > > Error from server (NotFound): secrets "cloudstack-secret" not found
> > > cloud@Kspot-App-control-18dd041902a:~$ kubectl get secret -A -n
> kube-system
> > > NAMESPACE  NAME
> TYPE  DATA   AGE
> > > kloudspot  dockerregistrykey
> kubernetes.io/dockerconfigjson <
> http://kubernetes.io/dockerconfigjson> >
> 1  8h
> > > kube-systembootstrap-token-cb0b7f
> bootstrap.kubernetes.io/token <
> http://bootstrap.kubernetes.io/token> 

Re: KVM VM consoles connection timing out due to authentication failure

[Wei ZHOU]

Hi Kapil,

If you run CloudStack in FIPS-mode, it does not work for now.

According to
https://qemu-project.gitlab.io/qemu/system/vnc-security.html#with-passwords
Password authentication is not supported when operating in FIPS 140-2
compliance mode as it requires the use of the DES cipher.

However, CloudStack generates VNC password for all VMs, VMs are also
started on hypervisors (for example KVM hosts) with a VNC password.


-Wei

On Tue, Feb 20, 2024 at 9:55 AM Kapil Bhuskute 
wrote:

> Hello,
> We have a POD setup with CloudStack 4.19 latest version and all schema
> with a Zone, POD, and cluster has been setup using a Advance Shared
> networking Architecture.
> We have a couple of VMs spun up on this environment now and were trying to
> access its VM console via VNC port. However, it has been observed that the
> VM console connections are getting timed out due to failed authentication
> errors observed on the vmconsoleproxy System VM logs.
>
> VM Console not working . We have mysql ssl enabled and console proxy ssl
> is disabled for now.
> Failed to connect/access token expired.
> While checking logs on CCVM ..we see vnc auth failed.
> 2024-02-13 16:12:12,926 INFO [vnc.security.VncTLSSecurity]
> (Thread-86:null) Processing VNC TLS security
> 2024-02-13 16:12:12,930 INFO [utils.nio.Link] (Thread-86:null) Conf file
> found: /usr/local/cloud/systemvm/conf/agent.properties
> 2024-02-13 16:12:12,964 INFO [vnc.security.VncAuthSecurity]
> (Thread-83:null) Finished VNCAuth security
> 2024-02-13 16:12:12,966 ERROR [consoleproxy.vnc.NoVncClient]
> (Thread-83:null) Connection to VNC server failed: wrong password.
> 2024-02-13 16:12:12,966 ERROR [consoleproxy.vnc.NoVncClient]
> (Thread-83:null) Connection to VNC server failed: wrong password. - Reason:
> Authentication failed
> 2024-02-13 16:12:13,164 INFO [vnc.security.VncAuthSecurity]
> (Thread-86:null) VNC server requires password authentication
> 2024-02-13 16:12:13,184 INFO [vnc.security.VncAuthSecurity]
> (Thread-86:null) Finished VNCAuth security
>
>
> Kindly suggest if anyone is aware of any fix for this.
>
> Regards,
> Kapil B
>

Re: K8s Dashboard Not Found

[Wei ZHOU]

Hi,

The image is not visible .

You can create a github discussion instead.


-Wei

On Tue, 20 Feb 2024 at 18:53, Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> Public IP is reachable from the local machine. Everything is working.
>
> But when I access the dashboard I encountered with the below Json format
>
>
>
>
>
> Also I am able to get all the details regarding deployment which I already
> below but unable to access the dashboard of K8s.
>
> Please check and help out from this situation. If any details or info you
> need pls let me know.
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_4184978167]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Tuesday, 20 February 2024 at 7:44 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: K8s Dashboard Not Found
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> so, it looks like the kubernetes-dashboard is working well.
> your question is, how to access the dashboard of the kubernetes cluster
> whose Public IP is unreachable from a local machine ?
>
>
>
> -Wei
>
> On Tue, 20 Feb 2024 at 12:41, Bharat Bhushan Saini
>  wrote:
>
> > Hi Wei,
> >
> >
> >
> > The cloudstack is setup on a single node and the info I provided is from
> > that node.
> >
> > I think as the control node and worker node is CLI based, Need to access
> > dashboard from outside the control node.
> >
> > Please guide me for that.
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_1512528664]
> >
> >
> >
> > *From: *Wei ZHOU 
> > *Date: *Tuesday, 20 February 2024 at 4:27 PM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: K8s Dashboard Not Found
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > The output in the control nodes looks good.
> >
> > Are you able to access the dashboard following the instruction on
> > https://github.com/apache/cloudstack/pull/7764#issuecomment-1647247993 ?
> >
> > -Wei
> >
> > On Tue, 20 Feb 2024 at 11:10, Bharat Bhushan Saini
> >  wrote:
> >
> > > Hi Wei,
> > >
> > >
> > >
> > > Please check the below info I think you will get it
> > >
> > > kubectl --kubeconfig kube.conf get pods --all-namespaces
> > >
> > > NAMESPACE  NAME
> > > READY   STATUSRESTARTS  AGE
> > >
> > > kube-systemcoredns-76f75df574-lfgzj
> > > 1/1 Running   0 22h
> > >
> > > kube-systemcoredns-76f75df574-mtktc
> > > 1/1 Running   0 22h
> > >
> > > kube-systemetcd-kloudspot-app-control-18dc0a3d55e
> > > 1/1 Running   0 22h
> > >
> > > kube-systemkube-apiserver-kloudspot-app-control-18dc0a3d55e
> > > 1/1 Running   0 22h
> > >
> > > kube-system
> > >   kube-controller-manager-kloudspot-app-control-18dc0a3d55e   1/1
> > >   Running   0 22h
> > >
> > > kube-systemkube-proxy-74zcb
> > > 1/1 Running   0 22h
> > >
> > > kube-systemkube-proxy-hts4p
> > > 1/1 Running   0 22h
> > >
> > > kube-systemkube-scheduler-kloudspot-app-control-18dc0a3d55e
> > > 1/1 Running   0 22h
> > >
> > > kube-systemweave-net-8j6j2
> > > 2/2 Running   0 22h
> > >
> > > kube-systemweave-net-mlv6t
> > > 2/2 Running   1 (22h ago)   22h
> > >
> > > kubernetes-dashboard   kubernetes-dashboard-api-645688966c-8xqjp
> > > 1/1 Running   0 22h
> > >
> > > kubernetes-dashboard
> > kubernetes-dashboard-metrics-scraper-b847579df-tjw86
> > >   1/1 Running   0 22h
> > >
> > > kubernetes-dashboard   kubernetes-dashboard-web-648b489598-psn94
> > > 1/1 Running   0 22h
> > >
> > >
> > >
> > > kubectl --kubeconfig kube.conf get nodes --all-namespaces
> > >

Re: K8s Dashboard Not Found

[Wei ZHOU]

so, it looks like the kubernetes-dashboard is working well.
your question is, how to access the dashboard of the kubernetes cluster
whose Public IP is unreachable from a local machine ?



-Wei

On Tue, 20 Feb 2024 at 12:41, Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> The cloudstack is setup on a single node and the info I provided is from
> that node.
>
> I think as the control node and worker node is CLI based, Need to access
> dashboard from outside the control node.
>
> Please guide me for that.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_1512528664]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Tuesday, 20 February 2024 at 4:27 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: K8s Dashboard Not Found
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> The output in the control nodes looks good.
>
> Are you able to access the dashboard following the instruction on
> https://github.com/apache/cloudstack/pull/7764#issuecomment-1647247993 ?
>
> -Wei
>
> On Tue, 20 Feb 2024 at 11:10, Bharat Bhushan Saini
>  wrote:
>
> > Hi Wei,
> >
> >
> >
> > Please check the below info I think you will get it
> >
> > kubectl --kubeconfig kube.conf get pods --all-namespaces
> >
> > NAMESPACE  NAME
> > READY   STATUSRESTARTS  AGE
> >
> > kube-systemcoredns-76f75df574-lfgzj
> > 1/1 Running   0 22h
> >
> > kube-systemcoredns-76f75df574-mtktc
> > 1/1 Running   0 22h
> >
> > kube-systemetcd-kloudspot-app-control-18dc0a3d55e
> > 1/1 Running   0 22h
> >
> > kube-systemkube-apiserver-kloudspot-app-control-18dc0a3d55e
> > 1/1 Running   0 22h
> >
> > kube-system
> >   kube-controller-manager-kloudspot-app-control-18dc0a3d55e   1/1
> >   Running   0 22h
> >
> > kube-systemkube-proxy-74zcb
> > 1/1 Running   0 22h
> >
> > kube-systemkube-proxy-hts4p
> > 1/1 Running   0 22h
> >
> > kube-systemkube-scheduler-kloudspot-app-control-18dc0a3d55e
> > 1/1 Running   0 22h
> >
> > kube-systemweave-net-8j6j2
> > 2/2 Running   0 22h
> >
> > kube-systemweave-net-mlv6t
> > 2/2 Running   1 (22h ago)   22h
> >
> > kubernetes-dashboard   kubernetes-dashboard-api-645688966c-8xqjp
> > 1/1 Running   0 22h
> >
> > kubernetes-dashboard
> kubernetes-dashboard-metrics-scraper-b847579df-tjw86
> >   1/1 Running   0 22h
> >
> > kubernetes-dashboard   kubernetes-dashboard-web-648b489598-psn94
> > 1/1 Running   0 22h
> >
> >
> >
> > kubectl --kubeconfig kube.conf get nodes --all-namespaces
> >
> > NAMESTATUS   ROLES   AGE
> VERSION
> >
> > kloudspot-app-control-18dc0a3d55e   Readycontrol-plane   22h
> v1.29.2
> >
> > kloudspot-app-node-18dc0a3f52e  Ready  22h
> v1.29.2
> >
> >
> >
> > kubectl --kubeconfig kube.conf get services --all-namespaces
> >
> > NAMESPACE  NAME   TYPE
> >   CLUSTER-IP   EXTERNAL-IP   PORT(S)  AGE
> >
> > defaultkubernetes
> >   ClusterIP   10.96.0.1443/TCP  22h
> >
> > kube-systemkube-dns
> >   ClusterIP   10.96.0.10   53/UDP,53/TCP,9153/TCP   22h
> >
> > kubernetes-dashboard   kubernetes-dashboard-api
> >   ClusterIP   10.102.124.599000/TCP 22h
> >
> > kubernetes-dashboard   kubernetes-dashboard-metrics-scraper
> ClusterIP   10.111.159.255   
> >   8000/TCP 22h
> >
> > kubernetes-dashboard   kubernetes-dashboard-web
> >   ClusterIP   10.108.135.214   8000/TCP 22h
> >
> >
> >
> >
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: testing with uefi on Ubuntu22 KVM

[Wei ZHOU]

Hi,

> guest.nvram.template.secure=/usr/share/OVMF/OVMF_VARS.fd

This is incorrect, please use `OVMF_VARS.ms.fd` or `OVMF_VARS_4M.ms.fd`.

> Is it safe to just delete the row in the db?

Yes, it is safe.


-Wei

On Tue, 20 Feb 2024 at 13:31,  wrote:

> Hi,
>
> I started testing with uefi on Ubuntu 22 KVM. I search the mailinglist and
> found some discussion and problems with uefi secure mode on Ubuntu22 KVM.
>
> Is there already a fix for "Guest has not initialized the display
> (yet)."-prolem on console proxy?
>
>
>
> For my test I added /etc/cloudstack/agent/uefi.properties with the
> following
> values:
>
> guest.nvram.template.secure=/usr/share/OVMF/OVMF_VARS.fd
>
> guest.nvram.template.legacy=/usr/share/OVMF/OVMF_VARS.fd
>
> guest.loader.secure=/usr/share/OVMF/OVMF_CODE.secboot.fd
>
> guest.loader.legacy=/usr/share/OVMF/OVMF_CODE.fd
>
> guest.nvram.path=/var/lib/libvirt/qemu/nvram/
>
>
>
> I also added the following line to /etc/libvirt/qemu.conf:
>
> nvram =
> ["/usr/share/OVMF/OVMF_CODE.secboot.fd:/usr/share/OVMF/OVMF_VARS.fd"]
>
>
>
> I restarted the following services:
>
> service libvirtd restart
>
> service cloudstack-agent restart
>
>
>
> I can see that CS is now showing the host as UEFI supported = true and CS
> added a row to db table host_details:
>
> | 7176 |   4 | host.uefi.enable   |
> true
> |
>
>
>
> I tried to disable UEFI support for this host by deleting the
> uefi.properties file and deleted the added line in qemu.conf file. I
> restarted both services.
>
> It looks like CS is not being updated. UI still shows me UEFI supported =
> true and db still shows me the row.
>
> Is this expected? I know that there is a check if UEFI is supported by the
> agent. This was implemented in 4.15 or 4.16 if I remember correctly. But is
> there also a check which will disable the support for a host?
>
>
>
> Is it save to just delete the row in the db?
>
>
>
> Regards,
>
> Swen
>
>

Re: K8s Dashboard Not Found

[Wei ZHOU]

The output in the control nodes looks good.

Are you able to access the dashboard following the instruction on
https://github.com/apache/cloudstack/pull/7764#issuecomment-1647247993 ?

-Wei

On Tue, 20 Feb 2024 at 11:10, Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> Please check the below info I think you will get it
>
> kubectl --kubeconfig kube.conf get pods --all-namespaces
>
> NAMESPACE  NAME
> READY   STATUSRESTARTS  AGE
>
> kube-systemcoredns-76f75df574-lfgzj
> 1/1 Running   0 22h
>
> kube-systemcoredns-76f75df574-mtktc
> 1/1 Running   0 22h
>
> kube-systemetcd-kloudspot-app-control-18dc0a3d55e
> 1/1 Running   0 22h
>
> kube-systemkube-apiserver-kloudspot-app-control-18dc0a3d55e
> 1/1 Running   0 22h
>
> kube-system
>   kube-controller-manager-kloudspot-app-control-18dc0a3d55e   1/1
>   Running   0 22h
>
> kube-systemkube-proxy-74zcb
> 1/1 Running   0 22h
>
> kube-systemkube-proxy-hts4p
> 1/1 Running   0 22h
>
> kube-systemkube-scheduler-kloudspot-app-control-18dc0a3d55e
> 1/1 Running   0 22h
>
> kube-systemweave-net-8j6j2
> 2/2 Running   0 22h
>
> kube-systemweave-net-mlv6t
> 2/2 Running   1 (22h ago)   22h
>
> kubernetes-dashboard   kubernetes-dashboard-api-645688966c-8xqjp
> 1/1 Running   0 22h
>
> kubernetes-dashboard   kubernetes-dashboard-metrics-scraper-b847579df-tjw86
>   1/1 Running   0 22h
>
> kubernetes-dashboard   kubernetes-dashboard-web-648b489598-psn94
> 1/1 Running   0 22h
>
>
>
> kubectl --kubeconfig kube.conf get nodes --all-namespaces
>
> NAMESTATUS   ROLES   AGE   VERSION
>
> kloudspot-app-control-18dc0a3d55e   Readycontrol-plane   22h   v1.29.2
>
> kloudspot-app-node-18dc0a3f52e  Ready  22h   v1.29.2
>
>
>
> kubectl --kubeconfig kube.conf get services --all-namespaces
>
> NAMESPACE  NAME   TYPE
>   CLUSTER-IP   EXTERNAL-IP   PORT(S)  AGE
>
> defaultkubernetes
>   ClusterIP   10.96.0.1443/TCP  22h
>
> kube-systemkube-dns
>   ClusterIP   10.96.0.10   53/UDP,53/TCP,9153/TCP   22h
>
> kubernetes-dashboard   kubernetes-dashboard-api
>   ClusterIP   10.102.124.599000/TCP 22h
>
> kubernetes-dashboard   kubernetes-dashboard-metrics-scraper   ClusterIP   
> 10.111.159.255   
>   8000/TCP 22h
>
> kubernetes-dashboard   kubernetes-dashboard-web
>   ClusterIP   10.108.135.214   8000/TCP 22h
>
>
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>

Re: IPv4+IPv6 Dual Stack Networking for Shared Networks

[Wei ZHOU]

Hi,

For a shared network with IPv6, you need to configure SLAAC on the upstream
router, as CloudStack VR is not the IPv6 gateway.

-Wei


On Tue, 20 Feb 2024 at 09:00, Ozhan Karaman  wrote:

> Hi All;
>
> I am using Cloudstack 4.19, I am trying to enable IPv4+IPv6 Dual Stack
> Networking for Shared Networks, so I add a new network with both dual stack
> ip definitions in Shared Mode. I started the vm and I noticed that I don't
> get ipv6 ip from VR.
>
> I connected to VR to check dhcp server/dnsmasq setup and it's setup is ok
> but I noticed that VR's eth0 does only have an ipv4 ip address not v6. I
> started to investigate more in VR and I noticed that ipv6 is disabled by
> sysctl settings so network setup could not be successfully applied. By the
> way, I am using the 4.19 SystemVM template.
>
> So it looks like the VR image does not like to work with IPv6, I started to
> investigate Network Offerings to check out if ipv6 needs to be enabled for
> shared networking somewhere but I could not find any specific settings.
>
> Does anyone have any clue for the missing piece?
>
> Thanks
> Ozhan
>

Re: K8s Dashboard Not Found

[Wei ZHOU]

Also, can you try with the CKS 1.27.8 or 1.28.4 on
https://download.cloudstack.org/cks/ ?

-Wei


On Tue, 20 Feb 2024 at 08:31, Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> I made the ISO from cloudstack-comman and that ISO was of latest version
> 1.29.1.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_698188016]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Tuesday, 20 February 2024 at 12:28 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: K8s Dashboard Not Found
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Which CKS ISO do you use?
>
> On Tuesday, February 20, 2024, Bharat Bhushan Saini
>  wrote:
>
> > Hi All,
> >
> > I enabled the CKS service in the cloudstack dashboard. After all the
> > things done I am unable to access the K8s dashboard.
> >
> > I encountered in the browser that ‘services “Kubernetes-dashboard” not
> > found’.
> >
> > Kindly suggest any resolvement for this.
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_2321445983]
> >
> > --- Disclaimer: --
> > This message and its contents are intended solely for the designated
> > addressee and are proprietary to Kloudspot. The information in this email
> > is meant exclusively for Kloudspot business use. Any use by individuals
> > other than the addressee constitutes misuse and an infringement of
> > Kloudspot's proprietary rights. If you are not the intended recipient,
> > please return this email to the sender. Kloudspot cannot guarantee the
> > security or error-free transmission of e-mail communications. Information
> > could be intercepted, corrupted, lost, destroyed, arrive late or
> > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> > for any issues arising from the transmission of this email.
> >
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: K8s Dashboard Not Found

[Wei ZHOU]

Hi,

The old way to access k8s dashboard does not work any more.
please refer to https://github.com/apache/cloudstack/pull/7764


-Wei



On Tue, 20 Feb 2024 at 08:27, Bharat Bhushan Saini
 wrote:

> Hi,
>
>
>
> I am hittine below URL
>
>
> http://localhost:8001/api/v1/namespaces/kubernetes-dashboard/services/https:kubernetes-dashboard:/proxy/
>
> Below some more info that will help you to recognise as below
>
> kubectl --kubeconfig kube.conf get pods --all-namespaces
>
> NAMESPACE  NAME
>   READY   STATUSRESTARTS  AGE
>
> kube-systemcoredns-76f75df574-lfgzj
>   1/1 Running   0 22h
>
> kube-systemcoredns-76f75df574-mtktc
>   1/1 Running   0 22h
>
> kube-systemetcd-kloudspot-app-control-18dc0a3d55e
>   1/1 Running   0 22h
>
> kube-systemkube-apiserver-kloudspot-app-control-18dc0a3d55e
>   1/1 Running   0 22h
>
> kube-system
> kube-controller-manager-kloudspot-app-control-18dc0a3d55e
>   1/1 Running   0 22h
>
> kube-systemkube-proxy-74zcb
>   1/1 Running   0 22h
>
> kube-systemkube-proxy-hts4p
>   1/1 Running   0 22h
>
> kube-systemkube-scheduler-kloudspot-app-control-18dc0a3d55e
>   1/1 Running   0 22h
>
> kube-systemweave-net-8j6j2
>   2/2 Running   0 22h
>
> kube-systemweave-net-mlv6t
>   2/2 Running   1 (22h ago)   22h
>
> kubernetes-dashboard   kubernetes-dashboard-api-645688966c-8xqjp
>   1/1 Running   0 22h
>
> kubernetes-dashboard
> kubernetes-dashboard-metrics-scraper-b847579df-tjw861/1 Running
>   0 22h
>
> kubernetes-dashboard   kubernetes-dashboard-web-648b489598-psn94
>   1/1 Running   0 22h
>
>
>
> kubectl --kubeconfig kube.conf get nodes --all-namespaces
>
> NAMESTATUS   ROLES   AGE   VERSION
>
> kloudspot-app-control-18dc0a3d55e   Readycontrol-plane   22h   v1.29.2
>
> kloudspot-app-node-18dc0a3f52e  Ready  22h   v1.29.2
>
>
>
> kubectl --kubeconfig kube.conf get services --all-namespaces
>
> NAMESPACE  NAME   TYPE
> CLUSTER-IP
>   EXTERNAL-IP   PORT(S)  AGE
>
> defaultkubernetes ClusterIP
> 10.96.0.1443/TCP  22h
>
> kube-systemkube-dns   ClusterIP   
> 10.96.0.10
>   53/UDP,53/TCP,9153/TCP   22h
>
> kubernetes-dashboard   kubernetes-dashboard-api   ClusterIP
> 10.102.124.599000/TCP 22h
>
> kubernetes-dashboard   kubernetes-dashboard-metrics-scraper   ClusterIP   
> 10.111.159.255
>   8000/TCP 22h
>
> kubernetes-dashboard   kubernetes-dashboard-web   ClusterIP   
> 10.108.135.214
>   8000/TCP 22h
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_828139211]
>
>
>
> *From: *Vivek Kumar 
> *Date: *Tuesday, 20 February 2024 at 12:17 PM
> *To: *Bharat Bhushan Saini 
> *Cc: *users@cloudstack.apache.org 
> *Subject: *Re: K8s Dashboard Not Found
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
>
> Can you share me the URL which you are hitting on the browser ?
>
>
>
>
> Vivek Kumar
>
> Sr. Manager - Cloud & DevOps
>
> TechOps | Indiqus Technologies
>
> [image: Image removed by sender.]
>
> vivek.ku...@indiqus.com
>
> [image: Image removed by sender.]
>
> www.indiqus.com
>
>
>
>
>
>
>
> On 20-Feb-2024, at 12:12 PM, Bharat Bhushan Saini <
> bharat.sa...@kloudspot.com> wrote:
>
>
>
> Hi Vivek,
>
>
>
> I am trying to access the dashboard from kubectl proxy.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> 
>
>
>
> *From: *Vivek Kumar via users 
> *Date: *Tuesday, 20 February 2024 at 12:08 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: K8s Dashboard Not Found
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hello Bharat,
>
> How are you accessing the dashboard ?  Using the kubeclt proxy ?
>
> Vivek Kumar
> Sr. Manager - Cloud & DevOps
> TechOps | Indiqus Technologies
>
> vivek.ku...@indiqus.com  >
> www.indiqus.com 
>
>
>
>
> > On 20-Feb-2024, at 12:00 PM, Bharat Bhushan Saini <
> bharat.sa...@kloudspot.com.INVALID> wrote:
> >
> > Hi All,
> >
> > I enabled the CKS service in the cloudstack dashboard. After all the
> things done I am unable to access the K8s dashboard.
> > I encountered in the browser that ‘services 

Re: K8s Dashboard Not Found

[Wei ZHOU]

Which CKS ISO do you use?

On Tuesday, February 20, 2024, Bharat Bhushan Saini
 wrote:

> Hi All,
>
> I enabled the CKS service in the cloudstack dashboard. After all the
> things done I am unable to access the K8s dashboard.
>
> I encountered in the browser that ‘services “Kubernetes-dashboard” not
> found’.
>
> Kindly suggest any resolvement for this.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2321445983]
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: restrict Instance console access

[Wei ZHOU]

In 4.18+, an API is used to create the console URL:
https://cloudstack.apache.org/api/apidocs-4.19/apis/createConsoleEndpoint.html
Denying the API can disable the VM console.

It is not available in 4.15.2

-Wei
Nux  于 2024年2月19日周一 22:23写道：

> Hi,
>
> I do not think there is one in that version - or later ones, although
> certain things do change, you'll have to do it outside Cloudstack
> somehow.
>
> On 2024-02-19 15:52, Gary Dixon wrote:
> > HI
> >
> > ACS 4.15.2
> >
> > Ubuntu 20.04
> >
> > We have a requirement to restrict access to the VM console for certain
> > tenants within our ACS implementation - however I cannot see a way to
> > accomplish this via Role permissions.
> >
> > Is there a way to restrict VM Console access for specific users ?
> >
> > BR
> >
> > Gary
> >
> >   Gary Dixon
> >
> >   Quadris Cloud Manager
> >
> >   0161 537 4980 [1]
> >
> >+44 7989717661 [2]
> >
> >   gary.di...@quadris.co.uk
> >
> > www.quadris.com
> >
> > Innovation House, 12‑13 Bredbury Business Park
> > Bredbury Park Way, Bredbury, Stockport, SK6 2SN
> >
> >
> >
> > Links:
> > --
> > [1] tel:0161%20537%204980
> > [2] tel:+44%207989717661
>

Re: CS 4.19.0.0 - KVM Reboot Loop

[Wei ZHOU]

Hi,

Can you add a line in agent.properties and retry ?

reboot.host.and.alert.management.on.heartbeat.timeout=false

-Wei



On Mon, 19 Feb 2024 at 12:14, W. Verleger - proIO GmbH 
wrote:

> Hi,
>
> We are using a 3 node KVM/CS 4.19.0.0 cluster with Linstor storage.
> Since CS 4.19.0.0 we are encountering a reboot loop of our hosts. They
> keep rebooting.
>
> HA is disabled (globally and cluster wide).
>
> We are getting the following log entries in the cloudstack-agent log:
>
> Feb 19 11:53:05 pc-kvm-2 java[6617]: WARN  [kvm.resource.KVMHAMonitor]
> (Thread-1:) (logid:) Write heartbeat for pool
> [71c272d3-b180-4b18-a0fc-cfc1dc5b86c9] failed: Down; try: 2 of 5.
> Feb 19 11:58:58 pc-kvm-2 java[9465]: WARN  [kvm.resource.KVMHAMonitor]
> (Thread-1:) (logid:) Write heartbeat for pool
> [71c272d3-b180-4b18-a0fc-cfc1dc5b86c9] failed: Down; try: 3 of 5.
> Feb 19 12:00:08 pc-kvm-2 java[9465]: WARN  [kvm.resource.KVMHAMonitor]
> (Thread-1:) (logid:) Write heartbeat for pool
> [71c272d3-b180-4b18-a0fc-cfc1dc5b86c9] failed: Down; try: 4 of 5.
> Feb 19 12:01:08 pc-kvm-2 java[9465]: WARN  [kvm.resource.KVMHAMonitor]
> (Thread-1:) (logid:) Write heartbeat for pool
> [71c272d3-b180-4b18-a0fc-cfc1dc5b86c9] failed: Down; try: 5 of 5.
> Feb 19 12:01:08 pc-kvm-2 java[9465]: WARN  [kvm.resource.KVMHAMonitor]
> (Thread-1:) (logid:) Write heartbeat for pool
> [71c272d3-b180-4b18-a0fc-cfc1dc5b86c9] failed: Down; stopping
> cloudstack-agent.
> Feb 19 12:02:08 pc-kvm-2 heartbeat: kvmspheartbeat.sh will reboot system
> because it was unable to write the heartbeat to the storage.
>
> Any idea why kvm heartbeat is still active?
>
>
> Best regards,
>
> Wilken
>
>
> - proIO GmbH -
> Geschäftsführer: Swen Brüseke
> Sitz der Gesellschaft: Frankfurt am Main
>
> USt-IdNr. DE 267 075 918
> Registergericht: Frankfurt am Main - HRB 86239
>
> Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte
> Informationen.
> Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich
> erhalten haben,
> informieren Sie bitte sofort den Absender und vernichten Sie diese Mail.
> Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail sind
> nicht gestattet.
>
> This e-mail may contain confidential and/or privileged information.
> If you are not the intended recipient (or have received this e-mail in
> error) please notify
> the sender immediately and destroy this e-mail.
> Any unauthorized copying, disclosure or distribution of the material in
> this e-mail is strictly forbidden.
>
>

Re: CPU Core Consumption High

[Wei ZHOU]

Hi,

Can you perform the same steps again ? If the result is same, you can
create an issue on github: https://github.com/apache/cloudstack/issues/new


-Wei



On Mon, 19 Feb 2024 at 10:30, Bharat Bhushan Saini
 wrote:

> Hi Wei,
>
>
>
> First I did poweroff from inside the vm the it is going off but the status
> show that it is running then I do turned off from the UI as well then
> status shows in UI stopped
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_615347824]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Monday, 19 February 2024 at 2:45 PM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CPU Core Consumption High
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> Hi,
>
> Did you poweroff from inside the VM or on cloudstack UI ?
>
> -Wei
>
> On Mon, 19 Feb 2024 at 09:53, Bharat Bhushan Saini
>  wrote:
>
> > Hi Wei/Darren,
> >
> >
> >
> > The issue was again trigged after the enable the
> resource.count.running.vms.only
> > option.
> > I shut down all the vm’s but the resource utilization is same as before
> > when vm’s are running.
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_2781584380]
> >
> >
> >
> > *From: *Wei ZHOU 
> > *Date: *Tuesday, 13 February 2024 at 12:59 AM
> > *To: *users@cloudstack.apache.org 
> > *Subject: *Re: CPU Core Consumption High
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > +1.
> >
> > The setting was introduced in 4.14 by my PR
> > https://github.com/apache/cloudstack/pull/3760
> > However, to keep backwards compatibility, the default value was set to
> > false, which does not make sense IMHO.
> >
> > -Wei
> >
> > 在 2024年2月12日星期一，Darren Cole  写道：
> >
> > > This caught me before as well.
> > > By default resource.count.running.vms.only is set to false, so
> resources
> > > are counted for all VMs.
> > > On clusters I run I set this to true so that only running VMs are
> counted
> > > for resource use.
> > >
> > > I have not tested 4.19 yet, but assume the setting stayed the same.
> > > There are also some similar/related settings to determine how running
> > > resources are counted.
> > > Some of these are specific what is backing the VMs.
> > > ie KVM, Xen, etc.
> > >
> > > Darren
> > > --
> > > This e-mail is confidential. Any distribution, use or copying of this
> > > e-mail or the information it contains other than by the intended
> > recipient
> > > is forbidden. If you are not the intended recipient, please advise the
> > > sender (by return e-mail or otherwise) immediately and delete this
> > e-mail.
> > >
> > >
> > > From: "Bharat Bhushan Saini" 
> > > To: "users" 
> > > Sent: Sunday, February 11, 2024 11:14:58 PM
> > > Subject: CPU Core Consumption High
> > >
> > >
> > >
> > > Hi All,
> > >
> > >
> > >
> > > I am facing an issue regarding the core consumption by the cloudstack.
> I
> > > started 2 vm with 6 cores and it takes 18 cores but when I poweroff the
> > vm
> > > the cores remains same in the dashboard.
> > >
> > >
> > >
> > >
> > > Thanks and Regards,
> > >
> > > Bharat Saini
> > >
> > >
> > >
> > >
> > >
> > >
> > > --- Disclaimer: --
> > > This message and its contents are intended solely for the designated
> > > addressee and are proprietary to Kloudspot. The information in this
> email
> > > is meant exclusively for Kloudspot business use. Any use by individuals
> > > other than the addressee constitutes misuse and an infringement of
> > > Kloudspot's proprietary rights. If you are not the intended recipient,
> > > please return this email to the sender. Kloudspot cannot guarantee the
> > > security or error-free transmission of e-mail communications.
> Information
> > > could be intercepted, corrupted, lost, destroyed, arrive late or
> > > incomplete, or contain viruses. Therefore, Kloudspot shall not be
> liable
&

Re: CPU Core Consumption High

[Wei ZHOU]

Hi,

Did you poweroff from inside the VM or on cloudstack UI ?

-Wei

On Mon, 19 Feb 2024 at 09:53, Bharat Bhushan Saini
 wrote:

> Hi Wei/Darren,
>
>
>
> The issue was again trigged after the enable the 
> resource.count.running.vms.only
> option.
> I shut down all the vm’s but the resource utilization is same as before
> when vm’s are running.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_2781584380]
>
>
>
> *From: *Wei ZHOU 
> *Date: *Tuesday, 13 February 2024 at 12:59 AM
> *To: *users@cloudstack.apache.org 
> *Subject: *Re: CPU Core Consumption High
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> +1.
>
> The setting was introduced in 4.14 by my PR
> https://github.com/apache/cloudstack/pull/3760
> However, to keep backwards compatibility, the default value was set to
> false, which does not make sense IMHO.
>
> -Wei
>
> 在 2024年2月12日星期一，Darren Cole  写道：
>
> > This caught me before as well.
> > By default resource.count.running.vms.only is set to false, so resources
> > are counted for all VMs.
> > On clusters I run I set this to true so that only running VMs are counted
> > for resource use.
> >
> > I have not tested 4.19 yet, but assume the setting stayed the same.
> > There are also some similar/related settings to determine how running
> > resources are counted.
> > Some of these are specific what is backing the VMs.
> > ie KVM, Xen, etc.
> >
> > Darren
> > --
> > This e-mail is confidential. Any distribution, use or copying of this
> > e-mail or the information it contains other than by the intended
> recipient
> > is forbidden. If you are not the intended recipient, please advise the
> > sender (by return e-mail or otherwise) immediately and delete this
> e-mail.
> >
> >
> > From: "Bharat Bhushan Saini" 
> > To: "users" 
> > Sent: Sunday, February 11, 2024 11:14:58 PM
> > Subject: CPU Core Consumption High
> >
> >
> >
> > Hi All,
> >
> >
> >
> > I am facing an issue regarding the core consumption by the cloudstack. I
> > started 2 vm with 6 cores and it takes 18 cores but when I poweroff the
> vm
> > the cores remains same in the dashboard.
> >
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> >
> >
> >
> > --- Disclaimer: --
> > This message and its contents are intended solely for the designated
> > addressee and are proprietary to Kloudspot. The information in this email
> > is meant exclusively for Kloudspot business use. Any use by individuals
> > other than the addressee constitutes misuse and an infringement of
> > Kloudspot's proprietary rights. If you are not the intended recipient,
> > please return this email to the sender. Kloudspot cannot guarantee the
> > security or error-free transmission of e-mail communications. Information
> > could be intercepted, corrupted, lost, destroyed, arrive late or
> > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> > for any issues arising from the transmission of this email.
> >
>
> --- Disclaimer: --
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>

Re: Unable to delete the template from the CloudStack 4.19

[Wei ZHOU]

You need to update the template type from SYSTEM to USER.

-Wei

On Mon, 19 Feb 2024 at 06:57, Kapil Bhuskute 
wrote:

> We are unable to delete a system template from the CloudStack 4.19
> management server from UI. The cloudmonkey API command is also failing with
> below errors to delete the template:
> (localcloud)  > delete template
> zoneid=cdf98dec-7061-442c-8466-cea05aa3f9b3
> id=9c55e8b4-570b-47c7-b634-94cfa1148943
> jobresultcode = 431
> created = 2024-02-19T05:53:07+
> domainid = 93097518-c82c-11ee-8d79-246e96679ca0
> userid = e928c912-c835-11ee-8d79-246e96679ca0
> jobresulttype = object
> jobinstancetype = Template
> completed = 2024-02-19T05:53:07+
> accountid = e927c982-c835-11ee-8d79-246e96679ca0
> jobinstanceid = 9c55e8b4-570b-47c7-b634-94cfa1148943
> account = admin
> cmd = org.apache.cloudstack.api.command.user.template.DeleteTemplateCmd
> jobstatus = 2
> jobprocstatus = 0
> jobresult = {
> "errorcode": 431,
> "errortext": "The DomR template cannot be deleted."
> }
> jobid = 56b29187-e556-4750-b351-8017b8cee423
> domainpath = ROOT
>  Error: async API failed for job 56b29187-e556-4750-b351-8017b8cee423
> (localcloud)  >
>
>
> Kindly suggest.
>
> Kapil Bhuskute
>

Re: ACL List Order

[Wei ZHOU]

Yes.

I suspect the source IP of the packets to the VR is not the IP `x.x.x.x/32`
in the rule.
You can use tcpdump in the VR to capture the packets and check the source
of the packets.

-Wei

On Thu, 15 Feb 2024 at 17:32, Wally B  wrote:

> I'm trying to add an allow rule for management into my ACL. I have a Deny
> All inbound at the bottom of the ACL and the allow management at the top.
> Yet I cannot SSH into Virtual Machines in the Subnet. If I change the Deny
> All Inbound to Allow or just remove it everything works.
>
> My understanding is that if I have an allow-all from x.x.x.x/32 at rule
> number 1 it would supersede any deny rules. Is that not correct?
>
> Here's my acl exported
>
>
> 6b7f371d-3dc4-469e-b5cf-6b74c1762195 all Ingress Active x.x.x.x/32
> 2d3758c6-2b98-433b-b507-c038ad03f33b test-acl-1 1 Allow TRUE SYSTEM:
> MANAGEMENT INBOUND
> 5baa2be8-39d1-4c6f-b2ee-e42b69f52242 icmp Ingress Active 0.0.0.0/0
> 2d3758c6-2b98-433b-b507-c038ad03f33b
>  test-acl-1 10998
> Deny TRUE Deny All
> ICMP Inbound
> 90801df9-3dcc-4406-8cf6-2923b70ce46a all Ingress Active 0.0.0.0/0
> 2d3758c6-2b98-433b-b507-c038ad03f33b
>  test-acl-1 11000
> Deny TRUE Deny All
> Inbound
>