[GitHub] [cloudstack-primate] DaanHoogland opened a new issue #374: [FEATURE] a query component for text driven questions to a user

[GitBox]

DaanHoogland opened a new issue #374:
URL: https://github.com/apache/cloudstack-primate/issues/374


   **Is your feature request related to a problem? Please describe.**
   When a user uploads an OVA template it might contain properties that require 
answering when deploying a VM based on that template. This is a concrete 
example but there might be others where the UI needs to query the user based on 
a text input. in the OVA deployment case we have
   - a query
   - a name
   - a default value
   - a type and
   - a constraints field (called "qualifiers" internally)
   I think a component might have more use than the OVA deployment. It can be 
used for cmdline parameters or more specific control of user-data input. Maybe 
for some plugins it could be used to control hardware specific configuration. I 
think it could even be useful for more static parts of the UI interaction.
   
   **Describe the solution you'd like**
   I would like a vue.js component that takes above input and can return the 
user choice or input (depending on type and constraints).
   
   **Describe alternatives you've considered**
   An alternative would be javascript methods as implemented in the old UI's 
instanceWizard. The amount of work would be the same but it would not be usable 
in multiple location but as boilerplate code.
   
   **Additional context**
   In the old UI a step 7.5 of sorts was put between step 7 and 8 of the deploy 
wizard in case an OVA would contain ovf properties. in the new UI this would be 
part of the deployment form (mistakenly called a wizard still). 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-primate] vladimirpetrov commented on pull request #326: Form to Migrate data between Image stores

[GitBox]

vladimirpetrov commented on pull request #326:
URL: 
https://github.com/apache/cloudstack-primate/pull/326#issuecomment-637979031


   @blueorangutan package



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-primate] blueorangutan commented on pull request #326: Form to Migrate data between Image stores

[GitBox]

blueorangutan commented on pull request #326:
URL: 
https://github.com/apache/cloudstack-primate/pull/326#issuecomment-637979251


   @vladimirpetrov a Jenkins job has been kicked to build primate packages. 
I'll keep you posted as I make progress.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-primate] rhtyd commented on pull request #372: Add support for UI customisation

[GitBox]

rhtyd commented on pull request #372:
URL: 
https://github.com/apache/cloudstack-primate/pull/372#issuecomment-637805114


   @utchoang just a note - when you test please do a `npm run build` and 
copy/run the dist files either under nginx/docker or within a CloudStack 
management server. The idea is end-user would install rpm/deb/docker container 
etc and should be able to make changes to the theme.json (or similar) config 
file.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Re: Managed Storage and HA

[Tutkowski, Mike]

Hi Sven,

You can use the ListVolumeStats API call (I put in an example request and 
response below).

Since this goes over the management network, though, it's possible if your 
management network is down, but your storage network is up that this call could 
fail, but your VMs might still have perfectly good access to their volumes.

Talk to you later!
Mike

Request:

{
   "method": "ListVolumeStats",
   "params": {
"volumeIDs": [1, 2]
   },
   "id" : 1
}

Response:

{
"id": 1,
"result": {
"volumeStats": [
{
"accountID": 1,
"actualIOPS": 14,
"asyncDelay": null,
"averageIOPSize": 13763,
"burstIOPSCredit": 0,
"clientQueueDepth": 0,
"desiredMetadataHosts": null,
"latencyUSec": 552,
"metadataHosts": {
"deadSecondaries": [],
"liveSecondaries": [],
"primary": 5
},
"nonZeroBlocks": 10962174,
"normalizedIOPS": 34,
"readBytes": 747306804224,
"readBytesLastSample": 0,
"readLatencyUSec": 0,
"readLatencyUSecTotal": 11041939920,
"readOps": 19877559,
"readOpsLastSample": 0,
"samplePeriodMSec": 500,
"throttle": 0,
"timestamp": "2020-06-02T17:14:35.444789Z",
"unalignedReads": 2176454,
"unalignedWrites": 1438822,
"volumeAccessGroups": [
1
],
"volumeID": 1,
"volumeSize": 2147483648000,
"volumeUtilization": 0.002267,
"writeBytes": 3231402834432,
"writeBytesLastSample": 106496,
"writeLatencyUSec": 552,
"writeLatencyUSecTotal": 44174792405,
"writeOps": 340339085,
"writeOpsLastSample": 7,
"zeroBlocks": 513325826
},
{
"accountID": 1,
"actualIOPS": 0,
"asyncDelay": null,
"averageIOPSize": 11261,
"burstIOPSCredit": 0,
"clientQueueDepth": 0,
"desiredMetadataHosts": null,
"latencyUSec": 0,
"metadataHosts": {
"deadSecondaries": [],
"liveSecondaries": [],
"primary": 5
},
"nonZeroBlocks": 28816654,
"normalizedIOPS": 0,
"readBytes": 778768996864,
"readBytesLastSample": 0,
"readLatencyUSec": 0,
"readLatencyUSecTotal": 7068679159,
"readOps": 14977610,
"readOpsLastSample": 0,
"samplePeriodMSec": 500,
"throttle": 0,
"timestamp": "2020-06-02T17:14:35.445978Z",
"unalignedReads": 890959,
"unalignedWrites": 358758,
"volumeAccessGroups": [
1
],
"volumeID": 2,
"volumeSize": 2147483648000,
"volumeUtilization": 0,
"writeBytes": 8957684071424,
"writeBytesLastSample": 0,
"writeLatencyUSec": 0,
"writeLatencyUSecTotal": 16780712096,
"writeOps": 406101472,
"writeOpsLastSample": 0,
"zeroBlocks": 495471346
}
]
}
}

On 6/2/20, 9:11 AM, "Sven Vogel"  wrote:

NetApp Security WARNING: This is an external email. Do not click links or 
open attachments unless you recognize the sender and know the content is safe.




Hi Paul,

Thanks for the answer and help.

Ok. Secondary Storage is no good solution what I understand.

> 1. HAManager
> 2. HighAvailbilityManager
> 3. KVMHAConfig


which of the three should we expand and which one should be active?

@Mike did you know somethings like that if there is a check of volume 
activity?
Maybe we can poll the API but I think this will be a massive polling 
(overload) if we poll for each volume.
Ah the moment I don’t have any idea how this could work.

Cheers

Sven


__

Sven Vogel
Lead Cloud Solution Architect

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98
s.vo...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

EWERK-Blog | LinkedIn | Xing | Twitter | Facebook

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Pr

Re: Managed Storage and HA

[Sven Vogel]

Hi Paul,

Thanks for the answer and help.

Ok. Secondary Storage is no good solution what I understand.

> 1. HAManager
> 2. HighAvailbilityManager
> 3. KVMHAConfig


which of the three should we expand and which one should be active?

@Mike did you know somethings like that if there is a check of volume activity?
Maybe we can poll the API but I think this will be a massive polling (overload) 
if we poll for each volume.
Ah the moment I don’t have any idea how this could work.

Cheers

Sven


__

Sven Vogel
Lead Cloud Solution Architect

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98
s.vo...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

EWERK-Blog | LinkedIn | Xing | Twitter | Facebook

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
Dank.

The contents of this e-mail (including any attachments) are confidential and 
may be legally privileged. If you are not the intended recipient of this 
e-mail, any disclosure, copying, distribution or use of its contents is 
strictly prohibited, and you should please notify the sender immediately and 
then delete it (including any attachments) from your system. Thank you.
> Am 01.06.2020 um 19:30 schrieb Paul Angus :
>
> Hi Sven,
>
> I think that there is a piece of the jigsaw that you are missing.
>
> Given that the only thing that we know, is that we can no longer communicate 
> with the host agent;  To avoid split brain/corruption of VMs, CloudStack must 
> determine if the guests VMs are still running on the host not.  The only way 
> we can do that is look for disk activity created by those VMs.
>
> Using a secondary storage heartbeat would give a false 'host is down' if say 
> a switch went down carrying sec storage and mgmt. traffic
>
> Wrt solidfire, you could poll SolidFire via API for activity on the volumes 
> which belong to the VMs on the unresponsive host.  I don't know if there is 
> an equivalent for Ceph.
>
> Kind regards
>
>
> Paul Angus
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Sven Vogel 
> Sent: 01 June 2020 12:30
> To: dev 
> Subject: Managed Storage and HA
>
> Hi Community,
>
> I try to encounter how HA works. Our goal is it to make it usable with 
> managed storage like (Netapp Solidfire / maybe it works with CEPH too) so if 
> its possible.
>
> This is a good guide and for some times we fixed and added the missing keys.
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/High+Availability+Developer%27s+Guide
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA
>
> In the database I found out there are three different types of HA.
>
> If you select in the configuration table "SELECT * FROM `configuration` WHERE 
> `component` LIKE '%ha%' LIMIT 0,1000;“ you will get three types of components.
>
> 1. HAManager
> 2. HighAvailbilityManager
> 3. KVMHAConfig
>
> "HAManager and HighAvailbilityManager" are the base which was extended from 
> Rohit with „KVMHAConfig“ - KVM with stonith fencing.
>
> I understand all things work together but maybe I need to understand the 
> process a little bit better.
>
> 
> To clarify I write down what I think to each of them. This is what I 
> understand but please correct me or help me to understand it a little bit 
> better.
>
> —>I found out that if we use managed storage a restart of virtual machines 
> only works on the same host. This is what I understand the lack of the 
> missing heartbeat file on the shared storage because we don’t have shared 
> storage like NFS.
>
> —
> "If the network ping investigation returns that it cannot detect the status 
> of the host, CloudStack HA then relies on the hypervisor specific 
> investigation. For VMware, there is no such investigation as the hypervisor 
> host handles its own HA. For XenServer and KVM, CloudStack HA deploys a 
> monitoring script that writes the current timestamp on to a heartbeat file on 
> shared storage."
> —
>
> And
>
> —
> For the initial release, only KVM with NFS storage will be supported. 
> However, the storage check component will be impleme

[GitHub] [cloudstack-documentation] ACSGitBot commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

ACSGitBot commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637516625


   Build finished.  You can review it at:   
https://acs-www.shapeblue.com/docs/WIP-PROOFING/pr134
   
   Build Log Output:
   
   
   No log errors found to report.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] ACSGitBot commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

ACSGitBot commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637515504


   Your request had been received, i'll go and build the documentation and 
check the output log for errors.
   
   This shouldn't take long.
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] shwstppr commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

shwstppr commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637515453


   request docbuild



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] shwstppr commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

shwstppr commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637515746


   @andrijapanicsb should be okay now



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] andrijapanicsb commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

andrijapanicsb commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637492571


   @shwstppr can you please rebased against 4.14 branch - as we need the fix in 
4.14 Docs (and I will forward merge later to master) - thx



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] andrijapanicsb commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

andrijapanicsb commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637491957


   @nvazquez can we also please include the improvements around supporting 
local/sharedMount points please, and also make correction/update that template 
is NOT downloaded directly to the Primary Storage, but to the staging/scratch 
area (which could be local or remote/mounted shared etc).



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] andrijapanicsb commented on a change in pull request #134: kvm: direct download templates for system VM

[GitBox]

andrijapanicsb commented on a change in pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#discussion_r433814577



##
File path: source/adminguide/templates/_bypass-secondary-storage-kvm.rst
##
@@ -41,6 +41,13 @@ To enable this option for a template:
 
 After the template is registered, it is automatically available for VM 
deployments.
 
+From CloudStack 4.14.0, system VM also support direct download templates. An 
administrator can register a new system VM template as ROUTING or USER type 
with the direct download flag, and it can be changed to SYSTEM type during the 
upgrade or by out-of-band database changes. Type of newly registered template 
can be changed to SYSTEM in the database using a SQL query similar to:

Review comment:
   ```suggestion
   From CloudStack 4.14.0, system VM templates also support direct download. An 
administrator can register a new system VM template as ROUTING or USER type 
with the direct download flag, and it can be changed to SYSTEM type during the 
upgrade or by out-of-band database changes. Type of newly registered template 
can be changed to SYSTEM in the database using a SQL query similar to:
   ```





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Broken SG on new 4.14 Centos7 installations

[nux]

Hi,

The SG functionality does not work on new 4.14 installations on CentOS7.
The sg python scripts call python3, but no python3 libvirt bindings 
installed by default (only python2).


Fixed it in the centos7 rpm spec here, python36-libvirt from EPEL is 
required.

https://github.com/apache/cloudstack/pull/4124/commits/aa984f5ea7508f9c3154a712fb617f0fabc8c7e1

HTH

[GitHub] [cloudstack-documentation] shwstppr commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

shwstppr commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637462649


   @andrijapanicsb please check



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] ACSGitBot commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

ACSGitBot commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637460039


   Build finished.  You can review it at:   
https://acs-www.shapeblue.com/docs/WIP-PROOFING/pr134
   
   Build Log Output:
   
   
   No log errors found to report.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] shwstppr commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

shwstppr commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637458994


   request docbuild



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] ACSGitBot commented on pull request #134: kvm: direct download templates for system VM

[GitBox]

ACSGitBot commented on pull request #134:
URL: 
https://github.com/apache/cloudstack-documentation/pull/134#issuecomment-637459037


   Your request had been received, i'll go and build the documentation and 
check the output log for errors.
   
   This shouldn't take long.
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] shwstppr opened a new pull request #134: kvm: direct download templates for system VM

[GitBox]

shwstppr opened a new pull request #134:
URL: https://github.com/apache/cloudstack-documentation/pull/134


   System VMs now support direct download templates.
   Different direct download timeouts have been made configurable with new 
global settings.
   Added with
   https://github.com/apache/cloudstack/pull/3731



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-documentation] davidjumani opened a new pull request #133: Edit OVS Plugin

[GitBox]

davidjumani opened a new pull request #133:
URL: https://github.com/apache/cloudstack-documentation/pull/133


   Adding a note to inform users how to use OVS despite it not showing up as a 
network service provider



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-primate] davidjumani opened a new pull request #373: Adding pvlan option for l2 and fixing passing none for no pvlan type

[GitBox]

davidjumani opened a new pull request #373:
URL: https://github.com/apache/cloudstack-primate/pull/373


   This adds the option to create PVLAN for L2 networks, as well as fixes the 
issue caused by passing 'none' as the PVLAN type when no secondary VLAN type is 
selected



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [cloudstack-primate] davidjumani commented on issue #369: [BUG] Fix translation usage across config and components and fix doclinks

[GitBox]

davidjumani commented on issue #369:
URL: 
https://github.com/apache/cloudstack-primate/issues/369#issuecomment-637350976


   Fixing in #371 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org