Re: 4.13 rbd snapshot delete failed

2019-09-06 Thread Andrija Panic
One question though... for me (4.13, Nautilus 14.2, test env) - it fails to
revert back to snapshot with below error

Which CEPH and QEMU/libvirt/os versions are you using?


Error:
2019-09-06 21:27:16,094 ERROR
[resource.wrapper.LibvirtRevertSnapshotCommandWrapper]
(agentRequest-Handler-3:null) (logid:9593f65a) Failed to connect to revert
snapshot due to RBD exception:
com.ceph.rbd.RbdException: Failed to open image 2
at com.ceph.rbd.Rbd.open(Rbd.java:243)
at com.ceph.rbd.Rbd.open(Rbd.java:226)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRevertSnapshotCommandWrapper.execute(LibvirtRevertSnapshotCommandWrapper.java:92)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRevertSnapshotCommandWrapper.execute(LibvirtRevertSnapshotCommandWrapper.java:49)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1476)
at com.cloud.agent.Agent.processRequest(Agent.java:640)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1053)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

On Fri, 6 Sep 2019 at 19:07, Andrija Panic  wrote:

> storage.cleanup.delay
> storage.cleanup.interval
>
> put both to 60 (seconds) and wait for up to 2min - should be deleted just
> fine...
>
> cheers
>
> On Fri, 6 Sep 2019 at 18:52, li jerry  wrote:
>
>> Hello All
>>
>> When I tested ACS 4.13 KVM + CEPH snapshot, I found that snapshots could
>> be created and rolled back (using API alone), but deletion could not be
>> completed.
>>
>>
>>
>> After executing the deletion API, the snapshot will disappear from the
>> list Snapshots, but the snapshot on CEPH RBD will not be deleted (rbd snap
>> list rbd/ac510428-5d09-4e86-9d34-9dfab3715b7c)
>>
>>
>>
>> Is there any way we can completely delete the snapshot?
>>
>> -Jerry
>>
>>
>
> --
>
> Andrija Panić
>


-- 

Andrija Panić


Hackathon @apachecon

2019-09-06 Thread Paul Angus
Hi All,

We have a large room for the day on Wednesday for a hackathon.  I think it 
might be a good idea if we marshal some thoughts around what we'd like to do 
with the time.
I guess that we'll end up with some splinter groups who want to work on 
something very specific together as well, I can't see that being a problem.

Some thing that I'd like to put out there as a discussion is the networking 
models - there has been talk of rationalising and dropping 'basic' networks as 
a separate model and using advanced networks with security groups instead.  
Also the combining of the VR and VPC code to make an isolated network a single 
tier VPC.   I'd like to have a group discussion around what everyone would like 
to do and how we might do it.

Are there any other topics that people think that would benefit from a group 
discussion ?


Cheers


Paul Angus


paul.an...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 



Re: 4.13 rbd snapshot delete failed

2019-09-06 Thread Andrija Panic
storage.cleanup.delay
storage.cleanup.interval

put both to 60 (seconds) and wait for up to 2min - should be deleted just
fine...

cheers

On Fri, 6 Sep 2019 at 18:52, li jerry  wrote:

> Hello All
>
> When I tested ACS 4.13 KVM + CEPH snapshot, I found that snapshots could
> be created and rolled back (using API alone), but deletion could not be
> completed.
>
>
>
> After executing the deletion API, the snapshot will disappear from the
> list Snapshots, but the snapshot on CEPH RBD will not be deleted (rbd snap
> list rbd/ac510428-5d09-4e86-9d34-9dfab3715b7c)
>
>
>
> Is there any way we can completely delete the snapshot?
>
> -Jerry
>
>

-- 

Andrija Panić


4.13 rbd snapshot delete failed

2019-09-06 Thread li jerry
Hello All

When I tested ACS 4.13 KVM + CEPH snapshot, I found that snapshots could be 
created and rolled back (using API alone), but deletion could not be completed.



After executing the deletion API, the snapshot will disappear from the list 
Snapshots, but the snapshot on CEPH RBD will not be deleted (rbd snap list 
rbd/ac510428-5d09-4e86-9d34-9dfab3715b7c)



Is there any way we can completely delete the snapshot?

-Jerry



[GitHub] [cloudstack-documentation] PaulAngus commented on issue #58: Hiding columns and keyboard labeling doc update

2019-09-06 Thread GitBox
PaulAngus commented on issue #58: Hiding columns and keyboard labeling doc 
update
URL: 
https://github.com/apache/cloudstack-documentation/pull/58#issuecomment-528906916
 
 
   @nvazquez @anuragaw @shwstppr review technical correctness still required to 
merge and publish asap please
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [cloudstack-documentation] PaulAngus commented on a change in pull request #58: Hiding columns and keyboard labeling doc update

2019-09-06 Thread GitBox
PaulAngus commented on a change in pull request #58: Hiding columns and 
keyboard labeling doc update
URL: 
https://github.com/apache/cloudstack-documentation/pull/58#discussion_r321795857
 
 

 ##
 File path: source/adminguide/ui.rst
 ##
 @@ -169,5 +169,93 @@ new, unique value.
 #. Type the new password, and click OK.
 
 
+Modifying the UI
+
+
+Root Administrators can modify some aspect of the UI, like:
+
+   -  Changing the keyboard names/labels (in the "Add Instance" wizard only)
+   -  Changing the text and the title in the "About" dialog box
+   -  Changing the Help link
+   -  Changing the application title on the browser tab
+   -  Hiding some columns in the Instance Metrics and Volume Metrics 
tables/views
+ 
+This can be done by editing the file 
"/usr/share/cloudstack-management/webapp/config.js" on your management 
server(s).
+After the file change, you do need to clear your browser cache. Hiding columns 
in Instance Metrics and Volume Metrics tables/views is only applicable to end 
users - i.e. those are always visible to Root Administrators.
+
+This is the default config.js content (comments ommitted for brevity):
+
+.. code:: javascript
+
+   cloudStackOptions = {
+  aboutText: "label.app.name", // This is the text shown in the 'About' box
+  aboutTitle: "label.about.app", // This is the Application 'Title' shown 
in the 'About' box
+  docTitle: "label.app.name", // This is the Application 'Title' shown on 
browser tab.
+  helpURL: "http://docs.cloudstack.apache.org/";, // This is the URL that 
opens when users click Help
+  keyboardOptions: {
+ "us": "label.standard.us.keyboard",
+ "uk": "label.uk.keyboard",
+ "fr": "label.french.azerty.keyboard",
+ "jp": "label.japanese.keyboard",
+ "sc": "label.simplified.chinese.keyboard"
+  },
+  hiddenFields: { // Fields to be hidden only for users in the tables below
+ "metrics.instances": [], // Options - "name", "state", "ipaddress", 
"zonename", "cpuused", "memused", "network", "disk"
+ "metrics.volumes": [] // Options - "name", "state", "vmname", 
"sizegb", "physicalsize", "utilization", "storagetype", "storage"
+  }
+   };
+
+Example of a changed confi.js file, is given bellow, as well as the apropriate 
screenshots which reflect (most of) those changes. Make sure that you are 
logged in as end user account.
+
+.. code:: javascript
+
+   cloudStackOptions = {
+  aboutText: "Custom About text!", // This is the text shown in the 
'About' box
+  aboutTitle: "Custom About Title!", // This is the Application 'Title' 
shown in the 'About' box
+  docTitle: "MyCloud", // This is the Application 'Title' shown on browser 
tab.
+  helpURL: "http://help.mycloud.com/";, // This is the URL that opens when 
users click Help
+  keyboardOptions: {
+ "us": "US",
+ "uk": "UK",
+ "fr": "FR",
+ "jp": "JP",
+ "sc": "CN"
+  },
+  hiddenFields: { // Fields to be hidden only for users in the tables below
+ "metrics.instances": ["zonename"], // Options - "name", "state", 
"ipaddress", "zonename", "cpuused", "memused", "network", "disk"
+ "metrics.volumes": ["utilization"] // Options - "name", "state", 
"vmname", "sizegb", "physicalsize", "utilization", "storagetype", "storage"
+  }
+   };
+
+|about-cloudstack-customized.JPG|
+
+Notice custom title and text
+
+
+|add-instance-keyboards-customized.JPG|
+
+Notice short keyboard names (based on country code)
+
+
+|instance-metrics-customized-view.JPG|
+
+Notice missing "Zone" column
+
+
+|volume-metrics-customized-view.JPG|
+
+Notice missing "Utilisation" column
 
 Review comment:
   ```suggestion
   Notice "Utilisation" column is hidden
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [cloudstack-documentation] PaulAngus commented on a change in pull request #58: Hiding columns and keyboard labeling doc update

2019-09-06 Thread GitBox
PaulAngus commented on a change in pull request #58: Hiding columns and 
keyboard labeling doc update
URL: 
https://github.com/apache/cloudstack-documentation/pull/58#discussion_r321795714
 
 

 ##
 File path: source/adminguide/ui.rst
 ##
 @@ -169,5 +169,93 @@ new, unique value.
 #. Type the new password, and click OK.
 
 
+Modifying the UI
+
+
+Root Administrators can modify some aspect of the UI, like:
+
+   -  Changing the keyboard names/labels (in the "Add Instance" wizard only)
+   -  Changing the text and the title in the "About" dialog box
+   -  Changing the Help link
+   -  Changing the application title on the browser tab
+   -  Hiding some columns in the Instance Metrics and Volume Metrics 
tables/views
+ 
+This can be done by editing the file 
"/usr/share/cloudstack-management/webapp/config.js" on your management 
server(s).
+After the file change, you do need to clear your browser cache. Hiding columns 
in Instance Metrics and Volume Metrics tables/views is only applicable to end 
users - i.e. those are always visible to Root Administrators.
+
+This is the default config.js content (comments ommitted for brevity):
+
+.. code:: javascript
+
+   cloudStackOptions = {
+  aboutText: "label.app.name", // This is the text shown in the 'About' box
+  aboutTitle: "label.about.app", // This is the Application 'Title' shown 
in the 'About' box
+  docTitle: "label.app.name", // This is the Application 'Title' shown on 
browser tab.
+  helpURL: "http://docs.cloudstack.apache.org/";, // This is the URL that 
opens when users click Help
+  keyboardOptions: {
+ "us": "label.standard.us.keyboard",
+ "uk": "label.uk.keyboard",
+ "fr": "label.french.azerty.keyboard",
+ "jp": "label.japanese.keyboard",
+ "sc": "label.simplified.chinese.keyboard"
+  },
+  hiddenFields: { // Fields to be hidden only for users in the tables below
+ "metrics.instances": [], // Options - "name", "state", "ipaddress", 
"zonename", "cpuused", "memused", "network", "disk"
+ "metrics.volumes": [] // Options - "name", "state", "vmname", 
"sizegb", "physicalsize", "utilization", "storagetype", "storage"
+  }
+   };
+
+Example of a changed confi.js file, is given bellow, as well as the apropriate 
screenshots which reflect (most of) those changes. Make sure that you are 
logged in as end user account.
+
+.. code:: javascript
+
+   cloudStackOptions = {
+  aboutText: "Custom About text!", // This is the text shown in the 
'About' box
+  aboutTitle: "Custom About Title!", // This is the Application 'Title' 
shown in the 'About' box
+  docTitle: "MyCloud", // This is the Application 'Title' shown on browser 
tab.
+  helpURL: "http://help.mycloud.com/";, // This is the URL that opens when 
users click Help
+  keyboardOptions: {
+ "us": "US",
+ "uk": "UK",
+ "fr": "FR",
+ "jp": "JP",
+ "sc": "CN"
+  },
+  hiddenFields: { // Fields to be hidden only for users in the tables below
+ "metrics.instances": ["zonename"], // Options - "name", "state", 
"ipaddress", "zonename", "cpuused", "memused", "network", "disk"
+ "metrics.volumes": ["utilization"] // Options - "name", "state", 
"vmname", "sizegb", "physicalsize", "utilization", "storagetype", "storage"
+  }
+   };
+
+|about-cloudstack-customized.JPG|
+
+Notice custom title and text
+
+
+|add-instance-keyboards-customized.JPG|
+
+Notice short keyboard names (based on country code)
+
+
+|instance-metrics-customized-view.JPG|
+
+Notice missing "Zone" column
 
 Review comment:
   ```suggestion
   Notice "Zone" column is hidden
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


Re: kvm: /var/log/cloudstack/agent/agent.log is a binary file

2019-09-06 Thread Wido den Hollander



On 9/5/19 6:03 PM, Riepl, Gregor (SWISS TXT) wrote:
> 
>>> Wido, makes sense that log4j and logrotate would conflict. Log4j
>>> has its
>>> own rotate functionality.
>>
> 
> Note that a few CS log files are not generated by log4j.
> You still need external logrotatation if you don't want them to fill up
> your disk.
> 
> I had this issue with access.log, for example.
> 
> I haven't encountered your "binary" log file issue, however.
> 

log4j and lograte combined seem to be the issue. The agent.log should
not be rotated by logrotate and then the issue is gone.

These files should however:

- security_group.log
- resizevolume.log

I'll check on a PR to fix this.

Create issue: https://github.com/apache/cloudstack/issues/3585

Wido