xuanyuanaosheng edited a comment on issue #5741:
URL: https://github.com/apache/cloudstack/issues/5741#issuecomment-986555736
@wido @weizhouapache
I have check all the config as your advices.
1. The label.rados.monitor is 10.29.44.1:6789 , The kvm node and the
v-route node can access the ceph node
```
kvm001:~# telnet 10.29.44.1 6789
Trying 10.29.44.1...
Connected to 10.29.44.1.
Escape character is '^]'.
ceph v027
,
񗲨ell
root@s-252-VM:~# telnet 10.29.44.1 6789
Trying 10.29.44.1...
Connected to 10.29.44.1.
Escape character is '^]'.
ceph v027
,
```
2. The RBD pool is exists: cloudstack
3. The user cloudstack has the access to the RBD pool: cloudstack
4. The secret is '_AQDLxqlhIdOLJRAABPqps8O6eSGbFnyR7aSJwQ==_' that has no
/ (slash) in the secret
5. The KVM node has ceph config: ceph.client.admin.keyring
```
# ls /etc/ceph/
ceph.client.admin.keyring ceph.client.cloudstack.keyring ceph.conf rbdmap
```
6. The related info and The libvirt secrets has nothing:
```
# virsh pool-list
Name State Autostart
------------------------------------------------------------
60b59087-7c53-3058-a50c-f50737e556bc active no
c4355ed4-8833-381f-b3f7-2981782ee3fa active no
c8e9ca6a-c004-3851-a074-19f4948b28ff active no
d8dabcb0-1a57-4e13-8a82-339b2052dec1 active no
# virsh secret-list
UUID Usage
---------------
# ls -a /etc/libvirt/secrets/
. ..
```
But I can not find the storage pool
**_d8dabcb0-1a57-4e13-8a82-339b2052dec1_** on cloudstack UI.
The error is still:
```
2021-12-06 17:42:02,899 DEBUG [kvm.resource.LibvirtConnection]
(Thread-4654:null) (logid:) Looking for libvirtd connection at: qemu:///system
2021-12-06 17:42:02,900 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4654:null)
(logid:) Found NFS storage pool c4355ed4-8833-381f-b3f7-2981782ee3fa in
libvirt, continuing
2021-12-06 17:42:02,900 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4654:null)
(logid:) Executing:
/usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh -i
10.29.44.1 -p /cephfs/cloudstack -m /mnt/c4355ed4-8833-381f-b3f7-2981782ee3fa
-h 10.26.246.6
2021-12-06 17:42:02,901 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4654:null)
(logid:) Executing while with timeout : 60000
2021-12-06 17:42:02,920 DEBUG [kvm.resource.KVMHAMonitor] (Thread-4654:null)
(logid:) Execution is successful.
2021-12-06 17:42:04,533 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-2:null) (logid:21625d39) Processing command:
com.cloud.agent.api.GetHostStatsCommand
2021-12-06 17:42:29,342 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-4:null) (logid:a04d2914) Failed to create RBD storage
pool: org.libvirt.LibvirtException: failed to create the RBD IoCTX. Does the
pool 'cloudstack' exist?: No such file or directory
2021-12-06 17:42:29,342 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-4:null) (logid:a04d2914) Failed to create the RBD storage
pool, cleaning up the libvirt secret
2021-12-06 17:42:29,343 WARN [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:a04d2914) Caught:
com.cloud.utils.exception.CloudRuntimeException: Failed to create storage
pool: b90eae9d-973c-362c-8afc-af88f0743892
at
com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:645)
at
com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.createStoragePool(KVMStoragePoolManager.java:329)
at
com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.createStoragePool(KVMStoragePoolManager.java:323)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtModifyStoragePoolCommandWrapper.execute(LibvirtModifyStoragePoolCommandWrapper.java:42)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtModifyStoragePoolCommandWrapper.execute(LibvirtModifyStoragePoolCommandWrapper.java:35)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1648)
at com.cloud.agent.Agent.processRequest(Agent.java:661)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1079)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2021-12-06 17:42:29,344 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:a04d2914) Seq 15-6687845446645196317: {
Ans: , MgmtId: 345052215515, via: 15, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":"false","details":"com.cloud.utils.exception.CloudRuntimeException:
Failed to create storage pool: b90eae9d-973c-362c-8afc-af88f0743892
at
com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:645)
at
com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.createStoragePool(KVMStoragePoolManager.java:329)
at
com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.createStoragePool(KVMStoragePoolManager.java:323)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtModifyStoragePoolCommandWrapper.execute(LibvirtModifyStoragePoolCommandWrapper.java:42)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtModifyStoragePoolCommandWrapper.execute(LibvirtModifyStoragePoolCommandWrapper.java:35)
at
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1648)
at com.cloud.agent.Agent.processRequest(Agent.java:661)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1079)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
","wait":"0","bypassHostMaintenance":"false"}}] }
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
