tuanhoangth1603 commented on issue #7336:
URL: https://github.com/apache/cloudstack/issues/7336#issuecomment-1467264467

   Thanks @kiwiflyer but not changed.
   This is my procedure:
   1. I removed the old CEPH primary storage that was added with one IP of 
ceph-mon, which was properly working. The result of the virsh pool-list command 
is:
   ```
    Name                                   State    Autostart
   ------------------------------------------------------------
    12d49b2f-792c-3aca-b27e-f9b9d5e858b2   active   no
    78ee67e3-53f0-4a62-b583-3f56975bd8a3   active   no
   ```
    12d49b2f-792c-3aca-b27e-f9b9d5e858b2: UUID of NFS Primary storage
    78ee67e3-53f0-4a62-b583-3f56975bd8a3: UUID of local storage pool
   
    2. I deleted the CEPH primary storage and CEPH pool, and then re-created a 
new CEPH pool. I added that pool to Cloudstack primary storage again via the 
rDNS of ceph-mon that points to 3 IPs, including an IP that was added 
previously. After adding the new pool, the result of the virsh list command is:
   ```
    Name                                   State    Autostart
   ------------------------------------------------------------
    12d49b2f-792c-3aca-b27e-f9b9d5e858b2   active   no
    78ee67e3-53f0-4a62-b583-3f56975bd8a3   active   no
    a1ace81c-e92d-31fb-b0bd-d8ac41219a78   active   no
   ```
   a1ace81c-e92d-31fb-b0bd-d8ac41219a78: this is new UUID of CEPH pool
   
   3. I create a new instance with CEPH primary storage, it's failed and show 
the error log as below:
   ```
   2023-03-14 09:15:28,998 WARN  
[resource.virtualnetwork.VirtualRoutingResource] (agentRequest-Handler-3:null) 
(logid:8378662e) Expected 1 answers while executing SetMonitorServiceCommand 
but received 3
   2023-03-14 09:15:29,254 INFO  
[resource.virtualnetwork.VirtualRoutingResource] (agentRequest-Handler-4:null) 
(logid:a6654827) Fetching health check result for 169.254.40.66 and executing 
fresh checks: false
   2023-03-14 09:15:42,361 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:c2df74eb) Trying to fetch storage pool 
12d49b2f-792c-3aca-b27e-f9b9d5e858b2 from libvirt
   2023-03-14 09:15:42,377 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:c2df74eb) Trying to fetch storage pool 
12d49b2f-792c-3aca-b27e-f9b9d5e858b2 from libvirt
   2023-03-14 09:15:42,389 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:c2df74eb) Trying to fetch storage pool 
12d49b2f-792c-3aca-b27e-f9b9d5e858b2 from libvirt
   2023-03-14 09:16:14,605 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-2:null) (logid:5f00792d) Trying to fetch storage pool 
12d49b2f-792c-3aca-b27e-f9b9d5e858b2 from libvirt
   2023-03-14 09:16:14,630 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-2:null) (logid:5f00792d) Asking libvirt to refresh 
storage pool 12d49b2f-792c-3aca-b27e-f9b9d5e858b2
   2023-03-14 09:16:14,642 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-3:null) (logid:5f00792d) Trying to fetch storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 from libvirt
   2023-03-14 09:16:14,649 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-3:null) (logid:5f00792d) Asking libvirt to refresh 
storage pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78
   2023-03-14 09:16:44,668 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-3:null) (logid:5f00792d) Attempting to create storage 
pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78 (RBD) in libvirt
   2023-03-14 09:16:44,690 WARN  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-3:null) (logid:5f00792d) Storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 was not found running in libvirt. Need to 
create it.
   2023-03-14 09:16:44,690 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-3:null) (logid:5f00792d) Didn't find an existing storage 
pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78 by UUID, checking for pools with 
duplicate paths
   2023-03-14 09:16:44,741 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-3:null) (logid:5f00792d) Trying to fetch storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 from libvirt
   2023-03-14 09:17:44,858 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:95c62b13) Trying to fetch storage pool 
12d49b2f-792c-3aca-b27e-f9b9d5e858b2 from libvirt
   2023-03-14 09:17:44,882 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:95c62b13) Asking libvirt to refresh 
storage pool 12d49b2f-792c-3aca-b27e-f9b9d5e858b2
   2023-03-14 09:17:44,937 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Trying to fetch storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 from libvirt
   2023-03-14 09:17:44,944 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Asking libvirt to refresh 
storage pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78
   2023-03-14 09:18:14,961 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Attempting to create storage 
pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78 (RBD) in libvirt
   2023-03-14 09:18:14,981 WARN  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 was not found running in libvirt. Need to 
create it.
   2023-03-14 09:18:14,982 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Didn't find an existing storage 
pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78 by UUID, checking for pools with 
duplicate paths
   2023-03-14 09:18:45,010 ERROR [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Failed to create RBD storage 
pool: org.libvirt.LibvirtException: failed to create the RBD IoCTX. Does the 
pool 'cloudstack-cfox' exist?: No such file or directory
   2023-03-14 09:18:45,010 ERROR [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-1:null) (logid:95c62b13) Failed to create the RBD storage 
pool, cleaning up the libvirt secret
   2023-03-14 09:19:45,132 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-4:null) (logid:079ae294) Trying to fetch storage pool 
12d49b2f-792c-3aca-b27e-f9b9d5e858b2 from libvirt
   2023-03-14 09:19:45,158 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-4:null) (logid:079ae294) Asking libvirt to refresh 
storage pool 12d49b2f-792c-3aca-b27e-f9b9d5e858b2
   2023-03-14 09:19:45,213 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:079ae294) Trying to fetch storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 from libvirt
   2023-03-14 09:19:45,216 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:079ae294) Attempting to create storage 
pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78 (RBD) in libvirt
   2023-03-14 09:19:45,218 WARN  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:079ae294) Storage pool 
a1ace81c-e92d-31fb-b0bd-d8ac41219a78 was not found running in libvirt. Need to 
create it.
   2023-03-14 09:19:45,218 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(agentRequest-Handler-5:null) (logid:079ae294) Didn't find an existing storage 
pool a1ace81c-e92d-31fb-b0bd-d8ac41219a78 by UUID, checking for pools with 
duplicate paths
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to