Sailaja Mada created CLOUDSTACK-3994: ----------------------------------------
Summary: Wrong error notification is generated when Primary storage (Cluster wide) is added with wrong path Key: CLOUDSTACK-3994 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3994 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: Storage Controller, VMware Affects Versions: 4.2.0 Reporter: Sailaja Mada Priority: Minor Steps: 1. Configure Adv Zone with VMWARE 2. Tried to add wrong cluster wide primary storage point It failed saying " Failed to delete storage pool on host" 2013-08-01 10:00:12,928 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532143: Executing request 2013-08-01 10:00:12,928 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532143: Response Received: 2013-08-01 10:00:12,929 DEBUG [agent.transport.Request] (DirectAgent-230:null) Seq 1-757532143: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"details":"success","wait":0}}] } 2013-08-01 10:00:12,933 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532143: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, { Answer } } 2013-08-01 10:00:12,933 DEBUG [agent.manager.AgentManagerImpl] (catalina-exec-23:null) Details from executing class com.cloud.agent.api.CreateStoragePoolCommand: success 2013-08-01 10:00:12,933 DEBUG [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (catalina-exec-23:null) In createPool Adding the pool to each of the hosts 2013-08-01 10:00:12,935 DEBUG [cloud.storage.StorageManagerImpl] (catalina-exec-23:null) Adding pool null to host 1 2013-08-01 10:00:12,940 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532144: Sending { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.ModifyStoragePoolCommand":{"add":true,"pool":{"id":5,"uuid":"86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","host":"10.102.192.100","path":"/cpg_vol/sailaja/ps1","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","wait":0}}] } 2013-08-01 10:00:12,941 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532144: Executing: { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.ModifyStoragePoolCommand":{"add":true,"pool":{"id":5,"uuid":"86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","host":"10.102.192.100","path":"/cpg_vol/sailaja/ps1","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","wait":0}}] } 2013-08-01 10:00:12,941 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532144: Executing request 2013-08-01 10:00:12,942 INFO [vmware.resource.VmwareResource] (DirectAgent-230:10.102.192.18) Executing resource ModifyStoragePoolCommand: {"add":true,"pool":{"id":5,"uuid":"86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","host":"10.102.192.100","path":"/cpg_vol/sailaja/ps1","port":2049,"type":"NetworkFilesystem"},"localPath":"/mnt//86ee5258-33e7-36f0-b3c1-f6029e5c8bdf","wait":0} 2013-08-01 10:00:13,144 INFO [vmware.mo.HostMO] (DirectAgent-230:10.102.192.18) Creation of NFS datastore on vCenter failed. Details: vCenter API trace - mountDatastore(). target MOR: host-8973, vmfs: false, poolHost: 10.102.192.100, poolHostPort: 2049, poolPath: /cpg_vol/sailaja/ps1, poolUuid: 86ee525833e736f0b3c1f6029e5c8bdf. Exception mesg: An error occurred during host configuration. 2013-08-01 10:00:13,145 ERROR [vmware.resource.VmwareResource] (DirectAgent-230:10.102.192.18) ModifyStoragePoolCommand failed due to Exception: java.lang.Exception Message: Creation of NFS datastore on vCenter failed. java.lang.Exception: Creation of NFS datastore on vCenter failed. at com.cloud.hypervisor.vmware.mo.HostMO.mountDatastore(HostMO.java:772) at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4102) at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:472) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-08-01 10:00:13,148 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 1-757532144: Response Received: 2013-08-01 10:00:13,151 DEBUG [agent.transport.Request] (DirectAgent-230:null) Seq 1-757532144: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"ModifyStoragePoolCommand failed due to Exception: java.lang.Exception\nMessage: Creation of NFS datastore on vCenter failed.\n","wait":0}}] } 2013-08-01 10:00:13,152 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 1-757532144: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1, Flags: 10, { Answer } } 2013-08-01 10:00:13,152 DEBUG [agent.manager.AgentManagerImpl] (catalina-exec-23:null) Details from executing class com.cloud.agent.api.ModifyStoragePoolCommand: ModifyStoragePoolCommand failed due to Exception: java.lang.Exception Message: Creation of NFS datastore on vCenter failed. 2013-08-01 10:00:13,152 WARN [apache.cloudstack.alerts] (catalina-exec-23:null) alertType:: 7 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Unable to attach storage pool5 to the host1 2013-08-01 10:00:13,161 WARN [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (catalina-exec-23:null) Unable to establish a connection between Host[-1-Routing] and org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@19976649 com.cloud.utils.exception.CloudRuntimeException: Unable establish connection from storage head to storage pool 5 due to ModifyStoragePoolCommand failed due to Exception: java.lang.Exception Message: Creation of NFS datastore on vCenter failed. 5 at org.apache.cloudstack.storage.datastore.provider.DefaultHostListener.hostConnect(DefaultHostListener.java:66) at com.cloud.storage.StorageManagerImpl.connectHostToSharedPool(StorageManagerImpl.java:882) at org.apache.cloudstack.storage.datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl.attachCluster(CloudStackPrimaryDataStoreLifeCycleImpl.java:390) at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:746) at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:176) at org.apache.cloudstack.api.command.admin.storage.CreateStoragePoolCmd.execute(CreateStoragePoolCmd.java:168) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:514) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:372) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:305) at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-08-01 10:00:13,163 WARN [datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl] (catalina-exec-23:null) No host can access storage pool org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@19976649 on cluster 1 2013-08-01 10:00:13,175 DEBUG [cloud.storage.StorageManagerImpl] (catalina-exec-23:null) Failed to add data store com.cloud.utils.exception.CloudRuntimeException: Failed to access storage pool at org.apache.cloudstack.storage.datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl.attachCluster(CloudStackPrimaryDataStoreLifeCycleImpl.java:401) at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:746) at com.cloud.storage.StorageManagerImpl.createPool(StorageManagerImpl.java:176) at org.apache.cloudstack.api.command.admin.storage.CreateStoragePoolCmd.execute(CreateStoragePoolCmd.java:168) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:514) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:372) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:305) at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-08-01 10:00:13,180 INFO [cloud.api.ApiServer] (catalina-exec-23:null) Failed to delete storage pool on host 2013-08-01 10:00:13,181 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.144.6.19 -- GET command=createStoragePool&scope=cluster&zoneid=176d7081-e1d2-4472-8a17-eff1322ddd39&podid=c227dd76-6ffd-4dc2-ad8a-0a71fc92c763&clusterid=2a9b03c7-edaa-416c-9e6c-d2cb8baf056e&name=new1&url=nfs%3A%2F%2F10.102.192.100%2Fcpg_vol%2Fsailaja%2Fps1&response=json&sessionkey=x8JP8GtGm4LirW0b8AK9sVj26D0%3D&_=1375331641550 2013-08-01 10:00:13,203 DEBUG [storage.image.BaseImageStoreDriverImpl] (RemoteHostEndPoint-8:null) Performing image store createTemplate async callback 2013-08-01 10:00:13,647 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 2-8579: Processing Seq 2-8579: { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2013-08-01 10:00:13,653 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 2-8579: Sending Seq 2-8579: { Ans: , MgmtId: 187767034175903, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } ^C -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira