[
https://issues.apache.org/jira/browse/CLOUDSTACK-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742075#comment-13742075
]
Koushik Das commented on CLOUDSTACK-4350:
-----------------------------------------
I looked at the uploaded logs (initial 1K hosts) and found that the time taken
for agent to come up is between 0 to 1 secs. Below are some snippets from the
logs suggesting that.
Snippet from starting of the logs for a simulated host
SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354 (as can be see the time
taken is ~0 secs.)
2013-08-15 03:45:51,189 DEBUG [agent.transport.Request] (ApiServer-4:null) Seq
-1--1: Startup request from directly connected host: { Cmd , MgmtId: -1, via:
-1, Ver: v1, Flags: 11,
[{"cpus":4,"speed":8000,"memory":8589934592,"dom0MinMemory":858993459,"poolSync":false,"vms":{},"caps":"hvm","hypervisorType":"Simulator","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"DcGlobal"},"type":"Routing","dataCenter":"1","pod":"92","cluster":"920","guid":"983467f0-7c25-4300-ac67-800e2a63a354","name":"SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354","version":"4.2.0-SNAPSHOT","privateIpAddress":"172.1.93.152","privateMacAddress":"00:00:00:00:00:00","storageIpAddress":"172.1.93.152","storageMacAddress":"00:00:00:00:00:00","storageIpAddressDeux":"172.1.93.152","storageMacAddressDeux":"172.1.93.152","agentTag":"agent-simulator","wait":0},{"parent":"/mnt/f9e83176-e98b-4d37-ac59-f9317cccfe32/","templateInfo":{},"totalSize":1099511627776,"poolInfo":{"uuid":"f9e83176-e98b-4d37-ac59-f9317cccfe32","host":"172.1.93.152","localPath":"/mnt/f9e83176-e98b-4d37-ac59-f9317cccfe32/","hostPath":"/mnt/f9e83176-e98b-4d37-ac59-f9317cccfe32/","poolType":"Filesystem","capacityBytes":1099511627776,"availableBytes":0},"resourceType":"STORAGE_POOL","fsType":"Filesystem","hostDetails":{},"type":"Storage","guid":"983467f0-7c25-4300-ac67-800e2a63a354","wait":0}]
}
2013-08-15 03:45:51,216 DEBUG [cloud.resource.ResourceState] (ApiServer-4:null)
Resource state update: [id = 921; name =
SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354; old state = Creating;
event = InternalCreated; new state = Enabled]
2013-08-15 03:45:51,216 DEBUG [cloud.host.Status] (ApiServer-4:null)
Transition:[Resource state = Enabled, Agent event = AgentConnected, Host id =
921, name = SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354]
2013-08-15 03:45:51,220 DEBUG [cloud.host.Status] (ApiServer-4:null) Agent
status update: [id = 921; name =
SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354; old status = Creating;
event = AgentConnected; new status = Connecting; old update count = 0; new
update count = 1]
2013-08-15 03:45:51,398 DEBUG [cloud.host.Status] (ApiServer-4:null)
Transition:[Resource state = Enabled, Agent event = Ready, Host id = 921, name
= SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354]
2013-08-15 03:45:51,403 DEBUG [cloud.host.Status] (ApiServer-4:null) Agent
status update: [id = 921; name =
SimulatedAgent.983467f0-7c25-4300-ac67-800e2a63a354; old status = Connecting;
event = Ready; new status = Up; old update count = 1; new update count = 2]
Snippet from end of the logs for a simulated host
SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab (as can be see the time
taken is ~1 sec.)
2013-08-15 03:47:29,559 DEBUG [agent.transport.Request] (ApiServer-9:null) Seq
-1--1: Startup request from directly connected host: { Cmd , MgmtId: -1, via:
-1, Ver: v1, Flags: 11,
[{"cpus":4,"speed":8000,"memory":8589934592,"dom0MinMemory":858993459,"poolSync":false,"vms":{},"caps":"hvm","hypervisorType":"Simulator","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"DcGlobal"},"type":"Routing","dataCenter":"1","pod":"100","cluster":"992","guid":"9a1ac158-8c97-41b6-ad6a-4303fd0f1bab","name":"SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab","version":"4.2.0-SNAPSHOT","privateIpAddress":"172.1.101.151","privateMacAddress":"00:00:00:00:00:00","storageIpAddress":"172.1.101.151","storageMacAddress":"00:00:00:00:00:00","storageIpAddressDeux":"172.1.101.151","storageMacAddressDeux":"172.1.101.151","agentTag":"agent-simulator","wait":0},{"parent":"/mnt/34e3b78b-aa5c-4656-ad76-79848d5350cd/","templateInfo":{},"totalSize":1099511627776,"poolInfo":{"uuid":"34e3b78b-aa5c-4656-ad76-79848d5350cd","host":"172.1.101.151","localPath":"/mnt/34e3b78b-aa5c-4656-ad76-79848d5350cd/","hostPath":"/mnt/34e3b78b-aa5c-4656-ad76-79848d5350cd/","poolType":"Filesystem","capacityBytes":1099511627776,"availableBytes":0},"resourceType":"STORAGE_POOL","fsType":"Filesystem","hostDetails":{},"type":"Storage","guid":"9a1ac158-8c97-41b6-ad6a-4303fd0f1bab","wait":0}]
}
2013-08-15 03:47:29,630 DEBUG [cloud.resource.ResourceState] (ApiServer-9:null)
Resource state update: [id = 993; name =
SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab; old state = Creating;
event = InternalCreated; new state = Enabled]
2013-08-15 03:47:29,630 DEBUG [cloud.host.Status] (ApiServer-9:null)
Transition:[Resource state = Enabled, Agent event = AgentConnected, Host id =
993, name = SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab]
2013-08-15 03:47:29,636 DEBUG [cloud.host.Status] (ApiServer-9:null) Agent
status update: [id = 993; name =
SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab; old status = Creating;
event = AgentConnected; new status = Connecting; old update count = 0; new
update count = 1]
2013-08-15 03:47:30,641 DEBUG [cloud.host.Status] (ApiServer-9:null)
Transition:[Resource state = Enabled, Agent event = Ready, Host id = 993, name
= SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab]
2013-08-15 03:47:30,649 DEBUG [cloud.host.Status] (ApiServer-9:null) Agent
status update: [id = 993; name =
SimulatedAgent.9a1ac158-8c97-41b6-ad6a-4303fd0f1bab; old status = Connecting;
event = Ready; new status = Up; old update count = 1; new update count = 2]
> [Performance Testing] Adding hosts take much longer time than baselines
> -----------------------------------------------------------------------
>
> Key: CLOUDSTACK-4350
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4350
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Management Server
> Affects Versions: 4.2.0
> Environment: 4.2, performance test env, with simulator
> Reporter: Sowmya Krishnan
> Assignee: Koushik Das
> Priority: Critical
> Labels: perfomance
> Fix For: 4.2.0
>
>
> Performance test setup:
> Basic zone, 1 host/cluster, tyring to deploy 20K simulator Hosts, with host
> tags
> Compared to baseline numbers, deploying hosts is taking much longer in the
> simulator environment
> For the 1st 1000 hosts, it took about 4 mins to deploy as per baseline
> With 4.2, the 1st 1000 hosts are taking almost 7 minutes
> Configurations:
> heap size: -Xmx12288m
> db.cloud.url.params=prepStmtCacheSize=517&cachePrepStmts=true&prepStmtCacheSqlLimit=4096&includeInnodbStatusInDeadlockExceptions=true&logSlowQueries=true
> For 20K Hosts, the number exponentially increases and the deployment time
> also increases.
> Attaching trace logs of 4.2 for 1k simulator hosts deployment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
