[
https://issues.apache.org/jira/browse/CLOUDSTACK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861271#comment-13861271
]
Sateesh Chodapuneedi commented on CLOUDSTACK-5408:
--------------------------------------------------
Messages from kernel inside SSVM with 256MB memory shows,
Jan 2 15:07:24 s-12-VM kernel: [18356.940273] Node 0 DMA32 free:1908kB
min:1904kB low:2380kB high:2856kB active_anon:100256kB inactive_anon:100564kB
active_file:108kB inactive_file:144kB unevictable:0kB isolated(anon):24kB
isolated(file):0kB present:242272kB mlocked:0kB dirty:4kB writeback:492kB
mapped:64kB shmem:24kB slab_reclaimable:4428kB slab_unreclaimable:12196kB
kernel_stack:1072kB pagetables:3312kB unstable:0kB bounce:0kB writeback_tmp:0kB
pages_scanned:409 all_unreclaimable? yes
Jan 2 15:07:24 s-12-VM kernel: [18356.940282] lowmem_reserve[]: 0 0 0 0
Jan 2 15:07:24 s-12-VM kernel: [18356.940285] Node 0 DMA: 0*4kB 1*8kB 0*16kB
1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1064kB
Jan 2 15:07:24 s-12-VM kernel: [18356.940291] Node 0 DMA32: 475*4kB 1*8kB
0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1908kB
Jan 2 15:07:24 s-12-VM kernel: [18356.940297] 2386 total pagecache pages
Jan 2 15:07:24 s-12-VM kernel: [18356.940298] 2311 pages in swap cache
Jan 2 15:07:24 s-12-VM kernel: [18356.940300] Swap cache stats: add 172642,
delete 170331, find 48505/61710
Jan 2 15:07:24 s-12-VM kernel: [18356.940301] Free swap = 0kB
Jan 2 15:07:24 s-12-VM kernel: [18356.940302] Total swap = 149500kB
Jan 2 15:07:24 s-12-VM kernel: [18356.940982] 65520 pages RAM
Jan 2 15:07:24 s-12-VM kernel: [18356.940984] 3755 pages reserved
Jan 2 15:07:24 s-12-VM kernel: [18356.940985] 60 pages shared
Jan 2 15:07:24 s-12-VM kernel: [18356.940986] 60488 pages non-shared
Jan 2 15:07:24 s-12-VM kernel: [18356.940987] [ pid ] uid tgid total_vm
rss cpu oom_adj oom_score_adj name
Jan 2 15:07:24 s-12-VM kernel: [18356.940992] [ 342] 0 342 5371
1 0 -17 -1000 udevd
Jan 2 15:07:24 s-12-VM kernel: [18356.940995] [ 423] 0 423 5370
1 0 -17 -1000 udevd
Jan 2 15:07:24 s-12-VM kernel: [18356.940997] [ 424] 0 424 5370
1 0 -17 -1000 udevd
Jan 2 15:07:24 s-12-VM kernel: [18356.941000] [ 2283] 0 2283 4742
0 0 0 0 rpcbind
Jan 2 15:07:24 s-12-VM kernel: [18356.941003] [ 2314] 104 2314 5835
0 0 0 0 rpc.statd
Jan 2 15:07:24 s-12-VM kernel: [18356.941005] [ 2328] 0 2328 7374
1 0 0 0 rpc.idmapd
Jan 2 15:07:24 s-12-VM kernel: [18356.941008] [ 3356] 0 3356 25126
55 0 0 0 vmtoolsd
Jan 2 15:07:24 s-12-VM kernel: [18356.941010] [ 3595] 0 3595 15910
0 0 0 0 rsyslogd
Jan 2 15:07:24 s-12-VM kernel: [18356.941013] [ 3632] 0 3632 1028
0 0 0 0 acpid
Jan 2 15:07:24 s-12-VM kernel: [18356.941015] [ 3674] 0 3674 5161
1 0 0 0 cron
Jan 2 15:07:24 s-12-VM kernel: [18356.941018] [ 3705] 102 3705 9747
19 0 0 0 ntpd
Jan 2 15:07:24 s-12-VM kernel: [18356.941020] [ 3897] 0 3897 4413
0 0 0 0 bash
Jan 2 15:07:24 s-12-VM kernel: [18356.941023] [ 3908] 0 3908 4436
1 0 0 0 bash
Jan 2 15:07:24 s-12-VM kernel: [18356.941025] [ 4405] 0 4308 195118
51440 0 0 0 java
Jan 2 15:07:24 s-12-VM kernel: [18356.941028] [ 4390] 0 4390 3643
1 0 0 0 getty
Jan 2 15:07:24 s-12-VM kernel: [18356.941030] [ 4391] 0 4391 3643
1 0 0 0 getty
Jan 2 15:07:24 s-12-VM kernel: [18356.941035] [ 4392] 0 4392 3643
1 0 0 0 getty
Jan 2 15:07:24 s-12-VM kernel: [18356.941038] [ 4393] 0 4393 3643
1 0 0 0 getty
Jan 2 15:07:24 s-12-VM kernel: [18356.941040] [ 4394] 0 4394 3643
1 0 0 0 getty
Jan 2 15:07:24 s-12-VM kernel: [18356.941043] [ 4395] 0 4395 3643
1 0 0 0 getty
Jan 2 15:07:24 s-12-VM kernel: [18356.941045] [ 4432] 0 4432 12462
0 0 -17 -1000 sshd
Jan 2 15:07:24 s-12-VM kernel: [18356.941048] [ 4637] 0 4637 21406
11 0 0 0 apache2
Jan 2 15:07:24 s-12-VM kernel: [18356.941050] [ 4639] 33 4639 21215
0 0 0 0 apache2
Jan 2 15:07:24 s-12-VM kernel: [18356.941053] [ 4640] 33 4640 77263
0 0 0 0 apache2
Jan 2 15:07:24 s-12-VM kernel: [18356.941055] [ 4641] 33 4641 77263
0 0 0 0 apache2
Jan 2 15:07:24 s-12-VM kernel: [18356.941057] [ 4765] 0 4765 8168
0 0 0 0 ntpd
Jan 3 06:25:23 s-12-VM cloud: cloud-cleanup cronjob: cleaning up logfiles in
/var/log/cloud older than 7 days and more than 1M in size
Jan
> [Automation] Failed to deploy vm in vmware environment with error "due to
> java.io.IOException: Cannot run program "mount": java.io.IOException:
> error=12, Cannot allocate memory"
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-5408
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5408
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: VMware
> Affects Versions: 4.3.0
> Environment: vmware 5.0 update 3
> 64 bit template
> Reporter: Rayees Namathponnan
> Assignee: Sateesh Chodapuneedi
> Priority: Critical
> Fix For: 4.3.0
>
> Attachments: CLOUDSTACK-5408.rar
>
>
> Steps to reproduce
> Create advanced zone in vmware
> use 64 bit template
> deploy VM
> Result
> SSVM are crated
> Routers are created
> VM deployment failed with below error
> yStorageResource.mountUri(NfsSecondaryStorageResource.java:2293)\n\tat
> org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:1934)\n\tat
>
> com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.getMountPoint(VmwareSecondaryStorageResourceHandler.java:311)\n\tat
>
> com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateFromSecondaryToPrimary(VmwareStorageProcessor.java:131)\n\tat
>
> com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateToPrimaryStorage(VmwareStorageProcessor.java:221)\n\tat
>
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)\n\tat
>
> com.cloud.storage.resource.VmwareStorageSubsystemCommandHandler.execute(VmwareStorageSubsystemCommandHandler.java:155)\n\tat
>
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)\n\tat
>
> com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequest(VmwareSecondaryStorageResourceHandler.java:101)\n\tat
>
> com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:56)\n\tat
> com.cloud.agent.Agent.processRequest(Agent.java:498)\n\tat
> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)\n\tat
> com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)\n\tat
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat
> java.lang.Thread.run(Thread.java:679)\nCaused by: java.io.IOException:
> java.io.IOException: error=12, Cannot allocate memory\n\tat
> java.lang.UNIXProcess.<init>(UNIXProcess.java:164)\n\tat
> java.lang.ProcessImpl.start(ProcessImpl.java:81)\n\tat
> java.lang.ProcessBuilder.start(ProcessBuilder.java:470)\n\t... 20
> more\n\n","wait":0}}] }
> 2013-12-07 14:07:59,776 DEBUG [c.c.a.t.Request] (Job-Executor-23:ctx-f22d6e84
> ctx-b6c94672) Seq 5-137756744: Received: { Ans: , MgmtId: 90928106758026,
> via: 5, Ver: v1, Flags: 10, { CopyCmdAnswer } }
> 2013-12-07 14:07:59,791 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) releasing lock for
> VMTemplateStoragePool 9
> 2013-12-07 14:07:59,791 WARN [c.c.u.d.Merovingian2]
> (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) Was unable to find lock for the
> key template_spool_ref9 and thread id 1402045270
> 2013-12-07 14:07:59,791 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) Unable to create
> Vol[8|vm=8|ROOT]:Unable to copy template to primary storage due to
> exception:Exception: com.cloud.utils.exception.CloudRuntimeException
> Message: GetRootDir for
> nfs://10.223.240.164:/home/common/automation/SC-CLOUD-QA03/secondary1 failed
> due to com.cloud.utils.exception.CloudRuntimeException: Unable to mount
> 10.223.240.164:/home/common/automation/SC-CLOUD-QA03/secondary1 at
> /mnt/SecStorage/c6ec0966-00ab-3817-8a96-e8f4c3e03269 due to
> java.io.IOException: Cannot run program "mount": java.io.IOException:
> error=12, Cannot allocate memory
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:488)
> at com.cloud.utils.script.Script.execute(Script.java:177)
> at com.cloud.utils.script.Script.execute(Script.java:155)
> at
> org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.attemptMount(NfsSecondaryStorageResource.java:2374)
> at
> org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mount(NfsSecondaryStorageResource.java:2331)
> at
> org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mountUri(NfsSecondaryStorageResource.java:2293)
> at
> org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:1934)
> at
> com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.getMountPoint(VmwareSecondaryStorageResourceHandler.java:311)
> at
> com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateFromSecondaryToPrimary(VmwareStorageProcessor.java:131)
> at
> com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateToPrimaryStorage(VmwareStorageProcessor.java:221)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
> at
> com.cloud.storage.resource.VmwareStorageSubsystemCommandHandler.execute(VmwareStorageSubsystemCommandHandler.java:155)
> at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
> at
> com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequest(VmwareSecondaryStorageResourceHandler.java:101)
> at
> com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:56)
> at com.cloud.agent.Agent.processRequest(Agent.java:498)
> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
> at com.cloud.utils.nio.Task.run(Task.java:83)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:679)
> Caused by: java.io.IOException: java.io.IOException: error=12, Cannot
> allocate memory
> at java.lang.UNIXProcess.<init>(UNIXProcess.java:164)
> at java.lang.ProcessImpl.start(ProcessImpl.java:81)
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:470)
> ... 20 more
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
