GitHub user Lauta11 added a comment to the discussion: Timeout snapshot
Hi, I updated to Cloudstack 4.20.2 and the "commands.timeout" option appeared.
I added CreateObjectCommand=18000 to it, restarted the management system, and
now when I try to take a snapshot, it times out after 10 seconds. I removed
this option, and it's back to normal.
Is this variable correct? Do I need to add anything else? Thanks. Logs attached.
Logs Management:
2025-11-12 14:59:17,408 ERROR [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717, ctx-aa135b73])
(logid:e981ed2a) Take snapshot: VolumeObject {"dataStore":"StoragePool
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","volumeVO":"Volume
{\"id\":1449,\"instanceId\":1117,\"name\":\"ROOT-1117\",\"uuid\":\"344e7caa-a74d-4861-81b4-1bb54c4e3cd2\",\"volumeType\":\"ROOT\"}"}
failed com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot
for volume [volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}],
in VM [i-329-1117-VM], due to [Failed to convert volumeTO
{"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFile
system\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}
snapshot of volume [KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136090554368,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5]
due to [timeout].]. 2025-11-12 14:59:17,410 ERROR
[c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:[ctx-e02923c9,
job-33716/job-33717, ctx-aa135b73]) (logid:e981ed2a) Invocation exception,
caused by: com.cloud.utils.exception.CloudRuntimeException: Failed take
snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\
":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}],
in VM [i-329-1117-VM], due to [Failed to convert volumeTO
{"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}
snapshot of volume [KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136090554368,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5]
due to [timeout].]. 2
025-11-12 14:59:17,410 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717, ctx-aa135b73])
(logid:e981ed2a) Rethrow exception
com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for
volume [volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}],
in VM [i-329-1117-VM], due to [Failed to convert volumeTO
{"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}
snapshot of volume [KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9
f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136090554368,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5]
due to [timeout].]. 2025-11-12 14:59:17,410 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717]) (logid:e981ed2a)
Unable to complete AsyncJob
{"accountId":329,"cmd":"com.cloud.vm.VmWorkTakeVolumeSnapshot","cmdInfo":"rO0ABXNyACVjb20uY2xvdWQudm0uVm1Xb3JrVGFrZVZvbHVtZVNuYXBzaG90BL5gG4Li1c8CAAdaAAthc3luY0JhY2t1cFoACXF1aWVzY2VWbUwADGxvY2F0aW9uVHlwZXQAKUxjb20vY2xvdWQvc3RvcmFnZS9TbmFwc2hvdCRMb2NhdGlvblR5cGU7TAAIcG9saWN5SWR0ABBMamF2YS9sYW5nL0xvbmc7TAAKc25hcHNob3RJZHEAfgACTAAIdm9sdW1lSWRxAH4AAkwAB3pvbmVJZHN0ABBMamF2YS91dGlsL0xpc3Q7eHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZEoABnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhb
mcvU3RyaW5nO3hwAAAAAAAAAUkAAAAAAAAAAQAAAAAAAARddAAUVm9sdW1lQXBpU2VydmljZUltcGwAAHBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAMBzcQB-AAgAAAAAAAAGrXNxAH4ACAAAAAAAAAWpc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4","cmdVersion":0,"completeMsid":null,"created":"Wed
Nov 12 14:58:56 ART
2025","id":33717,"initMsid":90520732656511,"instanceId":null,"instanceType":null,"lastPolled":null,"lastUpdated":null,"processStatus":0,"removed":null,"result":null,"resultCode":0,"status":"IN_PROGRESS","userId":1,"uuid":"26728688-30c2-421c-aa66-664248917e26"},
job origin: 33716 com.cloud.utils.exception.CloudRuntimeException: Failed take
snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-
1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO
{"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}
snapshot of volume [KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136090554368,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5]
due to [timeout].]. Caused by:
com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for
volume [volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"Ne
tworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}],
in VM [i-329-1117-VM], due to [Failed to convert volumeTO
{"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}
snapshot of volume [KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136090554368,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5]
due to [timeout].].
Logs Host:
2025-11-12 15:15:34,382 WARN [utils.script.Script] (AgentRequest-Handler-2:[])
(logid:) Process [608468] for command [qemu-img convert -O qcow2 -U
--image-opts
driver=qcow2,file.filename=/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2
/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/feade96a-8f4c-41d8-a123-9627d17d4d6d
] timed out. Output is []. 2025-11-12 15:15:34,381 WARN [utils.script.Script]
(Script-7:[]) (logid:) Interrupting script. 2025-11-12 15:15:35,107 ERROR
[kvm.storage.KVMStorageProcessor] (AgentRequest-Handler-2:[]) (logid:) Failed
take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}],
in VM [i-329-1117-VM], due to [Failed to convert volumeTO
{"dataStore":"PrimaryDataStoreTO {\"id\":55,
\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}
snapshot of volume [KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136142057472,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/feade96a-8f4c-41d8-a123-9627d17d4d6d]
due to [timeout].]. com.cloud.utils.exception.CloudRuntimeException: Failed to
convert volumeTO {"dataStore":"PrimaryDataStoreTO
{\"id\":55,\"name\":\"Pool-03\",\"poolType\":\"NetworkFilesystem\",\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2",
"uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume
[KVMPhysicalDisk
{"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"\/mnt\/9f38e203-81c7-3eeb-837c-3dbea8d4f256\/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool
{\"uuid\":\"9f38e203-81c7-3eeb-837c-3dbea8d4f256\"}","size":136142057472,"virtualSize":536870912000,"vmName":null}]
to
[/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/feade96a-8f4c-41d8-a123-9627d17d4d6d]
due to [timeout].
GitHub link:
https://github.com/apache/cloudstack/discussions/11923#discussioncomment-14950876
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
