Hi Doron,Thank you, I will do things like "swapoff" later. 1) Just a little
confused about how to caculate the value.###and I quote,----And in your case we
see the value is > 0.This means that swap_total < (swap_free+mem_available) or
in generalyour host is swapping.----###data in my case:[n34]# free -m
total used free shared buffers cachedMem:
32057 31713 344 0 78 13074-/+ buffers/cache:
18560 13497Swap: 29999 5098 24901Physical Memory:
32057 MB total, 18593 MB used, 13464 MB freeSwap Size:
29999 MB total, 5098 MB used, 24901 MB freeMax
free Memory for scheduling new VMs: 21644.5 MB----## formula in my case:
swap_total - swap_free > mem_available## substituting =>swap_total = 29999,
swap_free = 24901, mem_available = ? (mem_available is 344 or 13497 ?
Obviously the former value match the fomula, right?)2) suggestionDisable swap
on ovirt host should be explicit indicated in the document.(for instance:
http://www.ovirt.org/OVirt_Administration_Guide)------------------------------------------------------------------From:Doron
Fediuck <[email protected]>Time:2015 Dec 29 (Tue) 20:40To:pc
<[email protected]>Cc:users <[email protected]>, Golan, Roy
<[email protected]>Subject:Re: [ovirt-users] host xxx did no satisfy internal
filter Memory because its swap value was illegal.On Tue, Dec 29, 2015 at 5:54
AM, pc <[email protected]> wrote:[sorry, this is my first time to use mailing
list, repost again, with content from html to plain text]### Description ###1.
problem1) migrate vm {name:xyz001, mem(min, max) = (2G,4G)} from ovirt host n33
to n34, failed.2) shutting down vm {name: test001, mem(min, max) = (1G,1G)} on
n34, update test001's config: Host->Start Running On: Specific(n34), then start
test001, while, it's running on n33.2. err messageError while executing action:
migrate[engine gui]xyz001:Cannot migrate VM. There is no host that satisfies
current scheduling constraints. See below for details:The host n33 did not
satisfy internal filter Memory because has availabe 1863 MB memory.
Insufficient free memory to run the VM.The host n34 did not satisfy internal
filter Memory because its swap value was illegal.[engine.log]INFO
[org.ovirt.engine.core.bll.MigrateVmCommand] (default task-23) [5916aa3b] Lock
Acquired to object
'EngineLock:{exclusiveLocks='[73351885-9a92-4317-baaf-e4f2bed1171a=<VM,
ACTION_TYPE_FAILED_VM_IS_BEING_MIGRATED$VmName test11>]',
sharedLocks='null'}'INFO
[org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-23)
[5916aa3b] Candidate host 'n34' ('2ae3a219-ae9a-4347-b1e2-0e100360231e') was
filtered out by 'VAR__FILTERTYPE__INTERNAL' filter 'Memory' (correlation id:
null)INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default
task-23) [5916aa3b] Candidate host 'n33'
('688aec34-5630-478e-ae5e-9d57990804e5') was filtered out by
'VAR__FILTERTYPE__INTERNAL' filter 'Memory' (correlation id: null)WARN
[org.ovirt.engine.core.bll.MigrateVmCommand] (default task-23) [5916aa3b]
CanDoAction of action 'MigrateVm' failed for user admin@internal. Reasons:
VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName
n33,$filterName Memory,$availableMem
1863,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName
n34,$filterName
Memory,VAR__DETAIL__SWAP_VALUE_ILLEGAL,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAILINFO
[org.ovirt.engine.core.bll.MigrateVmCommand] (default task-23) [5916aa3b]
Lock freed to object
'EngineLock:{exclusiveLocks='[73351885-9a92-4317-baaf-e4f2bed1171a=<VM,
ACTION_TYPE_FAILED_VM_IS_BEING_MIGRATED$VmName test11>]',
sharedLocks='null'}'3. DCCompatibility Version: 3.54. ClusterMemory
Optimization: For Server Load - Allow scheduling of 150% of physical
memoryMemory Balloon: Enable Memory Balloon OptimizationEnable KSM: Share
memory pages across all available memory (best KSM effectivness)5. HOSTname:
n33, n34mem: 32G6. VM[n33] 11 vms(min, max) = (2G,4G) = 8(min, max) = (2G,8G) =
1(min, max) = (2G,2G) = 2total: 22G/44G[n34] 7 vms(min, max) = (0.5G,1G) =
1(min, max) = (1G,2G) = 1(min, max) = (2G,2G) = 1(min, max) = (2G,4G) = 3(min,
max) = (8G,8G) = 1total:
17.5G/25G--------------------------------------------(min, max) = (2G,4G)
stands for:Memory Size: 4GPhysical Memory Guaranteed: 2GMemory Balloon Device
Enabled: checked--------------------------------------------7. rpm
version[root@n33 ~]# rpm -qa |grep
vdsmvdsm-yajsonrpc-4.16.27-0.el6.noarchvdsm-jsonrpc-4.16.27-0.el6.noarchvdsm-cli-4.16.27-0.el6.noarchvdsm-python-zombiereaper-4.16.27-0.el6.noarchvdsm-xmlrpc-4.16.27-0.el6.noarchvdsm-python-4.16.27-0.el6.noarchvdsm-4.16.27-0.el6.x86_64[root@engine
~]# rpm -qa |grep
ovirtovirt-release36-001-2.noarchovirt-engine-setup-base-3.6.0.3-1.el6.noarchovirt-engine-setup-3.6.0.3-1.el6.noarchovirt-image-uploader-3.6.0-1.el6.noarchovirt-engine-wildfly-8.2.0-1.el6.x86_64ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.0.3-1.el6.noarchovirt-host-deploy-1.4.0-1.el6.noarchovirt-engine-backend-3.6.0.3-1.el6.noarchovirt-engine-webadmin-portal-3.6.0.3-1.el6.noarchovirt-engine-jboss-as-7.1.1-1.el6.x86_64ovirt-engine-lib-3.6.0.3-1.el6.noarchovirt-engine-setup-plugin-ovirt-engine-common-3.6.0.3-1.el6.noarchovirt-engine-setup-plugin-ovirt-engine-3.6.0.3-1.el6.noarchovirt-engine-setup-plugin-websocket-proxy-3.6.0.3-1.el6.noarchovirt-engine-sdk-python-3.6.0.3-1.el6.noarchovirt-iso-uploader-3.6.0-1.el6.noarchovirt-vmconsole-proxy-1.0.0-1.el6.noarchovirt-engine-extensions-api-impl-3.6.0.3-1.el6.noarchovirt-engine-websocket-proxy-3.6.0.3-1.el6.noarchovirt-engine-vmconsole-proxy-helper-3.6.0.3-1.el6.noarchebay-cors-filter-1.0.1-0.1.ovirt.el6.noarchovirt-host-deploy-java-1.4.0-1.el6.noarchovirt-engine-tools-3.6.0.3-1.el6.noarchovirt-engine-restapi-3.6.0.3-1.el6.noarchovirt-engine-3.6.0.3-1.el6.noarchovirt-engine-extension-aaa-jdbc-1.0.1-1.el6.noarchovirt-engine-cli-3.6.0.1-1.el6.noarchovirt-vmconsole-1.0.0-1.el6.noarchovirt-engine-wildfly-overlay-001-2.el6.noarchovirt-engine-dbscripts-3.6.0.3-1.el6.noarchovirt-engine-userportal-3.6.0.3-1.el6.noarchovirt-guest-tools-iso-3.6.0-0.2_master.fc22.noarch###
DB ###[root@engine ~]# su postgresbash-4.1$ cd ~bash-4.1$ psql engineengine=#
select vds_id, physical_mem_mb, mem_commited, vm_active, vm_count,
reserved_mem, guest_overhead, transparent_hugepages_state, pending_vmem_size
from vds_dynamic; vds_id | physical_mem_mb |
mem_commited | vm_active | vm_count | reserved_mem | guest_overhead |
transparent_hugepages_state |
pending_vmem_size--------------------------------------+-----------------+--------------+-----------+----------+--------------+----------------+-----------------------------+-------------------
688aec34-5630-478e-ae5e-9d57990804e5 | 32057 | 45836 |
11 | 11 | 321 | 65 | 2 |
0 2ae3a219-ae9a-4347-b1e2-0e100360231e | 32057 |
26120 | 7 | 7 | 321 | 65 |
2 | 0(2 rows)### memory ###[n33]# free -m
total used free shared buffers cachedMem: 32057
31770 287 0 41 6347-/+ buffers/cache:
25381 6676Swap: 29999 10025 19974Physical Memory:
32057 MB total, 25646 MB used, 6411 MB freeSwap Size:
29999 MB total, 10025 MB used, 19974 MB freeMax free
Memory for scheduling new VMs: 1928.5 MB[n34]# free -m total
used free shared buffers cachedMem: 32057
31713 344 0 78 13074-/+ buffers/cache: 18560
13497Swap: 29999 5098 24901Physical Memory:
32057 MB total, 18593 MB used, 13464 MB freeSwap Size:
29999 MB total, 5098 MB used, 24901 MB freeMax free Memory
for scheduling new VMs: 21644.5 MB### code #####from:
https://github.com/oVirt/ovirt-enginev3.6.0##from:
D:\code\java\ovirt-engine\backend\manager\modules\dal\src\main\resources\bundles\AppErrors.propertiesVAR__DETAIL__SWAP_VALUE_ILLEGAL=$detailMessage
its swap value was illegal##from:
D:\code\java\ovirt-engine\backend\manager\modules\bll\src\main\java\org\ovirt\engine\core\bll\scheduling\policyunits\MemoryPolicyUnit.java#-----------code--------------1#
private boolean isVMSwapValueLegal(VDS host) { if (!Config.<Boolean>
getValue(ConfigValues.EnableSwapCheck)) { return true;
} (omitted..) return ((swap_total - swap_free -
mem_available) * 100 / physical_mem_mb) <= Config.<Integer>
getValue(ConfigValues.BlockMigrationOnSwapUsagePercentage) (omitted..)
}#-----------code--------------1#if EnableSwapCheck = False then return True,
so we can simply disable this option? Any Suggestion?[root@engine ~]#
engine-config --get
BlockMigrationOnSwapUsagePercentageBlockMigrationOnSwapUsagePercentage: 0
version: generalso,,Config.<Integer>
getValue(ConfigValues.BlockMigrationOnSwapUsagePercentage) = 0so,,(swap_total -
swap_free - mem_available) * 100 / physical_mem_mb <= 0so,,swap_total -
swap_free - mem_available <= 0right?so,, if (swap_total - swap_free) <=
mem_available then return True else return
False#-----------code--------------2# for (VDS vds : hosts) {
if (!isVMSwapValueLegal(vds)) { log.debug("Host '{}' swap value
is illegal", vds.getName()); messages.addMessage(vds.getId(),
EngineMessage.VAR__DETAIL__SWAP_VALUE_ILLEGAL.toString());
continue; } if (!memoryChecker.evaluate(vds, vm)) {
int hostAavailableMem =
SlaValidator.getInstance().getHostAvailableMemoryLimit(vds);
log.debug("Host '{}' has {} MB available. Insufficient memory to run the VM",
vds.getName(), hostAavailableMem);
messages.addMessage(vds.getId(), String.format("$availableMem
%1$d", hostAavailableMem)); messages.addMessage(vds.getId(),
EngineMessage.VAR__DETAIL__NOT_ENOUGH_MEMORY.toString());
continue; } (omitted..)
}#-----------code--------------2#!isVMSwapValueLegal then throw exception,
right?so,, when we migrate vm from n33 to n34, the swap status on n34 actually
is:(swap_total - swap_free) > mem_availableswap_used > mem_available?
confused...so,, the logic is:1) check n33: swap[passed], then memory[failed],
then goto (for..continue..loop)2) check n34: swap[failed], then goto
(for..continue..loop)If I have misunderstood anything, please let me know.###
conclusion ###1) n33 do not have enough memory. [yes, I know that.]2) n34
memory is illegal [why and how to solve it?]3) what I tried:--change config:
BlockMigrationOnSwapUsagePercentage[root@engine ~]# engine-config --set
BlockMigrationOnSwapUsagePercentage=75 -cver general[root@engine ~]#
engine-config --get
BlockMigrationOnSwapUsagePercentageBlockMigrationOnSwapUsagePercentage: 75
version: generalResult: failed.--disable EnableSwapCheckHow? Option not found
from 'engine-config --list', should I update table field direct from
db?--disable swap partition on hostShould I do this operation?--update
ovirt-engine?No useful infomation found in latest release note, should I do
this operation?### help ###any help would be appreciated.ZYXW.
Referencehttp://www.ovirt.org/Sla/FreeMemoryCalculationhttp://lists.ovirt.org/pipermail/users/2012-November/010858.htmlhttp://lists.ovirt.org/pipermail/users/2013-March/013201.htmlhttp://comments.gmane.org/gmane.comp.emulators.ovirt.user/19288http://jim.rippon.me.uk/2013/07/ovirt-testing-english-instructions-for.htmlHi,
Let me simplify things.We do not allow swapping in general. The reason is that
it kills the performanceof all hosts.As you were able to see in our code (0 is
the default config value we have)we expect the following expression:swap_total
- swap_free - mem_available) * 100 / physical_mem_mb) <= 0And in your case we
see the value is > 0.This means that swap_total < (swap_free+mem_available) or
in generalyour host is swapping.Since the host is swapping, we do not allow to
run a VM on it.Let me know if you have any further questions.Doron_______________________________________________
Users mailing list
[email protected]
http://lists.ovirt.org/mailman/listinfo/users
