We have two identical machines (A and B) both equipped with 192 GiB RAM. The first one runs 10 VMs using 16,000 MB RAM each plus two smaller VMs with less than 3 GiB RAM:

   [root@A ~]# echo ::memstat | mdb -k
   Page Summary                Pages                MB  %Tot
   ------------     ----------------  ----------------  ----
   Kernel                    3726258             14555    7%
   Boot pages                  68306               266    0%
   ZFS File Data             2976930             11628    6%
   Anon                     41622277            162587   83%
   Exec and libs                5473                21    0%
   Page cache                  22635                88    0%
   Free (cachelist)            25908               101    0%
   Free (freelist)           1879280              7340    4%

   Total                    50327067            196590
   Physical                 50327066            196590

   [root@A ~]# mdb -ke 'availrmem/D ; pages_pp_maximum/D'
   availrmem:
   availrmem:      2350836
   pages_pp_maximum:
   pages_pp_maximum:               1947905

There are 2,350,836 pages of 4,096 bytes available resident memory which seems reasonable. However, on machine B we could create no more than six VMs with 16,000 MB RAM before we get timeouts. Here are its figures:

   [root@B ~]# echo ::memstat | mdb -k
   Page Summary                Pages                MB  %Tot
   ------------     ----------------  ----------------  ----
   Kernel                    2532099              9891    5%
   Boot pages                  68306               266    0%
   ZFS File Data              169799               663    0%
   Anon                     26373657            103022   52%
   Exec and libs                4432                17    0%
   Page cache                  14865                58    0%
   Free (cachelist)            13798                53    0%
   Free (freelist)          21150107             82617   42%

   Total                    50327063            196590
   Physical                 50327062            196590


   [root@B ~]# mdb -ke 'availrmem/D ; pages_pp_maximum/D'
   availrmem:
   availrmem:      8122046
   pages_pp_maximum:
   pages_pp_maximum:               1947905

On this machine vmadm create failed with

   timed out waiting for /var/svc/provisioning to move for $uuid

A: joyent_20160218T022556Z
B: joyent_20160317T000621Z

Any ideas?

Thanks in advance,
Stefan


-------------------------------------------
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Reply via email to