@ramirez We couldn’t update well yet as we had to wait until a new server with enough capacity was in the same Datacenter to move/migrate machines over. We will do this in the coming two weeks as the new machine was just installed on the 25th. @ Joshua Good to know about the swap … right now its still 64G, so the value before the upgrade
Once the live machines are migrated we will keep this machine running in the exact same state. Then we will perform a few tests. The test should consist of these steps (If anybody would like to chime in as far as a preferred order those comments are welcome): 1) Perform Tests without changes (logging values from arcstat etc as defined earlier) 2) Increase Swap – Redo Tests 3) Upgrade OS – Redo Tests 4) Limit ARC MAX with /etc/system (we might need help here to speed this up) – Redo Tests Now redoing the tests will require us to write a few load test scripts or mirror user load from the live system to this server. Otherwise the ARC usage might not go up the same way. From: Humberto Ramirez Sent: Wednesday, December 30, 2015 17:28 To: smartos-disc...@lists.smartos.org Subject: Re: [smartos-discuss] ZFS ARC MAX ? You are you running the release from February of this year, given that SmartOS is so simple to upgrade have you considered it? On Wed, Dec 30, 2015 at 5:19 AM, Matthias Götzke <mgt...@gmail.com> wrote: This behavior is on 20150219T102159Z with 64GB RAM SuperMicro "Product": "X9DRD-7LN4F(-JBOD)/X9DRD-EF", "CPU Type": "Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz", "CPU Physical Cores": 1, "CPU Total Cores": 16 We upgraded the RAM to 128GB now but this problem will obviously happen again when we cannot limit the ARC. I am considering starting a few dummy kvm’s with reserved RAM as buffers. NOTE: This is a dual CPU Board, with only 1 Socket used and only the RAM from that one socket filled. As demand increases we will likely add more RAM and another CPU. PS: I did hear that zfs_arc_max can be configured during boot using /etc/system but the process to actually change that at boot is not documented in a SOP kind of way, so I will have to experiment a bit to get this reliably working on a test machine first. From: Joshua M. Clulow Sent: Tuesday, December 29, 2015 23:39 To: Matthias Götzke Subject: Re: [smartos-discuss] ZFS ARC MAX ? On 29 December 2015 at 13:42, Matthias Götzke <mgt...@gmail.com> wrote: > It is readjusting, just halting the entire server , making it unreachable > while it’s doing so. And taking considerably longer doing so than just > rebooting. That means to me that it’s not just releasing ram pages marked as > non dirty (that should be faster). I believe we have seen a number of similar problems, where the process of ARC eviction was hurting system responsiveness. For example, OS-4949: https://smartos.org/bugview/OS-4949 What platform version are you running on the systems that become unresponsive? Cheers. -- Joshua M. Clulow UNIX Admin/Developer http://blog.sysmgr.org smartos-discuss | Archives | Modify Your Subscription ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
