Re: [boinc_dev] Project application using more memory than it, reports to BOINC
Windows 10 - 64bit. But his VBox is just 5.0.32 if his signature is to be believed. I have advised him to update to 5.1.14, so thanks for that catch. -- Jord van der Elst. On Tue, Mar 7, 2017 at 6:28 AM, Robert Miles <robertmi...@bellsouth.net> wrote: > Does he run 32-bit applications under 64-bit Windows Vista? I've found > that nearly > all 32-bit programs running under 64-bit Windows Vista cause Windows to > load > enough svchost.exe modules to approximately double the amount of memory > these > programs use. This happens even if these 32-bit applications are > unrelated to BOINC. > I have not seen this happen under Windows 7 or Windows 10. > > Also, which version of VirtualBox is he using? I found that the 5.0.* > versions do not > work properly for the VM applications I run, but the 5.1.* versions run > much better, > without using a lot of extra memory. > > Note that he may be seeing that problem only when running VM tasks. So it > might > be more reasonable to turn off VM tasks on all the servers which allow it, > drop any > BOINC projects that don't, and then keep BOINC running for the remaining > projects > and possibly add a few more. > >> Date: Sat, 4 Mar 2017 11:24:47 +0100 >> From: Jord van der Elst <els...@gmail.com> >> Subject: [boinc_dev] Project application using more memory than it >> reports to BOINC >> >> Hi David, >> >> A user on the BOINC forums reported that he was now getting ready to get >> rid of BOINC, because it would use his whole memory and then even more, >> swapping to page file and there was nothing he could do about it. (ref >> https://boinc.berkeley.edu/dev/forum_thread.php?id=11494) >> >> He states to be running into this problem when running ATLAS GARL tasks, >> that use 2GB per task, which he appeared to run 10 of at the same time, >> using then 20GB of memory. A bit troublesome on a system using 16GB. >> >> So stopping that, he switched to LHC and running the LHCb simulation he >> now >> runs into to same problem. Here however there is a thread explaining why >> that is (https://lhcathome.cern.ch/sixtrack/forum_thread.php?id=4072): >> the >> LHCb tasks use 2GB of memory but report they only use 480MB per. So BOINC >> thinks they use 480MB, but they really do use 2GB. >> >> These all run in VirtualBox for as far as I understand, so perhaps that >> there's a bug in the wrapper how the memory usage is being read. In any >> case, shouldn't BOINC always poll the actual memory in use and stop using >> more when all of the available RAM has been consumed, even if there are >> free CPUs? >> >> Thanks, >> >> -- Jord van der Elst. >> > > > ___ > boinc_dev mailing list > boinc_dev@ssl.berkeley.edu > http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev > To unsubscribe, visit the above URL and > (near bottom of page) enter your email address. > ___ boinc_dev mailing list boinc_dev@ssl.berkeley.edu http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev To unsubscribe, visit the above URL and (near bottom of page) enter your email address.
Re: [boinc_dev] Project application using more memory than it, reports to BOINC
Robert Miles is right. Boinc should not consume more memory if there is nearly none avail. (Even if the limit "*allows*" such extremes like: Use 94℅ of memory(i have only 8GB) while computer is in use. Hehehe, PC is *not* usable anyway, when 85%(+) of RAM is used for ex.by ATLAS@home WU). :-))) Not only that, I would personally LOVE *boinc letting some safety-reserve* there - something like 500 MB free (unless explicitly *Unset in a config file).* Just an idea. *Namaste* Filip Dne 7. 3. 2017 6:28 dopoledne napsal uživatel "Robert Miles" < robertmi...@bellsouth.net>: > Does he run 32-bit applications under 64-bit Windows Vista? I've found > that nearly > all 32-bit programs running under 64-bit Windows Vista cause Windows to > load > enough svchost.exe modules to approximately double the amount of memory > these > programs use. This happens even if these 32-bit applications are > unrelated to BOINC. > I have not seen this happen under Windows 7 or Windows 10. > > Also, which version of VirtualBox is he using? I found that the 5.0.* > versions do not > work properly for the VM applications I run, but the 5.1.* versions run > much better, > without using a lot of extra memory. > > Note that he may be seeing that problem only when running VM tasks. So it > might > be more reasonable to turn off VM tasks on all the servers which allow it, > drop any > BOINC projects that don't, and then keep BOINC running for the remaining > projects > and possibly add a few more. > >> Date: Sat, 4 Mar 2017 11:24:47 +0100 >> From: Jord van der Elst <els...@gmail.com> >> Subject: [boinc_dev] Project application using more memory than it >> reports to BOINC >> >> Hi David, >> >> A user on the BOINC forums reported that he was now getting ready to get >> rid of BOINC, because it would use his whole memory and then even more, >> swapping to page file and there was nothing he could do about it. (ref >> https://boinc.berkeley.edu/dev/forum_thread.php?id=11494) >> >> He states to be running into this problem when running ATLAS GARL tasks, >> that use 2GB per task, which he appeared to run 10 of at the same time, >> using then 20GB of memory. A bit troublesome on a system using 16GB. >> >> So stopping that, he switched to LHC and running the LHCb simulation he >> now >> runs into to same problem. Here however there is a thread explaining why >> that is (https://lhcathome.cern.ch/sixtrack/forum_thread.php?id=4072): >> the >> LHCb tasks use 2GB of memory but report they only use 480MB per. So BOINC >> thinks they use 480MB, but they really do use 2GB. >> >> These all run in VirtualBox for as far as I understand, so perhaps that >> there's a bug in the wrapper how the memory usage is being read. In any >> case, shouldn't BOINC always poll the actual memory in use and stop using >> more when all of the available RAM has been consumed, even if there are >> free CPUs? >> >> Thanks, >> >> -- Jord van der Elst. >> > > > ___ > boinc_dev mailing list > boinc_dev@ssl.berkeley.edu > http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev > To unsubscribe, visit the above URL and > (near bottom of page) enter your email address. > ___ boinc_dev mailing list boinc_dev@ssl.berkeley.edu http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev To unsubscribe, visit the above URL and (near bottom of page) enter your email address.
Re: [boinc_dev] Project application using more memory than it, reports to BOINC
Does he run 32-bit applications under 64-bit Windows Vista? I've found
that nearly
all 32-bit programs running under 64-bit Windows Vista cause Windows to load
enough svchost.exe modules to approximately double the amount of memory
these
programs use. This happens even if these 32-bit applications are
unrelated to BOINC.
I have not seen this happen under Windows 7 or Windows 10.
Also, which version of VirtualBox is he using? I found that the 5.0.*
versions do not
work properly for the VM applications I run, but the 5.1.* versions run
much better,
without using a lot of extra memory.
Note that he may be seeing that problem only when running VM tasks. So
it might
be more reasonable to turn off VM tasks on all the servers which allow
it, drop any
BOINC projects that don't, and then keep BOINC running for the remaining
projects
and possibly add a few more.
Date: Sat, 4 Mar 2017 11:24:47 +0100
From: Jord van der Elst <els...@gmail.com>
Subject: [boinc_dev] Project application using more memory than it
reports to BOINC
Hi David,
A user on the BOINC forums reported that he was now getting ready to get
rid of BOINC, because it would use his whole memory and then even more,
swapping to page file and there was nothing he could do about it. (ref
https://boinc.berkeley.edu/dev/forum_thread.php?id=11494)
He states to be running into this problem when running ATLAS GARL tasks,
that use 2GB per task, which he appeared to run 10 of at the same time,
using then 20GB of memory. A bit troublesome on a system using 16GB.
So stopping that, he switched to LHC and running the LHCb simulation he now
runs into to same problem. Here however there is a thread explaining why
that is (https://lhcathome.cern.ch/sixtrack/forum_thread.php?id=4072): the
LHCb tasks use 2GB of memory but report they only use 480MB per. So BOINC
thinks they use 480MB, but they really do use 2GB.
These all run in VirtualBox for as far as I understand, so perhaps that
there's a bug in the wrapper how the memory usage is being read. In any
case, shouldn't BOINC always poll the actual memory in use and stop using
more when all of the available RAM has been consumed, even if there are
free CPUs?
Thanks,
-- Jord van der Elst.
___
boinc_dev mailing list
boinc_dev@ssl.berkeley.edu
http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev
To unsubscribe, visit the above URL and
(near bottom of page) enter your email address.
Re: [boinc_dev] Project application using more memory than it reports to BOINC
Hi Jord, To my knowledge, Windows does not have a way to accurately determine how much memory is truly being used by a VM. And thus, it is a special case. VirtualBox states: https://www.virtualbox.org/manual/ch03.html#settings-motherboard 3.4. System settings 3.4.1. "Motherboard" tab Base memory This sets the amount of RAM that is allocated and given to the VM when it is running. The specified amount of memory will be requested from the host operating system, so it must be available or made available as free memory on the host when attempting to start the VM and will not be available to the host while the VM is running. David's solution to this, was to make BOINC budget that base memory amount, whenever the BOINC task scheduler schedules a VirtualBox VM task. Does the task VM's value for "base memory", match the BOINC task's property for "Working set size". It should, per David's code, I believe. Also, is that a problem somehow? Finally, how did the LHC tasks circumvent that - did they end up using more memory than the "base memory" somehow (dynamically grow?) and then BOINC didn't account for it? Regards, Jacob From: boinc_dev <boinc_dev-boun...@ssl.berkeley.edu> on behalf of Jord van der Elst <els...@gmail.com> Sent: Saturday, March 4, 2017 5:24 AM To: David Anderson Cc: BOINC Dev Mailing List Subject: [boinc_dev] Project application using more memory than it reports to BOINC Hi David, A user on the BOINC forums reported that he was now getting ready to get rid of BOINC, because it would use his whole memory and then even more, swapping to page file and there was nothing he could do about it. (ref https://boinc.berkeley.edu/dev/forum_thread.php?id=11494) He states to be running into this problem when running ATLAS GARL tasks, that use 2GB per task, which he appeared to run 10 of at the same time, using then 20GB of memory. A bit troublesome on a system using 16GB. So stopping that, he switched to LHC and running the LHCb simulation he now runs into to same problem. Here however there is a thread explaining why that is (https://lhcathome.cern.ch/sixtrack/forum_thread.php?id=4072): the LHCb tasks use 2GB of memory but report they only use 480MB per. So BOINC thinks they use 480MB, but they really do use 2GB. These all run in VirtualBox for as far as I understand, so perhaps that there's a bug in the wrapper how the memory usage is being read. In any case, shouldn't BOINC always poll the actual memory in use and stop using more when all of the available RAM has been consumed, even if there are free CPUs? Thanks, -- Jord van der Elst. ___ boinc_dev mailing list boinc_dev@ssl.berkeley.edu http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev To unsubscribe, visit the above URL and (near bottom of page) enter your email address. ___ boinc_dev mailing list boinc_dev@ssl.berkeley.edu http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev To unsubscribe, visit the above URL and (near bottom of page) enter your email address.
[boinc_dev] Project application using more memory than it reports to BOINC
Hi David, A user on the BOINC forums reported that he was now getting ready to get rid of BOINC, because it would use his whole memory and then even more, swapping to page file and there was nothing he could do about it. (ref https://boinc.berkeley.edu/dev/forum_thread.php?id=11494) He states to be running into this problem when running ATLAS GARL tasks, that use 2GB per task, which he appeared to run 10 of at the same time, using then 20GB of memory. A bit troublesome on a system using 16GB. So stopping that, he switched to LHC and running the LHCb simulation he now runs into to same problem. Here however there is a thread explaining why that is (https://lhcathome.cern.ch/sixtrack/forum_thread.php?id=4072): the LHCb tasks use 2GB of memory but report they only use 480MB per. So BOINC thinks they use 480MB, but they really do use 2GB. These all run in VirtualBox for as far as I understand, so perhaps that there's a bug in the wrapper how the memory usage is being read. In any case, shouldn't BOINC always poll the actual memory in use and stop using more when all of the available RAM has been consumed, even if there are free CPUs? Thanks, -- Jord van der Elst. ___ boinc_dev mailing list boinc_dev@ssl.berkeley.edu http://lists.ssl.berkeley.edu/mailman/listinfo/boinc_dev To unsubscribe, visit the above URL and (near bottom of page) enter your email address.
