Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Tobias Hammer

I get this on i386, when the VM sucks up ~ 2GB of memory. You can try
env PLT_SETUP_OPTIONS=-j 1, that helps for me.

Tobias


On Tue, 16 Apr 2013 17:50:52 +0200, Jon Rafkind rafk...@cs.utah.edu  
wrote:


The PPA build has been failing the past 2 days or so for amd64 machines  
due to the Racket VM running out of memory, usually during 'raco setup'  
but not correlated with any specific collection. I don't have an amd64  
machine on hand to test. Has anyone else seen this behavior on amd64 (or  
any architecture I guess)? The PPA i386 package seems to build fine.


See these buildlogs:
https://launchpadlibrarian.net/137534947/buildlog_ubuntu-oneiric-amd64.racket_5.3.4.3-20130416~oneiric_FAILEDTOBUILD.txt.gz  
https://launchpadlibrarian.net/137534947/buildlog_ubuntu-oneiric-amd64.racket_5.3.4.3-20130416%7Eoneiric_FAILEDTOBUILD.txt.gz
https://launchpadlibrarian.net/137532928/buildlog_ubuntu-quantal-amd64.racket_5.3.4.3-20130416~quantal_FAILEDTOBUILD.txt.gz  
https://launchpadlibrarian.net/137532928/buildlog_ubuntu-quantal-amd64.racket_5.3.4.3-20130416%7Equantal_FAILEDTOBUILD.txt.gz
https://launchpadlibrarian.net/137533283/buildlog_ubuntu-raring-amd64.racket_5.3.4.3-20130416~raring_FAILEDTOBUILD.txt.gz  
https://launchpadlibrarian.net/137533283/buildlog_ubuntu-raring-amd64.racket_5.3.4.3-20130416%7Eraring_FAILEDTOBUILD.txt.gz



--
-
Tobias Hammer
DLR / Robotics and Mechatronics Center (RMC)
Muenchner Str. 20, D-82234 Wessling
Tel.: 08153/28-1487
Mail: tobias.ham...@dlr.de
_
 Racket Developers list:
 http://lists.racket-lang.org/dev


Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Tony Garnock-Jones
On 2013-04-16 11:50 AM, Jon Rafkind wrote:
 The PPA build has been failing the past 2 days or so for amd64 machines
 due to the Racket VM running out of memory, usually during 'raco setup'
 but not correlated with any specific collection.

I have seen this behaviour after a 'raco pkg remove': during the
post-removal re-setup, Racket ends up consuming all memory and swap on
my machine. This machine has 32G of RAM and 40-something G of swap, so
that's quite a lot of memory to fill :-)

I'm not sure, but I think rerunning 'raco setup' after that has happened
gets stuck doing the same thing.

Tony
_
  Racket Developers list:
  http://lists.racket-lang.org/dev


Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Jon Rafkind
The build already passes '-j 1'.

On 04/16/2013 09:55 AM, Tobias Hammer wrote:
 I get this on i386, when the VM sucks up ~ 2GB of memory. You can try
 env PLT_SETUP_OPTIONS=-j 1, that helps for me.

 Tobias


 On Tue, 16 Apr 2013 17:50:52 +0200, Jon Rafkind rafk...@cs.utah.edu wrote:

 The PPA build has been failing the past 2 days or so for amd64 machines due 
 to the Racket VM running out of memory, usually during 'raco setup' but not 
 correlated with any specific collection. I don't have an amd64 machine on 
 hand to test. Has anyone else seen this behavior on amd64 (or any 
 architecture I guess)? The PPA i386 package seems to build fine.

 See these buildlogs:
 https://launchpadlibrarian.net/137534947/buildlog_ubuntu-oneiric-amd64.racket_5.3.4.3-20130416~oneiric_FAILEDTOBUILD.txt.gz
  
 https://launchpadlibrarian.net/137534947/buildlog_ubuntu-oneiric-amd64.racket_5.3.4.3-20130416%7Eoneiric_FAILEDTOBUILD.txt.gz
 https://launchpadlibrarian.net/137532928/buildlog_ubuntu-quantal-amd64.racket_5.3.4.3-20130416~quantal_FAILEDTOBUILD.txt.gz
  
 https://launchpadlibrarian.net/137532928/buildlog_ubuntu-quantal-amd64.racket_5.3.4.3-20130416%7Equantal_FAILEDTOBUILD.txt.gz
 https://launchpadlibrarian.net/137533283/buildlog_ubuntu-raring-amd64.racket_5.3.4.3-20130416~raring_FAILEDTOBUILD.txt.gz
  
 https://launchpadlibrarian.net/137533283/buildlog_ubuntu-raring-amd64.racket_5.3.4.3-20130416%7Eraring_FAILEDTOBUILD.txt.gz



_
  Racket Developers list:
  http://lists.racket-lang.org/dev


Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Neil Van Dyke
On these out-of-memory conditions, you might want to look at the kernel 
logs for what the OOM-killer said about what processes were running, 
their sizes, and who it thought the culprit was.


If the OOM logs show GB of virtual memory missing, but not used by any 
userspace process, you might want to email me privately so we can 
compare notes.  I've seen multiple instances of this quite recently, on 
multiple systems.  My prime person-of-interest is a particular kernel 
service that is used actively by only a small minority of GNU/Linux 
installations.


Neil V.

_
 Racket Developers list:
 http://lists.racket-lang.org/dev


Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Tony Garnock-Jones

On 04/16/2013 12:42 PM, Neil Van Dyke wrote:

On these out-of-memory conditions, you might want to look at the kernel
logs for what the OOM-killer said about what processes were running,
their sizes, and who it thought the culprit was.


It was *definitely* Racket: I was watching htop at the time.

Cheers,
  Tony
_
 Racket Developers list:
 http://lists.racket-lang.org/dev


Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Matthew Flatt
At Tue, 16 Apr 2013 11:57:40 -0400, Tony Garnock-Jones wrote:
 On 2013-04-16 11:50 AM, Jon Rafkind wrote:
  The PPA build has been failing the past 2 days or so for amd64 machines
  due to the Racket VM running out of memory, usually during 'raco setup'
  but not correlated with any specific collection.
 
 I have seen this behaviour after a 'raco pkg remove': during the
 post-removal re-setup, Racket ends up consuming all memory and swap on
 my machine. This machine has 32G of RAM and 40-something G of swap, so
 that's quite a lot of memory to fill :-)
 
 I'm not sure, but I think rerunning 'raco setup' after that has happened
 gets stuck doing the same thing.

Since I haven't seen this, any further information you can provide
would be useful.

Meanwhile, I've been meaning to make `raco pkg remove' setup only the
same collections that were setup for `raco pkg install' (minus any that
are gone after the uninstall), and I've pushed that change. I don't
expect that the change fixes the underlying problem that you're seeing.

_
  Racket Developers list:
  http://lists.racket-lang.org/dev


Re: [racket-dev] amd64 out of memory

2013-04-16 Thread Tony Garnock-Jones

On 04/16/2013 03:50 PM, Matthew Flatt wrote:

Meanwhile, I've been meaning to make `raco pkg remove' setup only the
same collections that were setup for `raco pkg install' (minus any that
are gone after the uninstall), and I've pushed that change. I don't
expect that the change fixes the underlying problem that you're seeing.


Thanks, that's great! I'll update to master and let you know if I spot 
it again.


Tony
_
 Racket Developers list:
 http://lists.racket-lang.org/dev