Re: OOM with Agents

2010-12-12 Thread Michael Ossareh
This was the first issue, the second issue is that I'm queueing up lots of data for the thread pools and as a result I'm able to completely exhaust the available memory. the clj-sys/work framework seems to be what I need to ensure there is a fixed number of threads. I wrote this up:

Re: OOM with Agents

2010-12-11 Thread Michael Ossareh
On Fri, Dec 10, 2010 at 23:36, Alex Osborne a...@meshy.org wrote: Michael Ossareh ossa...@gmail.com writes: There are 54874 companies in the companies var. The OOM tends to take place when there are 1000 or so companies to process. What is likely to be causing this issue? I replied on

OOM with Agents

2010-12-10 Thread Michael Ossareh
Hi, I've cobbled together some grungy code to attempt to work out the number of employees in different ranges - the code is a horrible mess of side effects: https://gist.github.com/737179 (pmap process-company (take 1500 companies)) results in: Exception in thread pool-2-thread-3905

Re: OOM with Agents

2010-12-10 Thread Ken Wesson
On Sat, Dec 11, 2010 at 1:05 AM, Michael Ossareh ossa...@gmail.com wrote: I've cobbled together some grungy code to attempt to work out the number of employees in different ranges - the code is a horrible mess of side effects: https://gist.github.com/737179 ... There are 54874 companies in

Re: OOM with Agents

2010-12-10 Thread Alex Osborne
Michael Ossareh ossa...@gmail.com writes: There are 54874 companies in the companies var. The OOM tends to take place when there are 1000 or so companies to process. What is likely to be causing this issue? I replied on IRC but just recapping here. I think you've probably been bitten by