Hmmmm. I don't believe that its impossible to process 4GB data or its sarcasm (sometimes, some jokes don't go well with this medium).
Personally, I have never processed data that's bigger than 1GB. In my case, the event is special or there's something wrong with what I am doing. Of course I've spent a few nights thinking about scaling up my J system if this does happen (thankfully it never has and with judicious evaluation of user request ... it never will) and I may do one or a mixture of the following: 1. Re-evaluate the purpose or objective of the code/request. Most of the time I'm being daft or the user is being daft or both of us are stupid buggers. :P 2. Partition the data and/or the process to manageable logical units. The president of the company would always tell me, "If your doing more than 9 categories ... your categories are wrong.". 3. Fix the hardware. Yep, I agree with Oleg, you can get a 64 bit machine and just memory map the data directly. Oh wow, I really wish I have the dough to upgrade my iBook G4 to a Mac Pro with 16GB memory (wipes away drool). 4. Make a cluster farm of J application servers. Yep, it can be done with one control server (does the data partitioning and distribution of tasks) and a multitude of J application server slaves. I did a prototype of this, 2 years ago I think, using the ICE Network Middleware Library by ZeroC < http://www.zeroc.com > using 3 clone PC's running WindowsXP. It actually worked but we didn't use it because we shifted our strategy to using Microsoft's Smart Clients, .NET Remoting and AJAX. Nick. Just tell us what you think of doing. Maybe we can help. There are a lot of brilliant people here on the list and maybe we can help thing move along for you. ;) r/Alex -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Nick Kostirya Sent: Thursday, January 03, 2008 4:02 PM To: [email protected] Subject: Re: [Jgeneral] Successful stories В Thu, 3 Jan 2008 12:36:57 +0800 "Alex Rufon" <[EMAIL PROTECTED]> пишет: > I just saw this and for some reason .. I got the one where Oleg > replied to it (I snipped it to make this post shorter). Thanks for your reply. By the way, I haven't received Oleg's reply for some reason. However, thanks to this message I found it in the newsletter archive. I'd like to say thanks to Oleg too. No doubts now it's impossible to process the 0.4 TByte data array. :-) Nick. ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
