Re: [computer-go] Serializing a very large object in Java

2007-02-11 Thread Roland Illig
Peter Drake wrote: out.writeObject(root); Storing the root node of the Monte Carlo search will get storeObject() called on all the siblings and children (assuming you are using an implementation similar to the one on http://senseis.xmp.net/?UCT. With 10.000 nodes, the depth of the tree is a

Re: [computer-go] Serializing a very large object in Java

2007-02-10 Thread Jacques BasaldĂșa
Peter Drake wrote (3 times): > Exception in thread "main" ... > . . . and 91.449 bytes later . . . > ... (ObjectOutputStream.java:1369) I studied the log file in depth and the problem is . . . . . . (you guessed) using Java ;-) Jacques. BTW. I store this list. If you need your log file in

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread Ray Tayek
At 09:55 AM 2/9/2007, you wrote: ..., Java has a stack overflow error. i assume you have tried the java -Xss to set the stack size (type java -X for help on these)? thanks --- vice-chair http://ocjug.org/ ___ computer-go mailing list computer-g

RE: [computer-go] Serializing a very large object in Java

2007-02-09 Thread Lucas, Simon M
ginal Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: 09 February 2007 18:40 To: computer-go@computer-go.org Subject: Re: [computer-go] Serializing a very large object in Java Peter, java serialization is not a good way to do persistent storage o

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread Stuart A. Yeates
I serialised some very large Markov models (tens to low hundreds of megabytes) for my PhD using java serialisation. A couple of hints: *) they can be faster if you compress them (I used the standard Java libraries). Disk access was the limiting factor in my case and compression (I got 80% compres

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread Peter Drake
The UCT portion. I'm storing/loading a "pre-built" UCT tree once at startup; the disk is not accessed during the game. Peter Drake Assistant Professor of Computer Science Lewis & Clark College http://www.lclark.edu/~drake/ On Feb 9, 2007, at 11:08 AM, terry mcintyre wrote: Is this opening

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread Peter Drake
On Feb 9, 2007, at 10:48 AM, Nick Apperson wrote: What type of data are you trying to serialize or rather store to disk? Do you have pointers in the data. Don't tell me you don't have pointers just because it is java. I wouldn't dream of it. Java has pointers and I use the hell out of 'em

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread terry mcintyre
Is this opening book database used for the UCT portion, or the playout portion of Orego? In the UCT portion, speed of access may not be that important; a database would probably be ideal. If used during the playout, then speed of access is more crucial. Terry McIntyre UNIX for hire software de

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread Nick Apperson
What type of data are you trying to serialize or rather store to disk? Do you have pointers in the data. Don't tell me you don't have pointers just because it is java. Java has pointers, it just preteneds it doesn't. Show us the datastructure and we can probably help you more. If each entry h

Re: [computer-go] Serializing a very large object in Java

2007-02-09 Thread wms
Peter, java serialization is not a good way to do persistent storage of any kind, especially large data structures. It has some pretty severe drawbacks: