Re: [basex-talk] basex OOM on 30GB database upon running /dba/db-optimize/

2019-10-03 Thread Christian Grün
Exactly, it seems to be the final MERGE step during index creation that blows up your system. If you are restricted to the 2 GB of main-memory, this is what you could try next: 1. Did you already try to tweak the JVM memory limit via -Xmx? What’s the largest value that you can assign on your

Re: [basex-talk] Does BaseX used as a command line XQuery processor build a full tree of an input document passed with -i option?

2019-10-03 Thread Christian Grün
Hi Martin, Yes, a full XDM tree will be created if an input is supplied via -i on command line. The resulting XDM representation is definitely more light-weight than the standard DOM tree (it’s an array-based main-memory version of the database storage), but obviously there’ll always be a limit.

Re: [basex-talk] HTTPServer + gzip compression

2019-10-03 Thread Christian Grün
Hi Stefan, There’s a StackOverflow entry that has previously been referenced on this list (by Michael Seiferle, see [2]). Based on this thread, in which Joakim Erdfelt (the magnificent Jetty core developer) explains why the existing approaches for enabling GZIP compression don’t work anymore, I

Re: [basex-talk] basex OOM on 30GB database upon running /dba/db-optimize/

2019-10-03 Thread Imsieke, Gerrit, le-tex
Hi, just saying that 16 GB of DDR3 RAM cost about 40 € now. Gerrit On 03.10.2019 08:53, first name last name wrote: I tried again, using SPLITSIZE = 12 in the .basex config file The batch(console) script I used is attached mass-import.xq This time I didn't do the optimize or index creation

Re: [basex-talk] basex OOM on 30GB database upon running /dba/db-optimize/

2019-10-03 Thread first name last name
I tried again, using SPLITSIZE = 12 in the .basex config file The batch(console) script I used is attached mass-import.xq This time I didn't do the optimize or index creation post-import, but instead, I did it as part of the import similar to what is described in [4]. This time I got a different