Am testing on Sun/Oracle x4800 with 512gig of RAM and 80cores (160 if
include hyperthreading).
My test case is to import 1.8gig 1.4million row text file.
My use case is to import 2 massive files, reconcile with some SQL then dump
results out to files and exit. So do not need any ACID features and will be
single user mode. Just want speed.
Java settings that seem to work best are:
java -verbose:gc -Xmx20G -Xms10G -d64 -server -jar h2*.jar -webAllowOthers
-web -tcp -pg -tcpAllowOthers
I tried playing with other GC's but did not help. Spents 2 secs during
import running GC.
Tried:
jdbc:h2:tcp://myserver:9092/mem:t2;LOG=0;LOCK_MODE=0;UNDO_LOG=0;DB_CLOSE_DELAY=-1
and
jdbc:h2:tcp://myserver:9092/mem:t2;LOG=0;UNDO_LOG=0;DB_CLOSE_DELAY=-1;MULTI_THREADED=1;lock_mode=1
both take same time. Played with PAGE_SIZE but makes no difference (is it
used in memory only DB's?). Also can not use MULTI_THREADED=1 and
LOCK_MODE=0 at same time? Is this a bug?
My SQL is:
CREATE TABLE test as select * from csvread('file.txt',null,'
fieldSeparator=;')
file.txt is in /tmp so held in RAM already.
Currently takes 43secs for 1st load and then about 35 second time. This is
great.
Anyone got any magic flags that would make it go even faster?
--
You received this message because you are subscribed to the Google Groups "H2
Database" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/h2-database/-/6k2ZYNA9zXAJ.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/h2-database?hl=en.
