Improving data insert performance

2010-01-13 Thread Nathan Boy
Hello, I have an embedded database application that generally involves inserting somewhere between 50k and 1000k rows of data into a database, and then analyzing and querying that data afterwards. The data goes into about ten tables, but the bulk of the data is in just a few of them. I run my

Re: Improving data insert performance

2010-01-13 Thread Bryan Pendleton
using prepared statements executed in batches, and this gives me between 10 and 20 row inserts per millisecond on average. I have Wow! You're already going very fast, and you've already put a lot of good effort into this, so I congratulate you on how far you've gone already. A couple of

Re: Improving data insert performance

2010-01-13 Thread Peter Ondruška
Also try using larger log files (10+MB) and if you rarely change data you load (which I guess is your case) you may want to use pageReservedSpace=0 and large pageSize (32kb?) On Wed, Jan 13, 2010 at 5:01 PM, Nathan Boy nathan@gmail.com wrote: Hello,   I have an embedded database application

Embedded Web Server in Java stand alone application...

2010-01-13 Thread Jim Crowell
I have a Java stand alone application that creates a Derby Database using the embedded derby connect. It work fine in creating, viewing and editing the Derby tables. I have a requirement to generate reports as a function of the constructed Derby file. In my infinite wisdom I decided to build the

Streaming Results

2010-01-13 Thread Stian Brattland
Hi, I've got a question regarding results streaming. The J/Connector for MySQL supports results streaming, which means that you can stream and process rows in a ResultSet one by one. Normally, all rows in a ResultSet will be retrived before you can process the ResultSet. However, i am curious