- What version of H2 do you use? A bug related to large databases was fixed recently (see the change log, I think version 1.3.161). But I'm not sure this will fix the problem. I am using the 1.3.155 version , as you pointed out i upgraded the version to 1.3.165 right now.
- Normally I would commit once every 1000 rows or so. 100 million sounds like way too much. I usually would do the same but as this insert are coming straight from the selected table(5 million rows), i thought am anyways increasing the memory on the job, so as well do a commit latter, as its a little faster without the shorter commits. But i have reduced it to 5 million as that would be the minimum from the table. -You should probably increase the cache size in H2 (cache_size). I have increased the cache_size as per Noel's advice too. - What kind of indexes to you use? For example, do you use an index on randomly distributed data? That would be a problem because it would it basically "kills the cache". I have no indexes nor primary keys. - Is there a file called <databaseName>.trace.db next to the database file? If yes what does it contain? No there isn't any trace.db file as i dont have any sql errors or exceptions yet :-). Thanks a lot guys will keep you updated on how this job progresses. regards Harish On Mon, Mar 26, 2012 at 1:05 PM, Thomas Mueller < [email protected]> wrote: > Hi, > > What version of H2 do you use? A bug related to large databases was > fixed recently (see the change log, I think version 1.3.161). But I'm > not sure this will fix the problem. > > > Yeah i commit after every 100 million. > > Normally I would commit once every 1000 rows or so. 100 million sounds > like way too much. > > > The job uses 1.4% of the 8gb. > > You should probably increase the cache size in H2 (cache_size). > > What kind of indexes to you use? For example, do you use an index on > randomly distributed data? That would be a problem because it would it > basically "kills the cache". > > Is there a file called <databaseName>.trace.db next to the database > file? If yes what does it contain? > > Regards, > Thomas > > -- > You received this message because you are subscribed to the Google Groups > "H2 Database" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/h2-database?hl=en. > > -- You received this message because you are subscribed to the Google Groups "H2 Database" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/h2-database?hl=en.
