> -----Original Message----- > From: Tom Poindexter [mailto:[EMAIL PROTECTED] > Sent: Thursday, December 11, 2003 4:01 PM > To: [EMAIL PROTECTED] > Subject: [sqlite] Fatal error loading large table > > > I'm trying to load a fairly large table (~ 7.5 million rows, > 1.5 gb of raw > data) with the 'copy' command, and I'm getting a sqlite fatal error: > > sqlite> copy or replace tab1 from 'tab1.can'; > sqlite> select count(*) from tab1; > 31624 > sqlite> copy or replace tab2 from 'tab2.can'; > SQL error: database disk image is malformed > > The 'tab1' copy works fine, just under 30 seconds to load the > 31,624 rows. > In loading 'tab2', the copy runs for 50 minutes (or longer, I > didn't time it), > The database is empty except for the table definitions. My > platform is > AIX 5.2, sqlite complied with gcc. I'm not a frequent user > of AIX; sqlite > seems to work fine, as does tclsqlite.so . >
This is just a workaround/diagnostic suggestion; what happens if: a) you commit after the 1st copy OR b) you copy tab2 first then copy tab1? If tab1 copy was an example to show that sqlite copy was working I guess my suggestions are moot :-). The other thing to consider; have you seen a working >2Gb sqlite database under AIX yet? I know sqlite supports big databases but it might be platform specific. Have you seen the size of the files in the database dir near the 50 min mark/end of copy? Good luck, Chris --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
