[sqlite] Attempting to merge large databases

I have several databases files that I need to “merge”. Each one has the same schema and about ½ million records. Here is what I’m currently doing (but in code) C:\Development\Main\Common\SQLite>sqlite3 c:\test\a.db3 SQLite version 3.2.7 Enter ".help" for instructions sqlite> attach

[sqlite] SQLite Select Optimization help

Good morning all, I'm wondering if someone can help me with my incredibly slow select statement. My program executes a SINGLE select statement and then generates a report based on the output. So far, it's worked great..until now. Yesterday, I wanted to add a new report that lists

Re: [sqlite] database disk image is malformed

That's an error that may be left over from 1.7. If you're filter is using a mapped drive, try using a UNC. I'm not near a computer, so I can't verify the error message. I will as soon as I get back to the office and kick on the generator, I will verify it. If you could run the User

Re: [sqlite] database disk image is malformed

Sorry, mispost ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] transaction question

I have a large sqlite database and I'm inserting a bunch of records into it. My question is this..shouldn't the -journal be getting larger since I've wrapped all the inserts inside a transaction? I'm watching the file sizes change and the main file is getting larger, but the journal files is

[sqlite] testing for "cannot commit transaction - SQL statements in progress"

Is there anyway to test for this condition so I handle it properly? Gene Allen ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] corrupt database recovery

It's not hard to update it...I'm just whining about that it's out of date and I hate having to deal with matching everything up so I was hoping that I could get past the Attach. I think your python script below might ease my maintenance whoas a bit. I'll port it to C# and just build my insert on

[sqlite] some help with datetime

Hello all, I have a table with a unixepoch column in it. I need to do some fancy calculation based on that time, hourly summaries, weekly averages, standard dev, etc.. Right now..I'm only using it for reporting and simple analysis and it's often formatted like this:

Re: [sqlite] corrupt database recovery

Ok...it's happened again and I've decided that I need to track this down once and for all! Here is what I'm seeing: I get errors when I do a integrity_check (see below), but I can .dump it to a text file and then .read it into another database ok. It seems to me that I'm screwing up an index or

Re: [sqlite] corrupt database recovery

-users-boun...@sqlite.org] On Behalf Of John Elrick > Sent: Wednesday, May 27, 2009 10:59 AM > To: General Discussion of SQLite Database > Subject: Re: [sqlite] corrupt database recovery > > Gene Allen wrote: > >> Ok...it's happened again and I've decided that I need to

Re: [sqlite] corrupt database recovery

very now and again I get a support ticket >> showing > a >> corrupt database. So I'm trying to figure out WHERE to look. >> >> -Original Message- >> From: sqlite-users-boun...@sqlite.org >> [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of John Elrick &

Re: [sqlite] corrupt database recovery

running your code through valgrind? Can you remove the custom VFS ? --- On Wed, 5/27/09, Gene Allen <g...@bystorm.com> wrote: > From: Gene Allen <g...@bystorm.com> > Subject: Re: [sqlite] corrupt database recovery > To: mgr...@medcom-online.de, "'General Discussion of

Re: [sqlite] corrupt database recovery

Yeah. Since my code works in blocks, read/compress/encrypt/write, loop. Almost all the real data was being written to the compressed file, however any finalization and flushing of the stream wasn't occurring (since the encrypt was failing) so the last bit of any SQLite database wouldn't be

Re: [sqlite] corrupt database recovery

'while do.' -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of John Machin Sent: Thursday, May 28, 2009 7:19 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] corrupt database recovery On 29/05/2009 9:34 AM, Ge

[sqlite] except and select

I need to come up with a query where I can remove records that match a certain condition. I have file auditing data and I need the query to show all the files that were deleted and the files that were renamed but not the files that was deleted AND renamed TO. Problem is the Delete is one

Re: [sqlite] except and select

name where t.operation = 'Deleted' and t_ren.ID is null Pavel On Wed, Jul 29, 2009 at 10:17 AM, Gene Allen<g...@bystorm.com> wrote: > I need to come up with a query where I can remove records that match a > certain condition. > > > > I have file auditing data and I need the query

[sqlite] Forensics data control

Hello all, I would like to ask for some guidance. We sell a file auditing product and, like you would think, the database can get large. SQLite has been a perfect engine for us since we only do inserts and searches. Well, now we want to add some sophisticated forensics features. Currently we