Re: [sqlite] SQLite and GHS Integrity Issues

2009-05-05 Thread Christopher Taylor
After running a night of tests I see that the VFS address space has run out of memory. Searching on this I have found a post from February which said there was an issue with the number of locks/unlocks not matching. I did not actually see a resolution in that thread. I am going to try and invest

Re: [sqlite] Max Value In Group By Scenario

2009-05-05 Thread Igor Tandetnik
"Eric Pankoke" wrote in message news:6a90e70a6f404948991a0380e6793...@gamesmachine The following query: > > SELECT MfgProductID, ProductID, SUM(Weight) As MaxWeight FROM > dominantmaterials GROUP BY MfgProductID, ProductID > > Gets me most of the way to what I need. What I'm really after, > howev

[sqlite] group_concat of empty strings with separator bug?

2009-05-05 Thread Steve Bauer
The behavior of group_concat for empty strings isn't what I expected. This looks to me like a bug. Would the sqlite developers consider it to be one? sqlite> .nullvalue VISIBLENULL sqlite> CREATE table example (id INTEGER PRIMARY KEY AUTOINCREMENT, a TEXT); sqlite> INSERT INTO example(a) VALUE

Re: [sqlite] group_concat of empty strings with separator bug?

2009-05-05 Thread D. Richard Hipp
On May 5, 2009, at 9:26 AM, Steve Bauer wrote: > The behavior of group_concat for empty strings isn't what I expected. See http://www.sqlite.org/cvstrac/tktview?tn=3806 D. Richard Hipp [email protected] ___ sqlite-users mailing list sqlite-users@sqlit

Re: [sqlite] group_concat of empty strings with separator bug?

2009-05-05 Thread Steve Bauer
Many thanks for: 1) the very fast response 2) the very active development 3) the pointer to the bug report -Original Message- From: [email protected] [mailto:[email protected]] On Behalf Of D. Richard Hipp Sent: Tuesday, May 05, 2009 9:33 AM To: General Discu

Re: [sqlite] sqlite3_prepare returns SQLITE_MISUSE

2009-05-05 Thread Beau Wilkinson
Thanks for the reply. SQLITE_MISUSE would make sense in the scenario you describe. But it is difficult for me to see how I could be calling prepare with an unopened or closed connection. I am basically in the process of executing a series of statements against an open database that is exclusive

Re: [sqlite] SQL error: database disk image is malformed

2009-05-05 Thread Griggs, Donald
Hi Joanne, It's possible you'll have to resort to your most recent backup. But before doing that, I wasn't sure from your reply that you saw the other points I listed. -- Hold tight to my backups of my data. -- Run "PRAGMA integrity_check;" as soon as possible. -- See if the problem can be r

Re: [sqlite] OT: how best to convert sqlite3_int64 to and from string in a cross platform fashion?

2009-05-05 Thread Ken
Dan... Yes the varint! --- On Mon, 5/4/09, Dan wrote: > From: Dan > Subject: Re: [sqlite] OT: how best to convert sqlite3_int64 to and from > string in a cross platform fashion? > To: "General Discussion of SQLite Database" > Date: Monday, May 4, 2009, 11:52 PM > > On May 4, 2009, at 10:14

Re: [sqlite] [newbie] How to upgrade sqlite3 in Ubuntu?

2009-05-05 Thread Eric Bohlman
Derrell Lipman wrote: > The amalgamation probably installed into some directory not in your path. > You should look at where it installed (re-run ../configure and look at its > output, which should tell you where it will install to. For Ubuntu, you > almost certainly want it to install into /usr/lo

Re: [sqlite] Max Value In Group By Scenario

2009-05-05 Thread epankoke
Thanks. - Original Message - From: "Igor Tandetnik" To: [email protected] Sent: Tuesday, May 5, 2009 8:05:42 AM GMT -05:00 US/Canada Eastern Subject: Re: [sqlite] Max Value In Group By Scenario "Eric Pankoke" wrote in message news:6a90e70a6f404948991a0380e6793...@gamesmac

[sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Kalyani Phadke
I have 2259207 records in table using SQLite3 database. I am running the select query to retrive records from DB SELECT ID, EventClassName, EventClassRef, TransitionTime, Message, MonitoredRef, EventRef,ToState,Priority,Acked from Events WHERE Events.NotificationTime >= {ts '2009-05-04 14:44:10'

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread BareFeet
Hi Kalyani, > I have 2259207 records in table using SQLite3 database. I am running > the > select query to retrive records from DB > > SELECT ID, EventClassName, EventClassRef, TransitionTime, Message, > MonitoredRef, EventRef,ToState,Priority,Acked from Events WHERE > Events.NotificationTime >

Re: [sqlite] SQLite and GHS Integrity Issues

2009-05-05 Thread Christopher Taylor
I cannot seem to get anywhere with this. The heap usage for the file system address space in my embedded app continues to rise until the file system crashes due to no more available RAM. In February 2008 someone mentioned issues with a mismatch on number of locks versus unlocks. Was this ever re

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Ken
Upgrade your ram. Are you sure its sqlite using all the memory and not the WebServer? Do you have an index on Events.NotificationTime ? --- On Tue, 5/5/09, Kalyani Phadke wrote: > From: Kalyani Phadke > Subject: [sqlite] Large SQLite3 Database Memory Usage > To: [email protected] >

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Kalyani Phadke
If I access other pages in my application ,it works fine. Its only this page with query given that's causing problem.I also tried running the query from sqlite studio query editor. It beahves the same . So I think its Sqlite and not the webserver. -Original Message- From: sqlite-users

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Kalyani Phadke
Thanks for your response. The query runs faster than mine but still facing problem after running the page multiple times.So I think I should try with 1GB of RAM. Thanks, -Original Message- From: [email protected] [mailto:[email protected]] On Behalf Of BareFee

[sqlite] one or many tables, what gives the best performance ?

2009-05-05 Thread Stef Mientki
Hello, Sorry I'm not very familiar with databases, so I probably don't use the right terms. I wonder what's the best approach in my specific case: I have a table "A", in this table "A", each row is connected to about 50 rows of other information. These 50 rows of other information have an ide

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Kalyani Phadke
How much RAM is needed to handle 610MB database with 2259207 records in table.Initially I was running Windows web server 2008 with 512 MB RAM,now I upgraded to 1GB RAM but still the same ..If I run my application once the query returns results in 80 sec and if run it again , memory usage starts

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Kalyani Phadke
I am running the query with CursorLocation = 2, CursorType = 2, LockType = 3 to handle 610MB database with 2259207 records in table. -Original Message- From: [email protected] [mailto:[email protected]] On Behalf Of Kalyani Phadke Sent: Tuesday, May 05, 20

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Virgilio Alexandre Fornazin
Are you using ADO or plain sqlite dll ? May this be a leak in your provider ? -Original Message- From: [email protected] [mailto:[email protected]] On Behalf Of Kalyani Phadke Sent: terça-feira, 5 de maio de 2009 16:13 To: General Discussion of SQLite Database S

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Kalyani Phadke
I am using SQLite ODBC Driver. How can I find if its leak in my provider??? -Original Message- From: [email protected] [mailto:[email protected]] On Behalf Of Virgilio Alexandre Fornazin Sent: Tuesday, May 05, 2009 12:23 PM To: 'General Discussion of SQLite Da

[sqlite] How to check the healthy of database and the indexes of the tables

2009-05-05 Thread Joanne Pham
Hi All, I had the database and one of the index is not good condition. Every time I use the index by select ... group by .. the result only return few rows and the message print  out that "database disk image is malformed". Is there any command to check if the index or database in good condition

[sqlite] Database Corruption

2009-05-05 Thread Jacob Siegel
Hi, I have found what I believe to be a bug in SQLite. It is reproducible fairly easily (though the database file is not small). Essentially, with a non-corrupt database, and auto_vaccum enabled, I can run a series of delete statements (through the command line tool) that cause the dat

Re: [sqlite] Database Corruption

2009-05-05 Thread D. Richard Hipp
On May 5, 2009, at 4:09 PM, Jacob Siegel wrote: > > Hi, > > >I have found what I believe to be a bug in SQLite. It is > reproducible > fairly easily (though the database file is not small). > > Essentially, with a non-corrupt database, and auto_vaccum enabled, > I can > run a series of

Re: [sqlite] How to check the healthy of database and the indexes of the tables

2009-05-05 Thread Kees Nuyt
On Tue, 5 May 2009 13:02:13 -0700 (PDT), Joanne Pham wrote: >Hi All, > I had the database and one of the index is >not good condition. Every time I use the >index by select ... group by .. the result >only return few rows and the message print >out that "database disk image is malformed". > Is

Re: [sqlite] How to check the healthy of database and the indexes ofthe tables

2009-05-05 Thread Griggs, Donald
Hello Joanne, Regarding: "Is there any command to check if the index or database in good condition." That's why I listed the pragma below in my email of last night and repeat email earlier. You're in luck if only the index is corrupted of course. SAVE a copy of your current database (very im

Re: [sqlite] How to check the healthy of database and the indexes of the tables

2009-05-05 Thread Joanne Pham
Thanks, I used sqlite 3.5.9 but when I ran PRAGMA integrity_check; it returns OK but one of the index has problem. Thanks, JP   From: Kees Nuyt To: [email protected] Sent: Tuesday, May 5, 2009 1:30:58 PM Subject: Re: [sqlite] How to check the healthy of

Re: [sqlite] How to check the healthy of database and the indexes ofthe tables

2009-05-05 Thread Joanne Pham
Thanks Donald, Ran  "PRAGMA integrity_check;" and it turned "ok" but the select statement using the select return the error message that "...malformed". I am using sqlite3.5.9. Thanks, JP From: "Griggs, Donald" To: General Discussion of SQLite Database

Re: [sqlite] SQL error: database disk image is malformed

2009-05-05 Thread Pavel Ivanov
Is it just me or somebody else is seeing too that the sql statement "select blobid, fbid from sig group by peerid" is invalid and shouldn't be executed or prepared at all? Pavel On Mon, May 4, 2009 at 2:51 PM, Joanne Pham wrote: > Hi All, > I ran the following sql statement: >     select blobid,

Re: [sqlite] How to check the healthy of database and the indexesofthe tables

2009-05-05 Thread Griggs, Donald
Joanne, I don't want to imply that you *have* to take my suggested course of action (and probably MOST of the folks on this list know better sqlite than I), but, nonetheless, I'm still wondering about the results of my suggestions. Maybe if you could either give your results for each, or a shor

Re: [sqlite] SQL error: database disk image is malformed

2009-05-05 Thread Kees Nuyt
On Tue, 5 May 2009 16:55:42 -0400, Pavel Ivanov wrote: >Is it just me or somebody else is >seeing too that the sql statement > "select blobid, fbid from sig group by peerid" >is invalid and shouldn't be >executed or prepared at all? You are right, it doesn't make sense. @Joannek: When using

Re: [sqlite] Large SQLite3 Database Memory Usage

2009-05-05 Thread Virgilio Alexandre Fornazin
Try to run those queries on sqlite3 program. Then compare memory working sets between your IIS Process and sqlite3 shell. -Original Message- From: [email protected] [mailto:[email protected]] On Behalf Of Kalyani Phadke Sent: terça-feira, 5 de maio de 2009 16:25

Re: [sqlite] Database Corruption

2009-05-05 Thread D. Richard Hipp
On May 5, 2009, at 4:09 PM, Jacob Siegel wrote: > > Hi, > > >I have found what I believe to be a bug in SQLite. It is > reproducible > fairly easily (though the database file is not small). > > Essentially, with a non-corrupt database, and auto_vaccum enabled, > I can > run a series of

[sqlite] Optimizing concurrency with sql query - locks?

2009-05-05 Thread Rosemary Alles
Hullo all, Run on a single processor, the following query is quite fast: // Select Statement sprintf(sql_statements, "select lp.%s, lp.%s, lp.%s, lp.%s, pb.%s from %s lp, %s pb " "where lp.%s > ? and lp.%s=pb.%s " "order by lp.%s, lp.%s, pb.%s",

Re: [sqlite] SQL error: database disk image is malformed

2009-05-05 Thread Jay A. Kreibich
On Tue, May 05, 2009 at 11:46:38PM +0200, Kees Nuyt scratched on the wall: > On Tue, 5 May 2009 16:55:42 -0400, Pavel Ivanov > wrote: > > >Is it just me or somebody else is > >seeing too that the sql statement > > "select blobid, fbid from sig group by peerid" > >is invalid and shouldn't be > >