Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Ian Katz
OK. I think you guys have answered my question: I'm not asking the right question. I need to get better data on my performance requirements if I'm going to start asking the right sort of questions. For now, I'll see what I can learn about using WAL mode and go from there. Thanks for the

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Marcus Grimm
> Converting variable name to variable ID (with separate lookup table) > was one of my first ideas, but turns out that the lookup itself was a > bigger hit in performance than the indexing. I'll revisit that and > see if I failed to tweak something properly. To me it sounds that it will just

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Simon Slavin
On 11 Apr 2012, at 6:11pm, Ian Katz wrote: > The database system that I'm designing is for an autonomous vehicle; > it collects a lot of (data which is currently getting stored as a flat > text file). So, it's going to write a LOT of data into many tables > independently,

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Black, Michael (IS)
I assume you are batching your inserts? How many inserts/sec do you need to do to keep up? Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop Grumman Information Systems From:

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Ian Katz
Converting variable name to variable ID (with separate lookup table) was one of my first ideas, but turns out that the lookup itself was a bigger hit in performance than the indexing. I'll revisit that and see if I failed to tweak something properly. -Ian On Wed, Apr 11, 2012 at 1:22 PM, Pavel

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Pavel Ivanov
> Am I missing any features of SQLite that would solve this problem in a > different/better way? If you didn't try it I would suggest to try a single table (timestamp, variable id, value). Index on integer variable id will work faster than text variable name. Other than that I'd say your design

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Ian Katz
These are all good points, and introduce some features of sqlite that I didn't know existed! The database system that I'm designing is for an autonomous vehicle; it collects a lot of (data which is currently getting stored as a flat text file). So, it's going to write a LOT of data into many

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Frank Chang
Message: 19 >Date: Wed, 11 Apr 2012 08:31:49 -0400 >From: Gabor Grothendieck >To: General Discussion of SQLite Database >Subject: Re: [sqlite] Is it possible to use substrings of Windows DOS >batch fiile parameters in sqlite3.exe -line db ?

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Frank Chang
inq1ltd, Thank you for your reply. Here is an excerpt of the most recent Windows CMD file: set var=%1 @echo %var:~0,-4% set abc= %var:~0,-4% cameron.cmd %abc% > From: inq1...@inqvista.com > To: sqlite-users@sqlite.org > CC: frank_chan...@hotmail.com > Subject: Re: [sqlite] Is it

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Pavel Ivanov
On Wed, Apr 11, 2012 at 12:01 PM, Ian Katz wrote: > The Sqlite3 manual says that any locking operations affect the entire > database, not individual tables. > http://www.sqlite.org/lockingv3.html > > I was wondering if this effect could be compensated for by splitting >

Re: [sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Simon Slavin
On 11 Apr 2012, at 5:01pm, Ian Katz wrote: > The Sqlite3 manual says that any locking operations affect the entire > database, not individual tables. > http://www.sqlite.org/lockingv3.html > > I was wondering if this effect could be compensated for by splitting > tables

[sqlite] Using "attach database" to work around DB locking

2012-04-11 Thread Ian Katz
Hello, The Sqlite3 manual says that any locking operations affect the entire database, not individual tables. http://www.sqlite.org/lockingv3.html I was wondering if this effect could be compensated for by splitting tables into separate databases and using the "attach database" option outlined

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Nick Shaw Sent: 11 April 2012 16:29 To: General Discussion of SQLite Database Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode -Original Message-

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy Sent: 11 April 2012 16:07 To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode > After sqlite3_close() returns

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy Sent: 11 April 2012 16:07 To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode > > I'll try your suggestion of setting

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread inq1ltd
On Tuesday, April 10, 2012 07:14:59 PM Frank Chang wrote: > Good evening, We are trying to generate automated SQLITE SQL scripts based > on the names of SQLite tables derived by substring manipulation of Windows > DOS batch file and/or Windows environment variables. For example: > > /*

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Dan Kennedy
On 04/11/2012 09:50 PM, Nick Shaw wrote: -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin Sent: 10 April 2012 19:04 To: General Discussion of SQLite Database Subject: Re: [sqlite] Unicode problem when setting

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin Sent: 10 April 2012 19:04 To: General Discussion of SQLite Database Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode >> Realised I made a typo

Re: [sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Pavel Ivanov
FYI: both leaks are fixed in trunk: http://www.sqlite.org/src/info/93a0f452a7. Pavel 2012/4/11 Zhenbo Xu : > What about the second one? > The heap object allocated at > 7547 home_dir = >

[sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Zhenbo Xu
Hi, all I have applied a memory leak detection tool Melton to find memory leaks in sqlite-3.7.11. Two bugs were found, and I check them manually as the real ones. Here is the url of the bugs:

Re: [sqlite] error compilation with sqlite amalgamation

2012-04-11 Thread Black, Michael (IS)
Oops...typo on my part. Missed a "p'. -lpthread Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop Grumman Information Systems From: sqlite-users-boun...@sqlite.org

Re: [sqlite] error compilation with sqlite amalgamation

2012-04-11 Thread Sako Youssouf
Problem resolved, it was pthread library instead of thread. Thank you again -Message d'origine- De : sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] De la part de Sako Youssouf Envoyé : mercredi 11 avril 2012 14:43 À : General Discussion of SQLite Database

Re: [sqlite] error compilation with sqlite amalgamation

2012-04-11 Thread Sako Youssouf
Thank you Michael, I compiled without including the library. When I include the dl library the "dl..." error disappear but I can't find the thread library. I find the "thread_db" library but the "thread..." error doesn't disappear when I use it. Do you know where can I find that thread

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Gabor Grothendieck
On Tue, Apr 10, 2012 at 7:14 PM, Frank Chang wrote: > > Good evening, We are trying to generate automated SQLITE  SQL scripts based > on the names of SQLite tables derived by substring manipulation of Windows > DOS batch file and/or Windows environment variables. For

Re: [sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Eduardo Morras
At 14:06 11/04/2012, you wrote: On Wed, Apr 11, 2012 at 02:01:29PM +0200, Eduardo Morras wrote: > At 12:09 11/04/2012, you wrote: > >Hi, all > >I have applied a memory leak detection tool > >Melton to > >find memory leaks in sqlite-3.7.11. > >Two bugs were

Re: [sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Zhenbo Xu
What about the second one? The heap object allocated at 7547 home_dir = find_home_dir() ; and is not released when exiting this function via 7558 return 1; 在 2012年4月11日 下午8:06,Andrew Suffield

Re: [sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Andrew Suffield
On Wed, Apr 11, 2012 at 02:01:29PM +0200, Eduardo Morras wrote: > At 12:09 11/04/2012, you wrote: > >Hi, all > >I have applied a memory leak detection tool > >Melton to > >find memory leaks in sqlite-3.7.11. > >Two bugs were found, and I check them manually

Re: [sqlite] error compilation with sqlite amalgamation

2012-04-11 Thread Black, Michael (IS)
You don't show how you're compiling...but this is what you need to do. gcc -o myprog myprog.c sqlite3.c -lthread -ldl Your undefined reference are to the two libraries you need to link in to resolve them. Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced

Re: [sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Eduardo Morras
At 12:09 11/04/2012, you wrote: Hi, all I have applied a memory leak detection tool Melton to find memory leaks in sqlite-3.7.11. Two bugs were found, and I check them manually as the real ones. Here is the url of the bugs:

[sqlite] error compilation with sqlite amalgamation

2012-04-11 Thread Sako Youssouf
Hi, I want to use sqlite with an arm processor, and when I compiled the source files from the amalgamation, I got these errors: sqlite3.o: In function `pthreadMutexAlloc': sqlite3.c:(.text+0x3a93): undefined reference to `pthread_mutexattr_init' sqlite3.c:(.text+0x3aa6): undefined reference

Re: [sqlite] Issue with Session while using SQLLITE database

2012-04-11 Thread Taleeb Anwar
As the error suggests you need to serialize you session object when using "State Server". See an example here - http://nareshkamuni.blogspot.in/2011/12/example-of-stateserver-session-mode-in.html(note the [serializable] tag). Maybe someone else may explain which will be a better option (to use

[sqlite] Two potential memory leaks in sqlite-3.7.11

2012-04-11 Thread Zhenbo Xu
Hi, all I have applied a memory leak detection tool Melton to find memory leaks in sqlite-3.7.11. Two bugs were found, and I check them manually as the real ones. Here is the url of the bugs:

Re: [sqlite] Issue with Session while using SQLLITE database

2012-04-11 Thread Dorababu Meka
Ok but I am using Mysql too in my application if I use that I am getting an error as *Unable to serialize the session state. In 'StateServer' and 'SQLServer' mode, ASP.NET will serialize the session state objects, and as a result non-serializable objects or MarshalByRef objects are not permitted.

Re: [sqlite] Issue with Session while using SQLLITE database

2012-04-11 Thread Taleeb Anwar
Ok. Here's what I guess is happening. You are making changes in you db file which is stored inside your bin directory. When there is a change in the bin directory* the App pool recycles *and thus you loose the session variable. There must be several ways of avoiding it - perhaps the following

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Kees Nuyt
On Tue, 10 Apr 2012 19:14:59 -0400, Frank Chang wrote: > > Good evening, We are trying to generate automated > SQLITE SQL scripts based on the names of SQLite > tables derived by substring manipulation of Windows > DOS batch file and/or Windows environment variables.