Re: [sqlite] upstreaming Chromium patches for file handle passing support

2010-09-09 Thread Paweł Hajdan , Jr .
On Tue, Aug 31, 2010 at 10:51, Richard Hipp wrote: > My suggestion is that you make a copy of the os_unix.c source file (call it > chromium_vfs.c or anything else that you like) and apply your edits to that > copy. Since you started with an exact copy of the original os_unix.c

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Max Vlasov
> But as a side effect I got not expected result in other area, when I tried > to append 1,500,000 records to this 1.7G file having 5G of free space on the > disk, I got the error a user reported recently about win7 64bit, "Disk I/O > error".

Re: [sqlite] In memory database and locking.

2010-09-09 Thread Hemant Shah
--- On Thu, 9/9/10, Kees Nuyt wrote: > From: Kees Nuyt > Subject: Re: [sqlite] In memory database and locking. > To: sqlite-users@sqlite.org > Date: Thursday, September 9, 2010, 11:48 AM > On Wed, 8 Sep 2010 21:03:05 -0700 > (PDT), Hemant Shah >

Re: [sqlite] In memory database and locking.

2010-09-09 Thread Hemant Shah
--- On Thu, 9/9/10, Black, Michael (IS) wrote: > From: Black, Michael (IS) > Subject: Re: [sqlite] In memory database and locking. > To: "General Discussion of SQLite Database" > Date: Thursday, September 9, 2010, 9:16

Re: [sqlite] Feature request: copying vacuum

2010-09-09 Thread Taras Glek
On 09/01/2010 11:41 AM, Taras Glek wrote: > Hi, > Currently VACUUM takes care of sqlite-level fragmentation. > Unfortunately it does little for fs-level fragmentation since the same > file is being reused. It would be really beneficial for Mozilla > performance if we could get a

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Shane Harrelson
Michele- I've looked at trying to reproduce your issue on an 32-bit Windows XP system using the latest code, and could not. Even assuming the "worst case" of a 512 byte page size, starting with a 1.2gb DB file, deleting all the records would result in a WAL file of roughly the same size

Re: [sqlite] Freelist walking and location of free blocks

2010-09-09 Thread David C. Smith
Got it - I think I understand. I don't really care about free list pages, just free blocks within a page. So, deleting a second row from my small test database gave me the following output: Page Size is: 1024 (0400) FreeListPage = 0 FreeListCount = 0 Going to offset: 1024 Freeblock = 964 (0D

Re: [sqlite] Query suggestion?

2010-09-09 Thread Doug
Thenk you Gerry. After some studying I now understand that the inner SELECT is executed for each outer row -- so trimming the outer result set early seems like a very good optimization idea. Doug > -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- >

Re: [sqlite] Freelist walking and location of free blocks

2010-09-09 Thread Richard Hipp
On Thu, Sep 9, 2010 at 4:03 PM, David C. Smith wrote: > All, I am trying to manually parse the freelist to recover deleted data. > Yes, I googled for someone to have created this already :) > > I am getting data that I don't expect and wanted to see if anyone could see >

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Max Vlasov
On Thu, Sep 9, 2010 at 7:16 PM, Dan Kennedy wrote: > > > > > Dan, don't know whether it is related, but I detected memory leak in > > 3.7.2 > > related to handle count increasing. > > I think there will be one open handle for each 32KB of > shared-memory space in use. Or

[sqlite] Freelist walking and location of free blocks

2010-09-09 Thread David C. Smith
All, I am trying to manually parse the freelist to recover deleted data. Yes, I googled for someone to have created this already :) I am getting data that I don't expect and wanted to see if anyone could see where I have a misunderstanding. I am using http://www.sqlite.org/fileformat2.html ()

Re: [sqlite] Query suggestion?

2010-09-09 Thread Gerry Snyder
On 9/9/2010 11:32 AM, Doug wrote: > Thank you Igor. > > You've helped me before with what also turned out to be a similar > select referencing the same table twice. I guess it's a concept > that I don't fully get. If there is a name for this technique > I'll go Google and study up on it. >

Re: [sqlite] Query suggestion?

2010-09-09 Thread Doug
Thank you Igor. You've helped me before with what also turned out to be a similar select referencing the same table twice. I guess it's a concept that I don't fully get. If there is a name for this technique I'll go Google and study up on it. Doug > -Original Message- > From:

Re: [sqlite] In memory database and locking.

2010-09-09 Thread Kees Nuyt
On Wed, 8 Sep 2010 21:03:05 -0700 (PDT), Hemant Shah wrote: > I forgot to mention, that I have set pragma journal_mode to off > and for every insert I do prepare -> step -> finalize -> COMMIT. That's a weird sequence. Because you use the same statement all the time, you only

Re: [sqlite] Query suggestion?

2010-09-09 Thread Igor Tandetnik
Doug wrote: > I'm wondering if the SQL gurus here can give me some direction. I have a > very simple stats table: > > CREATE TABLE StatData > ( > StatID INTEGER NOT NULL, > Value REAL NOT NULL, > Date INTEGER NOT NULL > ); > > I'd like to pull out the most recent date and

Re: [sqlite] issue on blob

2010-09-09 Thread Igor Tandetnik
Fabio Spadaro wrote: > 2010/9/9 Igor Tandetnik > >> Fabio Spadaro wrote: >>> Can you determine in the blob's data >>> what is buffered file type and what was its original length? >> >> You retrieve the size of the BLOB

[sqlite] Register For The 17th Annual Tcl/Tk Conference 2010

2010-09-09 Thread Andreas Kupries
17th Annual Tcl/Tk Conference (Tcl'2010) http://www.tcl.tk/community/tcl2010/ October 11 - 15, 2010 Hilton Suites/Conference Center Chicago/Oakbrook Terrace, Illinois, USA Registration for the Conference is open at http://www.tcl.tk/community/tcl2010/reg.html To book a room at the

[sqlite] Query suggestion?

2010-09-09 Thread Doug
I'm wondering if the SQL gurus here can give me some direction. I have a very simple stats table: CREATE TABLE StatData ( StatID INTEGER NOT NULL, Value REAL NOT NULL, Date INTEGER NOT NULL ); I'd like to pull out the most recent date and associated value for each StatID. I initially thought

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Michele Pradella
Hi Max, I got the problem in both situations: 1. I have a journal_mode=DELETE database and I convert it to WAL. 2. I create a new database with WAL mode. I never check the handles in the task manager, but I always see the mapped files in vmmap growing up. I think it's the same. Anyway I

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Dan Kennedy
On Sep 9, 2010, at 10:04 PM, Max Vlasov wrote: > On Thu, Sep 9, 2010 at 11:37 AM, Dan Kennedy > wrote: > >> >> On Sep 9, 2010, at 1:12 PM, Michele Pradella wrote: >> >>> Hi, do you have some news about the wasted memory? have you found >>> the >>> reason for the

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Max Vlasov
On Thu, Sep 9, 2010 at 11:37 AM, Dan Kennedy wrote: > > On Sep 9, 2010, at 1:12 PM, Michele Pradella wrote: > > > Hi, do you have some news about the wasted memory? have you found the > > reason for the windows backend? > > Fixed here: > >

Re: [sqlite] issue on blob

2010-09-09 Thread Fabio Spadaro
HI, 2010/9/9 Igor Tandetnik > Fabio Spadaro wrote: > > Can you determine in the blob's data > > what is buffered file type and what was its original length? > > You retrieve the size of the BLOB field with sqlite3_column_bytes function, > or with

Re: [sqlite] In memory database and locking.

2010-09-09 Thread Black, Michael (IS)
I've never seen an application that would run faster in ANY database vs custom code. Databases are for generic query problems...not the end-all to "store my data" when speed is a concern. I've pointed out a few times on this list where people are concerned for speed and showed things like 30X

Re: [sqlite] In memory database and locking.

2010-09-09 Thread Hemant Shah
--- On Thu, 9/9/10, Simon Slavin wrote: From: Simon Slavin Subject: Re: [sqlite] In memory database and locking. To: "General Discussion of SQLite Database" Date: Thursday, September 9, 2010, 8:24 AM On 9 Sep 2010, at

Re: [sqlite] issue on blob

2010-09-09 Thread Igor Tandetnik
Fabio Spadaro wrote: > Can you determine in the blob's data > what is buffered file type and what was its original length? You retrieve the size of the BLOB field with sqlite3_column_bytes function, or with length() function in SQL. I'm not familiar with the term

Re: [sqlite] EXTERNAL: In memory database and locking.

2010-09-09 Thread Hemant Shah
How do I setup trigger to run every minute? I thought about writing hash code, but thought sqlite or other in memory database would work. The in memory database seems to keep up with the in coming traffic. Hemant Shah E-mail: hj...@yahoo.com --- On Thu, 9/9/10, Black, Michael (IS)

[sqlite] issue on blob

2010-09-09 Thread Fabio Spadaro
Hi all. Can you determine in the blob's data what is buffered file type and what was its original length? Obviously the solution to store the blob on a files would be too easy and I do not like it. Workaround? -- Fabio Spadaro www.fabiospadaro.com ___

[sqlite] idle state and dead locks

2010-09-09 Thread Sam Carleton
I am having some issues with dead locks. Currently I have two different processes access the sqlite db, one is an Apache module using the dbd framework to manage connections, the other is a .Net program using the standard .Net provider. I wanted to just validate that both the providers can open

Re: [sqlite] In memory database and locking.

2010-09-09 Thread Simon Slavin
On 9 Sep 2010, at 4:55am, Hemant Shah wrote: > The other process wakes up every 60 seconds and deletes all row whose > timestamp columns is less then (current timestamp - 60). The timestamp is > number of seconds since epoch. Do you do this using a single DELETE FROM command ? Do you have an

Re: [sqlite] Detecting storage class from C

2010-09-09 Thread Simon Slavin
On 9 Sep 2010, at 7:13am, Max Vlasov wrote: > But if you write something universal, also have in mind that sqlilte won't > raise any exception, for example if you try to read an integer, but there's > a text stored there, you won't get an error, just zero as a result Two different situations

Re: [sqlite] EXTERNAL: In memory database and locking.

2010-09-09 Thread Black, Michael (IS)
Have you considered doing your cleanup during a trigger? I assume you're already using transactions for your inserts. I wouldn't think it would be much slower doing it every insert as you'd be deleting a much smaller set every time. This is really a LOT faster if you just hash your info and then

Re: [sqlite] How to inject primary keys which are set to autoincrement in sqlite??

2010-09-09 Thread Simon Davies
On 9 September 2010 12:22, tigermain wrote: > > In MS SQL I would use > > SET IDENTITY INSERT ON > > How do I do something similar in SQLite. I am trying to upgrade a database > and want to maintain the IDs from the original You choose whether to include the key as part of

[sqlite] How to inject primary keys which are set to autoincrement in sqlite??

2010-09-09 Thread tigermain
In MS SQL I would use SET IDENTITY INSERT ON How do I do something similar in SQLite. I am trying to upgrade a database and want to maintain the IDs from the original Thanks -- View this message in context:

[sqlite] How to inject primary keys which are set to autoincrement in sqlite??

2010-09-09 Thread tigermain
In MS SQL I would use SET IDENTITY INSERT ON How do I do something similar in SQLite. I am trying to upgrade a database and want to maintain the IDs from the original Thanks -- View this message in context:

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Michele Pradella
I have ported the changes of the fix http://www.sqlite.org/src/ci/f213e133f6 to my code (with some difficult because I have ported directly in my sqlite3.c source). Anyway I think that the problem still exist, after few test I'll see with vmmap mapped file growing up like before the fix. I

Re: [sqlite] "create table as" syntax

2010-09-09 Thread thomas veymont
> > > hello, > > > > I'm trying to use the "CREATE TABLE AS" syntax to create a table and > > insert > > in the same time a default row. > > > > e.g : > > > > sqlite> CREATE TABLE test (x NUMERIC) AS (SELECT 25 AS x); > > Error: near "AS": syntax error > > > > oops. > > > > this syntax is

Re: [sqlite] "create table as" syntax

2010-09-09 Thread Andy Gibbs
On Thursday, September 09, 2010 10:56 AM, thomas veymont wrote: > hello, > > I'm trying to use the "CREATE TABLE AS" syntax to create a table and > insert > in the same time a default row. > > e.g : > > sqlite> CREATE TABLE test (x NUMERIC) AS (SELECT 25 AS x); > Error: near "AS": syntax error >

Re: [sqlite] "create table as" syntax

2010-09-09 Thread Dan Kennedy
On Sep 9, 2010, at 3:56 PM, thomas veymont wrote: > hello, > > I'm trying to use the "CREATE TABLE AS" syntax to create a table and > insert > in the same time a default row. > > e.g : > > sqlite> CREATE TABLE test (x NUMERIC) AS (SELECT 25 AS x); > Error: near "AS": syntax error > > oops. > >

[sqlite] "create table as" syntax

2010-09-09 Thread thomas veymont
hello, I'm trying to use the "CREATE TABLE AS" syntax to create a table and insert in the same time a default row. e.g : sqlite> CREATE TABLE test (x NUMERIC) AS (SELECT 25 AS x); Error: near "AS": syntax error oops. this syntax is documented in http://www.sqlite.org/lang_createtable.html

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Michele Pradella
ok thank you, today I'm going to port the difference to my source code and I'm going to try if the memory it's ok Il 09/09/2010 9.37, Dan Kennedy ha scritto: > On Sep 9, 2010, at 1:12 PM, Michele Pradella wrote: > >> Hi, do you have some news about the wasted memory? have you found the >>

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Dan Kennedy
On Sep 9, 2010, at 1:12 PM, Michele Pradella wrote: > Hi, do you have some news about the wasted memory? have you found the > reason for the windows backend? Fixed here: http://www.sqlite.org/src/ci/f213e133f6 Does the problem still show up for you using fossil tip? > do you think

Re: [sqlite] Detecting storage class from C

2010-09-09 Thread Max Vlasov
On Thu, Sep 9, 2010 at 1:01 AM, Andrew Wood wrote: > Because I'm writing glue code between the SQLite API and a higher level > library which provides a standard API across several DBMSs. > > Have in mind that storage class is not a 'type', it's more like an effective way to

Re: [sqlite] memory wasted shm mapped file (3.7.2)

2010-09-09 Thread Michele Pradella
Hi, do you have some news about the wasted memory? have you found the reason for the windows backend? do you think it could be due to the windows implementation of the mmap? Il 02/09/2010 16.46, Richard Hipp ha scritto: > On Thu, Sep 2, 2010 at 9:59 AM, Marcus