Re: [sqlite] ANN: C#-SQLite 3.6.16

[Noah Hart]

Kosenko Max wrote:
> 
> 
> Noah Hart wrote:
>> C#-SQLite is now ready for review.  The project is located at
>> http://code.google.com/p/csharp-sqlite
> I think this name much better than sql-sharp. 
> I've posted a question on SQLite ADO.NET forum
> http://sqlite.phxsoftware.com/forums/p/1879/7971.aspx about supporting
> your implementation in ADO.NET Provider. In Silverlight that require some
> adjustments to your code (not much) and ADO Provider will need to have
> parts of System.Data included as a stubs.
> 
> From your point of view - which parts you haven't yet ported?
> 
The big things are:  FTS, VIRTUAL TABLES, INCRBLOB

And there are still 9 tests to review:  

I need to determine if the test errors are errors in the port, errors in the
TCL, or the test is not appropriate for C#


>From http://code.google.com/p/csharp-sqlite/wiki/CompilerOptions

I am currently compiling with the following OMIT options:

* SQLITE_MUTEX_OMIT
* SQLITE_OMIT_AUTHORIZATION
* SQLITE_OMIT_GET_TABLE
* SQLITE_OMIT_INCRBLOB
* SQLITE_OMIT_LOOKASIDE SQLITE
* OMIT_SHARED_CACHE
* SQLITE_OMIT_UTF16
* SQLITE_OMIT_VIRTUALTABLE 

I have not ported support for

* SQLITE_ENABLE_FTS3
* SQLITE_ENABLE_ICU
* SQLITE_ENABLE_MEMORY_MANAGEMENT
* SQLITE_ENABLE_RTREE 

Noah
-- 
View this message in context: 
http://www.nabble.com/ANN%3A-C--SQLite-3.6.16-tp24839242p24858586.html
Sent from the SQLite mailing list archive at Nabble.com.

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] translating CSV file into sqlite3 database for iPhone?

[John Machin]

On 7/08/2009 1:21 PM, aerende wrote:
> I'm trying to take a CSV file and create a sqlite3 database for the iPhone. 
> The CSV file has 33K entries and is 2 MB.  The problem I am having is that
> only about 1/10 of the database file gets written into the sqlite3 database.
> 
> I first translated the CSV file into SQL commands using the terminal-based
> verison of sqlite3:
> 
> % sqlite3
> sqlite> .mode csv
> sqlite> create table mydatabasetable (ITEM_ID INTEGER PRIMARY KEY,
> FIELDA TEXT, FIELDB TEXT);
> sqlite> .import myfile.csv mydatabasetable

Were there any error messages from that step?

If at this stage you do

select count(*) from mydatabasetable;

what is the result? If it's not the full 33K, which records are being 
left out?

> sqlite> .output mydatabasetable.sql

The .output command specifies what file any output will be sent to. It 
doesn't actually generate any output itself. Perhaps you are missing a 
.dump command and a quit command -- it's always a good idea to 
copy/paste actual output into your mail client, rather than re-typing it 
from memory.

> Then I tried to create a sqlite3 database from the sql file:
> 
> % sqlite3 mydatabasetable.sqlite < mydatabasetable.sql

Any errors from this step? What does select count(*) give you?

> 
> When I read in mydatabasetable.sqlite into a sqlite3 database,

What does that mean? A third step? If mydatabasetable.sqlite is not 
already a sqlite3 database, the previous steps have run amok somehow.

> only the
> first 3400 entries out of 33,000 are in the database even though
> mydatabasetable.sql has 33,000 unique insert commands.

In which database?

> Am I following the correct approach to write out an sqlite database? 

Dunno why you are doing it in two (three?) steps; the CSV import should 
be all you need.

> Is
> there some default database filesize limit that I need to set?  Does anyone
> know why only the first 3400 entries show up in the database?

It would help very much if you said what version of SQLite you are 
running and what platform you are running it on.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] translating CSV file into sqlite3 database for iPhone?

[aerende]

I'm trying to take a CSV file and create a sqlite3 database for the iPhone. 
The CSV file has 33K entries and is 2 MB.  The problem I am having is that
only about 1/10 of the database file gets written into the sqlite3 database.

I first translated the CSV file into SQL commands using the terminal-based
verison of sqlite3:

% sqlite3
sqlite> .mode csv
sqlite> create table mydatabasetable (ITEM_ID INTEGER PRIMARY KEY,
FIELDA TEXT, FIELDB TEXT);
sqlite> .import myfile.csv mydatabasetable
sqlite> .output mydatabasetable.sql


Then I tried to create a sqlite3 database from the sql file:

% sqlite3 mydatabasetable.sqlite < mydatabasetable.sql

When I read in mydatabasetable.sqlite into a sqlite3 database, only the
first 3400 entries out of 33,000 are in the database even though
mydatabasetable.sql has 33,000 unique insert commands.  

Am I following the correct approach to write out an sqlite database?  Is
there some default database filesize limit that I need to set?  Does anyone
know why only the first 3400 entries show up in the database?
-- 
View this message in context: 
http://www.nabble.com/translating-CSV-file-into-sqlite3-database-for-iPhone--tp24858168p24858168.html
Sent from the SQLite mailing list archive at Nabble.com.

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] sqlite database "signature" ?

[John Machin]

On 7/08/2009 2:36 AM, luc.moulinier wrote:

> I'd like to know what is the best way to know if a file
 > is a sqlite DB or not (without launching sqlite of course) ?
 > For example, is the first line of the file unambiguously
 > a signature of sqlite ? If so, what is its structure ?

http://www.sqlite.org/fileformat.html#database_header

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] FTS and postfix search

[Olaf Schmidt]

"Hugh Sasse"  schrieb im
Newsbeitrag
news:alpine.lfd.2.00.0908061712390.30...@trueman.cs.cse.dmu.ac.uk...

> I wonder if the idea of suffix arrays would belp.
> http://www.cs.dartmouth.edu/~doug/sarray/

I was about suggesting basically the same thing...

In case of Lukas' topics-table, one would have to
create an additional (search)table 'topics_suffixes',
where each word from within 'topics' is "expanded",
resulting in multiple record-entries.

In case the table 'topics' contains the word
'Motor' (with an ID of e.g. 12345) - the 'topics_suffixes'-
table should get the following insertions:
topic_id   |   word_suffixes
  12345   |   motor
  12345   |   otor
  12345   |   tor
  12345   |   or

In the above sequence the listing is stopped at a "maximum-
two-chars"-suffix (sparing us the storage or the last, singlechar),
to safe a bit of space, since single-char Like-queries, formulated
in "contains-format" (as e.g. ... word_suffixes Like '%t%' ...)
are probably not that interesting regarding their usual larger
recordcount-output (from the users point of view in such
"live-search-scenarios").

But all these "contains-queries", searching for wordparts,
larger than one single char can now be performed with
larger speed against the (agreed much larger) 'topics_suffixes'
table using:
Select Distinct topic_id Where word_suffixes Like 'somepart%'
(with a proper index on word_suffixes) - maybe combined in
a Join to table topics, depending on the Apps implementation.

The size of the topics_suffixes-table (and its index on
word_suffixes) dependent on the average-wordlenght
in topics of course - it's the usual tradeoff between
"used space" and speed.

Olaf




___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] sqlite database "signature" ?

[robin wen]

Yeah, in my project I just check if the file content starts with this string
to see if it's a Sqlite3 file.

I don't think of a way that could guarantee the "unambiguously".


2009/8/7 P Kishor 

> On Thu, Aug 6, 2009 at 11:36 AM, luc.moulinier
> wrote:
> > Hello !
> >
> > I'd like to know what is the best way to know if a file is a sqlite DB or
> not (without launching sqlite of course) ? For example, is the first line of
> the file unambiguously a signature of sqlite ? If so, what is its structure
> ?
>
> 'SQLite format 3'
>
> although, I am not sure what you expect from 'unambiguously'? I mean,
> while all files created by sqlite3 will start with the above string,
> that doesn't stop me or you from creating a spurious binary file that
> will start with the same string.
>
> Recognize at your own risk.
>
> > Many thanks in advance !
> > Luc
> >
> >
> >  Créez votre adresse électronique prenom@laposte.net
> >  1 Go d'espace de stockage, anti-spam et anti-virus intégrés.
> > ___
> > sqlite-users mailing list
> > sqlite-users@sqlite.org
> > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> >
>
>
>
> --
> Puneet Kishor http://www.punkish.org
> Carbon Model http://carbonmodel.org
> Charter Member, Open Source Geospatial Foundation http://www.osgeo.org
> Science Commons Fellow, http://sciencecommons.org/about/whoweare/kishor
> Nelson Institute, UW-Madison http://www.nelson.wisc.edu
> ---
> Assertions are politics; backing up assertions with evidence is science
> ===
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] sqlite database "signature" ?

[Rich Shepard]

On Thu, 6 Aug 2009, luc.moulinier wrote:

> I'd like to know what is the best way to know if a file is a sqlite DB or
> not (without launching sqlite of course) ? For example, is the first line
> of the file unambiguously a signature of sqlite ? If so, what is its
> structure ? Many thanks in advance ! Luc

   The first 16 bytes are:
SQLite format 3

Rich

-- 
Richard B. Shepard, Ph.D.   |  IntegrityCredibility
Applied Ecosystem Services, Inc.|Innovation
 Voice: 503-667-4517  Fax: 503-667-8863
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] sqlite database "signature" ?

[luc.moulinier]

Hello !

I'd like to know what is the best way to know if a file is a sqlite DB or not 
(without launching sqlite of course) ? For example, is the first line of the 
file unambiguously a signature of sqlite ? If so, what is its structure ?
Many thanks in advance !
Luc


 Créez votre adresse électronique prenom@laposte.net 
 1 Go d'espace de stockage, anti-spam et anti-virus intégrés.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] FTS and postfix search

[Jim Showalter]

You can lazy-init the table of substrings and substring matches when 
you save words, so you only use space for substrings that appear in 
words that have been saved in your database. That avoids entering 
substrings that never occur in English, and substrings that occur in 
English but not in any words you are searching.

- Original Message - 
From: "Jim Showalter" 
To: "General Discussion of SQLite Database" 
Sent: Thursday, August 06, 2009 8:59 AM
Subject: Re: [sqlite] FTS and postfix search


>I hadn't thought about it until now, but there's no reason you can't 
>treat the table of substrings as substrings appearing anywhere in a 
>word, and join each substring of a word to the substrings table.
>
> For 26 letters, you have > 17k three-letter substrings and almost 
> 500k four-letter substrings, so this technique probably is limited 
> to three-letter substrings. But that's not bad--it means that if 
> character sequences are evenly distributed in words (they're not, 
> but assume they are for a moment), then the set of all possible 
> words is cut into 1/>17,000 on the first search. There are only 
> about 600,000 words in the English language, so with even 
> distribution your first search cuts the results to ~34 words. But 
> uneven character-sequence distributions will skew that--some 
> sequences will result in more words than others. Sill, even if you 
> get back 500 words to search for the full match, that's better than 
> searching all of your words. (You also have to store all one-letter 
> and two-letter substrings, but those don't take up much additional 
> room.)
>
> You would have to have a separate table that has the multiple joins 
> (one per substring) in your words, because now each word can 
> potentially have M substrings in it, so M foreign keys.
>
> For your example, Motor/motor would match mot, oto, and tor. You 
> would use a rule to arbitrarily match the first N letters in a the 
> search term, so if someone searched for "%motor%", that would be a 
> search in the substrings table for "mot". This would return the 
> primary key for "mot". Then you search the substring-matches table 
> for all words that have that substring, and this gives you back a 
> list of words containing "mot". Then you search that result set for 
> "%motor%". Similarly, if someone searchs for "%oto%", you get the 
> substring key for "oto" and find words containing that substring.
>
> For all I know, full-text-search engines may do something like this.
>
> - Original Message - 
> From: "Lukas Haase" 
> To: 
> Sent: Thursday, August 06, 2009 6:54 AM
> Subject: Re: [sqlite] FTS and postfix search
>
>
>> Hi Jim,
>>
>> and thank you for the great idea. But I thought it would be 
>> possible to
>> search '*word*' - but this is not possible with this method either.
>>
>> Is there any chance for searching '*word*' quickly?
>>
>> Regards,
>> Luke
>>
>> Jim Showalter schrieb:
>>> You could store the words reversed (in addition to storing them in
>>> forward order). Then like 'xxx%' would be fast.
>>>
>>> This would double your disk footprint, but could give you the 
>>> search
>>> performance you're looking for.
>>>
>>> If that's too goofy, you could create a table of all one, two, and
>>> three-character word endings, and join to it from all of your 
>>> words
>>> (stored in forward order). Then search first for the primary key 
>>> of
>>> the word ending you want to search for, then search your words for
>>> that key.
>>>
>>> Index the join.
>>>
>>> - Original Message - 
>>> From: "Lukas Haase" 
>>> To: 
>>> Sent: Wednesday, August 05, 2009 6:16 PM
>>> Subject: Re: [sqlite] FTS and postfix search
>>>
>>>
 Wes Freeman schrieb:
> I clearly am not in the right mindset to be answering list 
> emails.
> Please ignore my response (it's too late now)--back to my 
> stressful
> deadline.
 :-)

> Strange that it's implemented for prefix and not postfix?
 Well, an explanation is easy: Same as with LIKE, LIKE 'xxx' or 
 LIKE
 'xxx%' can be performed easy because only the beginning of words
 need to
 be compared.

 However, there /is/ a way to also do postfix searches. I have the
 *same*
 database in *.hlp format and with WinHelp it's possible to search
 '*otor' (and others) with almost zero CPU and time consumption. 
 I'd
 be
 curious how they did this.

 For a solution for SQLite I would accept a small performance 
 penalty
 in
 that case (but very few secs max); additionally I would also 
 accept
 the
 index being bigger.

 Regards,
 Luke

> Wes
>
> On Wed, Aug 5, 2009 at 8:58 PM, Lukas Haase
> wrote:
>> Wes Freeman schrieb:
>>> Why not LIKE '%otor'?
>> SELECT topic_title FROM topics

Re: [sqlite] FTS and postfix search

[Jim Showalter]

I hadn't thought about it until now, but there's no reason you can't 
treat the table of substrings as substrings appearing anywhere in a 
word, and join each substring of a word to the substrings table.

For 26 letters, you have > 17k three-letter substrings and almost 500k 
four-letter substrings, so this technique probably is limited to 
three-letter substrings. But that's not bad--it means that if 
character sequences are evenly distributed in words (they're not, but 
assume they are for a moment), then the set of all possible words is 
cut into 1/>17,000 on the first search. There are only about 600,000 
words in the English language, so with even distribution your first 
search cuts the results to ~34 words. But uneven character-sequence 
distributions will skew that--some sequences will result in more words 
than others. Sill, even if you get back 500 words to search for the 
full match, that's better than searching all of your words. (You also 
have to store all one-letter and two-letter substrings, but those 
don't take up much additional room.)

You would have to have a separate table that has the multiple joins 
(one per substring) in your words, because now each word can 
potentially have M substrings in it, so M foreign keys.

For your example, Motor/motor would match mot, oto, and tor. You would 
use a rule to arbitrarily match the first N letters in a the search 
term, so if someone searched for "%motor%", that would be a search in 
the substrings table for "mot". This would return the primary key for 
"mot". Then you search the substring-matches table for all words that 
have that substring, and this gives you back a list of words 
containing "mot". Then you search that result set for "%motor%". 
Similarly, if someone searchs for "%oto%", you get the substring key 
for "oto" and find words containing that substring.

For all I know, full-text-search engines may do something like this.

- Original Message - 
From: "Lukas Haase" 
To: 
Sent: Thursday, August 06, 2009 6:54 AM
Subject: Re: [sqlite] FTS and postfix search


> Hi Jim,
>
> and thank you for the great idea. But I thought it would be possible 
> to
> search '*word*' - but this is not possible with this method either.
>
> Is there any chance for searching '*word*' quickly?
>
> Regards,
> Luke
>
> Jim Showalter schrieb:
>> You could store the words reversed (in addition to storing them in
>> forward order). Then like 'xxx%' would be fast.
>>
>> This would double your disk footprint, but could give you the 
>> search
>> performance you're looking for.
>>
>> If that's too goofy, you could create a table of all one, two, and
>> three-character word endings, and join to it from all of your words
>> (stored in forward order). Then search first for the primary key of
>> the word ending you want to search for, then search your words for
>> that key.
>>
>> Index the join.
>>
>> - Original Message - 
>> From: "Lukas Haase" 
>> To: 
>> Sent: Wednesday, August 05, 2009 6:16 PM
>> Subject: Re: [sqlite] FTS and postfix search
>>
>>
>>> Wes Freeman schrieb:
 I clearly am not in the right mindset to be answering list 
 emails.
 Please ignore my response (it's too late now)--back to my 
 stressful
 deadline.
>>> :-)
>>>
 Strange that it's implemented for prefix and not postfix?
>>> Well, an explanation is easy: Same as with LIKE, LIKE 'xxx' or 
>>> LIKE
>>> 'xxx%' can be performed easy because only the beginning of words
>>> need to
>>> be compared.
>>>
>>> However, there /is/ a way to also do postfix searches. I have the
>>> *same*
>>> database in *.hlp format and with WinHelp it's possible to search
>>> '*otor' (and others) with almost zero CPU and time consumption. 
>>> I'd
>>> be
>>> curious how they did this.
>>>
>>> For a solution for SQLite I would accept a small performance 
>>> penalty
>>> in
>>> that case (but very few secs max); additionally I would also 
>>> accept
>>> the
>>> index being bigger.
>>>
>>> Regards,
>>> Luke
>>>
 Wes

 On Wed, Aug 5, 2009 at 8:58 PM, Lukas Haase
 wrote:
> Wes Freeman schrieb:
>> Why not LIKE '%otor'?
> SELECT topic_title FROM topics
> WHERE topic LIKE '%otor%'
> ORDER BY topic_title ASC;
>
> This is very, very slow, especially on my > 100 MB database.
> "Realtime"
> search in the GUI is a requirement. This is exactly the reason 
> why
> I
> want to use FTS instead of LIKE...
>
> Regards,
> Luke
>
>> Wes
>>
>> On Wed, Aug 5, 2009 at 7:47 PM, Lukas Haase
>> wrote:
>>> Hi,
>>>
>>> It's me again, sorry. The next big problem concerning FTS. I
>>> have the
>>> requirement to do postfix searches, like:
>>>
>>> SELECT topic_title FROM topics
>>> WHERE topic MATCH '*otor'
>>> ORDER BY topic_title ASC;
>>>
>>> should 

Re: [sqlite] FTS and postfix search

[Lukas Haase]

Hi Jim,

and thank you for the great idea. But I thought it would be possible to 
search '*word*' - but this is not possible with this method either.

Is there any chance for searching '*word*' quickly?

Regards,
Luke

Jim Showalter schrieb:
> You could store the words reversed (in addition to storing them in 
> forward order). Then like 'xxx%' would be fast.
> 
> This would double your disk footprint, but could give you the search 
> performance you're looking for.
> 
> If that's too goofy, you could create a table of all one, two, and 
> three-character word endings, and join to it from all of your words 
> (stored in forward order). Then search first for the primary key of 
> the word ending you want to search for, then search your words for 
> that key.
> 
> Index the join.
> 
> - Original Message - 
> From: "Lukas Haase" 
> To: 
> Sent: Wednesday, August 05, 2009 6:16 PM
> Subject: Re: [sqlite] FTS and postfix search
> 
> 
>> Wes Freeman schrieb:
>>> I clearly am not in the right mindset to be answering list emails.
>>> Please ignore my response (it's too late now)--back to my stressful
>>> deadline.
>> :-)
>>
>>> Strange that it's implemented for prefix and not postfix?
>> Well, an explanation is easy: Same as with LIKE, LIKE 'xxx' or LIKE
>> 'xxx%' can be performed easy because only the beginning of words 
>> need to
>> be compared.
>>
>> However, there /is/ a way to also do postfix searches. I have the 
>> *same*
>> database in *.hlp format and with WinHelp it's possible to search
>> '*otor' (and others) with almost zero CPU and time consumption. I'd 
>> be
>> curious how they did this.
>>
>> For a solution for SQLite I would accept a small performance penalty 
>> in
>> that case (but very few secs max); additionally I would also accept 
>> the
>> index being bigger.
>>
>> Regards,
>> Luke
>>
>>> Wes
>>>
>>> On Wed, Aug 5, 2009 at 8:58 PM, Lukas Haase 
>>> wrote:
 Wes Freeman schrieb:
> Why not LIKE '%otor'?
 SELECT topic_title FROM topics
 WHERE topic LIKE '%otor%'
 ORDER BY topic_title ASC;

 This is very, very slow, especially on my > 100 MB database. 
 "Realtime"
 search in the GUI is a requirement. This is exactly the reason why 
 I
 want to use FTS instead of LIKE...

 Regards,
 Luke

> Wes
>
> On Wed, Aug 5, 2009 at 7:47 PM, Lukas Haase 
> wrote:
>> Hi,
>>
>> It's me again, sorry. The next big problem concerning FTS. I 
>> have the
>> requirement to do postfix searches, like:
>>
>> SELECT topic_title FROM topics
>> WHERE topic MATCH '*otor'
>> ORDER BY topic_title ASC;
>>
>> should find Motor, motor, Monotor etc. But this does not seem to 
>> work.
>> Is there any chance to get this working?
>>
>> Best regards,
>> Luke
>>
>> ___
>> sqlite-users mailing list
>> sqlite-users@sqlite.org
>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>>
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
 ___
 sqlite-users mailing list
 sqlite-users@sqlite.org
 http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

>>> ___
>>> sqlite-users mailing list
>>> sqlite-users@sqlite.org
>>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>>>
>> ___
>> sqlite-users mailing list
>> sqlite-users@sqlite.org
>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users 
> 
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> 


___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] FTS and postfix search

[Lukas Haase]

Roger Binns schrieb:
> [...]
> 
> Lukas Haase wrote:
>> additionally I would also accept the index being bigger.
> 
> You could have a second FTS table where you store the keywords in reverse
> order :-)

Hi,

DAMN!! Damn, damn. Thank you for the great idea. But unfortunately I 
thought I could combine postfix and prefix. But with this method this is 
not possible either. For example, consider the german word 
"Telefonanschlusskabel" (consisting of "Telefon", "Anschluss", "Kabel").

In this case '*anschluss*' should also find "Telefonanschlusskabel".

Or, to be more specific, any '*partial*' query should work.

Actually I need to solve this problem somehow. One possibility would be 
to write a complete FTS system on my own but this is really not what I 
want...

Regards,
Luke

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite Memory Pool overflow probelm

[shankar m]

Thanks Simon for response.

I got the problem. I need to use the  the macro *
SQLITE_DEFAULT_CACHE_SIZE=

*The documentation can be found at  *http://www.sqlite.org/compile.html
*
The default configuration is 2000 pages which is not fitting into 256 KB of
memory pool. I have reduced it and now its working fine :-)

Regards
Shankar




On Thu, Aug 6, 2009 at 4:06 PM, Simon Slavin wrote:

>
> On 6 Aug 2009, at 9:43am, shankar m wrote:
>
> > I am able to reproduce the problem in normal PC also.
> >
> > I am using sqlite3_exec statement
> > *
> > rc = sqlite3_exec(db, "INSERT INTO city (name, state) VALUES('ggg',
> > 'abcdef')", callback, 0, );*
> >
> > After your suggestion i used transcation statements. For every 1000
> > insertions i am doing a commit. But then also there is no change.
> > After 3500
> > insertions the SQLite memory pool overflows.
>
> The documentation for that command
>
> 
>
> says
>
> "The calling function should use sqlite3_free() to free the memory
> that *errmsg is left pointing at once the error message is no longer
> needed."
>
> I don't know enough about the way the library works to understand
> whether you need to do this after each call to sqlite3_exec.
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ANN: C#-SQLite 3.6.16

[Kosenko Max]

Noah Hart wrote:
> C#-SQLite is now ready for review.  The project is located at
> http://code.google.com/p/csharp-sqlite
I think this name much better than sql-sharp. 
I've posted a question on SQLite ADO.NET forum
http://sqlite.phxsoftware.com/forums/p/1879/7971.aspx about supporting your
implementation in ADO.NET Provider. In Silverlight that require some
adjustments to your code (not much) and ADO Provider will need to have parts
of System.Data included as a stubs.

>From your point of view - which parts you haven't yet ported?

-
Best Regards.
Max Kosenko.
-- 
View this message in context: 
http://www.nabble.com/ANN%3A-C--SQLite-3.6.16-tp24839242p24842794.html
Sent from the SQLite mailing list archive at Nabble.com.

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite Memory Pool overflow probelm

[Simon Slavin]

On 6 Aug 2009, at 9:43am, shankar m wrote:

> I am able to reproduce the problem in normal PC also.
>
> I am using sqlite3_exec statement
> *
> rc = sqlite3_exec(db, "INSERT INTO city (name, state) VALUES('ggg',
> 'abcdef')", callback, 0, );*
>
> After your suggestion i used transcation statements. For every 1000
> insertions i am doing a commit. But then also there is no change.  
> After 3500
> insertions the SQLite memory pool overflows.

The documentation for that command



says

"The calling function should use sqlite3_free() to free the memory  
that *errmsg is left pointing at once the error message is no longer  
needed."

I don't know enough about the way the library works to understand  
whether you need to do this after each call to sqlite3_exec.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Data synchronization between two offices

[Tguru]

Rstat wrote:
> 
> Hi everyone, 
> 
> After building a database for our growing company, we have a problem with
> our data and its synchronization. Our company has a rather small, but
> growing, book warehouse and sells books online. We have been able to deal
> with orders and stock because sales were not that large. 
> 
> But today we sell more and more books and the addition of a database means
> we need to synchronize our data from the warehouse database to the main
> office one, mainly to be able to know what kind of stock we have. I think
> we will have to go with a batch syncing scheduled twice a day for now. We
> have been dealing with Talend open studio so far and enjoy the product. 
> 
> Do you think Talend will be able to stand that type of operation? What
> kind of software could be used in this case? 
> 
> Thanks all!
> 



So basically what you want to do is sync up two databases several times a
day. You could use Talend Open Studio: it can efficiently do what you are
asking, so stay with this tool. 
You might want to go check Talend 's page on data synchronization:
http://www.talend.com/solutions-data-integration/data-synchronization.php

Just the fact you already know the software and use it, you'll save a lot of
time (and money) on this. it is much easier for you than taking a new one.

-- 
View this message in context: 
http://www.nabble.com/Data-synchronization-between-two-offices-tp24810303p24841066.html
Sent from the SQLite mailing list archive at Nabble.com.

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite Memory Pool overflow probelm

[shankar m]

I am able to reproduce the problem in normal PC also.

I am using sqlite3_exec statement
*
rc = sqlite3_exec(db, "INSERT INTO city (name, state) VALUES('ggg',
'abcdef')", callback, 0, );*

After your suggestion i used transcation statements. For every 1000
insertions i am doing a commit. But then also there is no change. After 3500
insertions the SQLite memory pool overflows.

Thanks in advance

Regards
Shankar



On Wed, Aug 5, 2009 at 6:49 PM, Simon Slavin wrote:

>
> On 5 Aug 2009, at 10:27am, shankar m wrote:
>
> > I am running SQLite on a embedded device. For SQLite memory pool I
> > am using
> > memsys5 memory allocator with size of 256 KB.
> > When i execute  "insert into" command for around 5*1000 times the
> > memory
> > pool is full but my database file has space. I cannot insert anymore.
> >
> > How to free the memory pool for further insertion? Do I need to do any
> > further configuration?.
>
> Are you using transactions around your 5000 inserts ?  Do you use
> BEGIN at all ?  If so, do you use COMMIT after each INSERT or each
> 1000 INSERTs ?  Or are you still inside the same transaction when you
> hit your 5000th INSERT ?
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users