Re: [sqlite] Boosting insert and indexing performance for 10 billion rows (?)

2018-11-29 Thread AJ Miles
Ah, this tool seems very handy. For those curious, I'll paste the results below. The index approximately doubles the storage size, but I am intentionally making that tradeoff to avoid the slow down when enforcing a unique/primary key on the Reference table while inserting. -AJ /** Disk-Space

Re: [sqlite] Boosting insert and indexing performance for 10 billion rows (?)

2018-11-29 Thread AJ Miles
table. This makes up some of the difference. These rows are probably on the order of 200-300 bytes each so if I do the math, something in the 210-250 gb range seems reasonable. -AJ -- Sent from: http://sqlite.1065341.n5.nabble.com/ ___ sqlite-users

Re: [sqlite] Boosting insert and indexing performance for 10 billion rows (?)

2018-11-28 Thread AJ Miles
version, but for my own personal projects I will try to fiddle with attach. The ability to split the database into multiple files will come in handy if I end up tackling anything larger. -AJ -- Sent from: http://sqlite.1065341.n5.nabble.com/ ___ sqlite

[sqlite] Boosting insert and indexing performance for 10 billion rows (?)

2018-11-28 Thread AJ M
haven't done the experiment, I don't know to what extent that would help. Thank you for any insight into this. The database is working fine as-is, but I am trying to see for the sake of convenience and education if I can get it to insert and/or index faster. Cheers, -AJ

[sqlite] Typo in documentation for fts trigger

2012-08-22 Thread AJ ONeal
postfixes changed to _au and _ad. CREATE TRIGGER t2_au AFTER UPDATE ON t2 BEGIN INSERT INTO t3(docid, b, c) VALUES(new.rowid, new.b, new.c); END; CREATE TRIGGER t2_ad AFTER INSERT ON t2 BEGIN INSERT INTO t3(docid, b, c) VALUES(new.rowid, new.b, new.c); END; AJ ONeal

Re: [sqlite] error in example rank function

2012-07-21 Thread AJ ONeal
, in the case that a column isn't supplied it makes sense to use a default weight of 1.0 if the weights aren't supplied. AJ ONeal On Sat, Jul 21, 2012 at 5:27 PM, AJ ONeal <coola...@gmail.com> wrote: > I also found an error in the signedness of ints (using -Wall -Werror). > > The corr

Re: [sqlite] matchinfo example does not work as documented

2012-07-21 Thread AJ ONeal
, it's been hand-formatted for easy-reading But y'all do whatcha gon' do. AJ ONeal On Sat, Jul 21, 2012 at 6:22 PM, Pavel Ivanov <paiva...@gmail.com> wrote: > On Sat, Jul 21, 2012 at 7:35 PM, AJ ONeal <coola...@gmail.com> wrote: > >> > >> Read the documentation care

Re: [sqlite] matchinfo example does not work as documented

2012-07-21 Thread AJ ONeal
rint native objects when they are to be represented as text. What about that paragraph indicates that the sqlite3 cli doesn't know how to pretty-print understand its own native types? AJ ONeal ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] error in example rank function

2012-07-21 Thread AJ ONeal
I also found an error in the signedness of ints (using -Wall -Werror). The corrected code here functions as described in the documentation's example: https://github.com/coolaj86/sqlite3-fts4-rank/blob/master/fts4-rank.c#L59 AJ ONeal On Sat, Jul 21, 2012 at 4:39 PM, AJ ONeal <coola...@gmail.

[sqlite] error in example rank function

2012-07-21 Thread AJ ONeal
(documents)) Seems that it would be best to assign a default weight of 1 if nVal == 1 or the double value of apVal[1] otherwise. Also the line double weight = sqlite3_value_double(apVal[iCol+1]); should be simplified to: double weight = sqlite3_value_double(apVal[1]); AJ ONeal

Re: [sqlite] No documentation for xFunc?

2012-07-21 Thread AJ ONeal
sqlite3_create_function(db, "testfn", -1, SQLITE_ANY, 0, testfn, 0, 0); testfn("1", "2", "3"); -- nVal is 3 testfn("1", "2"); -- nVal is 2 testfn(matchinfo(documents)); -- nVal is 1 testfn(matchinfo(documents), 2, 3, 4,

[sqlite] No documentation for xFunc?

2012-07-21 Thread AJ ONeal
be used. AJ ONeal ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] matchinfo example does not work as documented

2012-07-21 Thread AJ ONeal
000000010001000100 AJ ONeal On Sat, Jul 21, 2012 at 2:06 PM, AJ ONeal <coola...@gmail.com> wrote: > > Now I see a number which matches my expectations: >> > SELECT hex(matchinfo(t1)) FROM t1 WHERE

Re: [sqlite] matchinfo example does not work as documented

2012-07-21 Thread AJ ONeal
used. I imagine that most users who are following this documentation for the first time are using the sqlite3 binary and following along by copying and pasting the examples. AJ ONeal ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] matchinfo example does not work as documented

2012-07-21 Thread AJ ONeal
H 'default transaction'; returns two empty strings sqlite3 --version 3.7.13 2012-06-11 02:05:22 f5b5a13f7394dc143aa136f1d4faba6839eaa6dc AJ ONeal ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] How to compile and load the example fts4 rank function?

2012-07-21 Thread AJ ONeal
. AJ ONeal ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] How to compile and load the example fts4 rank function?

2012-07-21 Thread AJ ONeal
That example isn't from a 3rd party. It's the rank function listed here: http://www.sqlite.org/fts3.html#appendix_a Can you give me a link to documentation for what options to pass to gcc and what functions to call to activate such an extension? I've never done this before. AJ ONeal On Sat

[sqlite] How to compile and load the example fts4 rank function?

2012-07-21 Thread AJ ONeal
the right search terms to find it. AJ ONeal ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] unrecognized parameter: content=""

2012-07-21 Thread AJ ONeal
# which sqlite3 /usr/local/bin/sqlite3 It appears that the original version of sqlite3 that shipped with OS X is still in the PATH of the old terminal, but the new one installed with brew in loaded in the new on. Thanks for helping me figure this out! AJ ONeal On Sat, Jul 21, 2012 at 1:11 AM

Re: [sqlite] unrecognized parameter: content=""

2012-07-21 Thread AJ ONeal
I go back to the previous terminal window it fails again. What about my terminal session / environment might be contributing to this behavior? AJ ONeal On Sat, Jul 21, 2012 at 12:48 AM, AJ ONeal <coola...@gmail.com> wrote: > I'm on OS X > > brew install sqlite3 > sqlite3 --version

Re: [sqlite] unrecognized parameter: content=""

2012-07-21 Thread AJ ONeal
-init meta-fts.table.sql meta-fts-new.sqlite3 where `meta-fts.table.sql` is https://gist.github.com/3154874 wget https://raw.github.com/gist/3154874/8f582883d62c82aeafed5eabf639e603ec1ac379/meta-fts.table.sql Then it throws the error. AJ ONeal On Fri, Jul 20, 2012 at 11:34 PM, Kees Nuyt <k.n...@zon

[sqlite] unrecognized parameter: content=""

2012-07-20 Thread AJ ONeal
(content="", a, b, c); CREATE VIRTUAL TABLE fts USING fts4(content="data", name TEXT, path TEXT); Result: unrecognized parameter: content="" Was this never implemented? Is it deprecated? Does it require special build options? Any thoughts? AJ ONeal

[sqlite] sqlite_exec() encoding?

2009-09-27 Thread aj
what encoding does sqlite_exec() callback function receive data in ? some tests i've done seem to suggest UTF-8 other tests show chars U+80 to U+FF are returned as single chars with values 128-255. (suggesting its not UTF-8) where is *any* documentation about this? -- Not sent from an

[sqlite] Math Update with two tables

2008-12-20 Thread aj
I would like to use math with more then one table, for example I know how to do this (Factors & Potential = columns) UPDATE Records SET Factors= (Factors * Potential) but i don't know how with an additional table, i came up with UPDATE Records,Table2 SET Factors= (Factors * Potential

Re: [sqlite] How to maintain EXCLUSIVE access to database continuously ?

2006-09-24 Thread AJ
use your chosen OS's reader/writer locks per user. Some additional info User (Client App) connects to middle-tier application-server and then user may access any one company in normal or exclusive mode. Only application-server communicates with database. If user wants exclusive access,

Re: [sqlite] Wish to store a C structure in sqlite column

2006-09-22 Thread AJ
Narendran wrote: thanks a lot, I believe i can store a structure now, but there is still a cache . I am in the process on creating a Independant API,I can store a structure in SQLite thro the above specified ways. what if some one else wants to use my API's which i used to create the DBI's

Re: [sqlite] Wish to store a C structure in sqlite column

2006-09-22 Thread AJ
I hackish method might be something like this: struct s { ... }; struct s myS; char buf[sizeof(s)*2]; // *2 as base64 encoding will be approx 33% bigger. base64_encode( , buf, sizeof(s) ); INSERT INTO table ( myTextField ) VALUES ( 'buf' ); then retrieval is the opposite.

Re: [sqlite] cwd error?

2006-09-21 Thread AJ
Oh, it created one in the cwd, not the place where i thought the DB should be... is there a way to turn that 'feature' off, so that i can prevent that from happening, i'd prefer just an error. Will Leshner wrote: On 9/21/06, AJ <[EMAIL PROTECTED]> wrote: any ideas? You h

[sqlite] cwd error?

2006-09-21 Thread AJ
problem: SQL error: no such table: input_queue but when i check it using the commandline app, its clearly there. i just created another table called 'test' with 1 col of integers and inserted '34'and it .dumps OK (using the command line app) but says :SQL error: no such table: test

Re: [sqlite] What is that message?

2005-01-01 Thread AJ Bourg
It is an auto-response email generated because Stiaan is(was) apparently subscribed to this mailing list at one point. On Sat, 01 Jan 2005 16:15:56 +0200, Ahmet Aksoy <[EMAIL PROTECTED]> wrote: > Hi, > When I send a message to the group, I get the following message. > What is it? Who is Stiaan?

Re: [sqlite] A late Christmas gift / early New Year's gift...

2004-12-29 Thread AJ Bourg
I have 6, too. Haven't been able to get rid of them :) If you want them, you're more than welcome to have them. AJ On Wed, 29 Dec 2004 17:03:28 +0100, Nemanja Corlija <[EMAIL PROTECTED]> wrote: > If somebody didn't get an Gmail invite from Joseph, I have 4 more to > offer to SQLi

Re: [sqlite] VACUUM function problem

2004-12-28 Thread AJ Bourg
Defragging the database just removes empty pages making the database file smaller. It doesn't actually touch any data. Have a look here: http://www.sqlite.org/lang.html#vacuum AJ On Tue, 28 Dec 2004 17:30:10 +0100, D.W. <[EMAIL PROTECTED]> wrote: > I have deleted some objects in my