Re: [sqlite] Data race (file race) in pager

2012-05-04 Thread Dan Kennedy
On 05/04/2012 11:21 PM, Paul Thomson wrote: I am working on a tool that (among other things) can detect data races, including file access races. I have detected a file race in SQLite on the database file that appears to be real, although I am not certain - I have no experience with SQLite. I

Re: [sqlite] Multi-lingual support?

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 10:49 PM, Dale E. Edmons wrote: > Hi, > > I've built an extensive database that has three copies of the Jewish > Tanach in it. When trying to get sqlite3 to handle Hebrew (utf8 for > starters) it seems to be trying to manipulate the text and it ends

[sqlite] Multi-lingual support?

2012-05-04 Thread Dale E. Edmons
Hi, I've built an extensive database that has three copies of the Jewish Tanach in it. When trying to get sqlite3 to handle Hebrew (utf8 for starters) it seems to be trying to manipulate the text and it ends up backwards. My editors and nearly all command-line utilities don't corrupt the

Re: [sqlite] Details on New Features

2012-05-04 Thread Nico Williams
On Fri, May 4, 2012 at 4:04 PM, Richard Hipp wrote: > Correction:  The one that it encounters first, since subsequent rows of the > same value will not trigger a new copy of values into the output registers, > since only a new min/max does that. But surely that's

Re: [sqlite] Details on New Features

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 5:02 PM, Richard Hipp wrote: > > > On Fri, May 4, 2012 at 5:01 PM, Ralf Junker wrote: > >> On 04.05.2012 16:39, Richard Hipp wrote: >> >> > If a single min() or max() aggregate function appears in a query, then >> any >> > other columns

Re: [sqlite] Details on New Features

2012-05-04 Thread Igor Tandetnik
On 5/4/2012 5:01 PM, Ralf Junker wrote: On 04.05.2012 16:39, Richard Hipp wrote: If a single min() or max() aggregate function appears in a query, then any other columns that are not contained within aggregate functions and that are not elements of the GROUP BY will take values from one of the

Re: [sqlite] Details on New Features

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 5:01 PM, Ralf Junker wrote: > On 04.05.2012 16:39, Richard Hipp wrote: > > > If a single min() or max() aggregate function appears in a query, then > any > > other columns that are not contained within aggregate functions and that > > are not elements of

Re: [sqlite] Details on New Features

2012-05-04 Thread Marc L. Allen
The last one it saw. It's not deterministic. > -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of Ralf Junker > Sent: Friday, May 04, 2012 5:01 PM > To: General Discussion of SQLite Database > Subject: Re: [sqlite] Details

Re: [sqlite] Details on New Features

2012-05-04 Thread Ralf Junker
On 04.05.2012 16:39, Richard Hipp wrote: > If a single min() or max() aggregate function appears in a query, then any > other columns that are not contained within aggregate functions and that > are not elements of the GROUP BY will take values from one of the same rows > that satisfied the one

Re: [sqlite] Locking/Concurrency

2012-05-04 Thread Igor Tandetnik
On 5/4/2012 1:52 PM, KUSHAL SHAH wrote: I am trying to use SQLite in my .NET project. Client APIs are from System.Data.SqLite. Can you please help with below: It seemsthat multiple threads can actually read simultaneously from a sqlite Db. However, I am confused about the write part. Will

[sqlite] Locking/Concurrency

2012-05-04 Thread KUSHAL SHAH
I am trying to use SQLite in my .NET project. Client APIs are from System.Data.SqLite. Can you please help with below:   It seemsthat multiple threads can actually read simultaneously from a sqlite Db. However, I am confused about the write part. Will SQLite manage the write requests or the user

Re: [sqlite] Details on New Features

2012-05-04 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 04/05/12 09:42, Nico Williams wrote: > A pragma by which to cause SQLite3 to return an error instead might be > useful, but then, it's SQL_Lite_. What I have always wanted for SQLite is some sort of "lint" mode. It would tell you when your

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread Oliver Schneider
On 2012-05-02 14:06, peter korinis wrote: > Thank you all. > Look like I'm stuck with the CLI though I have contacted Nucleon software > support ... tried CLI yesterday but need more practice. > Is there a good reference book you would recommend for SQLite? Absolutely. The one by Mike Owens was a

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread Oliver Schneider
On 2012-05-01 20:41, Baruch Burstein wrote: > It is already wrapped in a transaction. > I seem to remember seeing somewhere that the .import command doesn't > understand escaping, e.g. > > "one","two,three" > > will get imported as > > "one" | "two | three" > > (the quotes are part of

Re: [sqlite] Details on New Features

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 12:44 PM, Eric Sink wrote: > > Is this new syntax likely to perform any better than the traditional way > of writing the query? > Dunno. Depends on which "traditional way" you are talking about, I suppose. Here's how it works: SQLite internally

Re: [sqlite] Details on New Features

2012-05-04 Thread Eric Sink
Is this new syntax likely to perform any better than the traditional way of writing the query? -- E On May 4, 2012, at 11:42 AM, Nico Williams wrote: > On Fri, May 4, 2012 at 9:20 AM, Richard Hipp wrote: >>> Queries of the form: "SELECT

Re: [sqlite] Details on New Features

2012-05-04 Thread Nico Williams
On Fri, May 4, 2012 at 9:20 AM, Richard Hipp wrote: >>         Queries of the form: "SELECT max(x), y FROM table" returns the >> value of y on the same row that contains the maximum x value. >> >> Is that standard SQL behavior?  I'd have expected that to return one row >> for

Re: [sqlite] Data race (file race) in pager

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 12:21 PM, Paul Thomson wrote: > I am working on a tool that (among other things) can detect data > races, including file access races. I have detected a file race in > SQLite on the database file that appears to be real, although I am not > certain - I

Re: [sqlite] Data Input Techniques

2012-05-04 Thread Nigel Verity
Dear All Thanks for all the help regarding ways of improving the speed of loading large volumes of data from a text file into a Sqlite table from within a bespoke application. The solution was indeed to place all the INSERT instructions between a BEGIN and a COMMIT. I can now load approx

[sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread joe.fis...@tanguaylab.com
I'm using R (R Studio) with large SQLite databases and it's a dream come true. Here's a simple example of a ToxCast chemical table inside a Substance database. # Load the following libraries into R # DBIR Database Interface # RSQLiteSQLite

[sqlite] Data race (file race) in pager

2012-05-04 Thread Paul Thomson
I am working on a tool that (among other things) can detect data races, including file access races. I have detected a file race in SQLite on the database file that appears to be real, although I am not certain - I have no experience with SQLite. I compiled SQLite with: #define SQLITE_THREADSAFE 2

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread Black, Michael (IS)
Here's a utility to import a comma separated file (does not work for quoted strings or strings with commas). Figures out the # of columns automagically from the csv file. All wrapped in a singled transaction. Shows progress every 100,000 inserts. Usage: csvimport filename databasename

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread Simon Slavin
On 4 May 2012, at 4:23pm, peter korinis wrote: > I have scaled down the attributes of interest to 46 columns (discarding the > other 550). No columns are calculated. No updates to this file ... one user > ... only query, sort, etc. type transactions. > So I want to load

Re: [sqlite] Details on New Features

2012-05-04 Thread Gabor Grothendieck
On Fri, May 4, 2012 at 10:46 AM, Gabor Grothendieck wrote: > On Fri, May 4, 2012 at 10:39 AM, Richard Hipp wrote: >> On Fri, May 4, 2012 at 10:33 AM, Gabor Grothendieck >> wrote: >> >>> On Fri, May 4, 2012 at 10:20 AM, Richard

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread peter korinis
I have scaled down the attributes of interest to 46 columns (discarding the other 550). No columns are calculated. No updates to this file ... one user ... only query, sort, etc. type transactions. So I want to load two 22GB csv files into an empty 46 column table. (I intend to test load with

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread Simon Slavin
On 4 May 2012, at 4:02pm, peter korinis wrote: > Sqlitespy looks good ... I will try it. > website says download contains sqlite itself, which I already have - will > there be a problem using ...spy with existing sqlite? SQLite is not a single library which has to live

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread peter korinis
Sqlitespy looks good ... I will try it. website says download contains sqlite itself, which I already have - will there be a problem using ...spy with existing sqlite? I was trying to use sqlite3 CLI cmd ".import testfile.txt test_tbl;" to load a 999x46 comma-delimited file into a previously

Re: [sqlite] Details on New Features

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 10:33 AM, Gabor Grothendieck wrote: > On Fri, May 4, 2012 at 10:20 AM, Richard Hipp wrote: > > On Fri, May 4, 2012 at 10:06 AM, Rob Richardson < > rdrichard...@rad-con.com>wrote: > > > >> Gabor Grothendieck mentioned a new

Re: [sqlite] Details on New Features

2012-05-04 Thread Gabor Grothendieck
On Fri, May 4, 2012 at 10:20 AM, Richard Hipp wrote: > On Fri, May 4, 2012 at 10:06 AM, Rob Richardson > wrote: > >> Gabor Grothendieck mentioned a new feature of SQLite in 3.7.11: >>         Queries of the form: "SELECT max(x), y FROM table" returns

Re: [sqlite] Details on New Features

2012-05-04 Thread Richard Hipp
On Fri, May 4, 2012 at 10:06 AM, Rob Richardson wrote: > Gabor Grothendieck mentioned a new feature of SQLite in 3.7.11: > Queries of the form: "SELECT max(x), y FROM table" returns the > value of y on the same row that contains the maximum x value. > > Is that

Re: [sqlite] Details on New Features

2012-05-04 Thread Rob Richardson
Gabor Grothendieck mentioned a new feature of SQLite in 3.7.11: Queries of the form: "SELECT max(x), y FROM table" returns the value of y on the same row that contains the maximum x value. Is that standard SQL behavior? I'd have expected that to return one row for every row in the

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-04 Thread Valentin Davydov
On Tue, May 01, 2012 at 04:06:01PM -0400, peter korinis wrote: > I'm new to SQLite . not a programmer . not a DBA . just an end-user with no > dev support for a pilot project (single user, no updates, just queries). > > > > I want to analyze the data contained in a 44GB csv file with 44M rows

[sqlite] Details on New Features

2012-05-04 Thread Gabor Grothendieck
In this link: http://sqlite.org/releaselog/3_7_11.html it refers to these new features: Queries of the form: "SELECT max(x), y FROM table" returns the value of y on the same row that contains the maximum x value. Improvements to the handling of CSV inputs in the command-line shell Is there

[sqlite] draft status is missing "is recommended."

2012-05-04 Thread Carlos Milon Silva
Status: Version 3.7.12 of SQLite is recommended for all new development. Upgrading from version 3.7.6.3, 3.7.7, 3.7.7.1, 3.7.8, 3.7.9, or 3.7.11 is optional. Upgrading from all other SQLite versions. ___ sqlite-users mailing list