Re: [sqlite] database permanently locked

2006-12-05 Thread Matt Sergeant
On 3-Dec-06, at 7:24 AM, [EMAIL PROTECTED] wrote: Max Barry <[EMAIL PROTECTED]> wrote: My database is permanently locked, and I've spent two fruitless days trying to unlock it. The problem: $ sqlite trac.db SQLite version 3.3.6 Enter ".help" for instructions sqlite> .databases Error:

Re: [sqlite] configure syntax error on HP

2008-06-19 Thread Matt Sergeant
On Wed, 18 Jun 2008 19:58:02 -0400, D. Richard Hipp wrote: > > On Jun 18, 2008, at 7:12 PM, Andrea Connell wrote: > >> I want to use the C API with a C++ class but when I try compiling... >> >> $ aCC -AA +W829 main.cpp sqlite3.c >> main.cpp: >> sqlite3.c: >> Error 482: "sqlite3.c", line 532 #

Re: [sqlite] configure syntax error on HP

2008-06-20 Thread Matt Sergeant
On Thu, 19 Jun 2008 12:05:56 -0400, D. Richard Hipp wrote: > > On Jun 19, 2008, at 11:49 AM, Matt Sergeant wrote: >> >> Note that there are some C++ style comments crept back into the code >> (I >> noticed in the amalgamation, so I can't give you a direct po

Re: [sqlite] configure syntax error on HP

2008-06-22 Thread Matt Sergeant
On Sat, 21 Jun 2008 11:50:31 +0700, Dan wrote: > >> On Thu, 19 Jun 2008 12:05:56 -0400, D. Richard Hipp wrote: >>> >>> On Jun 19, 2008, at 11:49 AM, Matt Sergeant wrote: >>>> >>>> Note that there are some C++ style comments crept back into the

Re: [sqlite] speeding up row by row lookup in a large db

2009-03-23 Thread Matt Sergeant
On Sat, 21 Mar 2009 23:42:30 +0100, Stefan Evert wrote: > On 21 Mar 2009, at 15:31, P Kishor wrote: > >> I did some benchmarking with the above schema using Perl DBI, and I >> get about 30 transactions per second as long as I returning the data >> to memory. > > Even for Perl/DBI, that seems

Re: [sqlite] Performance against huge datasets

2009-06-23 Thread Matt Sergeant
On Tue, 23 Jun 2009 22:01:26 +0200, Misza wrote: > I wonder if anyone used SQLite extensively with big datasets and could > provide some insight into performance? > In a nutshell, I am writing an ETL framework and need a good (read: > performing) engine for the "T"ransform part. > I suppose I

Re: [sqlite] SQLite3 immune from injection attacks if file is readonly?

2009-07-20 Thread Matt Sergeant
On Sat, 18 Jul 2009 10:17:14 -0700, Kelly Jones wrote: > On a website, I want to take a user's query "as is", save it to a > userquery.txt, and then do: > > sqlite3 /path/to/mydb < userquery.txt > > where /path/to/mydb is a *read-only* file. > > Is there *any* risk of an injection attack here?

Re: [sqlite] Does PRAGMA synchronous=OFF ensure that no synching is done for the entire session?

2009-08-14 Thread Matt Sergeant
On Fri, 14 Aug 2009 12:33:30 -0400, Angus March wrote: > I want my INSERT done right away, I just don't want it to be flushed > from the filesystem's write-behind cache until the kernel decides, not > when SQLite decides. Did you mean you do "want it to be flushed from the filesystem's

Re: [sqlite] Does PRAGMA synchronous=OFF ensure that no synching is done for the entire session?

2009-08-17 Thread Matt Sergeant
On Mon, 17 Aug 2009 10:47:23 -0400, Angus March wrote: >> Because yes, that's what synchronous=OFF means. It stops SQLite from >> issuing fflush calls (effectively). >> > Right, and this is implied by the documentation, but I was concerned > that the documentation might be playing fast and

Re: [sqlite] preventing text to integer conversion of bind variables in perl

2005-06-15 Thread Matt Sergeant
On 15 Jun 2005, at 11:56, Jonathan H N Chin wrote: I would be interested to know what version of DBD::SQLite Puneet Kishor is using, since I believe I have tracked the issue to a test in the sqlite_st_execute() function in dbdimp.c : else if (looks_like_number(value)) { /* bind

Re: [sqlite] preventing text to integer conversion of bind variables in perl

2005-06-15 Thread Matt Sergeant
On 15 Jun 2005, at 17:02, Jonathan H N Chin wrote: So perhaps the check no longer performs a useful function now that sqlite allows one to specify the data type of the column? Perhaps indeed. I think I'll remove it from the next release. Matt.

Re: [sqlite] Quick news on the Perl-bindings front

2005-06-21 Thread Matt Sergeant
On 20 Jun 2005, at 06:57, Randy J. Ray wrote: I just sent a patch to the maintainer of the DBD::SQLite package, that lets it build against an installed version of the library. The current package carries a copy of the code with it, and builds it locally. With this patch, you can update your

Re: [sqlite] Quick news on the Perl-bindings front

2005-06-21 Thread Matt Sergeant
On 21 Jun 2005, at 15:41, Darren Duncan wrote: At 1:29 PM -0400 6/21/05, Matt Sergeant wrote: 1.09 is now on CPAN. Note that there's a weird bug when trying to compile against the system sqlite on OS X Tiger due to some munging Apple have done to the header files. Someone is supplying me

Re: [sqlite] Does SQLite have a fulltext search like MySQL?

2005-07-06 Thread Matt Sergeant
On 5 Jul 2005, at 17:48, Michael Grice wrote: If not, are there plans to add this? What language are you planning to use? Perl has a bunch of full text search modules that implement FTS on top of any DB. Matt. __ This

Re: [sqlite] Request for comment: Proposed SQLite API changes

2005-11-03 Thread Matt Sergeant
On 3 Nov 2005, at 08:18, [EMAIL PROTECTED] wrote: As currently implemented, when an error occurs during sqlite3_step(), the function returns SQLITE_ERROR. Then you have to call either sqlite3_reset() or sqlite3_finalize() to find the actual error code. Suppose this where to change in version

Re: [sqlite] problem with blobs (perl code)

2005-12-01 Thread Matt Sergeant
On Thu, 1 Dec 2005, Matt Sergeant wrote: > > Looking now at the DBI documentation, I see that values bound using > > execute are 'usually treated as "SQL_VARCHAR" types unless the driver > > can determine the correct type (which is rare)'. Because it is simple > &g

Re: [sqlite] problem with blobs (perl code)

2005-12-01 Thread Matt Sergeant
On 1 Dec 2005, at 15:10, [EMAIL PROTECTED] wrote: So in the example of $sth->execute($blob), if $blob contains an integer, use sqlite3_bind_int64(), or if $blob contains a string use sqlite3_bind_text(), or if $blob contains a blob, then use sqlite3_bind_blob(), and so forth. Is there

Re: [sqlite] problem with blobs (perl code)

2005-12-02 Thread Matt Sergeant
On 1 Dec 2005, at 21:52, [EMAIL PROTECTED] wrote: SQLite does has a separate BLOB type. But for TEXT types, SQLite still works like Perl and carries around a length so that the string can have embedded '\000' characters. I just added a test to the test suite to verify that this works.

Re: [sqlite] problem with blobs (perl code)

2005-12-02 Thread Matt Sergeant
On 2 Dec 2005, at 08:07, [EMAIL PROTECTED] wrote: Would sqlite3_column_bytes() return the right length there rather than me doing strlen() on the resulting data? yes it will. Doh! In that case then 1.11 will head to CPAN with blobs working transparently.

Re: [sqlite] problem with blobs (perl code)

2005-12-05 Thread Matt Sergeant
On 2 Dec 2005, at 13:07, [EMAIL PROTECTED] wrote: Right. So it's retreival that's the issue when this occurs, because I do: int col_type = sqlite3_column_type(stmt, i); and it returns SQLITE_TEXT, so I then do: val = (char*)sqlite3_column_text(stmt, i); which doesn't return a length

Re: [sqlite] problem with blobs (perl code)

2005-12-05 Thread Matt Sergeant
On 5 Dec 2005, at 13:23, [EMAIL PROTECTED] wrote: I added a test case (check-in [2798]) that checks to make sure that sqlite3_result_text is able to deal with embedded '\000' characters in a string. I appears to work fine. I cannot reproduce the problem Can you suggest other ways of

Re: [sqlite] DBD::SQLite bug number 17292 - bounty!

2006-01-28 Thread Matt Sergeant
On 28 Jan 2006, at 01:09, Randy J. Ray wrote: Although - now that I've said all that - does the dbd interface actually use sqlite3, or just version 2? DBD::SQLite uses sqlite3. Correct. There's DBD::SQLite2 for those who have to use sqlite2 for legacy purposes, but I'm pretty sure it

Re: [sqlite] File locking additions

2006-03-16 Thread Matt Sergeant
On 7-Mar-06, at 7:06 PM, Adam Swift wrote: In order to provide locking support for database files mounted from remote file systems (NFS, SMB, AFP, etc) as well as provide compatible locking support between database clients both local and remote, I would like to propose some additions to

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-20 Thread Matt Sergeant
On 20-Apr-06, at 9:10 AM, Jay Sprenkle wrote: Just out of curiosity why is this data in the database? I've seen very few applications where the blob is indexed or operated upon by the database and it's always a pain to deal with it. We always just left binary data in the file system and

Re: [sqlite] sqlite driven web-site

2006-05-05 Thread Matt Sergeant
FWIW I've created a very high traffic web site (over 2000 tps) that uses SQLite at its core (also uses MS SQL Server, but don't blame me for that). So high traffic isn't a problem with a good design. On 5-May-06, at 11:30 AM, Clark Christensen wrote: I have dynamic apps running on my

Re: [sqlite] Get Max Samples

2009-11-10 Thread Matt Sergeant
On Tue, 10 Nov 2009 15:28:30 -0500, Pavel Ivanov wrote: > You're right about max() and group_concat() will not help you either. > You need something like this: > > select max(cnt) > from (select count(*) as cnt from table_name group by SampleNum) That'll give you the count of the largest set.

Re: [sqlite] Testing the new SQLite mailing list

2003-10-17 Thread Matt Sergeant
On 17 Oct 2003, at 15:41, Eric Schuyler wrote: I am having the same problem unsubscribing. My original subscription and the unsubscribe request came from *exactly* the same e-mail address ([EMAIL PROTECTED]). It looks like this feature isn't working correctly. Your unsubscribe request was

[sqlite] Confusion regarding unsubscribe

2003-10-17 Thread Matt Sergeant
OK, first off the simple fact: Unsubscribe is working perfectly. Now the confusion is brought about by the fact that there are now *two* lists. There's the old Yahoo Groups list. This is the one that gets spam (which is the reason we moved to a new list). Then there's the new list that is

Re: [sqlite] Spiders vandalizing the wiki

2003-11-25 Thread Matt Sergeant
On 25 Nov 2003, at 12:48, D. Richard Hipp wrote: In the past couple of days, I've been having problems with spiders vandalizing the Wiki at http://www.sqlite.org/cvstrac/wiki. The damage (so far) has been relatively minor and easy to fix. But I've been monitoring these spiders for a while and

Re: [sqlite] DBD::SQLite SQL logic error on ATTACH

2004-01-05 Thread Matt Sergeant
On 31 Dec 2003, at 12:33, David Morel wrote: $dbh = DBI->connect("DBI:SQLite:/var/db/INSPIRON.primaire.sql"); $dbh->do( "ATTACH '/var/db/INSPIRON.secondaire.sql' AS secondaire ;" ); of course, the very same command succeed when typed in sqlite Is this a bug or am I doing something wrong ?

Re: [sqlite] [Repost] Implementing Full Text Search

2004-01-20 Thread Matt Sergeant
On 20 Jan 2004, at 7:25, George Ionescu wrote: The question is this: since most of RDBMS implement full text search, shouldn't this be a feature sqlite could support ? SQLite is "lite" on purpose. Most RDBMS also support data types, as a counter example. Matt.

Re: [sqlite] Error on commit

2004-02-02 Thread Matt Sergeant
On 29 Jan 2004, at 18:23, Williams, Ken wrote: create_new_sqlite_database(); $dbh->do("BEGIN"); add_lots_of_rows_to_lots_of_tables(); $dbh->do("COMMIT"); Change to: create_new_sqlite_database(); $dbh->{AutoCommit} = 0; add_lots_of_rows_to_lots_of_tables(); $dbh->commit; #

Re: [sqlite] OK to drop support for legacy file formats?

2004-02-09 Thread Matt Sergeant
On 6 Feb 2004, at 14:05, D. Richard Hipp wrote: If you use a modern version of SQLite (version 2.6.0 through 2.8.11) to open an older database file (version 2.1.0 through 2.5.6) the library will automatically rebuild all the indices in the database in order to correct a design flaw in the older

Re: [sqlite] OK to drop support for legacy file formats?

2004-02-10 Thread Matt Sergeant
On 9 Feb 2004, at 14:53, D. Richard Hipp wrote: Brass Tilde wrote: My understanding is that SQLite has had this auto-update feature since version 2.6.0. If I understand correctly, you should only have a problem if you are *now* using a version prior to that, and go from that version directly to

Re: [sqlite] Storing large files

2004-07-15 Thread Matt Sergeant
On 15 Jul 2004, at 15:53, D. Richard Hipp wrote: In SQLite version 3.0, there is no theoretical limit on the size of BLOBs. (The limit is really about 4.6e+18 bytes, but file size limits will come into play first so you will never get to that size.) However, the same MAX_BYTES_PER_ROW

Re: [sqlite] sqlite3_changes not working for DELETE

2004-07-15 Thread Matt Sergeant
On 15 Jul 2004, Hans-Juergen Taenzer wrote: > Matt Sergeant ([EMAIL PROTECTED]) wrote: > > > This is now the only thing holding back DBD::SQLite's port to > > sqlite3. I've got everything else working and it's all looking > > great. inserts are about the same speed

Re: [sqlite] sqlite3_changes not working for DELETE

2004-07-16 Thread Matt Sergeant
On 15 Jul 2004, at 21:03, D. Richard Hipp wrote: Matt Sergeant wrote: In sqlite3, I can't get sqlite3_changes working for DELETE. I notice there's no tests for this. (I'm talking "DELETE FROM T WHERE ..." rather than flat out DELETE all). Can anyone else confirm this? There is at

Re: [sqlite] Improved Interpreter in latest SQLite version?

2004-07-20 Thread Matt Sergeant
On 19 Jul 2004, at 23:56, gohaku wrote: Does sqlite v3.0.2 include such an interpreter? No. I use dbish which is from the perl DBI::Shell package (on CPAN). If you install the right modules it has scrollback, EDITOR support, etc. Matt.

Re: [sqlite] OT: mailing list nomail option?

2004-07-21 Thread Matt Sergeant
You can do this with ezmlm, but it requires Richard to set something up on the sqlite.org server - a new subscription address ([EMAIL PROTECTED]) which just adds users to the "allow" file. I don't know how easy or hard that would be though. On 21 Jul 2004, at 10:51, Nuno Lucas wrote: Hi, I

Re: [sqlite] OT: Reply-To Munging Considered Useful

2004-07-23 Thread Matt Sergeant
On Fri, 23 Jul 2004, Brass Tilde wrote: > > Better: Somebody please write me a simple, secure, mail handler to > > replace qmail/ezmlm that lets each user decide for themselves whether > > they want a Reply-To back to the mailing list or unmunged headers. > > > > I'll be happy to supply

Re[2]: [sqlite] full text search working from CD ROM ( Steve O'Hara's solution )

2004-08-11 Thread Matt Sergeant
On Thu, 12 Aug 2004, Pavel wrote: > MS> There are some modules on CPAN which provide generic full text search > MS> backed on any RDBMS. Try http://search.cpan.org/ > > CPAN was my first search, only was I found was DBIx::FullTextSearch > that require MySQL and DBIx::TextIndex that search in

Re: [sqlite] locking via windows nfs client

2004-08-20 Thread Matt Sergeant
On 18 Aug 2004, at 23:13, Ara.T.Howard wrote: has anyone out there used sqlite from a windows machine when the db resided on an nfs filesystem mounted using the windows nfs client? if so, does it work? have you attempted concurrent access from other windows machines? other *nix machines? i'm

[sqlite] Re: [OT] Re: [sqlite] locking via windows nfs client

2004-08-20 Thread Matt Sergeant
On Fri, 20 Aug 2004, Ara.T.Howard wrote: > > NFS locks can get stale if you have network problems. The server loses the > > client, the lock remains on the server, nobody can lock the file. Everyone > > using NFS eventually runs into this, but good network setup and good kernel > > choices can

Re: [sqlite] Getting the Number of row returned by a query.

2004-08-22 Thread Matt Sergeant
On Sat, 21 Aug 2004, WysG wrote: > Well no that's not true, I found a "sloppy way" of getting the number of > row, that is executing the same query 2 times, once with sqlite3_exec > and a callback that does oRs->intRecordCount++ and then with > sqlite3_prepare to get the vm > > Is that the

Re: [sqlite] host parameters / bind variables - further workouts

2004-08-27 Thread Matt Sergeant
On 26 Aug 2004, at 19:15, Darren Duncan wrote: At 2:39 PM +0100 8/26/04, Matt Sergeant wrote: I already support sqlite3's numeric placeholders via the standard DBI API. Switching to non-numeric placeholders will be more complex (I'll have to use a hash instead of an array to store

[sqlite] New DBD::SQLite*s

2004-09-10 Thread Matt Sergeant
Uploaded to CPAN are DBD::SQLite 1.05 and DBD::SQLite2 0.33 Changes for DBD::SQLite2: 0.33 - Set HAVE_USLEEP appropriately. This massively improves concurrent access to your SQLite DB. Changes for DBD::SQLite: 1.05 - Enabled HAVE_USLEEP where available which should massively

Re: [sqlite] New DBD::SQLite*s

2004-09-11 Thread Matt Sergeant
On Fri, 10 Sep 2004, Darren Duncan wrote: > With this round, I will start using the new stuff like named host parameters. Sadly named host params are still broken in sqlite 3.0.6. When I parse this SQL: SELECT user_id, fname, lname FROM users WHERE lname like :1 UNION SELECT user_id,

[sqlite] Re: symbol conflict in v3 with v2 - using DBD::SQLite/2

2004-09-11 Thread Matt Sergeant
On Sat, 11 Sep 2004, Darren Duncan wrote: > However, this SQLite v2 and SQLite v3 can not be used simultaneously > as they have symbol conflicts. The one flagged was > _sqlite_busy_timeout, but from a quick scan of the offending files > there seem to be more conflicts. It all looks like a

Re: [sqlite] symbol conflict in v3 with v2 - using DBD::SQLite/2

2004-09-11 Thread Matt Sergeant
On Sat, 11 Sep 2004, Darren Duncan wrote: > And the results: > > [S0106000393c33758:Documents/Perl Distributions/devworld] > darrenduncan% ../perl58 dbd_load_test.pl > dyld: ../perl58 multiple definitions of symbol _sqlite_busy_timeout >

Re: [sqlite] symbol conflict in v3 with v2 - using DBD::SQLite/2

2004-09-12 Thread Matt Sergeant
On Sat, 11 Sep 2004, Darren Duncan wrote: > At 12:49 AM +0100 9/12/04, Matt Sergeant wrote: > >This is just because Mac OSX is fussy - Linux won't complain and will let > >the latterly loaded symbol supercede. But it's a valid bug in > >DBD::SQLite2, so I'll fix it in the

Re: [sqlite] symbol conflict in v3 with v2 - using DBD::SQLite/2

2004-09-12 Thread Matt Sergeant
On Sun, 12 Sep 2004, Matt Sergeant wrote: > On Sat, 11 Sep 2004, Darren Duncan wrote: > > > At 12:49 AM +0100 9/12/04, Matt Sergeant wrote: > > >This is just because Mac OSX is fussy - Linux won't complain and will let > > >the latterly loaded symbol supercede. Bu

[sqlite] Re: my own fixes for symbol conflict - encode.c

2004-09-12 Thread Matt Sergeant
On Sun, 12 Sep 2004, Darren Duncan wrote: > Following the application of Matt Sergeant's diffs, I still had some > similar problems. But this time, seeing what kinds of things he > changed, I tracked down and fixed the problems myself. > > Below this letter is the diff of my changes, which

Re: [sqlite] New DBD::SQLite*s

2004-09-13 Thread Matt Sergeant
On Fri, 10 Sep 2004, David Morel wrote: > Le ven 10/09/2004 à 17:51, Matt Sergeant a écrit : > > Uploaded to CPAN are DBD::SQLite 1.05 and DBD::SQLite2 0.33 > > > > Changes for DBD::SQLite2: > > > >0.33 > > - Set HAVE_USLEEP appropriately. This m

Re: [sqlite] Lock files....

2004-09-24 Thread Matt Sergeant
On 24 Sep 2004, at 17:43, Ara.T.Howard wrote: On Fri, 24 Sep 2004, Matt Sergeant wrote: On 24 Sep 2004, at 14:51, Ara.T.Howard wrote: What are people's views on this? i think it's sufficiently common to merit discussion on best practices at least. More than that, I'm thinking there might

Re: [sqlite] Sqlite3 BLOB support

2004-09-29 Thread Matt Sergeant
On 29 Sep 2004, at 11:23, Serge Semashko wrote: Hello all, I'm sorry for a probably lame question, I'm new to sqlite and database programming. Is it possible to store very large files in sqlite3 database? Are there any limitations? http://www.sqlite.org/faq.html#q10 Matt.

Re: [sqlite] Should Unary + Cast to a Number?

2005-03-17 Thread Matt Sergeant
On 17 Mar 2005, at 15:13, David Wheeler wrote: Probably off-topic for a SQLite list :-) I'm not sure Perl will cast a non-numeric string ("2005-03-22T00:00:00") to a number. What number are you looking for? Actually the code that was cast was "substr(a, 6, 2)", which was evaluating to "03", and

Re: [sqlite] Reading Database Schema Info. in Perl

2005-04-05 Thread Matt Sergeant
On 30 Mar 2005, at 04:05, [EMAIL PROTECTED] wrote: I need to be able to read all table names in the database, and further all attribute names in each table. ( am using DBD::SQLite in Perl) For gathering all the table names I've used the sqlite_master table. The problem is that the information on

Re: [sqlite] DBD-SQLite build query

2005-04-29 Thread Matt Sergeant
On 28 Apr 2005, at 17:53, Clark Christensen wrote: For what it's worth, it looks like getsqlite.pl hasn't been updated in quite some time. It gets the package just fine, but it extracts the archive using the archive's embedded dirnames, then changes directory to 'sqlite', at which point, the rest