Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Mark Halegua
On Saturday, September 13, 2014 01:10:37 AM Kees Nuyt wrote: > On Sat, 13 Sep 2014 00:55:23 +0200, Kees Nuyt > > wrote: > > It works better on your local filesystem. > > Perhaps you can configure (a partition on) the Seagate GoFlex as > an iSCSI target and configure an iSCSI

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Simon Slavin
On 13 Sep 2014, at 1:21am, Richard Hipp wrote: > On Fri, Sep 12, 2014 at 8:07 PM, Simon Slavin wrote: > >> one thing that annoys me about SQLite is that it needs to make a >> journal file which isn't part of the database file. Why ? Why can't it >>

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Richard Hipp
On Fri, Sep 12, 2014 at 8:07 PM, Simon Slavin wrote: > > one thing that annoys me about SQLite is that it needs to make a > journal file which isn't part of the database file. Why ? Why can't it > just write the journal to the database file it already has open ? This >

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Simon Slavin
On 13 Sep 2014, at 12:47am, James K. Lowden wrote: > I asked your question: why not add transactions to FFS? > > His answer: that's the province of a database. A file system is a database. It accepts data from a user. It stores it away for later retrieval. It

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Simon Slavin
On 13 Sep 2014, at 12:47am, James K. Lowden wrote: > The filesystem guys I've talked to all consider transactions to be a > high-level construct hardly ever needed by most applications. They're > interested in raw speed and a consistent file structure (metadata) >

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread James K. Lowden
On Fri, 12 Sep 2014 19:38:53 +0100 Simon Slavin wrote: > I don't think it can be done by trying to build it on top of an > existing file system. I think we need a file system (volume format, > drivers, etc.) built from the ground up with > atomicity/ACID/transactions in

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Kees Nuyt
On Sat, 13 Sep 2014 00:55:23 +0200, Kees Nuyt wrote: > It works better on your local filesystem. Perhaps you can configure (a partition on) the Seagate GoFlex as an iSCSI target and configure an iSCSI initiator on the PC ? A quick websearch on "seagate goflex iscsi" suggests

Re: [sqlite] Bug and fix in lemon.c

2014-09-12 Thread Richard Hipp
On Fri, Sep 12, 2014 at 7:23 AM, Benjamin Franksen < benjamin.frank...@helmholtz-berlin.de> wrote: > Hi Folks > > I am using the lemon parser generator for a different project. It > appears that an attempt to pro-actively avoid a 64-bit problem in fact > created one in the first place. I am

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Kees Nuyt
On Fri, 12 Sep 2014 18:33:46 -0400, Mark Halegua wrote: >On Friday, September 12, 2014 09:43:39 PM Simon Slavin wrote: >> On 12 Sep 2014, at 9:15pm, Mark Halegua wrote: >> > On Friday, September 12, 2014 06:57:21 PM Simon Slavin wrote: >> >>

Re: [sqlite] Reinstalling My Build Environment

2014-09-12 Thread Kees Nuyt
On Fri, 12 Sep 2014 23:23:39 +0100, Simon Slavin wrote: > >On 12 Sep 2014, at 10:33pm, Kees Nuyt wrote: > >> Sure, it's all available at >> https://system.data.sqlite.org/ >> >> I think the material there covers most of the questions. > >So the

Re: [sqlite] Reinstalling My Build Environment

2014-09-12 Thread Joe Mistachkin
Simon Slavin wrote: > > So the appropriate thing to do is post a pointer to > > > > ? That answers the questions about what to install, where to find it and how to install it ? > The FAQ (your link) and the download page

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Mark Halegua
On Friday, September 12, 2014 09:43:39 PM Simon Slavin wrote: > On 12 Sep 2014, at 9:15pm, Mark Halegua wrote: > > On Friday, September 12, 2014 06:57:21 PM Simon Slavin wrote: > >> On 12 Sep 2014, at 5:28pm, Mark Halegua wrote: > >>> The db

Re: [sqlite] Reinstalling My Build Environment

2014-09-12 Thread Simon Slavin
On 12 Sep 2014, at 10:33pm, Kees Nuyt wrote: > Sure, it's all available at > https://system.data.sqlite.org/ > > I think the material there covers most of the questions. So the appropriate thing to do is post a pointer to

Re: [sqlite] write internal blob vs external file

2014-09-12 Thread Kees Nuyt
On Fri, 12 Sep 2014 17:48:27 -0400, Eric Rubin-Smith wrote: >Looking at the sqlite web site and mailing lists shows that the SQLite team >has taken a stab at answering the question, "is it faster to read a blob >out of sqlite or out of a file?". See the links below. > >Does

Re: [sqlite] write internal blob vs external file

2014-09-12 Thread Simon Slavin
On 12 Sep 2014, at 10:48pm, Eric Rubin-Smith wrote: > Looking at the sqlite web site and mailing lists shows that the SQLite team > has taken a stab at answering the question, "is it faster to read a blob > out of sqlite or out of a file?". See the links below. > > Does the

Re: [sqlite] Need advice on using nested selects in JOIN statements as a logical \'AND\'

2014-09-12 Thread David Woodhouse
On Fri, 2014-09-12 at 15:35 -0600, Keith Medcalf wrote: > What happens if you phrase it like this? > >SELECT DISTINCT summary.uid, summary.vcard > FROM folder_id AS summary > LEFT JOIN 'folder_id_email_list' AS email_list >ON email_list.uid = summary.uid > AND

Re: [sqlite] write internal blob vs external file

2014-09-12 Thread Richard Hipp
On Fri, Sep 12, 2014 at 5:48 PM, Eric Rubin-Smith wrote: > Looking at the sqlite web site and mailing lists shows that the SQLite team > has taken a stab at answering the question, "is it faster to read a blob > out of sqlite or out of a file?". See the links below. > > Does

[sqlite] SQLite Development Team support of System.Data.SQLite (was RE: Reinstalling My Build Environment)

2014-09-12 Thread Joe Mistachkin
Kees Nuyt wrote: > > Well, if it doesn't ring the bell on your front door, why > answer? > This is an excellent point. I can assure you that this *IS* the most appropriate venue to ask questions about System.Data.SQLite. TO EVERYONE: PLEASE DO NOT MAKE ANY STATEMENTS TO THE CONTRARY ON THIS

Re: [sqlite] System.Data.Sqlite.dll v93 performance issues...

2014-09-12 Thread Joe Mistachkin
Andreas Hofmann wrote: > > 2) Where can I create a bug for this? > These issues should be fixed in the pre-release 1.0.94.0 build, available from here: https://system.data.sqlite.org/index.html/doc/preRelease/www/downloads.wiki Please let us know if this solves the issue in your

[sqlite] write internal blob vs external file

2014-09-12 Thread Eric Rubin-Smith
Looking at the sqlite web site and mailing lists shows that the SQLite team has taken a stab at answering the question, "is it faster to read a blob out of sqlite or out of a file?". See the links below. Does the team have analogous guidance regarding write speeds? I'm also interested in the

Re: [sqlite] Need advice on using nested selects in JOIN statements as a logical \'AND\'

2014-09-12 Thread Keith Medcalf
What happens if you phrase it like this? SELECT DISTINCT summary.uid, summary.vcard FROM folder_id AS summary LEFT JOIN 'folder_id_email_list' AS email_list ON email_list.uid = summary.uid AND email_list.value like 'foo%' WHERE email_list.value like 'foo%' OR

Re: [sqlite] Reinstalling My Build Environment

2014-09-12 Thread Kees Nuyt
On Fri, 12 Sep 2014 16:41:40 +0100, Simon Slavin wrote: > On 12 Sep 2014, at 3:44pm, > Drago, William @ MWG - NARDAEAST > wrote: > > It seems like a lot of people are unaware of > > System.Data.Sqlite. This is understandable since most people

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread FarSight Data Systems
when I try an insert I get this: Error: database is locked Mark On Friday, September 12, 2014 06:57:21 PM Simon Slavin wrote: > On 12 Sep 2014, at 5:28pm, Mark Halegua wrote: > > The db file is stored on a seagate goflex device as my kinda file server. > > on that

Re: [sqlite] Need advice on using nested selects in JOIN statements as a logical \'AND\'

2014-09-12 Thread David Woodhouse
On Wed, 27 Nov 2013 at 21:21:43 -0800, Igor Tandetnik wrote > Why are you using outer joins when your WHERE clause discards > unmatched records anyway? If you replace LEFT OUTER with INNER, the > end result would be exactly the same. Not for all queries. Consider the query (or (beginswith

[sqlite] Delays on multiple access to the database through shared network.

2014-09-12 Thread Motonari CHINO
Hello. I am connecting SQLite database through shared folder from application written with C# using “System.Data.SQLite.dll” When doing partial match searching from 300,000 records with just one PC connected to the network, it takes less than one second for the query result to be returned. But

[sqlite] Bug and fix in lemon.c

2014-09-12 Thread Benjamin Franksen
Hi Folks I am using the lemon parser generator for a different project. It appears that an attempt to pro-actively avoid a 64-bit problem in fact created one in the first place. I am referring to the following change:

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Remzi H. Arpaci-Dusseau
hi! Thanks for the note, and the interest. I'm cc'ing Thanu into this discussion -- he and a few other grad students did all the heavy lifting and can share the details of what they've found. As I recall, he has already spoken with some of the SQLite gang a bit about the purported "problem"

[sqlite] System.Data.Sqlite.dll v93 performance issues...

2014-09-12 Thread Andreas Hofmann
Guys, I do not know if this is the right forum, but we found a reproducible perf issue with System.Data.Sqlite.dll. A simple query like this: Select * from Dxlog where ContestNR = 0 order by contestnr, TS limit 24 offset 143098 Takes about 60ms to fetch the first record from the

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Simon Slavin
On 12 Sep 2014, at 9:15pm, Mark Halegua wrote: > On Friday, September 12, 2014 06:57:21 PM Simon Slavin wrote: >> On 12 Sep 2014, at 5:28pm, Mark Halegua wrote: >>> The db file is stored on a seagate goflex device as my kinda file server.

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Keith Medcalf
>when I try an insert I get this: >Error: database is locked Is that a "goflex" USB device or the network device? If the network device this likely means that you are attempting to use the device in a manner for which it was not designed. ___

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Mark Halegua
On Friday, September 12, 2014 06:57:21 PM Simon Slavin wrote: > On 12 Sep 2014, at 5:28pm, Mark Halegua wrote: > > The db file is stored on a seagate goflex device as my kinda file server. > > on that device I can open the db to read but not to write to. > > Do you get

Re: [sqlite] pls dont send so many message - once a month is enough

2014-09-12 Thread Larry Brasfield
Ketil Froyn writes: > Clicking the mailto works, but it's not a proper reply-to. These two > messages have appeared as a separate thread in my mailbox, probably because > Larry's message didn't add the proper message-id reference. So if you reply > like this on a high volume list, people

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Nico Williams
On Fri, Sep 12, 2014 at 1:18 PM, Howard Chu wrote: > Nico Williams wrote: >> On ZFS datasets with sync disabled fsync() functions as osync(), as a >> write >> barrier without durability and without the associated penalty. The >> obvious >> problem is that really do need osync()

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Simon Slavin
On 12 Sep 2014, at 7:08pm, Nico Williams wrote: > On ZFS datasets with sync disabled fsync() functions as osync(), as a write > barrier without durability and without the associated penalty. The obvious > problem is that really do need osync() and fsync(); just one or

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Howard Chu
Nico Williams wrote: On ZFS datasets with sync disabled fsync() functions as osync(), as a write barrier without durability and without the associated penalty. The obvious problem is that really do need osync() and fsync(); just one or the other is not a reasonable compromise. Write barriers

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Nico Williams
On ZFS datasets with sync disabled fsync() functions as osync(), as a write barrier without durability and without the associated penalty. The obvious problem is that really do need osync() and fsync(); just one or the other is not a reasonable compromise. Nico --

Re: [sqlite] sqlite db is locked on network drive

2014-09-12 Thread Simon Slavin
On 12 Sep 2014, at 5:28pm, Mark Halegua wrote: > The db file is stored on a seagate goflex device as my kinda file server. on > that device I can open the db to read but not to write to. Do you get an error message ? Or do your changes just disappear ? If it's an

[sqlite] sqlite db is locked on network drive

2014-09-12 Thread Mark Halegua
I'm developing an application, for single users, using python and wxpyton with pysqlite. I often go into the database via sqlite3 to modify stuff or add records to tables for testing. The db file is stored on a seagate goflex device as my kinda file server. on that device I can open the db

Re: [sqlite] [sqlite-dev] SQLite Vdbe Opcode MakeRecord

2014-09-12 Thread Keith Medcalf
sqlite-users is probably more appropriate than the development list so this should be carried on there. Please use that list to continue this discussion as more people are likely to see it, participate, and benefit from the discussions. Have you actually built some tables in SQLite and had

Re: [sqlite] Reinstalling My Build Environment

2014-09-12 Thread Simon Slavin
On 12 Sep 2014, at 3:44pm, Drago, William @ MWG - NARDAEAST wrote: > It seems like a lot of people are unaware of System.Data.Sqlite. This is > understandable since most people on this list are C programmers not > .NET/C#/VB developers, but this is the support list

Re: [sqlite] Reinstalling My Build Environment

2014-09-12 Thread Drago, William @ MWG - NARDAEAST
That was an excellent response, Joe. I think Paul Bainter gave up way too quickly and his conclusion that System.Data.SQLite is unsupported is unwarranted, but I can understand if he felt alienated by comments like: "You may have found a library built on SQLite...Whatever you found isn't

Re: [sqlite] pls dont send so many message - once a month is enough

2014-09-12 Thread Ketil Froyn
Clicking the mailto works, but it's not a proper reply-to. These two messages have appeared as a separate thread in my mailbox, probably because Larry's message didn't add the proper message-id reference. So if you reply like this on a high volume list, people following the thread might miss your

Re: [sqlite] PRAGMA cache_size;

2014-09-12 Thread Paul
> On Fri, Sep 12, 2014 at 5:00 AM, Paul wrote: > > > > > I have a few questions regarding 'cache_size' PRAGMA: > > > > (Q1) Does this PRAGMA affects all attached databases or should I set it > > for each > > attached database individually like 'PRAGMA attached.cache_size = > >

Re: [sqlite] pls dont send so many message - once a month is enough

2014-09-12 Thread John McKown
On Fri, Sep 12, 2014 at 1:16 AM, Larry Brasfield wrote: > John McKown writes: > >> The first option is to totally disable getting any emails at all. This >> is often called NOMAIL mode. If you decide to do that, then you can, >> at your convenience, go to this page:

Re: [sqlite] PRAGMA cache_size;

2014-09-12 Thread Richard Hipp
On Fri, Sep 12, 2014 at 5:00 AM, Paul wrote: > > I have a few questions regarding 'cache_size' PRAGMA: > > (Q1) Does this PRAGMA affects all attached databases or should I set it > for each > attached database individually like 'PRAGMA attached.cache_size = > 100'? > Set all

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Howard Chu
Richard Hipp wrote: On Thu, Sep 11, 2014 at 5:49 PM, Kees Nuyt wrote: Hi all, Today I bumped into a presentation about ordering and atomicity of filesystems that might interest you. https://www.youtube.com/watch?v=YvchhB1-Aws The Application/Storage Interface: After All

Re: [sqlite] presentation about ordering and atomicity of filesystems

2014-09-12 Thread Howard Chu
Simon Slavin wrote: On 12 Sep 2014, at 3:18am, Scott Robison wrote: That was an interesting 90 minutes. Indeed. Thanks to Kees for posting it. Though I was surprised he didn't mention the term 'ACID' explicitly. I'm still of the opinion that we need an actual

[sqlite] PRAGMA cache_size;

2014-09-12 Thread Paul
I have a few questions regarding 'cache_size' PRAGMA: (Q1) Does this PRAGMA affects all attached databases or should I set it for each attached database individually like 'PRAGMA attached.cache_size = 100'? (Q2) If it affects all databasess and, for example, I set it to 100, will it

Re: [sqlite] fts5

2014-09-12 Thread Paul
> Fts5 is still in the experimental stage at the moment. > > If anybody has any ideas for useful features, or knows of problems with > FTS4 that could be fixed in FTS5, don't keep them to yourself! > It would be awesome to be able to select document ids in the content-less FTS4 table.

[sqlite] pls dont send so many message - once a month is enough

2014-09-12 Thread Larry Brasfield
John McKown writes: > The first option is to totally disable getting any emails at all. This > is often called NOMAIL mode. If you decide to do that, then you can, > at your convenience, go to this page: > http://sqlite.org:8080/cgi-bin/mailman/private/sqlite-users/ and > review the