[sqlite] concurrency differences between in-memory and on disk?

2009-06-25 Thread Daniel Watrous
Hello, I've developed an application that has very high concurrency. In my initial testing we used SQLite 3 from python, but we experienced too many locks and the database always fell behind. We moved to MySQL, which handles the concurrency better, but there was a substantial increase in IO.

Re: [sqlite] Getting

2009-06-24 Thread Daniel Watrous
I think that sqlite3 is part of the standard python distribution since version 2.5. http://docs.python.org/library/sqlite3.html Are you trying to compile because you wanted a more up to date version? If not then you should be able to just start using it. On Wed, Jun 24, 2009 at 12:23 PM, Ryan

[sqlite] concurrency differences between in-memory and on disk?

2009-06-23 Thread Daniel Watrous
Hello, I've developed an application that has very high concurrency.  In my initial testing we used SQLite 3 from python, but we experienced too many locks and the database always fell behind.  We moved to MySQL, which handles the concurrency better, but there was a substantial increase in IO.  

Re: [sqlite] Techniques to delay writes to SQLite

2009-02-03 Thread Daniel Watrous
While I'm not sure how long your long running select would take, it seems like SQLite (at least version 3) already works the way you are describing. As soon as you issue a select against a database file a shared lock is obtained. On commit that shared lock is released. While you have a shared

Re: [sqlite] (no subject)

2009-02-02 Thread Daniel Watrous
se attempts a commit: > if errBool: > try: self.cur.execute('ROLLBACK;')# rollback on error > except: pass > else: > try: self.cur.execute('COMMIT;') > except: pass > > The same connection object is maintained throughout; it is never closed > until the

Re: [sqlite] (no subject)

2009-01-31 Thread Daniel Watrous
why don't you send us some code. It sounds like you might have an issue managing your connections. On Sat, Jan 31, 2009 at 3:09 PM, Boris Arloff wrote: > Hi, > > I am having a small problem with an sqlite3 v3.5.6 database being accessed > from within python 2.5 (import

Re: [sqlite] Index keywords

2009-01-29 Thread Daniel Watrous
; to find detailed information on field and index field descriptors or > modifiers, such as INTEGER, PRIMARY, KEY, AUTOINCREMENT, etc. > > Any recommendations? > > Vance > > Daniel Watrous wrote: > >>oops, sorry, here's the link: http://www.sqlite.org/lang.html >&

Re: [sqlite] Index keywords

2009-01-29 Thread Daniel Watrous
oops, sorry, here's the link: http://www.sqlite.org/lang.html On Thu, Jan 29, 2009 at 11:09 AM, Daniel Watrous <dwmaill...@gmail.com> wrote: > Could this be what you're looking for? > > On Thu, Jan 29, 2009 at 11:04 AM, Vance E. Neff <ven...@intouchmi.com> wrote: >

Re: [sqlite] Index keywords

2009-01-29 Thread Daniel Watrous
Could this be what you're looking for? On Thu, Jan 29, 2009 at 11:04 AM, Vance E. Neff wrote: > I have seen that list of keywords, but I'm looking for a description of > what they mean. In particular those associated with index definitions. > > Vance > > D. Richard Hipp

Re: [sqlite] PL/SQL in Sqlite?

2009-01-29 Thread Daniel Watrous
> > Something feels wrong about using an exclusive transaction here > too. I can't say why, and I may well be wrong, but... just a gut > hunch. > > On Thu, Jan 29, 2009 at 12:47 PM, Daniel Watrous <dwmaill...@gmail.com> wrote: >> Hello, >> >> I'm wonderi

[sqlite] PL/SQL in Sqlite?

2009-01-29 Thread Daniel Watrous
Hello, I'm wondering if there is anything like PL/SQL that is built into SQLite? I have an application that requires me to use EXCLUSIVE transactions as follows: BEGIN EXCLUSIVE SELECT from table limit 20 for each UPDATE record assignment COMMIT The requests for assignments are coming in