On 2 Jul 2015, at 11:16pm, Rob Willett wrote:
> We process this XML feed and pull out chunks of the XML, process it and
> update our database with it. This database is currently 16GB in size. Our
> concern is the time taken to process each file every five minutes. It has
> been getting steadi
Hi,
I'm not an expert on bash or scripts etc.
However, if I were doing something similar in C++ then I'd consider having a
dedicated thread to
manage a queue of dB operations and committing them all from this single thread.
You can then take control of a whole host of things - maintaining the
wri
Hi,
We?re trying to understand whether or not we have a performance problem with
our Sqlite database. It may well be that we are ?optimal? for some value of
optimal or it may be that we can improve our system. I was hoping to use the
experience here to help focus our attention or give some guid
On 2 Jul 2015, at 3:59pm, Kathleen Alexander wrote:
> I don't explicitly set sqlite3_busy_timeout(sqlite3*, int ms) so I will try
> adding that after the database connection is opened to see if it limits
> those errors.
This will have an extreme effect. The default timeout for SQLite is not to
Lots of good replies. My problem is solved, thank you.
My assumption was that GetBytes() could be used to read the bytes of any column
regardless of type. What difference should column type or affinity make if I'm
asking for bytes? If I'm using GetBytes() on a column with REAL affinity, it
shou
It's not mandatory to use x'' notation to insert into a blob, when one can
use cast.
The following should return blob content correctly without explicitly lying it
down as Hex:
sqlite> create table T (c blob check(typeof(c) = 'blob'));
sqlite> insert into T values ( cast('x y z' as blob) );
s
Thanks so much for the help. I set the timeout to 5 seconds (at each
instance of a db open connection) and was still seeing the database locked
errors with some frequency (haven't quantified it yet), so I will try
extending it to 30 seconds, as you suggest, and hopefully that makes a
difference.
F
Hi, Kathleen,
On Thu, Jul 2, 2015 at 5:34 PM, James K. Lowden
wrote:
> On Thu, 2 Jul 2015 10:09:12 -0400
> Kathleen Alexander wrote:
>
>> Essentially, I have written an application in C++ that interfaces
>> (reads and writes) with a SQLite database, and I am getting lots of
>> 'database is lock
On Thu, 2 Jul 2015 10:09:12 -0400
Kathleen Alexander wrote:
> Essentially, I have written an application in C++ that interfaces
> (reads and writes) with a SQLite database, and I am getting lots of
> 'database is locked' errors. [...]
>
> My application runs on Linux (ubuntu 13.10), and is drive
We use SQLite for indexing and searching the text contents of our app using
FTS4 (about 27k unique words, about 1 million words for the whole contents). In
particular, we use the offsets function. Currently, after some testing, we?re
experiencing a plenty of problems with finding the results nee
> On Jul 2, 2015, at 3:16 PM, Rob Willett
> wrote:
>
> We?re trying to understand whether or not we have a performance problem with
> our Sqlite database.
It may or may not apply to your situation, but after doing lots of inserts,
running ANALYZE can sometimes work wonders.
-- Ward
On 2015-07-02 03:24 PM, R.Smith wrote:
> That exception is only thrown if the source column is not a BLOB (as
> far as I can tell).
>
> You specify the column Type (or type affinity) as BLOB but then you
> store a non-BLOB TEXT value in it ('"blue" "red" "orange" "yellow"'
> <-- Not a BLOB)
>
On 2 July 2015 at 15:09, Kathleen Alexander wrote:
> Hi,
>
> I apologize if this is an incorrect forum for this question, but I am
> pretty new to SQLite and have been unable to resolve this issue through
> other searches. Feel free to direct me to a more appropriate forum.
>
> Essentially, I have
That exception is only thrown if the source column is not a BLOB (as far
as I can tell).
You specify the column Type (or type affinity) as BLOB but then you
store a non-BLOB TEXT value in it ('"blue" "red" "orange" "yellow"' <--
Not a BLOB)
SQLite will store this as TEXT, not BLOB.
A BLOB star
I tried with the following flags :
gcc -arch x86_64 -o sqlite3.o sqlite3.c shell.c
and
> gcc -m32 -o sqlite3.o sqlite3.c shell.c
but both results in the same error.
Can you please help me solve this ?
On Thu, Jul 2, 2015 at 2:47 PM, Andy Ling wrote:
> > I get the following error while
Hi Andy,
I get the following error while trying to compile after linking with the
library
ld: warning: ignoring file
> /Users/prakash-2282/Downloads/sqlite-amalgamation-201506301510/libsqlite3.a,
> file was built for archive which is not the architecture being linked
> (x86_64):
> /Users/prakash-
Please provide your code context, as in,
http://stackoverflow.com/questions/10746237/sqlite-in-c-sharp-throws-invalidcastexception-using-getbytes
Today, Bill wrote:
>
> All,
> Below is a .dump of the database I'm working with. I can use
> GetBytes() successfully on all the BLOB columns except
> m
Thanks a ton Andy for your reply.
can you specify how I should specify the include flags (-I).
The kore build complais that "sqlite3.h" header file is not found .
Thanks a lot for your time
On Thu, Jul 2, 2015 at 1:51 PM, Andy Ling wrote:
> > Can you please tell me how to compile it as a libra
On 2 Jul 2015, at 12:47pm, William Drago wrote:
> Below is a .dump of the database I'm working with. I can use GetBytes()
> successfully on all the BLOB columns except myTextArray. On that column I get
> a System.InvalidCastException error. Can anyone tell me why? Thanks.
SQLite has no inhere
Hi Adam,
Thank you very much for your response. I had not considered using copies of
the database. In my method there are cases where writes to the database by
one process may be relevant to another process, so I'm not sure that that
would be a good option.
I don't explicitly set sqlite3_busy_ti
Maybe this will help?
http://stackoverflow.com/questions/4234767/how-do-i-build-sqlite3-from-command-line
On Thu, Jul 2, 2015 at 10:25 AM, Prakash Premkumar
wrote:
> I tried with the following flags :
>
> gcc -arch x86_64 -o sqlite3.o sqlite3.c shell.c
>
>
> and
>
>
>> gcc -m32 -o sqlite3.o s
Good day,
I'm sure others on the list will add better insight, but is your task
parallel enough that your nodes can work with a copy of the database
and submit changes the one the others copy from when 'done' their
calculation?
Are you using https://www.sqlite.org/c3ref/busy_timeout.html ?
regar
FTFY, you're welcome ;-)
Now *MAYBE* someone can read it and possibly reply.
--
--
--
--???--
K e V i N
On Thu, Jul 2, 2015 at 9:11 AM, wrote:
> We use SQLite for indexing and searching the text contents of our app
> using FTS4
> (about 27k unique words, about 1 millio
Thanks for your reply Kees.
I am using kore web server and I want to pass sqlite library in the LDFLAGS
option to the kore webserver. ( https://kore.io/doc/#cli )
For this purpose, I would like to compile it as a library, I wont be able
to pass the sqlite3.c in the list of sources.
Can you pleas
Hi,
I apologize if this is an incorrect forum for this question, but I am
pretty new to SQLite and have been unable to resolve this issue through
other searches. Feel free to direct me to a more appropriate forum.
Essentially, I have written an application in C++ that interfaces (reads
and writes
> I tried with the following flags :
>
> gcc -arch x86_64 -o sqlite3.o sqlite3.c shell.c
>
>
> and
>
>
> > gcc -m32 -o sqlite3.o sqlite3.c shell.c
>
>
> but both results in the same error.
>
> Can you please help me solve this ?
>
It's getting outside my level of expertise (and not rea
> I get the following error while trying to compile after linking with the
> library
>
> ld: warning: ignoring file
> > /Users/prakash-2282/Downloads/sqlite-amalgamation-
> 201506301510/libsqlite3.a,
> > file was built for archive which is not the architecture being linked
> > (x86_64):
> > /Users
> Thanks a ton Andy for your reply.
>
> can you specify how I should specify the include flags (-I).
> The kore build complais that "sqlite3.h" header file is not found .
>
Sounds like you need to read a few more manuals :^)
Normally there are compiler options that let you tell it which directo
> Can you please tell me how to compile it as a library on Mac OSX and Linux
> platforms ?
>
Use your favourite compiler to generate sqlite3.o then use ar to wrap
that up as a .a file. Give that file a name something like
libsqlite3.a and you will be able to add -Lsqlite3 to your LDFLAGS.
The ar
If you are not using WAL mode that might help.
On 7/2/2015 7:59 AM, Kathleen Alexander wrote:
> Hi Adam,
>
> Thank you very much for your response. I had not considered using copies of
> the database. In my method there are cases where writes to the database by
> one process may be relevant to an
All,
Below is a .dump of the database I'm working with. I can use
GetBytes() successfully on all the BLOB columns except
myTextArray. On that column I get a
System.InvalidCastException error. Can anyone tell me why?
Thanks.
-Bill
---.dump file---
PRAGMA foreign_keys=OFF;
BEGIN TRANSACTION;
31 matches
Mail list logo