[sqlite] How do non-SQLite DBMS communicate?

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 11:28pm, Drago, William @ CSG - NARDA-MITEQ wrote: > So, SQLite databases are accessed via .dll where as other local databases run > a server that is accessed via ??? Most database systems have client/server architecture. There is somewhere a server. The only program whic

[sqlite] How do non-SQLite DBMS communicate?

2015-04-22 Thread Drago, William @ CSG - NARDA-MITEQ
All, I'm not sure how to ask this question. When using SQLite the application program accesses the SQLite DBMS via its .dll file. When using something like Oracle Express (a local DBMS) the application program is communicating with Oracle Express via some sort of network protocol even though t

[sqlite] Error while creating view through command line

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 4:49pm, Manoj Kumar Pasumarthi wrote: > attach 'SP_R3.s3db' as sprdb; > > BEGIN TRANSACTION; > > > CREATE view sprdb.[view1] as select model from sprdb.[windturbine]; > > COMMIT; > > .exit > > After executing this script, DB is getting corrupted. Please run

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 9:40pm, John McKown wrote: > ?only his app has access to this directory, > so there are no worries about "somebody else" putting files in it. So I am > _guessing_ that there are files in that directory which need to persist > between executions of his application. Correct. >

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Graham Holden
> ?Well, the best that I can think of is to have your application create a > new, randomly named, directory... I can't help directly (I don't the innards of SQLite) but can hopefully clarify what *I* think Simon's asking: he's already said in his original message that he used to use a temporary d

[sqlite] json_* functions in sqlite

2015-04-22 Thread Eric Rubin-Smith
On Wed, Apr 22, 2015 at 2:17 PM, Eric Rubin-Smith wrote: > > On Tue, Apr 21, 2015 at 9:09 PM, Ashish Sharma > wrote: > >> Many times I store JSON data in sqlite. It will be useful if sqlite came >> with functions which understand JSON. Presto has a nice set >> https://prestodb.io/docs/current/fu

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 7:18pm, Scott Hess wrote: > The only way SQLite can get to the disk is using the vfs, so if the > vfs encrypts things, all of the files (main db, temp db, journal, > everything) will be encrypted. Guys. Guys. Guys. My app doesn't have access to any level below standard fi

[sqlite] Regression in 3.8.9.0? Same row and rowid returned 2-3 times in SELECT with two ORDER BY keys

2015-04-22 Thread Eric Boesch
(Apologies if this gets posted twice.) The following ORDER BY query returns between 0 and 2 duplicates of each row, for 1 to 3 copies total, in 3.8.9 for Linux (CentOS). Otherwise, the returned rows are complete and correctly ordered. This database worked fine under 3.8.6. I can test other OSes or

[sqlite] json_* functions in sqlite

2015-04-22 Thread Eduardo Morras
On Tue, 21 Apr 2015 18:09:33 -0700 Ashish Sharma wrote: > Hi > > Many times I store JSON data in sqlite. It will be useful if sqlite > came with functions which understand JSON. Presto has a nice set > https://prestodb.io/docs/current/functions/json.html > > I have two questions > > 1. Will sq

[sqlite] Destroy all evidence of a database

2015-04-22 Thread R.Smith
Actually, I assumed SQLite made the duplicates / alternates, it may well have been the anti-virus doing it. I doubt anything else had a motive though. On 2015-04-22 06:20 PM, R.Smith wrote: > > > On 2015-04-22 05:56 PM, Simon Slavin wrote: >> On 22 Apr 2015, at 4:46pm, Michael Stephenson >> wr

[sqlite] Destroy all evidence of a database

2015-04-22 Thread R.Smith
On 2015-04-22 05:56 PM, Simon Slavin wrote: > On 22 Apr 2015, at 4:46pm, Michael Stephenson > wrote: > >> Simon, if the data in the database is sensitive, could you encrypt the >> database (ala something like https://www.zetetic.net/sqlcipher/)? > Unfortunately, this doesn't help. I'm not con

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 4:46pm, Michael Stephenson wrote: > Simon, if the data in the database is sensitive, could you encrypt the > database (ala something like https://www.zetetic.net/sqlcipher/)? Unfortunately, this doesn't help. I'm not concerned with the database file itself. I know exact

[sqlite] Destroy all evidence of a database

2015-04-22 Thread John McKown
On Wed, Apr 22, 2015 at 3:50 PM, Simon Slavin wrote: > > On 22 Apr 2015, at 9:40pm, John McKown > wrote: > > > ?only his app has access to this directory, > > so there are no worries about "somebody else" putting files in it. So I > am > > _guessing_ that there are files in that directory which

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 3:46pm, Jim Callahan wrote: > Can you turn off logging and overwrite the database with unencrypted zeros > or nulls; > just before deleting it? The operating system overwrites disks and memory with random bits both just after it is released and just before it is allocated a

[sqlite] Error while creating view through command line

2015-04-22 Thread Manoj Kumar Pasumarthi
Hi, I am trying to create a new view through command line script (sqlite3) as follow: attach 'SP_R3.s3db' as sprdb; BEGIN TRANSACTION; CREATE view sprdb.[view1] as select model from sprdb.[windturbine]; COMMIT; .exit After executing this script, DB is getting corrupted. Can anyone please

[sqlite] Destroy all evidence of a database

2015-04-22 Thread John McKown
On Wed, Apr 22, 2015 at 2:58 PM, Graham Holden wrote: > > > ?Well, the best that I can think of is to have your application create a > > new, randomly named, directory... > > I can't help directly (I don't the innards of SQLite) but can > hopefully clarify what *I* think Simon's asking: he's alre

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 3:23pm, John McKown wrote: > If it is > a POSIX compliant, perhaps what you could do is create a "temporary" > (mktemp) file of "appropriate" size. I had never considered that idea. Thank you very much. Unfortunately it won't work in this situation because the people in co

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Eduardo Morras
On Wed, 22 Apr 2015 13:50:43 +0100 Simon Slavin wrote: > Dear folks, > > Assuming no hardware/OS faults is it possible for any other > SQLite-created files to still exist ? Journal ? Temp index ? > Shared memory ? Anything ? a) If the app crash, it may create a dump file with sqlite cache i

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Scott Hess
On Wed, Apr 22, 2015 at 12:07 PM, Simon Slavin wrote: > On 22 Apr 2015, at 7:18pm, Scott Hess wrote: >> The only way SQLite can get to the disk is using the vfs, so if the >> vfs encrypts things, all of the files (main db, temp db, journal, >> everything) will be encrypted. > > Guys. Guys. Guys

[sqlite] Destroy all evidence of a database

2015-04-22 Thread John McKown
On Wed, Apr 22, 2015 at 2:07 PM, Simon Slavin wrote: > > On 22 Apr 2015, at 7:18pm, Scott Hess wrote: > > > The only way SQLite can get to the disk is using the vfs, so if the > > vfs encrypts things, all of the files (main db, temp db, journal, > > everything) will be encrypted. > > Guys. Guys

[sqlite] json_* functions in sqlite

2015-04-22 Thread Eric Rubin-Smith
On Tue, Apr 21, 2015 at 9:09 PM, Ashish Sharma wrote: > Hi > > Many times I store JSON data in sqlite. It will be useful if sqlite came > with functions which understand JSON. Presto has a nice set > https://prestodb.io/docs/current/functions/json.html > I wrote a little tool that more or less a

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
On 22 Apr 2015, at 2:07pm, Paul Sanderson wrote: > You haven't said what operating system you are using Sorry, but I can't. However, the OS is strongly oriented towards security paranoia. As long as the proper OS calls are used to delete files and release memory, you can assume that they a

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Paul Sanderson
You haven't said what operating system you are using but I strongly suspect that there will be plenty of pages from your database thrown around by the OS itself in various caches/pagefiles etc. all of course outside of the ability of SQLite to prevent. Getting at these cached pages is not difficul

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Simon Slavin
Dear folks, I have a setup where an app creates a single-user SQLite database by opening a connection, uses it for a number of complicated things, closes the connection, then deletes the database before quitting. The data which goes into this database is highly sensitive and it's very importan

[sqlite] json_* functions in sqlite

2015-04-22 Thread Stephen Chrzanowski
I'm no where near the level of an overlord, except maybe to the wifes dog. I'm in a debate mood, so why not? I'm open to the firing squad today. :] IMHO, there are four (I initially started with two) problems with this request in making it part of the core dealings Dr Hipp provides us all. I sa

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Donald Griggs
Regarding: ...A nice attack against encrypted SQLite databases might be to crash a SQLite application while it's processing and examine any journal files, shared memory file and temporary index files. It might be interesting to review the various encryption systems widely available for SQLite and

[sqlite] Index causing very slow queries

2015-04-22 Thread Hamish Symington
Hello, > On 10 Apr 2015, at 15:38, Hamish Symington > wrote: > >>> A follow up to this. If I run ANALYZE on the ?fast? version of the database >>> - ie *after* I?ve recreated the index - performance drops back to the >>> original slow speed. >> >> Please run ".fullschema" using the sqlite3.exe

[sqlite] Destroy all evidence of a database

2015-04-22 Thread tabris
ext attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: <http://mailinglists.sqlite.org/cgi-bin/mailman/private/sqlite-users/attachments/20150422/e7bbc8ea/attachment.pgp>

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Janke, Julian
My xFileControl() method has actually returned a SQLITE_OK and not as stated in the documentation, a SQLITE_NOTFOUND. I fixed it and now all the PRAGMAs worked fine. I thank you very much -Original Message- From: sqlite-users-bounces at mailinglists.sqlite.org [mailto:sqlite-users-bo

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Michael Stephenson
Simon, if the data in the database is sensitive, could you encrypt the database (ala something like https://www.zetetic.net/sqlcipher/)? That way if the file is left around for some reason, it's much less of a concern. Your app could generate a new (random) key each time it creates a new dat

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Janke, Julian
Okay, thanks for your reply. I had been concerned that it is the only way to implement it by myself in the custom vfs. -Original Message- From: sqlite-users-bounces at mailinglists.sqlite.org [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On Behalf Of Richard Hipp Sent: Mittwoch,

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Scott Hess
The only way SQLite can get to the disk is using the vfs, so if the vfs encrypts things, all of the files (main db, temp db, journal, everything) will be encrypted. I think in your case you can probably even get away without the more elaborate encrypted systems, because it sounds like you don't wa

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Janke, Julian
Thank you for the hint. I'll check that. -Original Message- From: sqlite-users-bounces at mailinglists.sqlite.org [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On Behalf Of Zsb?n Ambrus Sent: Mittwoch, 22. April 2015 10:58 To: General Discussion of SQLite Database Subject: Re: [sq

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Zsbán Ambrus
On Wed, Apr 22, 2015 at 10:46 AM, Janke, Julian wrote: > I have tested some of the other pragmas and none worked. After discussing > with you now I come to the conclusion that the problem is caused more by my > local setup. I In that case, as you have a custom vfs, could you check if it's your

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Jim Callahan
Can you turn off logging and overwrite the database with unencrypted zeros or nulls; just before deleting it? Encrypting the overwrite character(s) would give the encryption attacker a cleartext -- a bad move right out of the "Imitation Game". Jim On Wed, Apr 22, 2015 at 10:34 AM, Simon Slavin

[sqlite] building SQLite DLL with Visual C++

2015-04-22 Thread Adam Devita
Good day, Why are you compiling a dll instead of using the pre-compiled windows binaries at http://www.sqlite.org/download.html? Are you adding some sort of extra wrapper? Why are you not adding the amalgamated c source in your project (turn off use pre-compiled headers for that file) ? If you

[sqlite] Destroy all evidence of a database

2015-04-22 Thread Richard Hipp
On 4/22/15, Simon Slavin wrote: > Dear folks, > > I have a setup where an app creates a single-user SQLite database by opening > a connection, uses it for a number of complicated things, closes the > connection, then deletes the database before quitting. The data which goes > into this database i

[sqlite] Destroy all evidence of a database

2015-04-22 Thread John McKown
On Wed, Apr 22, 2015 at 9:34 AM, Simon Slavin wrote: > > On 22 Apr 2015, at 3:23pm, John McKown > wrote: > > > If it is > > a POSIX compliant, perhaps what you could do is create a "temporary" > > (mktemp) file of "appropriate" size. > > I had never considered that idea. Thank you very much. U

[sqlite] building SQLite DLL with Visual C++

2015-04-22 Thread Igor Tandetnik
On 4/21/2015 11:01 AM, Jay Smith wrote: > Before I sent the last message I had signed up to become a user. > My previous message was bounced. WHY I, for one, have received both your original and this new message. -- Igor Tandetnik

[sqlite] Destroy all evidence of a database

2015-04-22 Thread John McKown
On Wed, Apr 22, 2015 at 9:23 AM, John McKown wrote: > On Wed, Apr 22, 2015 at 8:14 AM, Simon Slavin > wrote: > >> >> On 22 Apr 2015, at 2:07pm, Paul Sanderson >> wrote: >> >> > You haven't said what operating system you are using >> >> Sorry, but I can't. However, the OS is strongly oriented t

[sqlite] Destroy all evidence of a database

2015-04-22 Thread John McKown
On Wed, Apr 22, 2015 at 8:14 AM, Simon Slavin wrote: > > On 22 Apr 2015, at 2:07pm, Paul Sanderson > wrote: > > > You haven't said what operating system you are using > > Sorry, but I can't. However, the OS is strongly oriented towards security > paranoia. As long as the proper OS calls are us

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Janke, Julian
I have tested some of the other pragmas and none worked. After discussing with you now I come to the conclusion that the problem is caused more by my local setup. I had hoped to be able to avoid it, but I will now try to debug the database and find the error. If I find the error, I will report y

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Richard Hipp
On 4/22/15, Janke, Julian wrote: > The embedded system has various storage media, with different read / write > speeds. > A quick and dirty test shows that the outsourcing of the journal files on a > faster medium may be a significant speed boost. > Is there a possibility to write journal(temporar

[sqlite] Problems with pragma journal_mode

2015-04-22 Thread Richard Hipp
On 4/22/15, Zsb?n Ambrus wrote: > > In that case, as you have a custom vfs, could you check if it's your > vfs that is handling those pragmas? The documentation at > "http://sqlite.org/c3ref/c_fcntl_busyhandler.html#sqlitefcntlpragma"; > describes that when you run a PRAGMA statement on a databas