Re: [sqlite] Protecting databases
On 2016-10-07 10:46 PM, Damien Sykes-Lindley wrote: Hi there, My name is Damien Lindley, and I am, among other things, an independent, hobbiest programmer. I have been blind since birth and thus all my computer work relies on screenreader software and keyboard. I have only just come through the brink of scripting into compiled programming and so I guess I am still a beginner in many respects. However I don’t work in C or C++, so most of my programming, if using a library, relies on precompiled static or dynamic libraries. Or of course libraries that are written or converted specifically for the language I work in (FreeBASIC). Recently, I decided I needed to create a piece of software that could manage family trees, since there seems to be a lack of screenreader accessible genealogy managers out there. I was advised the best way to do this is to use a database engine. I was also informed that SQLite is always a good choice for databases. I must admit, I have never worked with databases before and so now I am in the process of learning SQL. However looking at the programming API for SQLite I cannot see any means of password protecting the database without either buying a commercial extension to do this, or recompiling SQLite with the authentication extension. Due to financial constraints and unfamiliarity with compiling in C both of these are not an option for me. Also I need a secure way to do this, as I think I read that the SQLite version simply uses a table to store the user data, which of course can be read and accessed elsewhere. Are there any other options available for doing this? Any help appreciated. Thanks. Damien. Damien, Why do you need to password protect the database? Genealogy information is generally of the public record variety so there is nothing sensitive to protect. I am making genealogy software myself and so am familiar with many of the relevant issues. I would say please explain why you think you need password protection for this project and then the real issue at hand can be addressed. If yours is a network application and you don't want people on the open internet from accessing the database, fair enough, but that's an application-level solution; what you're asking for here is that people who have direct access to the SQLite database file are blocked by a password, and this I question. -- Darren Duncan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] Protecting databases
Hi there, My name is Damien Lindley, and I am, among other things, an independent, hobbiest programmer. I have been blind since birth and thus all my computer work relies on screenreader software and keyboard. I have only just come through the brink of scripting into compiled programming and so I guess I am still a beginner in many respects. However I don’t work in C or C++, so most of my programming, if using a library, relies on precompiled static or dynamic libraries. Or of course libraries that are written or converted specifically for the language I work in (FreeBASIC). Recently, I decided I needed to create a piece of software that could manage family trees, since there seems to be a lack of screenreader accessible genealogy managers out there. I was advised the best way to do this is to use a database engine. I was also informed that SQLite is always a good choice for databases. I must admit, I have never worked with databases before and so now I am in the process of learning SQL. However looking at the programming API for SQLite I cannot see any means of password protecting the database without either buying a commercial extension to do this, or recompiling SQLite with the authentication extension. Due to financial constraints and unfamiliarity with compiling in C both of these are not an option for me. Also I need a secure way to do this, as I think I read that the SQLite version simply uses a table to store the user data, which of course can be read and accessed elsewhere. Are there any other options available for doing this? Any help appreciated. Thanks. Damien. ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Parallel access to read only in memory database
Machines with >100GB of RAM have been commonplace for a several years. These days, 384 GB is quite common. Even 1 TB is not a "special build" anymore -- you can buy them "off the shelf" from Dell ... (Dell no longer makes custom machines but only sells fixed configurations off the boat from china) > -Original Message- > From: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] > On Behalf Of Simon Slavin > Sent: Friday, 7 October, 2016 14:49 > To: SQLite mailing list > Subject: Re: [sqlite] Parallel access to read only in memory database > > > On 7 Oct 2016, at 9:37pm, Daniel Meyer wrote: > > > We have database files that are on the order of 100GB [...] in memory > > You have 100GB memory ? > > Simon. > ___ > sqlite-users mailing list > sqlite-users@mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Parallel access to read only in memory database
(My two cents) I just setup two brand new machines in our Colo for ESX. Both machines had 256gig of memory. Not unheard of in server situations. ;) On Fri, Oct 7, 2016 at 4:48 PM, Simon Slavin wrote: > > On 7 Oct 2016, at 9:37pm, Daniel Meyer wrote: > > > We have database files that are on the order of 100GB [...] in memory > > You have 100GB memory ? > > Simon. > ___ > ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Parallel access to read only in memory database
On 7 Oct 2016, at 9:37pm, Daniel Meyer wrote: > We have database files that are on the order of 100GB [...] in memory You have 100GB memory ? Simon. ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Parallel access to read only in memory database
Daniel Meyer wrote: > > How can we allow many reader threads on an in memory, write once read many > times database and achieve multi-core performance? Is this possible with > sqlite? > Have you tried using the URI "file::memory:?cache=shared" with one of the sqlite3_open*() C APIs? Further details on using URI file names may be found here: https://www.sqlite.org/uri.html -- Joe Mistachkin @ https://urn.to/r/mistachkin ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] Parallel access to read only in memory database
We are interested in using sqlite as a read only, in memory, parallel access database. We have database files that are on the order of 100GB that we are loading into memory. We have found great performance when reading from a single thread. We need to scale up to have many parallel reader threads. Once the DB is created it never needs to be modified. How can we allow many reader threads on an in memory, write once read many times database and achieve multi-core performance? Is this possible with sqlite? ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
