RE: Stress-testing SQLite

2010-11-01 Thread Lynn Fredricks
Check out information from one user from about eight years ago (!) in building a kiosk project, comparing Valentina with MS Access. Of course, you probably wouldn't do this with Access today, but worth considering is that this is with major hardware constraints, the overhead of

Re: Stress-testing SQLite

2010-11-01 Thread Pierre Sahores
Le 1 nov. 2010 à 16:09, Lynn Fredricks a écrit : Check out information from one user from about eight years ago (!) in building a kiosk project, comparing Valentina with MS Access. Of course, you probably wouldn't do this with Access today, but worth considering is that this is with

Re: Stress-testing SQLite -- what means theoretical limits from C++ point of view

2010-10-31 Thread Ruslan Zasukhin
On 10/31/10 12:10 AM, Monte Goulding mo...@sweattechnologies.com wrote: Charts like this, especially on Wikipedia should be taken with a grain of salt. Feature comparisions (yes/no) I can appreciate, but when it comes to capacity and performance, that's a bit different. Indeed. With

Re: Stress-testing SQLite -- millions records? Use Valentina DB

2010-10-31 Thread Ruslan Zasukhin
On 10/30/10 10:14 PM, stephen barncard stephenrevoluti...@barncard.com wrote: Yes, I've been waiting for Ruslan to chime in here. Valentina has been the *elephant in the room* in this discussion and I find it slightly odd that Richard (no newbie in the Rev world) hadn't considered this

Re: Stress-testing SQLite -- testimonials

2010-10-31 Thread Ruslan Zasukhin
On 10/31/10 12:14 AM, Richard Gaskin ambassa...@fourthworld.com wrote: However, the TPC doesn't have the power to run benchmark tests on a database platform without the approval of the database vendor. In fact, with the exception of IBM, most major database vendors include in

Re: Stress-testing SQLite

2010-10-31 Thread Pierre Sahores
Le 30 oct. 2010 à 23:41, Lynn Fredricks a écrit : http://www.informationweek.com/news/software/linux/showArticle .jhtml?articleID=201001901 If a test could be setup in benchmarking the same test database set to run as : - PHP+ Oracle 11g - PHP+PostgreSQL 8.2 - PHP+ Valentina - LiveCode

Re: Stress-testing SQLite

2010-10-31 Thread Ruslan Zasukhin
On 10/31/10 12:41 AM, Lynn Fredricks lfredri...@proactive-intl.com wrote: http://www.informationweek.com/news/software/linux/showArticle .jhtml?articleID=201001901 That's an interesting benchmark, I wish I had a couple of $60K to $75K server boxes handy so we could see how Valentina would

Re: benches // Stress-testing SQLite

2010-10-31 Thread Ruslan Zasukhin
On 10/31/10 9:55 AM, Pierre Sahores psaho...@free.fr wrote: Hi Pierre, If a test could be setup in benchmarking the same test database set to run as : - PHP+ Oracle 11g - PHP+PostgreSQL 8.2 - PHP+ Valentina - LiveCode server+Oracle 11g - LiveCode server+PostgreSQL 8.2 - LiveCode

Re: benches // Stress-testing SQLite

2010-10-31 Thread Pierre Sahores
Thanks for this interesting post, Ruslan. It point me on the need to learn more about Valentina, as soon as i will get enough time for this. Best Regards, Pierre Le 31 oct. 2010 à 09:42, Ruslan Zasukhin a écrit : On 10/31/10 9:55 AM, Pierre Sahores psaho...@free.fr wrote: Hi Pierre,

Re: Stress-testing SQLite

2010-10-31 Thread Peter Brigham MD
On Oct 30, 2010, at 1:55 PM, Richard Gaskin wrote: With LiveCode, for example, fields can *theoretically* hold up to 4GB, but I pity the person who tries it. There's often a vast difference between theoretical addressing limits and real-world use, hence my interest in finding actual use

RE: Stress-testing SQLite

2010-10-31 Thread Lynn Fredricks
I'm not sure at all that PostgreSQL would be slower than Oracle 11g, on both the OpenSuse 11 and OSX SL platforms and it would be interesting to know how Valentina performs for its own against both PostgreSQL and Oracle (would it be faster, as it's presented to to be on the

Re: Stress-testing SQLite

2010-10-31 Thread Pierre Sahores
Hi Lynn, I'm not sure at all that PostgreSQL would be slower than Oracle 11g, on both the OpenSuse 11 and OSX SL platforms and it would be interesting to know how Valentina performs for its own against both PostgreSQL and Oracle (would it be faster, as it's presented to to be on the

Re: Stress-testing SQLite

2010-10-30 Thread Kee Nethery
many of the data stores for the major apple apps use sqlite. it's a petty robust single user data store. kee nethery On Oct 29, 2010, at 5:32 PM, Mark Stuart wrote: on Fri Oct 29 19:17:40 CDT 2010, Richard Gaskin wrote: Thanks in advance for sharing your experiences with large data sets

Re: Stress-testing SQLite -- millions records? Use Valentina DB

2010-10-30 Thread Ruslan Zasukhin
On 10/30/10 3:17 AM, Richard Gaskin ambassa...@fourthworld.com wrote: Hi Richard, I have a need coming up for a data store that can robustly handle at least a million records, ideally up to five million, where each record may be as large as 5k. I don't need relationality, so for me SQLite

Re: Stress-testing SQLite -- degradation on big selections

2010-10-30 Thread Ruslan Zasukhin
On 10/30/10 4:10 AM, Richard Gaskin ambassa...@fourthworld.com wrote: Hi Richard, Hi Mark, Mark Stuart wrote: on Fri Oct 29 19:17:40 CDT 2010, Richard Gaskin wrote: Thanks in advance for sharing your experiences with large data sets if SQLite. Hi Richard, How many tables and how

Re; Stress-testing SQLite

2010-10-30 Thread Richard Gaskin
Sivakatirswami wrote: I was using and old example SQL stack... small data returns were fast, but a lot of data (select * from table whatever.. i.e. everything) from a PostGreSQL database adding it to a display field. It took forever... Then I remembered Dont' Do That! When I got all the

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
many of the data stores for the major apple apps use sqlite. it's a petty robust single user data store. Of course I don't need to expand on what Ruslan will say about Valentina, but I will say that there's a right tool for each job, and others that sort of work but aren't optimal. I can use

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
32TB db limit according to this: http://en.wikipedia.org/wiki/Comparison_of_relational_database _management_systems#Limits Charts like this, especially on Wikipedia should be taken with a grain of salt. Feature comparisions (yes/no) I can appreciate, but when it comes to capacity and

Re: Stress-testing SQLite

2010-10-30 Thread Richard Gaskin
Lynn Fredricks wrote: 32TB db limit according to this: http://en.wikipedia.org/wiki/Comparison_of_relational_database _management_systems#Limits Charts like this, especially on Wikipedia should be taken with a grain of salt. Feature comparisions (yes/no) I can appreciate, but when it comes

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
There are some database vendors that in their EULAs state you cannot publish performance data, and also have sued some who have done so. A curious limitation. Which ones? A bad Halloween joke first: Q: Where do vampires learn to suck blood? A: Law school. Without naming names, Ones

Re: Stress-testing SQLite -- millions records? Use Valentina DB

2010-10-30 Thread stephen barncard
Yes, I've been waiting for Ruslan to chime in here. Valentina has been the *elephant in the room* in this discussion and I find it slightly odd that Richard (no newbie in the Rev world) hadn't considered this product for his project. If I were starting a new db project right now and wasn't

Re: Stress-testing SQLite

2010-10-30 Thread Mark Wieder
Lynn- Saturday, October 30, 2010, 11:15:48 AM, you wrote: Without naming names, Ones with a Really Awesome, Conniving Legal Environments have been known to include such things. Sounds a bit of an urban legend. I just checked my license (granted it's only version 8.0.5, but...) and there's

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
Without naming names, Ones with a Really Awesome, Conniving Legal Environments have been known to include such things. Sounds a bit of an urban legend. I just checked my license (granted it's only version 8.0.5, but...) and there's nothing like that. It was big news a few years ago

Re: Re; Stress-testing SQLite

2010-10-30 Thread Monte Goulding
Could you post some of your results here Richard. Sent from my iPad On 31/10/2010, at 2:23 AM, Richard Gaskin ambassa...@fourthworld.com wrote: It seems in my initial tests that the time it takes to get data through the externals interface is much long than what it takes to move data

Re: Stress-testing SQLite

2010-10-30 Thread Monte Goulding
On 31/10/2010, at 4:55 AM, Richard Gaskin ambassa...@fourthworld.com wrote: Lynn Fredricks wrote: 32TB db limit according to this: http://en.wikipedia.org/wiki/Comparison_of_relational_database _management_systems#Limits Charts like this, especially on Wikipedia should be taken with a

Re: Stress-testing SQLite

2010-10-30 Thread Richard Gaskin
Interesting find: The Truth About the TPC ... For example, one reader asked, Why does the TPC organization only test commercially licensed operating systems and databases? My presumptions would lead me to think that a non-profit based organization would be benchmarking anything they

Re: Stress-testing SQLite

2010-10-30 Thread Mark Wieder
Richard- http://www.informationweek.com/news/software/linux/showArticle.jhtml?articleID=201001901 -- -Mark Wieder mwie...@ahsoftware.net ___ use-revolution mailing list use-revolution@lists.runrev.com Please visit this url to subscribe, unsubscribe

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
Indeed. With LiveCode, for example, fields can *theoretically* hold up to 4GB, but I pity the person who tries it. My point was that given your expected max db size of 5kB * 500 is 23GB this is only a very small fraction of the stated theoretical limits of SQLite. I have a feeling

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
Oracle, Sybase, and Informix each have a similar clause. These clauses are generically referred to as DeWitt clauses. David DeWitt was one of the founders of the Wisconsin Benchmarks, which were first published in the mid-1980s. At that time, the Wisconsin Benchmarks published

RE: Stress-testing SQLite -- millions records? Use Valentina DB

2010-10-30 Thread Lynn Fredricks
Right now they are offering the beta of Valentina Studio Pro for free ( and there's a free Valentina Linux server for non-commercial use - Richmond?) geesh, I just talked myself into finally trying this product myself. I don't see any other db company bending over backward to serve

RE: Stress-testing SQLite

2010-10-30 Thread Lynn Fredricks
http://www.informationweek.com/news/software/linux/showArticle .jhtml?articleID=201001901 That's an interesting benchmark, I wish I had a couple of $60K to $75K server boxes handy so we could see how Valentina would do. We've always emphasized what can be done with modest hardware specs. Best

Stress-testing SQLite

2010-10-29 Thread Richard Gaskin
I have a need coming up for a data store that can robustly handle at least a million records, ideally up to five million, where each record may be as large as 5k. I don't need relationality, so for me SQLite is an option but only an option; I'm happy to consider other options as well. (Yes,

Stress-testing SQLite

2010-10-29 Thread Mark Stuart
on Fri Oct 29 19:17:40 CDT 2010, Richard Gaskin wrote: Thanks in advance for sharing your experiences with large data sets if SQLite. Hi Richard, How many tables and how many columns per table (on average) are you talking about? That can make a big difference to the performance if there are

Re: Stress-testing SQLite

2010-10-29 Thread Richard Gaskin
Mark Stuart wrote: on Fri Oct 29 19:17:40 CDT 2010, Richard Gaskin wrote: Thanks in advance for sharing your experiences with large data sets if SQLite. Hi Richard, How many tables and how many columns per table (on average) are you talking about? Probably just a single table, with about

Re: Stress-testing SQLite

2010-10-29 Thread Sivakatirswami
On 10/29/10 3:10 PM, Richard Gaskin wrote: It'll vary, and in my own tests that seems to be the only bottleneck with SQLit; queries that return little data are ultra speedy, but once we get into large amounts of return data I see the hit. Just a reminder, which you probably don't need at

Re: Stress-testing SQLite

2010-10-29 Thread Monte Goulding
32TB db limit according to this: http://en.wikipedia.org/wiki/Comparison_of_relational_database_management_systems#Limits Maybe use limit and offset to page through query results though. Cheers Monte Sent from my iPad On 30/10/2010, at 11:17 AM, Richard Gaskin ambassa...@fourthworld.com