On 2.3.2006, at 16:44, Trausti Thor Johannsson wrote:
Just out of curiosity, and to learn. I have seen some mails here
about databases containing like 30 million or more records. I have
never worked with a database like that. The largest table I have
is like 90.000 records. So my question is, how does one work with
such a database without doing things like I do them currently.
Currently, I have an Object that takes an sql command, queries, and
then read all into a dictionary containing individual objects.
90.000 records, it does take time to read on, and create objects.
I would think that reading in the whole shebang would cause out of
memory or something bad happening, having millions of objects in
memory. At least it would take an awful long time.
Hope someone can help me with this one. I do not care how some
databases do this, I have heard very nice things about valentina
database, but I am asking as a more formal computer science approach.
I did until recently work on Patient Information systems where there
could be millions of records.
The normal way to deal with such is to make the user-interface
account for it, that it from the user perspective then it never makes
any sense to show him 90.000 records, or millions of records. So you
normally would design the user-interface so that the user always has
to filter to narrow down what he wants. Like in my case if displaying
90.000 patients then the tool would not be very helpful at all, the
user would spend all day just scrolling.
The bottom line here is that if you are expecting excessive amount of
data then you should design the user interface slightly different to
enforce filtering to get always smaller result sets to work on.
--
______________________________________________________________________
Björn Eiríksson [EMAIL PROTECTED]
Einhugur Software
http://www.einhugur.com/
______________________________________________________________________
Einhugur Software has sold its products in 52 countries world wide.
______________________________________________________________________
For support: [EMAIL PROTECTED]
To post on the maillist: [EMAIL PROTECTED]
_______________________________________________
Unsubscribe or switch delivery mode:
<http://www.realsoftware.com/support/listmanager/>
Search the archives of this list here:
<http://support.realsoftware.com/listarchives/lists.html>