Eric Smith wrote: 

> I'd like to show it to the forum -- is it possible to send emails with 
> attachments here?  It's a 60kb jpg file.  

God bless the gnuplot developers, who provided an ascii output option:

  time (minutes) to insert 2m records
    10 ++----------+----------+-----------+----------+-----------+---------++
       +           +          +           +  A       +           +          +
     9 ++..................................................AAAA............++
       |                                              AAA AAAAA             |
     8 ++..........................................AAA..AAAAA..............++
       |                                         A   AAAA                   |
     7 ++.....................A.............A..AAAAAAA.....................++
       |                                      AAAA                          |
     6 ++..................AA...........A.AAAAA............................++
       |                            AAAAAAA                                 |
     5 ++....................A...AAAAAA....................................++
     4 ++.........AA.AA..AAAAA.AAAAA.......................................++
       |           A AAAAAAA  AA                                            |
     3 ++............AAAA..................................................++
       |           AAA                                         A  A         |
     2 ++.........AA...........................................AAAAAAAA....++
       |                                                             AA     |
     1 ++...AAAAAAA........................................................++
       AAAAAAA     +          +           +          +           +          +
     0 ++----------+----------+-----------+----------+-----------+---------++
       0          100        200         300        400         500        600
                           millions of existing records


You can see how we ran out of RAM at 100m records.  From 100m to 200m
there was a cron job running that was causing the disk cache to get
thrown out; I killed it at around 200m records.  

You can see the linear progression quite clearly.

At ~480m records I halted the process, built user indices, and restarted.
And voila, we're back down in happy-land.

Eric

-- 
Eric A. Smith

The people can always be brought to the bidding of the leaders. That 
is easy. All you have to do is tell them they are being attacked and 
denounce the pacifists for lack of patriotism and exposing the 
country to danger. It works the same way in any country. 
    -- Herman Goering, at the Nuremberg trials
_______________________________________________
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to