Hi,

I've finally found a better way to bulk load records via perl & odbc - a lot 
more stable.

However, I've noticed many times mclient crashing mserver5 when loading records 
via the interactive interface. For instance, I tried to load about 130 inserts 
from a sql file using this command :
mclient -lsql -d mydb < public_sysuser.sql

After few seconds I started to see :

#BBPTRIM: memtarget=17978753 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=273741960
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
#BBPTRIM_ENTER: memsize=275281456,vmsize=275166768
#BBPTRIM: memtarget=19273201 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=275158816
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
#BBPTRIM_ENTER: memsize=276161752,vmsize=276047064
#BBPTRIM: memtarget=20153497 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=276056368
[ 1     ]
#BBPTRIM_ENTER: memsize=276322608,vmsize=276207920
#BBPTRIM: memtarget=20314353 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=276198064

Top is showing :

top - 23:26:14 up 249 days,  9:57,  5 users,  load average: 0.00, 0.20, 0.45
Tasks:  96 total,   1 running,  95 sleeping,   0 stopped,   0 zombie
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   4025600k total,  2433324k used,  1592276k free,   191788k buffers
Swap:  9502408k total,       92k used,  9502316k free,  1993392k cached

I don't think i'm running out of memory. I had to stop and restart mserver5, 
flush the table, then re-run the command - all the records were inserted. Also 
I noticed this type of messages on the mserver5 console when piping 
records through the mclient (over 1million records) . It seems that the mclient 
is quiet instable (cf my post about "COPY, terminating connection" few months 
ago).

So, is there a way to increase the memory limit  or make sure mserver5 won't 
crash when running bash inserts via a cron job ? 

Please advise,
Thank you
SB


      
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
Monetdb-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-developers

Reply via email to