On Sun, Nov 23, 2008 at 02:04:09AM +0100, Stefan de Konink wrote:
> #GDKmalloc(14777222432) fail => BBPtrim(enter)
> usage[mem=14840896,vm=27527806976]
> #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976
> #BBPTRIM: memtarget=4611686018427387904 vmtarget=0
> #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976
> #GDKmalloc(14777222432) fail => BBPtrim(ready)
> usage[mem=11538120,vm=27527806976]
> #BATpropcheck: BAT tmp_1260(-688): could not allocate hash table for key
> test
> #GDKmalloc(14777222432) fail => BBPtrim(enter)
> usage[mem=11537664,vm=27527806976]
> #BBPTRIM_ENTER: memsize=11537664,vmsize=27527806976
> #BBPTRIM: memtarget=4611686018427387904 vmtarget=0
> #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976
> #GDKmalloc(14777222432) fail => BBPtrim(ready)
> usage[mem=10416208,vm=27527806976]
> #BATpropcheck: BAT tmp_1135(-605): could not allocate hash table for key
> test
> MAPI = [EMAIL PROTECTED]:50000
> QUERY = COPY 773410980 RECORDS INTO node_tags from
> '/mnt/data2/csv/node_tags.csv' USING DELIMITERS ',', '\n', '''';
> ERROR = !MALException: GDKmallocmax: failed for 1892320544 bytes
> !ERROR: GDKload: failed name=12/1252, ext=thash
> !ERROR: GDKmallocmax: failed for 1892320544 bytes
> !ERROR: GDKload: failed name=12/1253, ext=thash
>
> What kind of voodoo is this?
>
> I'm trying to import a 42GB csv file using copy into, on a native
> system, 2GB of memory, 4GB of swap. Latest CVS version, this time
> compiled for CoreDuo, without debuging, with optimise.
>From the trace above, I comclude that MonetDB is unable to allocate a 14GB
chunk --- first (obvious) questions to ask and answer:
Is your CoreDuo (or Core2Duo?) a 64-bit CPU?
If so, are you running a 64-bit OS (which?)?
If so, are you using a 64-bit build of MonetDB?
If so, is your MonetDB configured with 64-bit or 32-bit OIDs?
The output of
`mserver5 --version`
should answer most of these questions ...
Stefan
>
> Stefan
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Monetdb-developers mailing list
> Monetdb-developers@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers
>
--
| Dr. Stefan Manegold | mailto:[EMAIL PROTECTED] |
| CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ |
| 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 |
| The Netherlands | Fax : +31 (20) 592-4312 |
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-developers mailing list
Monetdb-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/monetdb-developers
