Hi John!
I'm using fastbit 1.2.3. I have 5 CSV files, each csv file has 6,438,450 rows
and about 460 MB. These data are organized into eight columns on which I build
the data partition without problems, as follows:
/opt/fastbit-ibis1.2.3/examples/ardea -d /test/agg/index0 -m
"col5:key,col4:key,col7:key,col6:key,col1:double,col0:double,col3:key,col2:int"
-t /test/agg/csv0.csv -t /test/agg/csv1.csv -t /test/agg/csv2.csv
/opt/fastbit-ibis1.2.3/examples/ardea -d /test/agg/index1 -m
"col5:key,col4:key,col7:key,col6:key,col1:double,col0:double,col3:key,col2:int"
-t /test/agg/csv3.csv -t /test/agg/csv4.csv
But when I build the index:
/opt/fastbit-ibis1.2.3/examples/ibis -d / test/agg/index0 -b "<bining none/>
<encoding equality/>"
The ibis consumes all available memory, and do much swap and not complete the
construction, this operation has been running for about 15 hours.
My machine has 2 GB of RAM, where the accounts should support up to 44,564,480
lines to build the index. But even using only about 19 million lines for the
first partition, the ibis was unable to build the index.
What could be the problem?
Thanks for the help.OuvirLer foneticamente
Best regards
[]s
_______________________________________________
FastBit-users mailing list
[email protected]
https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
