Hi, Dominique, The program tests/setqgen.cpp is a C++ program that generates on disk data without depending on the rest of FastBit code. Another example is tests/readcsv.cpp.
Roughly, a data file is named after the column name. A directory contains a "data partition" with a metadata file named '-part.txt' (note the dash in the front of the file name). The metadata file contains names of the columns and their types. Hope this helps. John On 1/9/12 12:39 PM, Dominique Prunier wrote: > Hi, > > > > I was wondering if a reference of the on-disk format exists somewhere. > > My goal would be to be able to create a partition using an external > lightweight process without any dependency to the fastbit library. > > I already know some basics from > http://crd-legacy.lbl.gov/~kewu/fastbit/doc/dataLoading.html but it > doesn’t explain much about .dic files (for Category string), all the > required fields in the –part.txt file and the format of the null mask. > > > > First of all, i don’t know if it is a recommended way of doing things > (if the on-disk format changes often, ...), and if it is possible to > create partitions this way, i’d like to know where i can find the most > up-to-date information. > > > > Thanks, > > > > */Dominique Prunier/**//* > > APG Lead Developper > > Logo-W4N-100dpi > > 4388, rue Saint-Denis > > Bureau 309 > > Montreal (Quebec) H2J 2L1 > > Tel. +1 514-842-6767 x310 > > Fax +1 514-842-3989 > > [email protected] <mailto:[email protected]> > > www.watch4net.com <http://www.watch4net.com/> > > / / > > /This message is for the designated recipient only and may contain > privileged, proprietary, or otherwise private information. If you have > received it in error, please notify the sender immediately and delete > the original. Any other use of this electronic mail by you is prohibited. > > //Ce message est pour le récipiendaire désigné seulement et peut > contenir des informations privilégiées, propriétaires ou autrement > privées. Si vous l'avez reçu par erreur, S.V.P. avisez l'expéditeur > immédiatement et effacez l'original. Toute autre utilisation de ce > courrier électronique par vous est prohibée./// > > > > > > _______________________________________________ > FastBit-users mailing list > [email protected] > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
