Thanks John, It seems that tests/setqgen.cpp uses the tablex object from the library but tests/readcsv.cpp seems to do what i'm looking for. However, it is missing an example of null mask. Is it possible to do that without using the library (the .msk formatdoesn't seems straightforward) ?
Thanks, -----Original Message----- From: K. John Wu [mailto:[email protected]] Sent: Monday, January 09, 2012 3:59 PM To: FastBit Users Cc: Dominique Prunier Subject: Re: [FastBit-users] FastBit binary format reference Hi, Dominique, The program tests/setqgen.cpp is a C++ program that generates on disk data without depending on the rest of FastBit code. Another example is tests/readcsv.cpp. Roughly, a data file is named after the column name. A directory contains a "data partition" with a metadata file named '-part.txt' (note the dash in the front of the file name). The metadata file contains names of the columns and their types. Hope this helps. John On 1/9/12 12:39 PM, Dominique Prunier wrote: > Hi, > > > > I was wondering if a reference of the on-disk format exists somewhere. > > My goal would be to be able to create a partition using an external > lightweight process without any dependency to the fastbit library. > > I already know some basics from > http://crd-legacy.lbl.gov/~kewu/fastbit/doc/dataLoading.html but it > doesn’t explain much about .dic files (for Category string), all the > required fields in the –part.txt file and the format of the null mask. > > > > First of all, i don’t know if it is a recommended way of doing things > (if the on-disk format changes often, ...), and if it is possible to > create partitions this way, i’d like to know where i can find the most > up-to-date information. > > > > Thanks, > > > > */Dominique Prunier/**//* > > APG Lead Developper > > Logo-W4N-100dpi > > 4388, rue Saint-Denis > > Bureau 309 > > Montreal (Quebec) H2J 2L1 > > Tel. +1 514-842-6767 x310 > > Fax +1 514-842-3989 > > [email protected] <mailto:[email protected]> > > www.watch4net.com <http://www.watch4net.com/> > > / / > > /This message is for the designated recipient only and may contain > privileged, proprietary, or otherwise private information. If you have > received it in error, please notify the sender immediately and delete > the original. Any other use of this electronic mail by you is prohibited. > > //Ce message est pour le récipiendaire désigné seulement et peut > contenir des informations privilégiées, propriétaires ou autrement > privées. Si vous l'avez reçu par erreur, S.V.P. avisez l'expéditeur > immédiatement et effacez l'original. Toute autre utilisation de ce > courrier électronique par vous est prohibée./// > > > > > > _______________________________________________ > FastBit-users mailing list > [email protected] > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
