Hi, Michael, The function tafel::write is not updating the dictionary at all. I took a brief look at the code and was not sure which function might have update dictionary incorrectly. It might take a more careful tracking of the the progress of a sample code in order for me to figure out exactly which function is at fault here.
Do you happen to have a small sample code that I can use for this purpose? Thanks. John On 10/18/12 12:23 PM, Chong, Michael wrote: > Hi John, > > I have a question about Fastbit CATEGORY columns. > > I have some code which adds rows to a table (ibis::tafel). One of the columns > is a CATEGORY column. > > My code sequence is: > > 1) ibis::tafel t->appendRow() add some rows, may be 100,000 or so. > 2) save all the rows to disk with a ibis::tafel t->write(directory_name) > 3) t->clearData() to get back memory > 4) Go back to 1 and add more rows() > > Every time I clearData the dictionary gets reset to zero, which is as it > should. > However is there a way for this not to be the case? I think the only way to > save a > CATEGORY column correctly is all in one shot. I found that if I write, and > then clear > and then write some more the dictionary only has the most recent batch of > tags in it. > Is this a correct understanding? Or have I got a bug somewhere? > > I tried to figure out a way to extract the dictionary from a ibis::tafel > CATEGORY column, > so that I could preserve it in between clearData() calls but could not figure > out a way. > > My code works with the write all in one shot, but it sure uses a lot of DRAM > memory, and I was > wondering if I could reduce that usage. > > Many thanks, John. > > Best, Mike. > > > DISCLAIMER: This e-mail message and any attachments are intended solely for > the use of the individual or entity to which it is addressed and may contain > information that is confidential or legally privileged. If you are not the > intended recipient, you are hereby notified that any dissemination, > distribution, copying or other use of this message or its attachments is > strictly prohibited. If you have received this message in error, please > notify the sender immediately and permanently delete this message and any > attachments. > _______________________________________________ > FastBit-users mailing list > [email protected] > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users > _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
