Hi, Jilong, The documentation for FastBit is at <http://sdm.lbl.gov/fastbit/doc>.
In general, bitmap indexes are not good for sparse value changes. However, we have demonstrated that if you are willing to batch changes, FastBit indexes could be updated at pretty good speed <https://sdm.lbl.gov/~kewu/ps/LBNL-61080.html>. Sparse changes could be implemented by marking existing data records as inactive and then add the new version of the records. Unfortunately, this procedure works on whole rows at a time, so if you can a single value, you will have to modify the whole row. Feel free to let us know if you have any more questions. John On 12/10/14 8:52 PM, wang jilong wrote: > Hi John, > > 1. Can you please point us to a document on fastbit index/data file formats, > or just a high level explain? > > 2. Is index/data file good for sparse value changes？ > > For example, "Table" person (user_id, gender, class). Indexed column is > "gender". We already have fastbit index/data files on "gender". > Next day, a couple of persons update their genders. Can we efficiently update > "index/data" files, instead of re-creating these files? > > Thanks for your time in advance. > > Jilong Wang > > > _______________________________________________ > FastBit-users mailing list > [email protected] > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users > _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
