kangpinghuang edited a comment on issue #1684: [Proposal] Bitmap Index File Format for V2 segment URL: https://github.com/apache/incubator-doris/issues/1684#issuecomment-526081460 `<beginning of the file> [Bitmap Index for Column 1] [Bitmap Index for Column 2] ... [Bitmap Index for Column n] [Footer] // FooterPB, FooterPBSize(4), FooterCRC(4), MagicNumber(4) <end of the file>` Can we write bitmap index of each column into a independent file, named with column_id in its name, eg: segment_name.1.bitmap is the bitmap index file for column 1. So we can add index for a column easily and drop index file directly when delete index. And we can keep the generated file immutable. The shortcome is that it will open more files and incur more IO when load multiple columns simultaneously, But compared to the data size and with page cache, maybe it can be ignored.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
