gaodayue commented on a change in pull request #1577: Support Segment for
BetaRowset
URL: https://github.com/apache/incubator-doris/pull/1577#discussion_r310382403
##########
File path: gensrc/proto/segment_v2.proto
##########
@@ -117,3 +121,39 @@ message FileFooterPB {
repeated MetadataPairPB file_meta_datas = 8; // meta data of file
optional PagePointerPB key_index_page = 9; // short key index page
}
+
+message ShortKeyFooterPB {
+ // How many index item in this index.
+ optional uint32 num_items = 1;
+ // The total bytes occupied by the index key
+ optional uint32 key_bytes = 2;
+ // The total bytes occupied by the key offsets
+ optional uint32 offset_bytes = 3;
+ // Segment id which this index is belong to
+ optional uint32 segment_id = 4;
+ // number rows in each block
+ optional uint32 num_rows_per_block = 5;
+ // How many rows in this segment
+ optional uint32 num_segment_rows = 6;
+ // Total bytes for this segment
+ optional uint32 segment_bytes = 7;
+}
+
+message SegmentHeaderPB {
+}
+
+message SegmentFooterPB {
+ optional uint32 version = 1 [default = 1]; // file version
+ repeated ColumnMetaPB columns = 2; // tablet schema
+ optional uint64 num_rows = 3; // number of values
+ optional uint64 index_footprint = 4; // total idnex footprint of all
columns
+ optional uint64 data_footprint = 5; // total data footprint of all columns
+ optional uint64 raw_data_footprint = 6; // raw data footprint
+
+ optional CompressionTypePB compress_type = 7 [default = ZSTB]; // default
compression type for file columns
Review comment:
I would prefer LZ4 as the default for its better throughput (decompression
speed: 3700 MB/s(lz4) vs 1380 MB/s(zstd)).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
