vtlim commented on code in PR #12808:
URL: https://github.com/apache/druid/pull/12808#discussion_r926060218
##########
docs/design/segments.md:
##########
@@ -193,9 +193,7 @@ A segment contains several files:
* `XXXXX.smoosh`
- A number of files containing concatenated binary data.
-
- The `smoosh` files represent multiple files "smooshed" together in order
to minimize the number of file descriptors that must be open to house the data.
They are files of up to 2GB in size (to match the limit of a memory mapped
ByteBuffer in Java). The `smoosh` files house individual files for each of the
columns in the data as well as an `index.drd` file with extra metadata about
the segment.
+ Smoosh (`.smoosh`) files contain concatenated binary data. This file
consolidation reduces the number of file descriptors that must be open when
accessing data. The files should be 2 GB or less in size to remain within the
limit of a memory mapped `ByteBuffer` in Java. Smoosh files contain individual
files for each column in the data and an `index.drd` file that contains
additional segment metadata.
Review Comment:
Another suggestion, to integrate the `__time` column:
```suggestion
Smoosh (`.smoosh`) files contain concatenated binary data. This file
consolidation reduces the number of file descriptors that must be open when
accessing data. The files are 2 GB or less in size to remain within the limit
of a memory-mapped `ByteBuffer` in Java. Smoosh files contain the following:
* Individual files for each column in the data, including one for the
`__time` column that refers to the time column of the segment
* An `index.drd` file that contains additional segment metadata
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
