dracoooooo opened a new pull request, #1552:
URL: https://github.com/apache/horaedb/pull/1552
## Rationale
#1279
## Detailed Changes
1. Added a struct `Segment` responsible for reading and writing segment
files, and it records the offset of each record.
2. Add a struct SegmentManager responsible for managing all segments,
including:
1. Reading all segments from the folder upon creation.
2. Writing only to the segment with the largest ID.
3. Maintaining a cache where segments not in the cache are closed,
while segments in the cache have their files open and are memory-mapped using
mmap.
3. Implement the `WalManager` trait.
## Test Plan
Unit tests.
## Todos
- [ ] Implement a disk-based WAL that can pass the existing unit tests.
- [x] write
- [x] read
- [x] scan
- [ ] delete
- [ ] multiple segments
- [ ] Remove `unwarp` and handle errors.
- [ ] Add unit tests for the new code.
- [ ] Test on large-scale data.
- [ ] Compare with the existing RocksDB WAL implementation and optimize
performance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
