Hi all, I wrote a proposal for consolidated segment metadata management a few weeks ago. Since it's also a huge and incompatible change, I would like to get more attention from others.
As described in the proposal, Druid currently stores segment metadata in two places: metadata store and deep storage. This design has some drawbacks like not easy to keep them synced. To solve this problem, the proposal proposes to store the segment metadata in only metadata store. As a result, insert-segment-to-db tool should be removed together because it depends on the segment metadata in deep storage. Please take a look and let me know what you think. Thanks, Jihoon