Hello,

I started working on OAK-3148, which is a new feature that allows to gradually 
migrate blobs from one store to another, without turning off the instance. In 
order to create the SplitBlobStore I need a way to remember (and save) already 
transferred blob ids.

So, basically I need a persistent and mutable set of strings. Do we have 
something like this in Oak already? I thought about a few custom solutions:

1. Saving blob ids in a file (at the beginning it can be a flat text file, then 
some b-tree), with a memory cache and/or bloom filter.
  - but it adds complexity, requires the maintenance, etc.
2. Creating SegmentNodeStore, with bucketing via the hashcode
  - but running the second segment node store just to persist a bunch of ids 
seems a little excessive.
3. Custom cache solution, like ehcache
  - but adding a new, big library just to support this feature doesn’t seem 
right as we have to deal with dependency versions, embedding, etc.

So, maybe there is some lightweight and reliable “4” in the Oak already?

Thanks,
Tomek

-- 
Tomek Rękawek | Adobe Research | www.adobe.com
[email protected]

Reply via email to