Dear HBase Dev Community,

In our quest to pursue optimal performance for hbase when configuring root
dir over cloud storage, we have been relying heavily on local cache using
ephemeral SSD disks normally available on given cloud provider instance
types.

Currently, our reference architecture for such use cases leverages file
based BucketCache, but that has certain limitations, and we are now at
early stages of testing an alternative approach using hdfs storage types
and policies to mirror root dir content from S3 to hdfs dirs mounted on
these ephemeral SSD disks. Additional technical details are documented here
<https://docs.google.com/document/d/1XcUSBrsVTQLq_j_Tq6FrC_NRPiVNxdIU8gu2gDPT-eM/edit?tab=t.0>
.

So far in our PoC, we have implemented and tested the read/write from/to
the different file system locations, we would like to continue this feature
implementation in collaboration with the community, so we plan to open an
umbrella jira ticket, together with individual subtasks for each
functionality described in the document mentioned above. Comments and
feedback are very welcome.

Thanks,
Wellington

Reply via email to