Hi all,

I’d like to start a discussion on FLIP-XXX:

*Support Pluggable Storage Backend forHistoryServer*.

This FLIP proposes improving the HistoryServer
to address excessive *small files* when handling
large numbers of archived jobs.

[Proposal]
Optional *RocksDB-based storage* to reduce
small files

[Compatibility]
Full backward compatibility (FILE as default)

The detailed design is described in the
FLIP document:

https://docs.google.com/document/d/1idHu5bq0GOsUuUAEIJSJ2UuekcDjbW0tHLNbsQfugDg/edit?usp=sharing

This FLIP is split from the earlier discussion [1].

Looking forward to your feedback.

[1] https://lists.apache.org/thread/6thlq9c5twyvzmcw7q24nm4q0rcbz5qp


Best regards,

Zihao Chen

Reply via email to