Hi devs, Recently, I have been working on reducing the size of the Amoro installation package. Considering the Amoro installation package is almost 1GB in size, this task really should be done ASAP.
I found the largest dependent of Amoro is the rocksdb lib (more than 50MB). It is used to cache some data to disk storage when the memory is not enough. It is originally used to cache iceberg delete records in optimizers. But when we have improved the delete records caching with bloom filter, this feature is really not needed anymore. So I am considering removing the rocksdb dependencies from the project to reduce the installation package size. I am looking forward to hearing any point from anyone regarding this issue. Best regards, Jinsong