On Tue, Sep 4, 2018 at 2:55 AM, Ilya Kasnacheev <ilya.kasnach...@gmail.com> wrote:
> Hello! > > Each node has a local dictionary (per node currently, per cache planned). > Dictionary is never shared between nodes. As data patterns shift, > dictionary rotation is also planned. > > With Zstd, the best dictionary size seems to be 1024 bytes. I imagine It is > enough to store common BinaryObject boilerplate, and everything else is > compressed on the fly. The source sample is 16k records. > > Thanks, Ilya, understood. I think per-cache is a better idea. However, I have a question about dictionary size. Ignite stores TBs of data. How do you plan the dictionary to fit in 1K bytes? D.
