Hi,

 

In one of our project, we compact java objects which have lots of long zeros. 
It save disk greatly when serialization. 

Thus slow Disk IO operations become fast CPU operations and performance is 
improved.  

Data compact algorithm is inspired by this paper 
http://www.vldb.org/pvldb/vol8/p1816-teller.pdf.

 

Thanks

Shawn

发件人: Vladimir Ozerov [mailto:[email protected]] 
发送时间: 2016年10月28日 5:21
收件人: [email protected]
主题: Re: BinaryObject pros/cons

 

Hi,

 

I am not very concerned with null fields overhead, because usually it won't be 
significant. However, there is a problem with zeros. User object might have 
lots of int/long zeros, this is not uncommon. And each zero will consume 4-8 
additional bytes. We probably will implement special optimization which will 
write such fields in special compact format.

 

Vladimir.

 

On Thu, Oct 27, 2016 at 10:55 PM, vkulichenko <[email protected] 
<mailto:[email protected]> > wrote:

Hi,

Yes, null values consume memory. I believe this can be optimized, but I
haven't seen issues with this so far. Unless you have hundreds of fields
most of which are nulls (very rare case), the overhead is minimal.

-Val



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/BinaryObject-pros-cons-tp8541p8563.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

 

Reply via email to