Ravindra Pesala created CARBONDATA-757: ------------------------------------------
Summary: Big decimal optimization in store and processing Key: CARBONDATA-757 URL: https://issues.apache.org/jira/browse/CARBONDATA-757 Project: CarbonData Issue Type: Improvement Reporter: Ravindra Pesala Assignee: Ravindra Pesala Currently Decimal is converted to bytes and using LV (length + value) format to write to store. And while getting back read the bytes in LV format and convert back the bigdecimal. We can do following operations to improve storage and processing. 1. if decimal precision is less than 9 then we can fit in int (4 bytes) 2. if decimal precision is less than 18 then we can fit in long (8 bytes) 3. if decimal precision is more than 18 then we can fit in fixed length bytes(the length bytes can vary depends on precision but it is always fixed length) So in this approach we no need store bigdecimal in LV format, we can store in fixed format.It reduces the memory. -- This message was sent by Atlassian JIRA (v6.3.15#6346)