Ravindra Pesala created CARBONDATA-2494:
-------------------------------------------
Summary: Improve Lucene datamap size and performnace.
Key: CARBONDATA-2494
URL: https://issues.apache.org/jira/browse/CARBONDATA-2494
Project: CarbonData
Issue Type: Improvement
Reporter: Ravindra Pesala
Improved lucene datamap size and performance by using the following parameters.
New DM properties
`flush_cache`: size of the cache to maintain in Lucene writer, if specified
then it tries to aggregate the unique data till the cache limit and flush to
Lucene. It is best suitable for low cardinality dimensions.
`split_blocklet`: when made as true then store the data in blocklet wise in
lucene , it means new folder will be created for each blocklet thus it
eliminates storing on blockletid in lucene. And also it makes lucene small
chunks of data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
