Ravindra Pesala created CARBONDATA-1364:
-------------------------------------------

             Summary: Add the blocklet info to index file and make the datamap 
distributable with job
                 Key: CARBONDATA-1364
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1364
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ravindra Pesala


Add the blocklet info to index file and make the datamap distributable with job

1. Add the blocklet info to the carbonindex file, so datamap not required to 
read each carbondata file footer to the blocklet information. This makes the 
datamap loading faster.

2. Make the data map distributable and add to the spark job. So datamap pruning 
could happen distributable and pruned blocklet list would be sent to driver.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to