kunal642 commented on a change in pull request #3566: [CARBONDATA-3492]: Added prepriming in the Index Server Documentation URL: https://github.com/apache/carbondata/pull/3566#discussion_r364559033
########## File path: docs/index-server.md ########## @@ -119,6 +119,16 @@ be written to file. The user can set the location for these file by using 'carbon.indexserver.temp.path'. By default table path would be used to write the files. +## Prepriming +The caching of the datamaps in the Index Server will start once the query is fired on the table for +the first time. All the datamaps will be loaded if a count(*) query is fired and only the required +will be loaded for any filter query. Unless the query is fired on the table there will be no caching, +which reduces the performance of the first time query. To improve the performance of the first time +query, cache can be preprimed in the Index Server. During prepriming the datamaps can be loaded in the +Index Server during load command before a select query is fired on the table. + +The user can enable prepriming by using 'carbon.indexserver.enable.prepriming'. Review comment: Mention about the async call and that the load performance will not be degraded. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
