jackylk opened a new pull request #3627: [CARBONDATA-3710] Make stage files queryable URL: https://github.com/apache/carbondata/pull/3627 ### Why is this PR needed? Currenlty, stage files are written by SDK to a temp folder inside carbondata table path, but it is only queryable after calling "INSERT INTO tableName STAGE" command, it makes data latency longer. ### What changes were proposed in this PR? This PR is to add a feature to make stage files queryable before inserting them into the table. Since these stage files do not have index, they need to be scanned like normal columnar files ### Does this PR introduce any user interface change? - No ### Is any new testcase added? - No (current testcase is enhanced to test querying the stage files, see TestCarbonWriter)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
