GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2322
[CARBONDATA-2472] Fixed:Refactor NonTransactional table code for Index file
IO performance
[CARBONDATA-2472] Fixed:Refactor NonTransactional table code for Index file
IO performance
problem: For NonTransactional table, for each query, 2 times IO happens
(one time for actual blocklet load and one time for validation of schema) This
results in more IO time.
Solution: At the time of blocklet load itself do the validation. So, IO
will be only one time.
- [ ] Any interfaces changed? NA
- [ ] Any backward compatibility impacted? NA
- [ ] Document update required? NA
- [ ] Testing done
Already UT for this scenarios
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA. NA
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ajantha-bhat/carbondata unmanaged_table
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2322.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2322
----
commit 591966f2e4a4ea50f11fc2b591366a155b204be1
Author: ajantha-bhat <ajanthabhat@...>
Date: 2018-05-18T13:37:46Z
[CARBONDATA-2472] Fixed:Refactor NonTransactional table code for Index file
IO performance
----
---
