GitHub user manishgupta88 opened a pull request:
https://github.com/apache/carbondata/pull/2454
[WIP] [CARBONDATA-2701] Refactor code to store minimal required info in
Block and Blocklet Cache
Things done as part of this PR
1. Refactored code to keep only minimal information in block and blocklet
cache.
2. Introduced segment properties holder at JVM level to hold the segment
properties. As it is heavy object, new segment properties object will be
created only when schema or cardinality is changed for a table.
This PR depends on PR #2437
- [ ] Any interfaces changed?
No
- [ ] Any backward compatibility impacted?
NA
- [ ] Document update required?
No
- [ ] Testing done
Yes
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
NA
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/manishgupta88/carbondata
refactor_segmentproperties
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2454.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2454
----
commit c06de06046da4efe6dc606f410686dcea256d46f
Author: manishgupta88 <tomanishgupta18@...>
Date: 2018-06-25T06:43:00Z
segregate block and blocklet cache
commit a5017751f45a43ce75a98610214049e1c894e1e7
Author: manishgupta88 <tomanishgupta18@...>
Date: 2018-07-04T15:30:54Z
Refactor Block and Blocklet DataMap to store only segmentProeprties Index
instead of segmentProperties
----
---
